CRO Learnings: what your finished tests taught the AI

Every test you finish teaches you something, and then you forget it. CRO Learnings is the plugin’s memory: each completed test leaves a short record of what changed, what happened and how sure we are, and the AI reads those records before it suggests anything. Suggestions build on what won and stop repeating what lost.

Where to find it

Split Tests → Optimization Hub → Learnings. There is nothing to switch on. Tests you completed before the update are added automatically, newest first, with no AI calls.

Filter by outcome with the pills at the top. Every learning is one of four:

• Won – a variation beat the original.
• Lost – the original held.
• Inconclusive – no reliable difference.
• Adaptive – a bandit test with no declared winner.

What is in a learning

Open a row to see the whole record.

The lesson is written in plain English: what happened, the likely reason, the principle behind it and a test to try next. Tests with at least 100 visitors get one, on paid plans.

Added to your test ideas lists the follow-up tests the learning filed for you – up to two from each of your five most recent learnings. One iterates on the same page, one carries the result somewhere else. They appear in Test Ideas marked “From a past test”.

Correcting the record

Two buttons on each learning:

• Add your takeaway – your own sentence, which the AI then uses instead of the written lesson. Worth doing when you know why a test won.
• Don’t use for AI – keeps a misleading result (a broken variation, a Black Friday week) out of every future suggestion. The learning stays on the tab.

Gotchas

• Restarting a test deletes its learning. It is recorded again the next time the test completes.
• Trashing a test keeps it. What it taught outlives it, so the Hub shows the learning without a link.
• The last 100 are kept. Older records drop off.
• Changing the winner rewrites the learning but keeps your takeaway and your exclusion.
• Lessons need a paid plan and 100 visitors. Below that the record is still there, just without the written lesson.
• Sample tests and tests with no visits are never recorded.

For developers

• abst_learnings_enabled – return false to stop capture and all use.
• abst_learnings_max – how many records to keep (default 100).
• abst_learning_lesson_min_visits – visitors needed for a written lesson (default 100).
• abst_learning_lesson_ideas – follow-up ideas per lesson (default 2, 0 turns them off).
• abst_ai_learnings_max_chars – how much of the record goes into each AI prompt (default 2000).

Related: The Optimization Hub · Test Ideas