Can I Run Multivariate or ABCD Tests in AB Split Test?
Yes — with one important distinction.
Unlimited variations in a single test
AB Split Test lets you run as many variations as you want within a single test. You are not limited to just A and B. You can run A, B, C, D, and beyond.
Each variation is a complete set of changes. So variation A might have headline A, body copy A, and button A, while variation B has its own headline, copy, and button. The plugin randomly serves each complete variation to visitors and tracks which one converts best.
This is the most practical form of multivariate testing for most WordPress sites, and it covers the vast majority of real-world CRO needs.
What is not supported: full combinatorial testing
True multivariate testing shows every possible combination of individual elements simultaneously. For example, with three elements each having two options, that is eight combinations running at the same time: headline A with copy A and button B, headline B with copy A and button A, and so on.
This approach requires a very large sample size to reach statistical significance across all combinations. For most WordPress sites it is not practical, and for most CRO goals it is not necessary.
AB Split Test does not run this type of exhaustive combinatorial testing. Instead, you build each variation as a complete package and test those packages against each other.
Which approach should you use
For most tests, running two to four complete variations covers what you need to know. If you are unsure which variation to include, the AI CRO Agent can generate variation suggestions based on your page content so you are not starting from scratch.
If you want to test many elements simultaneously, consider running sequential tests — test one element first, implement the winner, then test the next. This gives you clean data on each decision rather than trying to interpret complex combinatorial results.
Last updated: May 2026