Can I multivariate (ABCDx) Test?

The AB Split Test plugin provides robust capabilities for split testing with support for testing unlimited variables simultaneously. However, it’s important to understand the specifics of how this testing works.

Unlimited Variable Split Testing

The plugin allows you to conduct split tests using as many variables as you like. Each variation can have as many elements as you like.  This means you could test different combinations like (headline A, text A, button A) versus (headline B, text B, button B), and so on.

Limitation: Full Multivariate Testing

While our plugin supports unlimited variables in split testing, it doesn’t currently support full multivariate testing. In full multivariate testing, all possible combinations of variations are shown. For instance, with three variables, you could potentially have combinations like (headline A, text B, button C), and so on.

This type of exhaustive testing requires a much larger sample size and is more complex to implement and analyze. Hence, the AB Split Test plugin focuses on split testing variations of a complete set, which provides valuable insights for most users without the complexity of full multivariate testing.