Multi-Armed Bandit – Continuous optimization mode (Teams plan only)

What is Multi-Armed Bandit?

The Multi-Armed Bandit (MAB) is a smart traffic allocation mode designed to send more visitors to your highest-converting variation while the test is still running.

Unlike Bayesian mode (our standard testing approach), which focuses on providing statistical confidence after the test ends, Multi-Armed Bandit continuously adjusts traffic in real time. This allows you to capture more conversions during the test, instead of sending equal traffic to losing variations.

How it Works

• Even Start
  All variations receive an even split of traffic until at least 40 conversions have been recorded. This gives every variation a fair opportunity and ensures a reliable sample.
• Dynamic Weighting
  After the 40-conversion threshold, traffic starts to be shifted towards the variation(s) with the highest conversion rate.
• Minimum Weighting
  Every variation always receives a guaranteed minimum amount of traffic:
  • All variations receive a minimum of 10% of their allocated traffic share. For example
    • A 2-variation test split 50/50, even the weakest variation will continue to receive at least 5% of total traffic. The strongest will (eventually) see 95% of traffic
    • A 3-variation test split 33/33/33 weakest variation will see 3.3% of traffic, highest converting will see 93%

This approach balances exploration (still testing all options) with exploitation (favoring the winner).

How to Use

To create a test with Continuous Optimization, you must first enable it from the settings.

Enable in WP Admin > Settings > AB Split Test

Create a new test – Any test type

Choose Multi Armed Bandit mode as Winning mode

When to Use Multi-Armed Bandit

Choose Multi-Armed Bandit when your goal is to maximize immediate conversions during the test period. It’s ideal for:

• Short-lived campaigns (e.g. promotions, seasonal sales, news articles).
• Revenue-critical experiments where you can’t afford to waste traffic on poor variations.
• Situations where speed matters more than certainty.

When to Use Bayesian (Recommended Default)

We usually recommend Bayesian mode for most experiments. Bayesian testing is designed to provide statistically confident results that you can rely on for long-term decisions. It’s best for:

• Ongoing or permanent changes (e.g. homepage design, pricing tests).
• Long-running experiments where accuracy is more important than speed.
• Strategic team decisions where certainty is critical.

Plan Availability

🔒 Multi-Armed Bandit is a Teams plan feature.
Legacy licenses with over 20 site support like old LTD licenses are also included.

If you’re on the Free or Solo plan, you’ll still have access to Bayesian mode — the best choice for most split tests.

Legacy licenses with more than 20 site licenses will have Multi Armed Bandit mode.

With AB Split Test, you have the flexibility to match your testing mode to your business goals.