Test Duration Estimation

This powerful estimation feature predicts how much longer your current test will need to run to reach a conclusive result. This estimation is based on the current traffic and conversion rates, ensuring that you can plan and adjust your testing strategy more effectively.

How the Estimation Works

The calculation takes into account the number of visits and conversions each variation receives. It then projects how many more days are required until the test can statistically determine a winner with a high level of confidence (95%). This projection updates continuously as new data comes in, refining the estimate based on the latest information.

Limitations of the Estimation

It will take some time before an accurate estimate is given. For the first 7 days, an estimate is only shown if it is 150 days or less. Otherwise you will see “Collecting data” with the number of visitors so far.

There are practical limits to the estimation process. If more than 150 days are still needed, the plugin says so, for example “About 200 more days needed at this traffic. More traffic would settle it sooner.” If the variations are still too close to separate after 14 days, it shows “Too close to call after 14 days. A bolder change is more likely to show a difference.” Either message is a sign that you might need to adjust your test or drive more traffic to it.

Benefits of Using the Duration Estimation

Using the duration estimation feature allows you to:

• Make informed decisions about when to end a test or extend its duration.
• Adjust marketing strategies to increase traffic or conversion rates if the test is taking too long.
• Plan resources and timelines for implementing test results.

This feature is particularly useful for marketing teams and website managers who need to align their testing schedules with campaign timelines or product updates. By providing a clear picture of the test’s timeline, the AB Split Test plugin helps streamline decision-making and optimize digital marketing efforts.