FROM THE BLOG

Control Your A/B Tests from Anywhere: CLI, API, and MCP Support

What if you could create and manage A/B tests without opening WordPress?

AB Split Test now includes WP-CLI support, REST API, and MCP (Model Context Protocol) integration. Here's what that means for your workflow.

The Problem: Dashboard-Only Testing

Most A/B testing tools require clicking through WordPress dashboards. But modern workflows need more flexibility:

  • Developers want to deploy tests from command line
  • Agencies need to manage multiple sites efficiently
  • Teams want AI assistants to handle routine tasks
  • DevOps want to automate testing workflows

AB Split Test now supports all of these use cases.

The Solution: CLI, API, and MCP Support

AB Split Test now includes WP-CLI support, REST API, and MCP (Model Context Protocol) integration.

This means you can:

  • Deploy tests from your terminal alongside your code
  • Let AI assistants create and manage tests with natural language
  • Build custom automations that fit your exact workflow
  • Manage multiple sites without logging into each one

No more context switching. No more manual configuration. Just testing that fits your workflow.

Feature 1: AI Assistant Integration (MCP)

Model Context Protocol (MCP) lets AI assistants like Claude control AB Split Test directly.

How It Works

Instead of manually configuring tests through WordPress, you can tell your AI assistant in natural language:

"Test the homepage hero"

The AI assistant can:

  • Create tests using natural language
  • Configure test settings
  • Monitor results
  • Get recommendations on next steps

AB Split Test provides the right context to help your AI make informed decisions.

AB Split Test handles all the heavy calculations internally, providing AI-friendly compressed data with smart flags.

This means:

  • You don't need an LLM to calculate significance - AB Split Test does it for you
  • Faster AI responses - the data is already processed and compressed
  • Token efficient - no wasted tokens on statistical calculations

Your AI assistant gets straight to insights.

Feature 2: Command Line Control (WP-CLI)

Full WP-CLI support means you can create and manage tests from the command line.

What You Can Do

 

Install and activate:

wp plugin install "https://absplittest.com/cli.zip?e=you@email.com" --activate --allow-root

Create a Magic test (text swap on any page):

wp absplittest create_test \
  --name="Hero headline test" \
  --type=magic \
  --magic_definition='[{"original":"Book a Demo","variations":["Start Free Trial","Get Started"]}]' \
  --status=publish

Create an A/B test with CSS selectors:

wp absplittest create_test \
  --name="Hero headline test" \
  --type=magic \
  --magic_definition='[{"selector":"h1","original":"Book a Demo","variations":["Start Free Trial","Get Started"],"scope":{"page_id":"*"}}]' \
  --status=publish

List existing tests:

wp absplittest list_tests

Check results:

wp absplittest get_results 123

 

Use Cases

The page mentions these workflows:

  • Deploy tests from Git
  • Publish winners in CI/CD pipelines
  • Generate daily reports with cron jobs

Your testing fits your dev workflow instead of interrupting it.

Feature 3: REST API for Custom Integrations

Full REST API for programmatic control from any application.

What You Can Build

The API enables:

  • Creating tests from your CRM
  • Pulling results into custom dashboards
  • Triggering tests from webhooks
  • Building custom integrations with your existing tools

Your testing data, your rules.

Getting Started

For AI Integration (MCP):

Connect your AI assistant (Claude, etc.) to AB Split Test and create tests with natural language.

For Custom Integration (REST API):

Full REST API available for programmatic control from any application.

Install via WP-CLI:

bash
# Install & activate - starts 24hr trial immediately
wp plugin install "https://absplittest.com/cli.zip?e=you@email.com" --activate --allow-root

# Check your email - click confirmation link for 7-day trial

# Create your first Magic test
wp absplittest create_test 
  --name="Homepage hero test" 
  --type=magic 
  --magic_definition='[{"original":"Sign Up","variations":["Get Started","Start Free"]}]' 
  --status=publish

# List all tests
wp absplittest list_tests

# Check results
wp absplittest get_results 123

Start Testing from Anywhere

Control your A/B tests from command line, AI assistants, or custom applications.

Start with a free trial →
Read the documentation →