Comparison of split testing tools

Performing split testing on a website requires a combination of features. There are many tools that make it easier to rotate variants and report results, yet they have many differences.

Definitions

  • Integration of a tool with web development: using a JavaScript snippet means the developer must edit and install a snippet into the HTML code of the website. Use of a WordPress plug-in requires download and activation of the plug-in.
  • Content testing: identifying what the tool allows the developer to test, and what requires optimization
  • Test creation: whether tests can be created by the developer (user defined), or the tool automatically CREATES tests based on many permutations of all options that can be tested
  • Minimum traffic required: by the website receive before it can use the tool
  • Release: open to the public, or only granted to a select few users

Overview

Tool

Integration

Content Tested

Test Creation

Minimum Traffic Required

Release

AdPushup

JavaScript snippet

Ads

User defined

5,000 daily views

Private Beta

AmpedSense

WordPress plugin

Ads

User defined

No minimum

Stable

Ezoic

JavaScript snippet or DNS Switching

Ads

Automatic

100,000 monthly views

Stable

Optimizely

JavaScript snippet

Any HTML

User defined

No minimum

Stable

Visual Website Optimizer

JavaScript snippet

Any HTML

User defined

No minimum

Stable

Maxymizely

JavaScript snippet

Any HTML

User defined

No minimum

Stable