Comparison of split testing tools
Performing split testing on a website requires a combination of features. There are many tools that make it easier to rotate variants and report results, yet they have many differences.
Definitions
- Integration of a tool with web development: using a JavaScript snippet means the developer must edit and install a snippet into the HTML code of the website. Use of a WordPress plug-in requires download and activation of the plug-in.
- Content testing: identifying what the tool allows the developer to test, and what requires optimization
- Test creation: whether tests can be created by the developer (user defined), or the tool automatically CREATES tests based on many permutations of all options that can be tested
- Minimum traffic required: by the website receive before it can use the tool
- Release: open to the public, or only granted to a select few users
Overview
Tool |
Integration |
Content Tested |
Test Creation |
Minimum Traffic Required |
Release |
|---|---|---|---|---|---|
AdPushup |
JavaScript snippet |
Ads |
User defined |
5,000 daily views |
Private Beta |
AmpedSense |
WordPress plugin |
Ads |
User defined |
No minimum |
Stable |
Ezoic |
JavaScript snippet or DNS Switching |
Ads |
Automatic |
100,000 monthly views |
Stable |
Optimizely |
JavaScript snippet |
Any HTML |
User defined |
No minimum |
Stable |
Visual Website Optimizer |
JavaScript snippet |
Any HTML |
User defined |
No minimum |
Stable |
JavaScript snippet |
Any HTML |
User defined |
No minimum |
Stable |