A/B testing is no longer a new field. Finding a proper A/B testing tool isn’t the problem anymore. Now, the problem is choosing the right one.
You could hire someone full time to sift through and analyze the pros and cons of each tool, but it’s easier to learn from the experience of others and make a decision based on that.
To help you with that, we’ve assembled a list of the most popular A/B testing tools and corresponding reviews from A/B testing experts to help you in your decision making process.
Without further ado, here are the top A/B testing tools used by experts (click below to navigate to a specific tool):
- AB Tasty
- Adobe Target
- Dynamic Yield
- Google Optimize
AB Tasty is a reasonably priced, simple-to-use tool that serves as a good starting point for companies just starting in conversion optimization.
AB Tasty offers A/B testing, split testing, multivariate testing, and funnel testing capabilities. Using AB Tasty’s visual editor, you are able to quickly put together variants and tests and receive real-time reports with confidence levels on your goals.
At the same time, you have full control of testing through advanced targeted scenarios, allowing you to trigger tests based on URL, geolocation, demographics, and so on. You are also able to enrich the platform’s data by integrating existing data from CRMs and DMPs.
A/B Test Planning: How to Build a Process that Works
A strong A/B testing plan will allow you to increase your revenue and learn valuable insights about your customers.
Chloe O’ Keeffe, former associate conversion consultant at Conversion.com, shares some pros and cons:
Pricing for AB Tasty is available on request.
Adobe Target is a popular enterprise tool that combines targeted testing and personalization.
Adobe Target walks you through a three-step workflow where you first create the variant, then target the variant based on visitor segmentation, and lastly customize your goals and settings for the test. Based on this emphasis of targeting, it should come as no surprise that Adobe Target’s most exciting feature is automated personalization.
Target’s self-learning algorithm continually and automatically adjusts itself to make associations between visitor behavior and content in order to give you the best results possible. Real-time adaptation of content can help you better meet the needs of diverse visitors.
Here’s a review from Sean Patterson, former senior conversion consultant at Conversion.com:
Pricing for Adobe Target is available on request.
Apptimize offers you a full-control visual editor where you’ll be able to rapidly create new variants and target them at different user segments. You’ll also be able to add dynamic variations and code blocks that support Objective-C, Swift, Java, HTML5, Xamarin, and React Native. Their randomized experiment methodology also ensures your experiments will return statistically significant results.
We sourced reviews for Apptimize from G2. Here’s an anonymous review talking about some things they liked about Apptimize:
Easy to get set up and use, awesome to be able to create tests without updating the browser (after the initial Apptimize-enabled version is deployed).
And here’s a review discussing some disappointments:
The real-time changes that we can deploy are actually limited in the scope—so, not all of our original goals can be met with this tool. Also, we have to plan in advance what sections of parts of our app we would like to change, and only after that we can start using this feature, which means that there is a lag/delay between the time that we want to change something and the time when it actually becomes a reality. For example, with our sprint structure this delay can be as long as three to four weeks.
Apptimize starts at $995/month and supports up to 100,000 monthly active users. You can also request a custom plan based on your needs
Conductrics is an advanced tool that offers methods from A/B testing blended with machine learning to delivering optimal experiences, for each user, automatically.
You can use it as either a server-side or client-side tool, and you can pretty much customize it in any way you want to use it.
Here’s a review from an experimentation and optimization expert Andrew Anderson:
Pricing for Conductrics is available on request.
Convert is perfect for small to medium-size clients and businesses doing in-house optimization. It is well loved for its exceptional customer support over live chat.
Convert operates using an intuitive drag and drop system. You can create A/B, multivariate, multipage, and split tests using the provided visual editor and break out more the more advanced style sheet editor for dynamic pages, giving you full control of your content.
It also boosts a smooth onboarding process of your CMS and ecommerce platform and seamless integration with Google Analytics. Personalization is also an option with over 35 different elements you can use to build customer profiles.
Here’s Julien Le Nestour, an applied behavioral scientist and CRO consultant based in Sydney, giving his opinion:
Convert’s most basic plan, Essential, starts at $599/month and gives you access to 10 active goals, 5 personalizations, unlimited tests, advanced targeting and segments, and more. You can also contact sales to explore enterprise plans.
Dynamic Yield is a powerful suite of personalization and engagement solutions.
With Dynamic Yield, you’ll have access to a wide range of tools. Most importantly, you’ll be able to continuously A/B test and optimize across platforms (desktop, mobile web, apps). These tests are predictive in nature and leverage the capabilities of machine learning algorithms to continuously improve ROI.
Dynamic Yield, however, specializes in advanced omnichannel personalization solutions. You’ll be able to segment and quantify every user interaction and response and dynamically adjust your content to best suit each individual. Combine your segments with personalized notifications to get the most out of this particular tool.
According to a review by Martin Nicholson on TrustRadius, some pros of the tool are:
The out of the box features are impressive and quick to implement. Overlays, messaging and content changes can be made instantly enabling tests to be carried out quickly.
Creation of custom actions enables us to bridge the gap between our online and offline tests by injecting code changes directly onto the page.
The test segmenting features are very robust, actions can be triggered by device, IP, cookie, audience type, and specific times of day, allowing us to test whatever we want, when we want.
And some cons:
We’re not using all the features of the tool, there’s so much to choose from it’s sometimes overwhelming. The support team however are superb and have always been able to help.
More integration with GA would be useful.
Some of the features do require some technical knowledge to implement, again support are always on hand to help.
Pricing for Dynamic Yield is available on request.
Evolv is a new generation testing tool that merges machine learning algorithms with conversion optimization.
Evolv enables you to do goal-oriented experimentation. Once you’ve set up your goals and KPIs, it uses machine learning to experiment with the largest number of ideas possible.
Evolv covers the entire customer journey and can optimize elements like copy, button styling, background images, slider treatment and timing, image order, and more. One of biggest advantages of Evolv is the ability to run multivariate tests on a massive scale.
Pricing for Evolv is available on request.
Google Optimize is a Google tool that lets you test and tailor different variations of your website.
The main selling point of Google Optimize is its native integration with Google Analytics, allowing you to gain automatic access to rich behavioral insights. You’ll also be able to target the valuable segments you’ve already discovered using Analytics.
Try out Google Optimize for free and upgrade to Google Optimize 360 for enterprise-level website testing and personalization.
Intellimize is a predictive personalization platform that automates many of the more laborious and time-consuming aspects of setting up and running A/B tests.
Using machine learning, the Intellimize platform tests personalized site changes, then automatically prioritizes the winning result.
Gabe Meierotto from LaserAway reviews it below:
You can try Intellimize by contacting the company via their website.
Kameleoon was featured in Forrester’s 2020 Q4 Wave for Experience Optimization Platforms as a “challenger” to Optimizely, Adobe Target, and legacy tools.
With its focus on data security and privacy, Kameleoon is a popular choice for healthcare, financial services, and organizations. Ecommerce brands appreciate its robust integration with Shopify and personalization features.
Depending on traffic, the annual license rate for its a/b testing solution starts at approximately $30,000 per year.
Here is what Ben Labay, Managing Director of Speero said about Kameleoon:
Request a demo or contact Kameleoon to get a quote.
Maxymiser is a powerful testing tool that helps you design and run sophisticated campaigns.
Like other tools, Maxymiser offers a visual editor that will help you set up variants and tests as well as an extensible coding environment for more complex projects.
However, Maxymiser shines through most in terms of personalization and targeting. This tool provides you with the ability to build rules directly using the visual editor to target profitable customer segments and display personalized content.
Most impressively, Maxymiser automatically builds a customer profile that aggregates data on historic and in-session behaviors and visitor attributes for each unique visitor to your page.
Pricing for Maxymiser is available on request.
Monetate is another well-loved testing tool that has a reputation for providing fantastic client services. They provide both a testing and segmentation tool as well as a personalization tool.
With Monetate Testing and Segmentation, you can perform advanced A/B tests and multivariate tests. They also have built-in measures of statistical significance and dynamic testing which adjusts traffic allocation to optimize for ROI. Monetate’s 1-to-1 Personalization Engine is an advanced machine learning engine that determines which actions will help you achieve a given goal. This means you can automate and optimize personalization decisions.
Pricing for Monetate is available on request.
Omniconvert is another important player in the testing tool market. They position themselves as a sort of all in one optimization tool: on-page surveys, A/B testing, personalization, overlays, segmentation.
They’re an especially good tool for beginners, affordable with lots of features included.
Omniconvert’s plan starts at $324/month. There’s also an enterprise plan available.
Optimizely is an experimentation platform aimed at enterprise customers exclusively. Their tool is powerful and targeted at websites with high traffic—in other words, companies that are very serious about testing and personalization.
At the root of it, Optimizely is focused on web experimentation and personalization. With their Web Experimentation product, you can safely run multiple experiments on the same page.
You can also use Optimizely beyond your website and expand to mobile apps, messaging platforms, and more so you can optimize your entire customer experience.
Pricing for Optimizely is available on request.
Qubit is a testing platform focused around personalization, making it one of the strongest segmentation tools on the market.
With Qubit, you’ll be able to run A/B tests and multivariate tests in order to measure progress and effectiveness of various personalization techniques. You’ll also get access to cart abandonment recovery, product recommendations, and social proof tools, making this software a great choice for ecommerce businesses.
- Great A/B test ideas based on both quantitative and qualitative evidence.
- The Qubit consultants and engineers we have worked with have an excellent ‘can do’ attitude.
- Excellent communication and clarity on test results.
From the same review, the cons are:
- There is room for improvement on the velocity of getting new tests developed and QA’d.
- I would like to see improvements to the exit survey interface to make it easier to flag, categorise and disseminate feedback to different areas in the business.
- Depending on the test/experience it can add extra weight to page load times and cause ‘flicker.’
Pricing for Qubit is available on request.
SiteGainer is a company that offers a full suite of conversion optimization tools, including A/B testing, multivariate testing, personalization, heatmaps, popups, and surveys.
The tool is quite easy to set up and use, and creating everything from simple A/B tests to surveys, popups, and more is very intuitive.
They also have a team of experts to assist you with test ideas, design, programming, analytics, and personalization.
SiteGainer offers a free trial. Pricing plans are based on monthly traffic, payment schedule, and additional services.
SiteSpect offers a server-side solution and is a great choice for more technically advanced testers. By editing HTML before it leaves the server, it is popular with self-hosting companies and security-conscious clients.
Of course, SiteSpect does offer a visual editor tool to help make setting up optimization and testing processes convenient and efficient. What makes it different is its ability to give you access to both client and server side, allowing for a comprehensive view of the entire customer experience and high performance for speed and scaling.
Choose from a variety of packages that vary in integrations, features, and accounts depending on your scale and needs.
Visual Website Optimizer (VWO) is another big player in the A/B testing software market. It is a top choice for businesses with slightly smaller budgets and popular amongst many marketers.
One of the reasons it’s so popular is because of the variety in tools it gives you access to, which VWO separates into five categories: Testing, Insights, FullStack, Engage, and Plan.
With VWO, you are able to create multiple variations of web pages and track various conversion goals. VWO also provides statistical analysis of your results. A favorite feature of VWO is its built-in heatmap tool that tracks visitor click behavior and tracking habits.
Notably, if personalization is important to your work, VWO offers easy tools for segmenting and delivering targeted offers.
Here’s a review of Alex Harris, CRO director at Perficient:
VWO plans for web-based testing range from $99/month to $467/month. Their FullStack plan is $1,999/month. A 30-day free trial is available.
There you have it: the top A/B testing tools, reviewed by the experts.
While each has their own pros and cons, it’s likely you’ll have to some some strategic thinking and exploration to get the solution that is right for your business and specific situation. Hopefully these reviews help you in the process.