A/B Testing

Which Button Color Converts the Best?

Color is an essential part of how we experience the world. But do colors really matter for conversion optimization? Can a button color guarantee better performance for a call to action (CTA)?

No single color is better than another. Ultimately, what matters is how much a button color contrasts with the area around it.

Keep reading »
12 A/B Testing Mistakes I See All the Time

A/B testing is fun. With so many easy-to-use tools, anyone can—and should—do it. However, there’s more to it than just setting up a test. Tons of companies are wasting their time and money.

Keep reading »
Top 20 A/B Ecommerce Test Ideas

There’s nothing that always works and pretty much nothing that never works either. Websites are highly contextual.

That being said, there are tests that tend to have a very high win rate. These are the test ideas that, while they don’t work 100% of the time, work more often than not.

Naturally, everything depends on the specific implementation — a good idea implemented poorly will not yield any results.

The following 20 testing ideas come from our own client-based research done over the years. Keep reading »

Predicting Winning A/B Tests Using Repeatable Patterns

If you ever ran a highly trustworthy and positive a/b test, chances are that you’ll remember it with an inclination to try it again in the future – rightfully so. Testing is hard work with many experiments failing or ending up insignificant. It’s optimal to try and exploit any existing knowledge for more successes and fewer failures. In our own practice we started doing just that. Keep reading »

How to Use A/B Testing and Personalization Best Together

If you ask most marketers, they will tell you that A/B testing and personalization are two completely different things. I respectfully disagree, and I think this disagreement is at the root of how to use them best together. Keep reading »

How to Segment A/B Test Results to Find Gold

You run an A/B test, and it’s a winner. Or maybe it’s flat (no difference in performance between variations). Does it mean that the treatments that you tested didn’t resonate with anyone? Probably not.

If you target all visitors with the A/B test, it merely reports overall results – and ignores what happens in a portion of your traffic, in segments.

Keep reading »

How to Analyze Your A/B Test Results with Google Analytics

A/B testing tools like Optimizely or VWO make testing easy, and that’s about it. They’re tools to run tests, and not exactly designed for post-test analysis. Most testing tools have gotten better at it over the years, but still lack what you can do with Google Analytics – which is like everything. Keep reading »

Google Optimize

Chances are, you’ve heard of Google Optimize by now. It’s Google’s solution for A/B testing and personalization. It launched in beta in 2016  and left optimizers around the world waiting in line to try it out.
Now that it’s out of beta, you can give it a try without the wait.

But what can you expect? How do you configure it properly? How do you run your first experiment?

Keep reading »
16 Ecommerce A/B Test Ideas Backed by UX Research

Nothing works all the time on all sites. That’s why we test in the first place; to let the data tell us what is actually working.

That said, we have done quite a bit of user experience on ecommerce sites and have seen some trends in terms of what generates positive experiences from a customer perspective.

This post will outline 16 A/B test ideas based on that data.

Keep reading »

How CRO Experts Build and Maintain Testing Roadmaps

It will come as no surprise, but like most things in life, conversion optimization will benefit from a strong strategic approach.

This generally includes aligning your goals and resources to build out a roadmap, or at least a framework/process, for your experiments.

Keep reading »