Become great at A/B testing

Start making more money with your online experiments

Online course:
A/B testing mastery course

By Ton Wesseling,

Specialist in Conversion Optimization and Digital Experimentation @ Ton Wesseling

Course length: 5h 10min

Sign up to All-Access: $289 / month Buy just this program for $299

English subtitles Certificate included

Some of the companies that train their teams at CXL:


Learn to get more value out of your online experiments

Discover approaches that work, pitfalls you will encounter, and lots of smart solutions to common issues.

This course will teach you how to get more wins, bigger wins and more insights from your experimentation efforts.

Course overview

In just 18 lessons, you’ll learn how to

  • Get more wins through a long term impact optimization process.
  • Calculate where to run experiments, and with what impact.
  • Make a hypothesis based on data and psychology.
  • Prioritize test hypotheses and experiments.
  • Design, start and stop experiments at the right time.
  • Come up with proper insights from experiments run.
  • Build up a knowledge library on validated user insights.
  • Scale your digital experimentation efforts.

Skills you will master

A/B testingA/B test prioritizationA/B testing monitoringA/B tests setupExperimentation analysisA/B testing statisticsRunning experimentsCustomer base studiesPrioritization

Zharina Pelea, Digital Conversion Specialist @ Catchi Digital

I was able to immediately apply concepts such as segmentation and presentation of experiment results to my clients’ conversion programs. Ton shared great testing tools for better pre and post test calculations and analysis. I highly recommend this course to anyone who wants to up their A/B testing game!

Theodor Andrei, Digital Growth Manager @ WaterBear Network

Even though the content was difficult, it was explained in relatively simple terms.

Philip Cross, CEO and Conversion Rate Optimizer @ Premeni Services Company

The A/B testing mastery course was phenomenal! One of the more challenging courses due to Ton’s in-depth teaching on testing math, pre-test planning, testing errors, and quality assurance. It really pushed me – and I loved it.

Here’s why most of your tests are flat (or losing)

With today’s tools, anyone can run A/B tests – but it’s not the tool that determines the outcome of the test. The most powerful tool is still your brain.

The outcomes of your experiments are mostly determined by what you test and the right treatments. Most people who run tests, but are not getting uplifts, are just doing it wrong. They’re either doing spaghetti testing (“maybe this will work!”), building tests based on gut feelings, or are just tinkering with the small stuff (button colors or font sizes) instead of solving problems.

This course is designed to teach you optimal testing strategies, so you can start winning

The “secret sauce” to getting more wins – and bigger wins – is about the process for identifying the biggest opportunities, and coming up with optimal solutions. It’s also about statistics: knowing when you have a false negative on your hands, and when to stop the tests to begin with.

Sometimes it’s the post-test analysis that will give you the insights you need to turn a failing test into a win. You need to know what to look for when you crunch the data.

This course is right for you if…

  • You’re responsible (even partially) for the conversion rate of your digital channels.
  • You’re part of a team that runs – or should be running – online experiments.
  • Your company or client has at least 1,000 conversions coming in per month.

This course is probably not for you if…

  • An advanced statistics guru that knows everything about frequentist and Bayesian statistics, including the fact that false negatives are a way bigger problem than false positives.
  • Part of an organization with the highest testing maturity level: Evidence-based optimization is in the DNA of how the company operates.
  • Working at a company (or for clients) with fewer than 1,000 conversions coming in per month (the first four lessons are still valuable, but the last four won’t apply to your situation).

Skills you should have before taking this course

  • Basic digital analytics know-how
  • Basic user research knowledge
  • Some experience with running online experiments (or you’re going to join a team soon that is doing this)

Ton Wesseling

Specialist in Conversion Optimization and Digital Experimentation @ Ton Wesseling

Ton is one of the most respected practitioners in the conversion optimization space. He’s a sought-after digital optimization expert (over 20 years of experience), and recognized worldwide as an influential thinker, writer, and public speaker on conversion optimization and A/B testing.

He founded Online Dialogue – one of the global thought leaders in evidence-based growth. With his team, he helps and trains companies throughout the world to be effective at data-informed growth.

Get a lesson preview

  • Get more behavior insights with the 6V research model

    Understand why and how to gather insights on: View, Voice, Versus, Validated, Verified, and Value—all in this free lesson.

  • This field is for validation purposes and should be left unchanged.

Your full course curriculum

Pillar 1 – “Intro”

This whiteboard lessons will give you an overview on:

  • The history of A/B-testing
  • The value it can bring to your company
  • When to use A/B-testing

Pillar 2 – “Planning”

This is where you will get from “no idea what to A/B-test” to a “prioritized A/B-test roadmap”:

  • Do you have enough data to conduct A/B-tests?
  • Which KPI to pick?
  • Research to get insights for your A/B-tests
  • Hypothesis setting
  • Prioritize your A/B-tests

Pillar 3 – “Execution”

Now you know which A/B-test you are going to execute it’s time to get it done!

  • Design, Develop and QA your A/B-test
  • Configure your A/B-test in your tool
  • How to calculate the length of your A/B-test
  • Monitoring your A/B-test

Pillar 4 – “Results”

Your A/B-test is finished, it’s time to dive in the results with the following lessons:

  • A/B-test outcomes
  • Presenting your learnings
  • Business case calculations

Pillar 5 – “Outro”

You are not here for 1 A/B-test, you want to run a A/B-test program, so the next lessons are:

  • Scaling up testing
  • Sharing and scaling insights

Pillar 6 – “Bonus”

These bonus lessons are created because of frequently asked questions of students from the A/B-testing mastery course:

  • What impact have data tracking issues on my A/B-test?
  • What about Multi Arm Bandits, Bandits and AI solutions to experimentation?
  • Bayesian or Frequentistic?
  • What’s the right A/B-test tool for my company?

Show off your hard-earned skills and strengthen your profile.

LinkedIn found that people who add credentials to their profile receive 6x more profile views than those who don’t.

Add your certificates to your profile, share your accomplishments with the world, and join our alumni network.

Subscribe to CXL and get access

  • 120+ courses (full list here) on all aspects of data-driven marketing (new courses added every month)
  • 10 minidegrees that give you advanced level skills

Got a team, multiple users? Get our Teams All-Access plan instead.

The CXL guarantee

  • 7-day no questions asked money back period
  • You can immediately apply learnings and improve your results.

Need help convincing your boss?

Click here for a pitch deck, swipe files and tips.

Subscribe to CXL

Get access to this and 100+ other training programs.

See plans and pricing

or

Request demo (for teams 2+)

Learn A/B Testing: FAQ

Who is this course for?

This course is for you if:

  • You’re responsible (even partially) for the conversion rate of your digital channels.
  • You’re part of a team that runs – or should be running – online experiments.
  • Your company or client has at least 1,000 conversions coming in per month.

Some careers that will especially benefit from this course are CRO specialist, growth marketer, digital marketing manager, product manager, UX designer, data scientist, software engineer, web developer, or business analyst.

What will you learn?

After taking this course, you will:

  • Get more wins through a long term impact optimization process.
  • Calculate where to run experiments, and with what impact.
  • Make a hypothesis based on data and psychology.
  • Prioritize test hypotheses and experiments.
  • Design, start and stop experiments at the right time.
  • Come up with proper insights from experiments run.
  • Build up a knowledge library on validated user insights.
  • Scale your digital experimentation efforts.

What does the course include?

Our A/B Testing training includes 19 lessons, 6 downloadable resources, 5h 10min of video material, several assignments, and a final exam.

Are subtitles available for the lessons?

Lessons have English subtitles and transcriptions available.

Will I receive a certificate of completion?

After taking this course, you will receive the A/B Testing Mastery Certification from CXL, with credentials that you can add to your LinkedIn profile.

What is the refund policy?

All plans come with a 7-day refund period .

How long will it take for me to finish it?

This is entirely up to you – it’s how many study hours per week you can put in. This course is 5h 10min long.