Become great at A/B testing
Start making more money with your online experiments
A/B testing mastery course
By Ton Wesseling, Founder of Online Dialogue
Course length: 5h 10min
Some of the companies that train their teams at CXL Institute:
Learn to get more value out of your online experiments
Discover approaches that work, pitfalls you will encounter, and lots of smart solutions to common issues.
This course will teach you how to get more wins, bigger wins and more insights from your experimentation efforts.
In just 18 lessons, you’ll learn how to
- Get more wins through a long term impact optimization process.
- Calculate where to run experiments, and with what impact.
- Make a hypothesis based on data and psychology.
- Prioritize test hypotheses and experiments.
- Design, start and stop experiments at the right time.
- Come up with proper insights from experiments run.
- Build up a knowledge library on validated user insights.
- Scale your digital experimentation efforts.
Here’s why most of your tests are flat (or losing)
With today’s tools, anyone can run A/B tests – but it’s not the tool that determines the outcome of the test. The most powerful tool is still your brain.
The outcomes of your experiments are mostly determined by what you test and the right treatments. Most people who run tests, but are not getting uplifts, are just doing it wrong. They’re either doing spaghetti testing (“maybe this will work!”), building tests based on gut feelings, or are just tinkering with the small stuff (button colors or font sizes) instead of solving problems.
This course is designed to teach you optimal testing strategies, so you can start winning
The “secret sauce” to getting more wins – and bigger wins – is about the process for identifying the biggest opportunities, and coming up with optimal solutions. It’s also about statistics: knowing when you have a false negative on your hands, and when to stop the tests to begin with.
Sometimes it’s the post-test analysis that will give you the insights you need to turn a failing test into a win. You need to know what to look for when you crunch the data.
This course is right for you if…
- You’re responsible (even partially) for the conversion rate of your digital channels.
- You’re part of a team that runs – or should be running – online experiments.
- Your company or client has at least 1,000 conversions coming in per month.
This course is probably not for you if…
- An advanced statistics guru that knows everything about frequentist and Bayesian statistics, including the fact that false negatives are a way bigger problem than false positives.
- Part of an organization with the highest testing maturity level: Evidence-based optimization is in the DNA of how the company operates.
- Working at a company (or for clients) with fewer than 1,000 conversions coming in per month (the first four lessons are still valuable, but the last four won’t apply to your situation).
Skills you should have before taking this course
- Basic digital analytics know-how
- Basic user research knowledge
- Some experience with running online experiments (or you’re going to join a team soon that is doing this)
Ton is one of the most respected practitioners in the conversion optimization space. He’s a sought-after digital optimization expert (over 20 years of experience), and recognized worldwide as an influential thinker, writer, and public speaker on conversion optimization and A/B testing.
He founded Online Dialogue – one of the global thought leaders in evidence-based growth. With his team, he helps and trains companies throughout the world to be effective at data-informed growth.
Your full course curriculum
Pillar 1 – “Intro”
This whiteboard lessons will give you an overview on:
- The history of A/B-testing
- The value it can bring to your company
- When to use A/B-testing
Pillar 2 – “Planning”
This is where you will get from “no idea what to A/B-test” to a “prioritized A/B-test roadmap”:
- Do you have enough data to conduct A/B-tests?
- Which KPI to pick?
- Research to get insights for your A/B-tests
- Hypothesis setting
- Prioritize your A/B-tests
Pillar 3 – “Execution”
Now you know which A/B-test you are going to execute it’s time to get it done!
- Design, Develop and QA your A/B-test
- Configure your A/B-test in your tool
- How to calculate the length of your A/B-test
- Monitoring your A/B-test
Pillar 4 – “Results”
Your A/B-test is finished, it’s time to dive in the results with the following lessons:
- A/B-test outcomes
- Presenting your learnings
- Business case calculations
Pillar 5 – “Outro”
You are not here for 1 A/B-test, you want to run a A/B-test program, so the next lessons are:
- Scaling up testing
- Sharing and scaling insights
Pillar 6 – “Bonus”
These bonus lessons are created because of frequently asked questions of students from the A/B-testing mastery course:
- What impact have data tracking issues on my A/B-test?
- What about Multi Arm Bandits, Bandits and AI solutions to experimentation?
- Bayesian or Frequentistic?
- What’s the right A/B-test tool for my company?
Show off your new skills: Get a certificate of completion
Once you complete the course, pass a test to get CXL certified in A/B testing.
Get this course and 50+ others when you sign up for CXL Institute
This course (and all others – full list here) are included with the CXL Institute subscription.
At CXL Institute, you can take online courses on growth, digital marketing, optimization, analytics, persuasion – all in a single subscription.
- World’s leading practitioners teaching you their best stuff.
- 50+ online courses on all things data-driven marketing
- New courses added every single month
Sign up for CXL Institute and get access to
- 50+ courses (full list here) on all aspects of data-driven marketing (new courses added every month)
- 4 Minidegrees that give you advanced level skills
- Talk recordings by world class practitioners at CXL Live and Elite Camp
Got a team, multiple users? Get our Teams All-Access plan instead.
The CXL Institute guarantee:
- 7-day no questions asked money back period
- You can immediately apply learnings and improve your results.
Need help convincing your boss?