Learn to A/B test like a professional

Course Curriculum

Chapter 1: Introduction

Lecture 1: Course overview

Lecture 2: Tip to finish the course in less time

Chapter 2: A/B testing and the optimisation process

Lecture 1: Introduction

Lecture 2: Insight gathering

Lecture 3: Testing and iteration

Lecture 4: Targeting and personalisation

Chapter 3: Measuring success

Lecture 1: Introduction

Lecture 2: The importance of a measurement framework

Lecture 3: Knowing your top-level business objectives

Lecture 4: Primary vs secondary metrics

Lecture 5: Documenting objectives and goals

Lecture 6: Setting a baseline

Chapter 4: Insight gathering

Lecture 1: Introduction

Lecture 2: Quantitative and qualitative data

Lecture 3: Analytics insights

Lecture 4: Heuristic analysis

Lecture 5: Customer surveys

Lecture 6: Live chat

Lecture 7: Session replay

Lecture 8: Online user testing

Chapter 5: Testing and iteration

Lecture 1: Introduction

Lecture 2: A/B testing

Lecture 3: Multivariate testing

Lecture 4: Multi-page testing

Lecture 5: Split URL or redirect testing

Lecture 6: Which types of testing should I do? All of them?

Chapter 6: Before testing

Lecture 1: Introduction

Lecture 2: Building your team

Lecture 3: Experiment planning

Lecture 4: Prioritising experiments

Lecture 5: Why you need a problem statement

Lecture 6: Creating a hypothesis

Lecture 7: Generating ideas to test

Lecture 8: Choosing which segments to target

Lecture 9: Quality assurance

Lecture 10: Creating an A/B test

Lecture 11: Setting objectives for your A/B test

Lecture 12: Targeting your visitors

Chapter 7: During testing

Lecture 1: Introduction

Lecture 2: Knowing when to stop an experiment

Lecture 3: Understanding p-value

Lecture 4: Significance and sample size calculators

Lecture 5: One-tailed versus two-tailed tests

Lecture 6: Understanding validity

Lecture 7: Amending experiments while they are in progress

Lecture 8: The correct way to ramp up traffic volumes

Chapter 8: After testing

Lecture 1: Introduction

Lecture 2: Analysing and interpreting experiment results

Lecture 3: What to do if a variant loses

Lecture 4: Running experiments as series, not in isolation

Lecture 5: Maintaining an experiment backlog

Chapter 9: Documenting your A/B tests

Lecture 1: Introduction

Lecture 2: The test plan

Lecture 3: The test prioritisation planner

Lecture 4: The test report

Lecture 5: The test results template

Lecture 6: The test scheduler

Lecture 7: Bonus lecture