A Growth Manager and Product Manager’s Guide to Experimentation, A/B Testing Strategy and Analyzing Results
Learn the basics of Experimentation (aka A/B or AB testing) that all Product Managers should know in about an hour!
Other options:
- Take the course on Udemy
- Take the course on Skillshare
At the end of this no-nonsense course, students will understand the role of Experimentation in helping make strategic decisions, how to design basic Experiments and analyze their results, and how to develop a strategy that maximizes your resources and drives results.
Click the links below to view the lessons:
- Introduction
- Why PMs must Experiment
- When should you run Experiments?
- The Impact of Experimentation on Uncertainty
- How Experimentation fits in with other data sources
- 10 important Experimentation terms
- The Experimentation Cycle
- The value of an an Experimentation Roadmap for PMs
- The value of an an Experimentation Roadmap for PMs – Part 2
- The Experimentation-led product team
- Nurturing an Experimentation culture
- How to communicate launches and results
- How to document an Experiment
- Frequentist: Intro to Power, Desired Confidence Level, and Sample Size
- Frequentist: Selecting Power, Confidence Levels, and Minimum detectable effects
- Frequentist: Statistical and Practical Significance
- Sequential and the multiple comparisons problem
- Intro to Bayesian
- Sample Ratio Mismatch and Experiment Interaction
- Useful links
We’ll explore:
- When should you run Experiments?
- 10 important terms in Experimentation
- The Experimentation process
- Developing an Experimentation roadmap
- Building the team
- How to nurture an Experimentation culture
- Communication
- Documentation
- Intermediate/Advanced topic: Analyzing Results (Introduction to Frequentist, Bayesian, and Sequential statistics)
Bonus: Buy this course directly from Experiment Nation and receive a free PDF version of our new book, “Sprinting to show value”.
Other options:
- Take the course on Udemy
- Take the course on Skillshare
- Check out our How to convince your company to invest in A/B testing
