Episodes
See our recent episodes below or watch them all on YouTube.
Season 4
Season 3
Recent Events
Product Experimentation
Trends that have to stop
Recent Episodes
Some episodes from the last couple of years
A/B Testing Statistics Concepts Experimenters must know with Ronny Kohavi
Learn A/B Testing Statistics, how to use Overall Evaluation Criterion, Twyman's law, how much traffic do you need to run A/B tests, and other statistical concepts all Experimenters must know.
Build or buy your Google Optimize replacement with Kenneth Kutyn
Are you looking to replace Google Optimize? On Experiment Nation's recent podcast, Charlotte April Bomford chats with Kenneth Kutyn about replacing Google Optimize, how to select a new vendor, and whether it's worth building your own Experimentation Platform (spoiler alert: the answer is usually no).
Sharing insights, AI and the future of CRO with Tim Thijsse
Tim Thijsse, a senior CRO (Conversion Rate Optimization) consultant at Orange Valley, discusses AI and the future of CRO, and the importance of incorporating qualitative research into company-wide processes. He emphasizes the challenge of linking user behavior and mindset to knowledge and information. Tim shares his background, starting as an interaction designer and later transitioning to UX design and CRO. He highlights the evolution of CRO, the need for a culture of experimentation, and the role of qualitative insights in optimization strategies. Tim also discusses the challenges companies face in adopting an experimentation mindset, such as aligning strategy, operations, and technical aspects, and the importance of having a common metric and collaboration among teams.
7 must-know CRO fundamentals based on running 22,000 tests with Ayat Shukairy
Ayat Shukairy emphasizes the importance of addressing the functional, social, and emotional aspects of customer needs when designing websites. She shares seven lessons learned from her experience in conversion rate optimization.
CRO Insights from a Meta-analysis of over 1000 A/B Tests with Georgi Georgiev
Georgi Georgiev performed a meta-analysis of over 1000 A/B tests and has a great deal to share about:- What you should expect your win rate to be- The benefits of sequential testing- Why you should report on confidence intervals
Get Executive buy-in for your CRO program with Jonny Longden
Let's face it, experimentation is completely misunderstood. The power and the benefit and potential of it is to innovate and develop a business. And when you think about it, that's what experimentation has always been in relation to the scientific method. If you think about spaceflight, medicine, anything great that's happened in the history of modern civilization, this has all happened as a result of the careful application of the scientific method.
A/B Testing Statistics issues CROs should ignore with Timothy Chan
Experimenters obsess about many A/B Testing Statistics concepts - but not all of them are worth worrying about. Statsig's Timothy Chan shares his thoughts about test isolation, interaction effects and confidence levels - some of his thoughts may surprise you.
Client Relationship Tips from a CRO Agency Founder with Andra Baragan
In this presentation, Andra Baragan, the Founder of ONTRACK DIGITAL will walk you through what you need to know to build a strong, successful relationship with your clients and with your team.You will learn:- how to set expectations with your client from Day 1- how to leverage operating procedures and automate your work- how to communicate with clients and get stakeholder buy-in every time
What you need to know about Launching a CRO agency with John Ekman
10 lessons that helped John Ekman in Launching a CRO agency. John learned many lessons when launching his agency - he wants to share them with you.
Optimize Customer Lifetime Value - NOT Conversion Rates with Valentin Radu
After decades of acquisition marketing, companies are waking up to the fact that optimising the entire lifecycle of the customer is the way to go. That happens due to rising acquisition costs, cookie deprecation, siloes, company mentalities, etc.In this session, Valentin will share insights from his 12 years of experience transitioning from CRO - website optimization to increase the conversion rate to CVO - experimenting towards improving the CLV.
Improve conversions with the Message-market Fit framework With Daphne Tideman
Message-Market fit is the idea that a message, whether it be a product, service or idea, needs to resonate with a specific target market in order to be successful. It involves finding the right message that effectively communicates the value proposition of a product or service to a particular audience, in a way that resonates with them.
Avoid AB Testing Statistics Mistakes with Max LI
A/B testing plays a critical role in decision-making - but so does AB Testing Statistics Mistakes. In data-driven companies, A/B tests not only prove positive impacts of product features (treatments) but also provide evidence to safely roll out neutral features that are not expected to move business metrics. When rolling out a neutral feature, we need to test if the treatment is non-inferior to control, and conventional A/B testing is not suitable in this case.
Stop having bad test ideas - with Bart Schutz
Add Exploration and Validation phases to your testing program - because most of your wins are fake.
How to be good at coding A/B tests with Jeroen Wiersma
How to be a good test coder with Jereon Wieresema
The problem with the word, “Hypothesis” and the importance of HiPPOs with Nima Yassini
Having mature conversations with immature markets, the problem with the word, “Hypothesis”, the importance of HiPPOs with Nima Yassini
How to adopt a CRO mindset for life optimization with Ruben de Boer
Life optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life.
Zuko Analytics' Alun Lucas on Why good form design is important and common form optimization myths
Richard talks to Alun Lucas from Zuko Analytics about Form Optimization
Online Dialogue's Ton Wesseling shares his thoughts on how CRO will probably die
Our new podcast host, Richard Joe, speaks to Online Dialog's Ton Wesseling about how he got started, the lessons he learned during his career, and how the CRO industry will die.