Episodes
See our recent episodes below or watch them all on YouTube.
Season 4
Season 3
Recent Events
Product Experimentation
Trends that have to stop
Recent Episodes
Some episodes from the last couple of years
AI and the Experimentation Lifecycle featuring Joey Herzberg
In this episode, we have Joey Herzberg who shares his thoughts on how AI fits in the experimentation life cycle, the utility of keeping easily referenced records of test results, and the importance of experimentation strategy with regard to sample ratios.
Use automation to build optimal flow states with Shawn David
Learn about human-first engineering in this in-depth interview where Shawn David discusses strategies to organize work and to break down tasks into smaller digestible sessions. He explained the most effective ways for teams to discover the work that should be automated the most by focusing on the desires and strengths of individuals, to remove work that is menial especially to them. We explored the impacts on company culture that menial tasks can cause and discussed some of the pitfalls with new technologies as well as lessons to keep in mind while reviewing new tools and technologies.
The Challenges of Building a Culture of Experimentation: Insights from Industry Leader Nima Yassini
Join Nima Yassini as he dives into experimentation culture, the journey of building a brand UX and digital marketing agency focused on conversion rate optimization, the integration of digital marketing and experimentation culture, the struggles and benefits of adopting a culture of experimentation, and the need for leadership and reinvestment in the experimentation industry.
Don't A/B Test?! featuring Solomon Kahn
CEO and founder of Delivery Layer, Solomon Kahn shares why he thinks that most companies should NOT be A/B testing and what we should do instead. He also shares details about his recent exchange with Ron Kohavi on LinkedIn on this same topic. What side are YOU on?
Experiment Nation's 2024 CRO Salary Report and how to paid what you're worth with Tracy Laranjo
It's that time of year again! It's time for Experiment Nation's 2024 CRO Salary Report. In this episode, we explore some of the report's highlights with Tracy Laranjo as well as ask her for her thoughts on how CROs and Experimenters can get paid fairly.
Always start by testing your best variation with Zach Lebovics
Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers.
Navigating Stakeholder Management and Gaining Buy-In with Shiva Manjunath
Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.
The truth about app development and optimization with Juliana Jackson
Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.
The power of CRO mentorship with Tracy Laranjo
Fractional Head of CRO, Tracy Laranjo talks about the power of Mentorship for Conversion Rate Optimizers (CROs). We cover:Why would CROs need mentorship?How do you find one?When are you ready to be a mentor and how do you get that word out?Would Tracy be a mentor for our listeners?
Product Management vs. CRO with Bryce York
In an insightful interview at Experiment Nation’s Conference, Bryce York, Director of Product Management at Tatari, delves into several key insights. He explores the parallels and distinctions between CRO and product management, especially in smaller companies where overlapping skills are crucial. Bryce shares his personal journey from entrepreneurship to product management, underscoring the significance of both qualitative and quantitative data in experiment design. Additionally, he emphasizes the importance of documentation and knowledge sharing in cultivating an experiment-driven culture.
Create a more impactful testing roadmap with this framework - ft. Edmund Beggs
Documentation. The unsung, yet incredibly important part of any experimentation program. Great documentation allows you to look back at past experiments and find patterns of what were the most effective levers to inform your testing roadmap and levers you probably can deprioritize. In today's episode of Experiment Nation, our own Charlotte April Bomford recently spoke to Edmund Beggs about the "Levers Framework" which allows Convert.com to deliver results for their clients in shorter amounts of time. If you'd like to learn more about this interesting framework, watch the full interview.
How to learn from failures (from losing and winning tests) with Simon Girardin
Simon Girardin emphasizes the importance of learning from every test, capturing value by reviewing data, segmenting results, and analyzing user behavior through session recordings and heatmaps.
How to build a community around experimentation with Rommil Santiago
Koalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.
Level-up your UX Research with Diary Studies featuring Mike Green
Research is important to Conversion Rate Optimization, but are you leveraging the power of Diary Studies? If not, you're missing out. Learn more from Mike Green.
How to get Stakeholder Buy-in for all your Experiments featuring André Morys
Learn from André Morys, CEO of KonversionsKRAFT, on gaining crucial stakeholder buy-in for experiments. André highlights the challenges faced by optimizers and advocates for understanding team dynamics through stakeholder mapping. He emphasizes approaching stakeholders, using empathy to build relationships, and overcoming objections. André shares practical insights on conflict management, including a stakeholder map with color-coded power dynamics. Discover the significance of regular check-ins, fostering trust, and achieving tangible results in experimentation. Master the art of securing support for your experiments effectively.
Will Laurenson: From Startups to CRO Mastery
Will Laurenson shares his journey from startup to becoming a CRO (Conversion Rate Optimization) expert. Will discusses the significance of usability, anxiety, and motivation in CRO, drawing from his extensive experience in running tests and optimizing various businesses. Will's approach to CRO involves deep insights into user behavior and a focus on aligning products with customer needs, challenging the common pitfalls of assuming product-market fit based solely on initial traction or advertising success.
The CRO Statistical concepts all CROs should know featuring Ishan Goel
In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of experimentation and statistics in the realm of Conversion Rate Optimization.
Ad Optimization: Your Ads Aren’t Working and Here’s Why ft. Joe Fitzpatrick
So much is spent on ads that it's a no-brainer to invest in ad optimization. Embracing experimentation and learning from failures is essential for long-term success in performance marketing. Experiment Nation's Tracy Laranjo spoke with Joe Fitzpatrick about reasons why your ads aren't working and what you can do about it.
Maximizing Results: A Comprehensive Guide to Ad Network Experimentation ft. João Marcelo Rodrigues
Maximizing results in ad network optimization requires a systematic approach. Start with A/B testing on Google Ads and gradually introduce more complex campaigns, balancing technical and creative aspects. Analyze your channel's performance, ensuring sufficient impressions and conversions for statistically significant results. Shape your product to align with the ad network's requirements and consider user experience. Prioritize velocity in testing initially, gradually enhancing quality, and encourage collaboration across different platforms for valuable insights in the quest for optimization.
The top CRO Myths that experimenters have to bust ft. Lucas Vos
Lucas, a senior conversion specialist, shares his journey in the media industry, emphasizing the transformative impact of A/B testing. He discusses myths about experimentation - debunking them along the way as well as highlights the importance of validation, integration into essential projects, and showcasing negative results. Lucas encourages testing the obvious and unexpected, questioning assumptions, and showing the value of experimentation to reduce risk and aid decision-making, making it an asset for senior managers and specialists.