Episodes
See our recent episodes below or watch them all on YouTube.
Season 4
Season 3
Recent Events
Product Experimentation
Trends that have to stop
Recent Episodes
Some episodes from the last couple of years
Optimizing organizational processes with Ruben de Boer
Ruben de Boer, a lead consultant at Online Dialogue and the founder of Conversion Ideas, shares his approach to conversion rate optimization (CRO) and experimentation. With 15 years of experience, Ruben emphasizes the importance of data-driven decision-making and understanding human behavior. He highlights the shift from focusing solely on digital products to also optimizing organizational processes. Ruben provides insights into the challenges of implementing experimentation in organizations, the need for higher management support, and the significance of aligning with colleagues' goals and motivations. He advocates for a research-driven approach, continuous feedback, and fostering an experimentation culture within teams to drive better results.
Watch our Product Experimentation Event
It's a wrap - Experiment Nation's Product Experimentation event may be over but you can still watch it all. A huge thanks to all our amazing speakers: Ellie Hughes ?Aarushi Raizada ?Stefanie Grimmling ?Anastasia Shvedova ?Olga Kosyreva ?Marilyn Koutsonikolas ?Jyoti Malec ?Dennis Nederlof ?Marylisa Santos With over 9K views, it has been one of our most successful events ever! Thanks to everyone who took the time to watch.
Growth cannot be siloed featuring Tymur Donets
Tymur Donets, a seasoned Growth PM and experimentation consultant, shared some powerful insights during his Experiment Nation talk. Here are five key takeaways:Growth PMs are holistic: Don’t be siloed! Growth PMs work across the entire customer journey, ensuring marketing and product teams are aligned.Commercial awareness is key: Both Growth PMs and CROs must understand the business impact of their work and how it contributes to the bottom line.Empathy is vital: CROs need to understand the pressures their PM colleagues face and proactively offer support.Leverage your expertise: If you’re a CRO, consider specializing in Growth PM to expand your impact and skillset.Transparency is key: Clear communication between teams helps everyone understand their roles and collaborate effectively.
CRO isn’t just for marketers with Kelly Wortham
Kelly Wortham dropped some serious knowledge bombs in our recent Experiment Nation chat. Here’s what stood out: - CRO isn’t just for marketers: Lawyers, project managers, even developers can thrive in this field. It’s all about a love of learning and adaptability. - Don’t underestimate the power of mentorship: Kelly has THREE mentors, each focusing on different aspects of her career. Find your own advisors to help you grow! - Certifications are nice, but experience trumps all: While CXL is great, hands-on testing platform experience is the real deal. - UX psychology is CRUCIAL: Understand your users’ motivations and behaviors to create truly effective tests.
Don’t rely on macro goals with Gursimran (Simar) Gujral
Simar, CEO and Founder of OptiPhoenix, shared invaluable insights on A/B testing and CRO at Experiment Nation. Here are 5 key takeaways: Don’t rely solely on macro goals: Micro goals reveal user behavior, driving better testing strategies and informing future hypotheses. Iterative testing trumps scrapping: Learn from failed tests by adjusting hypotheses and running new experiments, boosting your win rate. QA is critical but often neglected: Invest time in thorough QA, ensuring your test is accurate and integrated correctly. Outsourcing AB test development can be beneficial: Consider outsourcing for faster scale-up, access to expert resources, and reduced development burden. Prioritize experimentation within your workflow: Make A/B testing an integral part of your product development process, leading to better decisions and faster results.
Navigating Experimentation at Startups with Avishek Basu Mallick
Avishek Basu Mallick, a Senior PM at CheapOair talks about: - Experimentation at scale: Even with high traffic, rigorous experimentation is crucial. - Idea generation: User research, NPS surveys, and internal stakeholders are valuable sources of experiment ideas. - Communicating progress: Regular updates with leadership build trust and ensure alignment. - Personalization is nuanced: Distinguish between customization, segmentation, and true personalization. - Generative AI’s potential: Explore its use for simplifying the travel planning experience.
People are the biggest challenge featuring Michael St Laurent
Michael St Laurent, a seasoned CRO expert, shared his insights on large-scale testing Here are 5 key takeaways for marketers: Prioritization is key: Large-scale testing requires prioritizing tests based on potential impact and aligning with overall business goals. AI is the future, but humans guide it: Mike emphasizes the power of AI in automating processes and analyzing data, but highlights the importance of human expertise and guidance. Data quality is crucial: AI models rely heavily on the quality of data. Invest in building a robust data infrastructure to ensure accurate results. People are the biggest challenge: Navigating internal politics and managing stakeholder expectations is often the biggest hurdle for large-scale testing. Building a testing culture is a win: The ultimate goal of large-scale testing is to create a data-driven culture that fosters continuous improvement and better user experiences.
Start Small and Stay Curious featuring Ellie Hughes
Ellie Hughes, a top CRO expert and Experimentor of the Year, shared some incredible insights in her recent Experiment Nation interview. Here are 5 takeaways to boost your experimentation game:- Start Small and Stay Curious: Ellie emphasizes that experimentation is a journey, not a destination. Start small, stay curious, and never stop learning!- Prioritize Value, Not Tasks: Focus your time on activities that truly drive client value, like uncovering insights and ideation, rather than spending hours on tedious tasks.- Set Clear Expectations: Clearly define reporting timelines and communicate about peeking, managing client expectations, and setting the stage for success.- Embrace Iteration: Experimentation is an iterative process. Be open to changing your process, adapting to new learnings, and continuously improving.- Maximize Impact Through Big Ideas: Larger changes can be easier to detect, resulting in faster results and more impactful growth. Encourage clients to think big!
Using measurement to test on low-traffic sites featuring Chris Mercer
Join us for a deep dive into conversion rate optimization on low-traffic sites with these actionable insights Chris MercerMeasure before optimizing: Understand the current user journey and behaviors to identify areas for improvement.Test sequentially: Iterate faster on low-traffic websites by testing changes sequentially instead of using AB tests.Focus on the right metrics: Prioritize actions that drive meaningful outcomes, such as lead generation or revenue.Listen to the market: Gather user feedback to inform your optimization strategy and meet their needs.Automate measurement: Leverage Google Analytics 4 to collect and analyze data effectively to guide decision-making.
Build a Learning Library featuring Nick Murphy
Discover the power of experimenting to learn and win! ?Nick Murphy shares his expertise on building learning libraries. Here are 5 key takeaways:- Learning libraries capture the “why” behind successful and unsuccessful tests.- Organize your learning library with consistent and digestible fields.- Use “broad” and “specific” learning columns for a layered understanding.- Encourage cross-team collaboration by sharing insights company-wide.- Learning libraries foster a culture of experimentation and growth.
How To Build An Unstoppable Alliance With CX Feat. Courtney Leblanc
In this episode, senior customer experience leader, Courtney LeBlanc, reveals the ideal partnership between CX and experimenters and shares invaluable insights on:Forging powerful partnerships between CX and experimentersNavigating the daily demands of a CX leaderSimplifying CX workflows with customer insights... and so much more!Don't miss out on this enlightening conversation from an expert in the CX game!
Product Experimentation: How to get Product Managers to Experiment ft. Shagun Aulakh
How do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management - Experimentation at American Express shares with Rommil here tips.
AI and the Experimentation Lifecycle featuring Joey Herzberg
In this episode, we have Joey Herzberg who shares his thoughts on how AI fits in the experimentation life cycle, the utility of keeping easily referenced records of test results, and the importance of experimentation strategy with regard to sample ratios.
Use automation to build optimal flow states with Shawn David
Learn about human-first engineering in this in-depth interview where Shawn David discusses strategies to organize work and to break down tasks into smaller digestible sessions. He explained the most effective ways for teams to discover the work that should be automated the most by focusing on the desires and strengths of individuals, to remove work that is menial especially to them. We explored the impacts on company culture that menial tasks can cause and discussed some of the pitfalls with new technologies as well as lessons to keep in mind while reviewing new tools and technologies.
The Challenges of Building a Culture of Experimentation: Insights from Industry Leader Nima Yassini
Join Nima Yassini as he dives into experimentation culture, the journey of building a brand UX and digital marketing agency focused on conversion rate optimization, the integration of digital marketing and experimentation culture, the struggles and benefits of adopting a culture of experimentation, and the need for leadership and reinvestment in the experimentation industry.
Don't A/B Test?! featuring Solomon Kahn
CEO and founder of Delivery Layer, Solomon Kahn shares why he thinks that most companies should NOT be A/B testing and what we should do instead. He also shares details about his recent exchange with Ron Kohavi on LinkedIn on this same topic. What side are YOU on?
Experiment Nation's 2024 CRO Salary Report and how to paid what you're worth with Tracy Laranjo
It's that time of year again! It's time for Experiment Nation's 2024 CRO Salary Report. In this episode, we explore some of the report's highlights with Tracy Laranjo as well as ask her for her thoughts on how CROs and Experimenters can get paid fairly.
Always start by testing your best variation with Zach Lebovics
Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers.
Navigating Stakeholder Management and Gaining Buy-In with Shiva Manjunath
Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.
The truth about app development and optimization with Juliana Jackson
Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.