Episodes
See our recent episodes below or watch them all on YouTube.
Season 4
Season 3
Recent Events
Product Experimentation
Trends that have to stop
Recent Episodes
Some episodes from the last couple of years
The top CRO Myths that experimenters have to bust ft. Lucas Vos
Lucas, a senior conversion specialist, shares his journey in the media industry, emphasizing the transformative impact of A/B testing. He discusses myths about experimentation - debunking them along the way as well as highlights the importance of validation, integration into essential projects, and showcasing negative results. Lucas encourages testing the obvious and unexpected, questioning assumptions, and showing the value of experimentation to reduce risk and aid decision-making, making it an asset for senior managers and specialists.
Personalization timing matters - Avoid these common mistakes ft. Eric Melchor
Eric Melchor, an evangelist at Optimonk, emphasizes the importance of focusing on the product page for effective conversion rate optimization (CRO). He suggests treating website visitors as individuals and creating a personalized and enjoyable customer experience in real-time. Melchor also discusses the significance of capturing visitor interest early on and leveraging smart CRO tactics and personalization timing throughout the customer journey. Additionally, he mentions the value of optimizing the product page, as it can yield significant returns on investment.
CRO Organizational Structure- Centralized Team vs Process: with Oliver Paton
We explore various angles of CRO Organizational Structure. We discussed primarily the differences between centralized CRO teams vs a company-wide experimentation culture, and how this is best looked at as a continuum. Companies starting out might benefit from a centralized CRO team whereas more mature optimization programs can benefit more from working experimentation into all facets of the company. How can a company who does 0 experimentation introduce and adopt an experimentation process/culture? We also chatted about experimentation at the customer level, what this means, and how it could be the future of optimization.
What CROs need to know about Heatmaps with Deborah O'Malley
Heatmaps to the rescue! Creating an impactful website hero section above the fold is vital for user engagement. Clear value propositions and compelling calls to action are essential, as users often don't scroll past this section. Heat mapping, combined with other techniques like exit polls and A/B testing, provides a comprehensive understanding of user behavior. While urgency and scarcity tactics can be effective, users have become more skeptical of overused strategies like countdown timers. Understand your audience through analytics data and tailor your optimization strategies accordingly, whether it's for B2C, B2B, or other sectors. Mobile interactions may have imprecise heat map data, so use it alongside other sources for a well-rounded view.
Getting start-ups to adopt a culture of experimentation with Simon Girardin
To ensure the success of CRO projects, it's vital to involve all stakeholders, including executives and directors, right from the start. This inclusive approach not only helps them understand the intricacies of the CRO process but also demonstrates the depth of strategic thinking behind it. Even skeptical executives can be won over by involving them in CRO calls, showcasing the complexity that goes beyond mere marketing tactics. Such transparency and involvement lead to a more informed and supportive team, fostering successful CRO initiatives.
How to Maximize Hypotheses Testing ft. Eduardo Marconi Pinheiro Lima
In the world of Conversion Rate Optimization (CRO), Eduardo, a seasoned practitioner, shares his journey and the evolving landscape of CRO in Brazil. He underscores the importance of maintaining a problem-solution mindset and learning from mistakes to drive meaningful impact. One core principle he highlights is the need to focus on hypotheses that yield significant results, comparing them to squeezing fruit for juice. This strategy involves exploring promising hypotheses further and discarding those with neutral or unimpressive outcomes, a practice essential for effective experimentation, whether in-house or at an agency. The key takeaway is to persevere with ideas, akin to squeezing every drop of insight from hypotheses, and leveraging comprehensive data for a deeper understanding, a competitive edge held by in-house roles in the experimentation field.
What you need to know about Landing pages with Claire More
Integrating landing pages is crucial for tailored user experiences. Without it, visitors are directed to generic pages lacking personalized messaging. Landing pages are designed to enhance conversion rates and ROI. E-commerce companies benefit by using various types of landing pages, like the classic hero for focused products, listicle hero for storytelling, collection hero for multiple items, and content advertorials for top-funnel content. Mistakes include using one-size-fits-all pages and lacking customer-oriented content. Improve by collaborating with ads teams, using customer voices, and continuous experimentation. Claire More from Splitbase shared insights on optimizing landing pages for effective campaigns.
Don't test everything with Oliver Palmer
Don't test everything. Experimentation isn't about proving how clever you are. Mistakes in testing ideas from your own head are common; personal bias clouds results. High-performing experimentation needs executive buy-in and integrated roles. Successful teams engage diverse players with vested interest, ensuring hypotheses formation and metric selection are comprehensive. Valuable experimentation saves time by testing what not to do. Rather than just chasing conversion lifts, recognize when improvements won't make a difference. Cultural shifts, humility, and prioritizing efficient use of time are key components of effective experimentation programs. Test what makes sense.
The truth about building an Experimentation Culture with Mark Eltsefon
In this podcast episode, Mark Eltsefon, a senior data scientist and experimentation evangelist, discusses building an experimentation culture in different companies. He shares his journey from starting as a software developer to becoming passionate about data science and experimentation. He contrasts the experimentation culture at TikTok, where data-driven decisions were central and democratization was encouraged, with his current role at an e-commerce company specializing in print-on-demand. He emphasizes the importance of educating stakeholders about data-driven decision-making, and he highlights the need for strong experimentation infrastructure and high-quality hypothesis testing. He believes that while democratization is valuable, it's important to balance it with maintaining the quality of ideas and statistical rigor.
How to get Personalization Right with Juliana Amorim
Juliana Amorim emphasizes that personalization is not a silver bullet and recommends its use when aligned with strong hypotheses and business goals. She co-founded Croct, a personalization experimentation platform, focusing on adapting user journeys to context. Examples include tailoring websites for diverse buyer personas within B2B companies and customizing content for users at different stages, like newcomers or existing customers. AI-based personalization and rule-based personalization can coexist. Brands should prioritize personalizing their websites and consider first-party data support.
Stop limiting yourself - build your CRO brand today with Carlos Trujillo
Building a personal brand as a conversion rate optimizer is crucial in today's competitive digital landscape. Your personal brand serves as a powerful tool to establish credibility, showcase expertise, and attract new opportunities. By cultivating a strong brand identity, you position yourself as an authority in the field, gaining trust from potential clients or employers. A well-developed personal brand helps differentiate you from others, highlighting your unique approach and methodologies. It opens doors to collaborations, speaking engagements, and thought leadership opportunities. Additionally, a strong personal brand creates a lasting impression, leading to increased visibility, a larger professional network, and ultimately, a steady stream of clients or job offers.
Building a CRO Culture & Ideation Strategies with Lucia van den Brink
By implementing ideation strategies and fostering a culture of experimentation, companies can drive innovation and stay ahead of the curve. Building an experimentation culture is crucial for companies that want to innovate and stay ahead of the competition. It starts with creating an environment where experimentation is encouraged and failure is seen as an opportunity to learn and improve. Teams should be given the freedom to try new ideas and test them quickly using small-scale experiments. It's important to collect and analyze data from these experiments to make informed decisions about what works and what doesn't. Lucas Vos interviews Lucia van den Brink in this great AMA session.
Learn from Mistakes: What Eddie Aguilar learned from accidentally taking down InVision
Eddie Aguilar, a developer and CRO specialist, shares his experience with experimentation and optimization. He discusses how he started as a developer at a young age and eventually shifted to optimization. He recounts a specific incident while working with Envision App, where he made a global change to the website that caused a significant error, resulting in a spike in error logs. Eddie emphasizes the importance of communication and collaboration in such situations. Despite the error, the test yielded impressive results, with a 227% revenue lift and 70% LTV lift.
Make Personalization Personal with Care and Competence with David Mannheim
David Mannheim, author and expert on personalization, discusses the importance of personalization in marketing. He emphasizes the need for brands to focus on building relationships with customers based on trust and care. Mannheim distinguishes personalization from segmentation, highlighting personalization as a communication principle rather than just a marketing tactic. He also mentions the challenges faced in implementing personalization, such as the pressure for immediate returns and the balance of metrics.
Customer Value Optimization Explained with Defiant's Jason Chappel
We sat down with Jason Chappel, founder of Defiant, a specialist Customer Value Optimization agency, to discuss what sets CVO apart from CRO. Jason shares his insight on the importance of understanding and optimizing the entire customer journey, from acquisition to retention, and how CVO can help businesses increase customer lifetime value and drive sustainable growth in your business strategy.
Combining Quantitative and Qualitative to Increase Conversions with Harriet Swan
We all know that humans are very complex and are hard to predict how they will behave. This is why we want to do use multiple methodologies in tandem to understand our customers.
Great PMs know how to tell good stories with Priya Bhatia
To have any real influence or buy-in, you need to be able to tell a good story. Khalil recently interviewed Priya Bhatia to get their advice on how to tell a good story.
Do 3-column layouts increase orders? with Nicoleta Danile?
Optimizing forms during checkout is crucial for a seamless user experience. By simplifying and streamlining the process, businesses reduce cart abandonment rates and increase conversions. Shortening form length, utilizing autofill options, and providing clear instructions enhance efficiency, minimize user frustration, and ultimately boost customer satisfaction, loyalty, and revenue.Nicoleta walks us through a case-study where she explores a 1 column form vs a 3 column form in checkout.
A/B Testing Statistics Concepts Experimenters must know with Ronny Kohavi
Learn A/B Testing Statistics, how to use Overall Evaluation Criterion, Twyman's law, how much traffic do you need to run A/B tests, and other statistical concepts all Experimenters must know.