Ekaterina (Shpadareva) Gamsriegler, a seasoned growth and marketing expert, shared her insights on mobile app experimentation. Here are 5 key takeaways: Mobile experimentation is more complex: Release cycles are longer, and dependencies on app versions can slow down learning. Think beyond the app: Experimentation should encompass ads, store listing pages, and the app itself. Borrow insights from other areas: Use data from paid advertising to inform store listing optimizations. Interconnectivity is key: Changes in one area can impact others. Strong stakeholder management is crucial. Document everything: Detailed documentation helps track results and avoid surprises.
Category Archives: Interviews with Experimenters
Building Your CRO Brand with Tracy Laranjo
Tracy Laranjo shares learnings from years of growing her career with Suchita Srinivasan, here are some key takeaways: 1. CRO vs Experimentation: CRO focuses on driving performance and results, while experimentation centers around decision-making and validating ideas. 2. Agency vs In-House: Tracy’s journey highlights the benefits of agency experience for rapid skill development and exposure to diverse challenges. 3. Building Your Experimental Brand: Don’t be afraid to be yourself online, even if it’s not the typical thought leader persona. 4. Adapting to Constant Change: Focus on fundamentals and building your skills; stay curious and open to new developments, but don’t fear the future. 5. CRO is for Everyone: While AB testing requires scale, CRO encompasses qualitative research and user interviews, making it accessible for businesses of all sizes.
Have a narrow and well-defined ICP with Dr. Else van der Berg
Dr. Elsa van der Berg, a B2B SaaS product management expert, shares some key advice: Don’t try to build for everyone. ICP discrepancies are a common problem. ICP descriptions need to be evidence-based. Embrace focused testing. Understand the difference between signal and noise: Not all feedback is actionable. Focus on pain points that users have actively tried to solve.
Product pages are the Grand Central Station of conversions with Rishi Rawat
We recently had the pleasure of chatting with Rishi, a Shopify product expert. Here are 5 key takeaways for optimizing your product pages: 1) Product pages are the Grand Central Station of conversions. They’re where buyers make the decision to buy or leave. 2) Pop-ups aren’t as effective as you think. Focus on valuable content, not annoying interruptions. 3) Content is king (but don’t be afraid to go long!). Detailed product descriptions are more effective than short ones. 4) Build trust above the fold. Establish your company’s credibility before highlighting product features. 5) Understand the filters buyers use. Address common concerns like “too good to be true” to build confidence.
Speak the language of Profit with Ilan Hurwitz
Black Friday is coming, and the pressure is on. But don’t worry, Ilan Hurwitz has some expert advice to help you navigate the chaos. Here are five key takeaways from his chat with Tracy Laranjo: 1) Start now! Don’t wait until the last minute to get buy-in and start testing. 2) Speak the language of profit. Showcase the ROI of CRO to your stakeholders, focusing on increasing conversions and profits. 3) Don’t be afraid to experiment. Test offers, product placements, and even email campaigns outside of standard website A/B testing. 4) Focus on the customer journey. Don’t just look at your website. Analyze customer service tickets, reviews, and LTV to identify areas for improvement. 5) Think beyond discounting. Explore creative offers like gift with purchase, cross-sells, and subscription incentives to boost sales. Get ready to conquer Black Friday!
Leadership buy-in is essential with Lukas Vermeer
Experimentation is a journey, not a destination. Don’t expect to build a culture of experimentation overnight.
Cross-functional teams are critical. Breaking down silos and bringing together engineers, product managers, and designers will create a unified vision and drive faster iteration.
Leadership buy-in is essential. A top-down approach to embedding experimentation ensures everyone is on board and resources are allocated strategically.
Don’t underestimate the importance of organizational rhythms. Establish clear processes and structures to ensure smooth collaboration and avoid friction.
Embrace the growing pains. Change is rarely easy. Be prepared for challenges and celebrate milestones along the way.
Uncovering Solution Bias with Iqbal Ali
In this podcast episode of Experiment Nation, hosted by Charlotte Bomford, guest Iqbal Ali, an experienced web designer, researcher, and comic book writer, discusses the concept of solution bias and the importance of identifying underlying problems before diving into solutions. Ali emphasizes using AI to help understand problem landscapes, avoiding hastily jumping to solutions, and improving experimentation processes. The conversation covers techniques like premortems and frameworks to minimize potential issues and ensure experiments address real user problems. Ali highlights the collaborative potential of AI tools in maintaining the connection between problem statements and solutions, advocating for a more thoughtful approach to A/B testing and problem-solving in product development.
Optimizing organizational processes with Ruben de Boer
Ruben de Boer, a lead consultant at Online Dialogue and the founder of Conversion Ideas, shares his approach to conversion rate optimization (CRO) and experimentation. With 15 years of experience, Ruben emphasizes the importance of data-driven decision-making and understanding human behavior. He highlights the shift from focusing solely on digital products to also optimizing organizational processes. Ruben provides insights into the challenges of implementing experimentation in organizations, the need for higher management support, and the significance of aligning with colleagues’ goals and motivations. He advocates for a research-driven approach, continuous feedback, and fostering an experimentation culture within teams to drive better results.
Watch our Product Experimentation Event
It’s a wrap – Experiment Nation’s Product Experimentation event may be over but you can still watch it all. A huge thanks to all our amazing speakers: Ellie Hughes ?Aarushi Raizada ?Stefanie Grimmling ?Anastasia Shvedova ?Olga Kosyreva ?Marilyn Koutsonikolas ?Jyoti Malec ?Dennis Nederlof ?Marylisa Santos With over 9K views, it has been one of our most successful events ever! Thanks to everyone who took the time to watch.
Growth cannot be siloed featuring Tymur Donets
Tymur Donets, a seasoned Growth PM and experimentation consultant, shared some powerful insights during his Experiment Nation talk. Here are five key takeaways:
Growth PMs are holistic: Don’t be siloed! Growth PMs work across the entire customer journey, ensuring marketing and product teams are aligned.
Commercial awareness is key: Both Growth PMs and CROs must understand the business impact of their work and how it contributes to the bottom line.
Empathy is vital: CROs need to understand the pressures their PM colleagues face and proactively offer support.
Leverage your expertise: If you’re a CRO, consider specializing in Growth PM to expand your impact and skillset.
Transparency is key: Clear communication between teams helps everyone understand their roles and collaborate effectively.
CRO isn’t just for marketers with Kelly Wortham
Kelly Wortham dropped some serious knowledge bombs in our recent Experiment Nation chat. Here’s what stood out: – CRO isn’t just for marketers: Lawyers, project managers, even developers can thrive in this field. It’s all about a love of learning and adaptability. – Don’t underestimate the power of mentorship: Kelly has THREE mentors, each focusing on different aspects of her career. Find your own advisors to help you grow! – Certifications are nice, but experience trumps all: While CXL is great, hands-on testing platform experience is the real deal. – UX psychology is CRUCIAL: Understand your users’ motivations and behaviors to create truly effective tests.
Don’t rely on macro goals with Gursimran (Simar) Gujral
Simar, CEO and Founder of OptiPhoenix, shared invaluable insights on A/B testing and CRO at Experiment Nation. Here are 5 key takeaways: Don’t rely solely on macro goals: Micro goals reveal user behavior, driving better testing strategies and informing future hypotheses. Iterative testing trumps scrapping: Learn from failed tests by adjusting hypotheses and running new experiments, boosting your win rate. QA is critical but often neglected: Invest time in thorough QA, ensuring your test is accurate and integrated correctly. Outsourcing AB test development can be beneficial: Consider outsourcing for faster scale-up, access to expert resources, and reduced development burden. Prioritize experimentation within your workflow: Make A/B testing an integral part of your product development process, leading to better decisions and faster results.
Navigating Experimentation at Startups with Avishek Basu Mallick
Avishek Basu Mallick, a Senior PM at CheapOair talks about: – Experimentation at scale: Even with high traffic, rigorous experimentation is crucial. – Idea generation: User research, NPS surveys, and internal stakeholders are valuable sources of experiment ideas. – Communicating progress: Regular updates with leadership build trust and ensure alignment. – Personalization is nuanced: Distinguish between customization, segmentation, and true personalization. – Generative AI’s potential: Explore its use for simplifying the travel planning experience.
People are the biggest challenge featuring Michael St Laurent
Michael St Laurent, a seasoned CRO expert, shared his insights on large-scale testing Here are 5 key takeaways for marketers: Prioritization is key: Large-scale testing requires prioritizing tests based on potential impact and aligning with overall business goals. AI is the future, but humans guide it: Mike emphasizes the power of AI in automating processes and analyzing data, but highlights the importance of human expertise and guidance. Data quality is crucial: AI models rely heavily on the quality of data. Invest in building a robust data infrastructure to ensure accurate results. People are the biggest challenge: Navigating internal politics and managing stakeholder expectations is often the biggest hurdle for large-scale testing. Building a testing culture is a win: The ultimate goal of large-scale testing is to create a data-driven culture that fosters continuous improvement and better user experiences.
Start Small and Stay Curious featuring Ellie Hughes
Ellie Hughes, a top CRO expert and Experimentor of the Year, shared some incredible insights in her recent Experiment Nation interview. Here are 5 takeaways to boost your experimentation game:
– Start Small and Stay Curious: Ellie emphasizes that experimentation is a journey, not a destination. Start small, stay curious, and never stop learning!
– Prioritize Value, Not Tasks: Focus your time on activities that truly drive client value, like uncovering insights and ideation, rather than spending hours on tedious tasks.
– Set Clear Expectations: Clearly define reporting timelines and communicate about peeking, managing client expectations, and setting the stage for success.
– Embrace Iteration: Experimentation is an iterative process. Be open to changing your process, adapting to new learnings, and continuously improving.
– Maximize Impact Through Big Ideas: Larger changes can be easier to detect, resulting in faster results and more impactful growth. Encourage clients to think big!
Using measurement to test on low-traffic sites featuring Chris Mercer
Join us for a deep dive into conversion rate optimization on low-traffic sites with these actionable insights Chris Mercer
Measure before optimizing: Understand the current user journey and behaviors to identify areas for improvement.
Test sequentially: Iterate faster on low-traffic websites by testing changes sequentially instead of using AB tests.
Focus on the right metrics: Prioritize actions that drive meaningful outcomes, such as lead generation or revenue.
Listen to the market: Gather user feedback to inform your optimization strategy and meet their needs.
Automate measurement: Leverage Google Analytics 4 to collect and analyze data effectively to guide decision-making.
Build a Learning Library featuring Nick Murphy
Discover the power of experimenting to learn and win! ?
Nick Murphy shares his expertise on building learning libraries. Here are 5 key takeaways:
– Learning libraries capture the “why” behind successful and unsuccessful tests.
– Organize your learning library with consistent and digestible fields.
– Use “broad” and “specific” learning columns for a layered understanding.
– Encourage cross-team collaboration by sharing insights company-wide.
– Learning libraries foster a culture of experimentation and growth.
How To Build An Unstoppable Alliance With CX Feat. Courtney Leblanc
In this episode, senior customer experience leader, Courtney LeBlanc, reveals the ideal partnership between CX and experimenters and shares invaluable insights on:
Forging powerful partnerships between CX and experimenters
Navigating the daily demands of a CX leader
Simplifying CX workflows with customer insights
… and so much more!
Don’t miss out on this enlightening conversation from an expert in the CX game!
Product Experimentation: How to get Product Managers to Experiment ft. Shagun Aulakh
How do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management – Experimentation at American Express shares with Rommil here tips.
AI and the Experimentation Lifecycle featuring Joey Herzberg
In this episode, we have Joey Herzberg who shares his thoughts on how AI fits in the experimentation life cycle, the utility of keeping easily referenced records of test results, and the importance of experimentation strategy with regard to sample ratios.
Use automation to build optimal flow states with Shawn David
Learn about human-first engineering in this in-depth interview where Shawn David discusses strategies to organize work and to break down tasks into smaller digestible sessions. He explained the most effective ways for teams to discover the work that should be automated the most by focusing on the desires and strengths of individuals, to remove work that is menial especially to them. We explored the impacts on company culture that menial tasks can cause and discussed some of the pitfalls with new technologies as well as lessons to keep in mind while reviewing new tools and technologies.
The Challenges of Building a Culture of Experimentation: Insights from Industry Leader Nima Yassini
Join Nima Yassini as he dives into experimentation culture, the journey of building a brand UX and digital marketing agency focused on conversion rate optimization, the integration of digital marketing and experimentation culture, the struggles and benefits of adopting a culture of experimentation, and the need for leadership and reinvestment in the experimentation industry.
Don’t A/B Test?! featuring Solomon Kahn
CEO and founder of Delivery Layer, Solomon Kahn shares why he thinks that most companies should NOT be A/B testing and what we should do instead. He also shares details about his recent exchange with Ron Kohavi on LinkedIn on this same topic. What side are YOU on?
Experiment Nation’s 2024 CRO Salary Report and how to paid what you’re worth with Tracy Laranjo
It’s that time of year again! It’s time for Experiment Nation’s 2024 CRO Salary Report. In this episode, we explore some of the report’s highlights with Tracy Laranjo as well as ask her for her thoughts on how CROs and Experimenters can get paid fairly.
Always start by testing your best variation with Zach Lebovics
Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn’t solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers.
Navigating Stakeholder Management and Gaining Buy-In with Shiva Manjunath
Media.Monk’s Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.
The truth about app development and optimization with Juliana Jackson
Media.Monk’s Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.
The power of CRO mentorship with Tracy Laranjo
Fractional Head of CRO, Tracy Laranjo talks about the power of Mentorship for Conversion Rate Optimizers (CROs). We cover:
Why would CROs need mentorship?
How do you find one?
When are you ready to be a mentor and how do you get that word out?
Would Tracy be a mentor for our listeners?
Product Management vs. CRO with Bryce York
In an insightful interview at Experiment Nation’s Conference, Bryce York, Director of Product Management at Tatari, delves into several key insights. He explores the parallels and distinctions between CRO and product management, especially in smaller companies where overlapping skills are crucial. Bryce shares his personal journey from entrepreneurship to product management, underscoring the significance of both qualitative and quantitative data in experiment design. Additionally, he emphasizes the importance of documentation and knowledge sharing in cultivating an experiment-driven culture.
Create a more impactful testing roadmap with this framework – ft. Edmund Beggs
Documentation. The unsung, yet incredibly important part of any experimentation program. Great documentation allows you to look back at past experiments and find patterns of what were the most effective levers to inform your testing roadmap and levers you probably can deprioritize. In today’s episode of Experiment Nation, our own Charlotte April Bomford recently spoke to Edmund Beggs about the “Levers Framework” which allows Convert.com to deliver results for their clients in shorter amounts of time. If you’d like to learn more about this interesting framework, watch the full interview.
How to learn from failures (from losing and winning tests) with Simon Girardin
Simon Girardin emphasizes the importance of learning from every test, capturing value by reviewing data, segmenting results, and analyzing user behavior through session recordings and heatmaps.
How to build a community around experimentation with Rommil Santiago
Koalatative’s Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.
Level-up your UX Research with Diary Studies featuring Mike Green
Research is important to Conversion Rate Optimization, but are you leveraging the power of Diary Studies? If not, you’re missing out. Learn more from Mike Green.
How to get Stakeholder Buy-in for all your Experiments featuring André Morys
Learn from André Morys, CEO of KonversionsKRAFT, on gaining crucial stakeholder buy-in for experiments. André highlights the challenges faced by optimizers and advocates for understanding team dynamics through stakeholder mapping. He emphasizes approaching stakeholders, using empathy to build relationships, and overcoming objections. André shares practical insights on conflict management, including a stakeholder map with color-coded power dynamics. Discover the significance of regular check-ins, fostering trust, and achieving tangible results in experimentation. Master the art of securing support for your experiments effectively.
Will Laurenson: From Startups to CRO Mastery
Will Laurenson shares his journey from startup to becoming a CRO (Conversion Rate Optimization) expert. Will discusses the significance of usability, anxiety, and motivation in CRO, drawing from his extensive experience in running tests and optimizing various businesses. Will’s approach to CRO involves deep insights into user behavior and a focus on aligning products with customer needs, challenging the common pitfalls of assuming product-market fit based solely on initial traction or advertising success.
The CRO Statistical concepts all CROs should know featuring Ishan Goel
In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of experimentation and statistics in the realm of Conversion Rate Optimization.
Ad Optimization: Your Ads Aren’t Working and Here’s Why ft. Joe Fitzpatrick
So much is spent on ads that it’s a no-brainer to invest in ad optimization. Embracing experimentation and learning from failures is essential for long-term success in performance marketing. Experiment Nation’s Tracy Laranjo spoke with Joe Fitzpatrick about reasons why your ads aren’t working and what you can do about it.
Maximizing Results: A Comprehensive Guide to Ad Network Experimentation ft. João Marcelo Rodrigues
Maximizing results in ad network optimization requires a systematic approach. Start with A/B testing on Google Ads and gradually introduce more complex campaigns, balancing technical and creative aspects. Analyze your channel’s performance, ensuring sufficient impressions and conversions for statistically significant results. Shape your product to align with the ad network’s requirements and consider user experience. Prioritize velocity in testing initially, gradually enhancing quality, and encourage collaboration across different platforms for valuable insights in the quest for optimization.
The top CRO Myths that experimenters have to bust ft. Lucas Vos
Lucas, a senior conversion specialist, shares his journey in the media industry, emphasizing the transformative impact of A/B testing. He discusses myths about experimentation – debunking them along the way as well as highlights the importance of validation, integration into essential projects, and showcasing negative results. Lucas encourages testing the obvious and unexpected, questioning assumptions, and showing the value of experimentation to reduce risk and aid decision-making, making it an asset for senior managers and specialists.
Personalization timing matters – Avoid these common mistakes ft. Eric Melchor
Eric Melchor, an evangelist at Optimonk, emphasizes the importance of focusing on the product page for effective conversion rate optimization (CRO). He suggests treating website visitors as individuals and creating a personalized and enjoyable customer experience in real-time. Melchor also discusses the significance of capturing visitor interest early on and leveraging smart CRO tactics and personalization timing throughout the customer journey. Additionally, he mentions the value of optimizing the product page, as it can yield significant returns on investment.
CRO Organizational Structure- Centralized Team vs Process: with Oliver Paton
We explore various angles of CRO Organizational Structure. We discussed primarily the differences between centralized CRO teams vs a company-wide experimentation culture, and how this is best looked at as a continuum. Companies starting out might benefit from a centralized CRO team whereas more mature optimization programs can benefit more from working experimentation into all facets of the company. How can a company who does 0 experimentation introduce and adopt an experimentation process/culture? We also chatted about experimentation at the customer level, what this means, and how it could be the future of optimization.
What CROs need to know about Heatmaps with Deborah O’Malley
Heatmaps to the rescue! Creating an impactful website hero section above the fold is vital for user engagement. Clear value propositions and compelling calls to action are essential, as users often don’t scroll past this section. Heat mapping, combined with other techniques like exit polls and A/B testing, provides a comprehensive understanding of user behavior. While urgency and scarcity tactics can be effective, users have become more skeptical of overused strategies like countdown timers. Understand your audience through analytics data and tailor your optimization strategies accordingly, whether it’s for B2C, B2B, or other sectors. Mobile interactions may have imprecise heat map data, so use it alongside other sources for a well-rounded view.
Getting start-ups to adopt a culture of experimentation with Simon Girardin
To ensure the success of CRO projects, it’s vital to involve all stakeholders, including executives and directors, right from the start. This inclusive approach not only helps them understand the intricacies of the CRO process but also demonstrates the depth of strategic thinking behind it. Even skeptical executives can be won over by involving them in CRO calls, showcasing the complexity that goes beyond mere marketing tactics. Such transparency and involvement lead to a more informed and supportive team, fostering successful CRO initiatives.
How to Maximize Hypotheses Testing ft. Eduardo Marconi Pinheiro Lima
In the world of Conversion Rate Optimization (CRO), Eduardo, a seasoned practitioner, shares his journey and the evolving landscape of CRO in Brazil. He underscores the importance of maintaining a problem-solution mindset and learning from mistakes to drive meaningful impact. One core principle he highlights is the need to focus on hypotheses that yield significant results, comparing them to squeezing fruit for juice. This strategy involves exploring promising hypotheses further and discarding those with neutral or unimpressive outcomes, a practice essential for effective experimentation, whether in-house or at an agency. The key takeaway is to persevere with ideas, akin to squeezing every drop of insight from hypotheses, and leveraging comprehensive data for a deeper understanding, a competitive edge held by in-house roles in the experimentation field.
What you need to know about Landing pages with Claire More
Integrating landing pages is crucial for tailored user experiences. Without it, visitors are directed to generic pages lacking personalized messaging. Landing pages are designed to enhance conversion rates and ROI. E-commerce companies benefit by using various types of landing pages, like the classic hero for focused products, listicle hero for storytelling, collection hero for multiple items, and content advertorials for top-funnel content. Mistakes include using one-size-fits-all pages and lacking customer-oriented content. Improve by collaborating with ads teams, using customer voices, and continuous experimentation. Claire More from Splitbase shared insights on optimizing landing pages for effective campaigns.
Don’t test everything with Oliver Palmer
Don’t test everything. Experimentation isn’t about proving how clever you are. Mistakes in testing ideas from your own head are common; personal bias clouds results. High-performing experimentation needs executive buy-in and integrated roles. Successful teams engage diverse players with vested interest, ensuring hypotheses formation and metric selection are comprehensive. Valuable experimentation saves time by testing what not to do. Rather than just chasing conversion lifts, recognize when improvements won’t make a difference. Cultural shifts, humility, and prioritizing efficient use of time are key components of effective experimentation programs. Test what makes sense.
Roof sprinklers not advised in wildfire fight: Vernon fire chief
The truth about building an Experimentation Culture with Mark Eltsefon
In this podcast episode, Mark Eltsefon, a senior data scientist and experimentation evangelist, discusses building an experimentation culture in different companies. He shares his journey from starting as a software developer to becoming passionate about data science and experimentation. He contrasts the experimentation culture at TikTok, where data-driven decisions were central and democratization was encouraged, with his current role at an e-commerce company specializing in print-on-demand. He emphasizes the importance of educating stakeholders about data-driven decision-making, and he highlights the need for strong experimentation infrastructure and high-quality hypothesis testing. He believes that while democratization is valuable, it’s important to balance it with maintaining the quality of ideas and statistical rigor.
How to get Personalization Right with Juliana Amorim
Juliana Amorim emphasizes that personalization is not a silver bullet and recommends its use when aligned with strong hypotheses and business goals. She co-founded Croct, a personalization experimentation platform, focusing on adapting user journeys to context. Examples include tailoring websites for diverse buyer personas within B2B companies and customizing content for users at different stages, like newcomers or existing customers. AI-based personalization and rule-based personalization can coexist. Brands should prioritize personalizing their websites and consider first-party data support.
Stop limiting yourself – build your CRO brand today with Carlos Trujillo
Building a personal brand as a conversion rate optimizer is crucial in today’s competitive digital landscape. Your personal brand serves as a powerful tool to establish credibility, showcase expertise, and attract new opportunities. By cultivating a strong brand identity, you position yourself as an authority in the field, gaining trust from potential clients or employers. A well-developed personal brand helps differentiate you from others, highlighting your unique approach and methodologies. It opens doors to collaborations, speaking engagements, and thought leadership opportunities. Additionally, a strong personal brand creates a lasting impression, leading to increased visibility, a larger professional network, and ultimately, a steady stream of clients or job offers.
Building a CRO Culture & Ideation Strategies with Lucia van den Brink
By implementing ideation strategies and fostering a culture of experimentation, companies can drive innovation and stay ahead of the curve. Building an experimentation culture is crucial for companies that want to innovate and stay ahead of the competition. It starts with creating an environment where experimentation is encouraged and failure is seen as an opportunity to learn and improve. Teams should be given the freedom to try new ideas and test them quickly using small-scale experiments. It’s important to collect and analyze data from these experiments to make informed decisions about what works and what doesn’t. Lucas Vos interviews Lucia van den Brink in this great AMA session.
Learn from Mistakes: What Eddie Aguilar learned from accidentally taking down InVision
Eddie Aguilar, a developer and CRO specialist, shares his experience with experimentation and optimization. He discusses how he started as a developer at a young age and eventually shifted to optimization. He recounts a specific incident while working with Envision App, where he made a global change to the website that caused a significant error, resulting in a spike in error logs. Eddie emphasizes the importance of communication and collaboration in such situations. Despite the error, the test yielded impressive results, with a 227% revenue lift and 70% LTV lift.
Make Personalization Personal with Care and Competence with David Mannheim
David Mannheim, author and expert on personalization, discusses the importance of personalization in marketing. He emphasizes the need for brands to focus on building relationships with customers based on trust and care. Mannheim distinguishes personalization from segmentation, highlighting personalization as a communication principle rather than just a marketing tactic. He also mentions the challenges faced in implementing personalization, such as the pressure for immediate returns and the balance of metrics.
Customer Value Optimization Explained with Defiant’s Jason Chappel
We sat down with Jason Chappel, founder of Defiant, a specialist Customer Value Optimization agency, to discuss what sets CVO apart from CRO. Jason shares his insight on the importance of understanding and optimizing the entire customer journey, from acquisition to retention, and how CVO can help businesses increase customer lifetime value and drive sustainable growth in your business strategy.
Combining Quantitative and Qualitative to Increase Conversions with Harriet Swan
We all know that humans are very complex and are hard to predict how they will behave. This is why we want to do use multiple methodologies in tandem to understand our customers.
Great PMs know how to tell good stories with Priya Bhatia
To have any real influence or buy-in, you need to be able to tell a good story. Khalil recently interviewed Priya Bhatia to get their advice on how to tell a good story.
Do 3-column layouts increase orders? with Nicoleta Danile?
Optimizing forms during checkout is crucial for a seamless user experience. By simplifying and streamlining the process, businesses reduce cart abandonment rates and increase conversions. Shortening form length, utilizing autofill options, and providing clear instructions enhance efficiency, minimize user frustration, and ultimately boost customer satisfaction, loyalty, and revenue.
Nicoleta walks us through a case-study where she explores a 1 column form vs a 3 column form in checkout.
A/B Testing Statistics Concepts Experimenters must know with Ronny Kohavi
Learn A/B Testing Statistics, how to use Overall Evaluation Criterion, Twyman’s law, how much traffic do you need to run A/B tests, and other statistical concepts all Experimenters must know.
Build or buy your Google Optimize replacement with Kenneth Kutyn
Are you looking to replace Google Optimize? On Experiment Nation’s recent podcast, Charlotte April Bomford chats with Kenneth Kutyn about replacing Google Optimize, how to select a new vendor, and whether it’s worth building your own Experimentation Platform (spoiler alert: the answer is usually no).
Sharing insights, AI and the future of CRO with Tim Thijsse
Tim Thijsse, a senior CRO (Conversion Rate Optimization) consultant at Orange Valley, discusses AI and the future of CRO, and the importance of incorporating qualitative research into company-wide processes. He emphasizes the challenge of linking user behavior and mindset to knowledge and information. Tim shares his background, starting as an interaction designer and later transitioning to UX design and CRO. He highlights the evolution of CRO, the need for a culture of experimentation, and the role of qualitative insights in optimization strategies. Tim also discusses the challenges companies face in adopting an experimentation mindset, such as aligning strategy, operations, and technical aspects, and the importance of having a common metric and collaboration among teams.
7 must-know CRO fundamentals based on running 22,000 tests with Ayat Shukairy
Ayat Shukairy emphasizes the importance of addressing the functional, social, and emotional aspects of customer needs when designing websites. She shares seven lessons learned from her experience in conversion rate optimization.
CRO Insights from a Meta-analysis of over 1000 A/B Tests with Georgi Georgiev
Georgi Georgiev performed a meta-analysis of over 1000 A/B tests and has a great deal to share about:
– What you should expect your win rate to be
– The benefits of sequential testing
– Why you should report on confidence intervals
Get Executive buy-in for your CRO program with Jonny Longden
Let’s face it, experimentation is completely misunderstood. The power and the benefit and potential of it is to innovate and develop a business. And when you think about it, that’s what experimentation has always been in relation to the scientific method. If you think about spaceflight, medicine, anything great that’s happened in the history of modern civilization, this has all happened as a result of the careful application of the scientific method.
A/B Testing Statistics issues CROs should ignore with Timothy Chan
Experimenters obsess about many A/B Testing Statistics concepts – but not all of them are worth worrying about. Statsig’s Timothy Chan shares his thoughts about test isolation, interaction effects and confidence levels – some of his thoughts may surprise you.
Client Relationship Tips from a CRO Agency Founder with Andra Baragan
In this presentation, Andra Baragan, the Founder of ONTRACK DIGITAL will walk you through what you need to know to build a strong, successful relationship with your clients and with your team.
You will learn:
– how to set expectations with your client from Day 1
– how to leverage operating procedures and automate your work
– how to communicate with clients and get stakeholder buy-in every time
What you need to know about Launching a CRO agency with John Ekman
10 lessons that helped John Ekman in Launching a CRO agency. John learned many lessons when launching his agency – he wants to share them with you.
Optimize Customer Lifetime Value – NOT Conversion Rates with Valentin Radu
After decades of acquisition marketing, companies are waking up to the fact that optimising the entire lifecycle of the customer is the way to go. That happens due to rising acquisition costs, cookie deprecation, siloes, company mentalities, etc.
In this session, Valentin will share insights from his 12 years of experience transitioning from CRO – website optimization to increase the conversion rate to CVO – experimenting towards improving the CLV.
Improve conversions with the Message-market Fit framework With Daphne Tideman
Message-Market fit is the idea that a message, whether it be a product, service or idea, needs to resonate with a specific target market in order to be successful. It involves finding the right message that effectively communicates the value proposition of a product or service to a particular audience, in a way that resonates with them.
Avoid AB Testing Statistics Mistakes with Max LI
A/B testing plays a critical role in decision-making – but so does AB Testing Statistics Mistakes. In data-driven companies, A/B tests not only prove positive impacts of product features (treatments) but also provide evidence to safely roll out neutral features that are not expected to move business metrics. When rolling out a neutral feature, we need to test if the treatment is non-inferior to control, and conventional A/B testing is not suitable in this case.
Stop having bad test ideas – with Bart Schutz
Add Exploration and Validation phases to your testing program – because most of your wins are fake.
How to be good at coding A/B tests with Jeroen Wiersma
How to be a good test coder with Jereon Wieresema
The problem with the word, “Hypothesis” and the importance of HiPPOs with Nima Yassini
Having mature conversations with immature markets, the problem with the word, “Hypothesis”, the importance of HiPPOs with Nima Yassini
How to adopt a CRO mindset for life optimization with Ruben de Boer
Life optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life.
Zuko Analytics’ Alun Lucas on Why good form design is important and common form optimization myths
Richard talks to Alun Lucas from Zuko Analytics about Form Optimization
Experimenter of the Week: Charlotte April Bomford
Check out our Experimenter of the week!
Online Dialogue’s Ton Wesseling shares his thoughts on how CRO will probably die
Our new podcast host, Richard Joe, speaks to Online Dialog’s Ton Wesseling about how he got started, the lessons he learned during his career, and how the CRO industry will die.
Experimenter of the Week: Dorian Gonzalez
Check out our Experimenter of the week!
How to verify your data truly reflects user behaviour with Florent Buisson
Florent Buisson is a decade-long behavioral economist who published a practical guide to behavioral data analysis in business. It’s the book he wished he had when he started in analytics.
In this episode, he shares:
Why intuition can actually be a good thing in data analytics. If you need to know R or Python to understand your users. Why and when causal analytics are important.
Choosing the right A/B testing tool with Product for Product
Matt Green and Moshe Mikanovsky of Product for Product podcast help you navigate the plethora of A/B testing tools out there.
Whether you’re in product or marketing, listen for a beginner-friendly comparison of tools like Google Optimize, Optimizely, and more.
**This episode, nor those of Product for Product, are endorsements of any of the discussed tools.**
Johann Van Tonder on how to conquer 4 common ideation pitfalls with research-backed methods
eCommerce CRO veteran Johann Van Tonder shares what usually goes wrong when coming up with test ideas and how to fix it. We also discuss the merits of quantity vs. quality of ideas, the problem with brainstorming, and what to do instead for more effective ideation sessions.
Jessica James on optimizing in the online gaming space and what she misses about the UK
CROs follow a lot of the same strategies across industries, but some industries like Online Gaming require some special considerations.
Rachel Harrison on how CROs can work remotely and still remain impactful
CROs that work with clients are always looking to be impactful. But in today’s remote/hybrid work environments – that’s become more challenging. Rachel Harrison shares her tips on how CROs can navigate this new world.
LeanConvert’s Edd Saunders on the importance of web performance and Google’s Core Web Vitals
As the saying goes, every second counts. Edd walks us through Google’s Core Web Vitals as well as how he approaches testing for website performance.
Sina Fak on why CRO is not a person but a multidisciplinary Experimentation team
Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO.
The importance of keeping current: A conversation with Webtrends Optimize’s Sandeep Shah
Webtrends Optimize’s Sandeep Shah was recently crowned CRO Memes’ Funniest CRO of the Year. Find out about his career, how he stays on top of the industry, and his upcoming personal project.
Building a team in a cost-effective way: Tips from Luke McDermott
Luke McDermott on Common CRO Political Obstacles and the most cost-effective ways to stand up a CRO team.
What 13 Years of A/B Testing Revealed with Rishi Rawat
Rishi Rawat is the product page guy. With his 13 years of running A/B tests, Rishi shares what makes an effective product description, his go-to method for segmenting product pages, and how to stand out to your visitors during their most “promiscuous state”.
Symplify’s Mika Sano Janze shares her advice for those looking to get into CRO
Symplify’s Mika Sano Janze shares her advice for those looking to get into CRO
Speero’s Experimentation Maturity Audit with Edgar Spongolts
Speero’s Director of CX Optimization, Edgar Spongolts, dives deep into the influential agency’s Experimentation Maturity Audit and why maturity matters. Learn about the four pillars of a successful experimentation program and what it takes to reach the highest levels of maturity. Take the audit yourself here: https://speero.link/ExperimentNation
Aiven’s Petra Lylander on experimentation documentation and processes
Petra Lylander is a growth marketer who developed the experimentation process at Helsinki-based SaaS company, Aiven. In this episode she talks about process documentation for experimentation and how to get other teammates to care about it.
Perxels’ Olabanji Ewenla on Growth Product Managers vs. Product Managers – and why Experimentation is important to both
Olabanji Ewenla is a mentor, a Growth Product Manager, and a believer in Experimentation. Learn about his new book, “The Blood Money in Tech”.
IU’s Sebastian Bernhardt on Best Approaches and the fun of connecting with the Experimentation Community
Sebastian Bernhardt shares the story behind his new series called Best Approaches, CRO in Germany, and his love for connecting with the Experimentation community.
Curology’s Darian Rusow on App Store Optimization and 2 important traits CROs should have
Curology’s Darian Rusow talks about App Store Optimization and the two important traits CROs should have.
Specsavers’ Steph Le Prevost on growing a top UK CRO program
Steph walks us through the challenges of growing Specsavers’ CRO team and how she overcame them, her experimentation red flags, and her take on if CRO certifications are really worth it. Plus: A comparison of the CRO job market between Canada vs. the UK, including how well you can expect to be paid as an optimizer.
Better Collective’s Luka Nikolic on the importance of hypotheses and “obliquity” to Experimentation
If you didn’t know what the word, “obliquity” meant, read on and discover why it’s so important to Experimentation.
Evelyn EBO talks about the importance of Experimentation to Product Managers
Evelyn EBO shares her thoughts on why Product Managers should Experiment and how she gives back to the Product Community.
Microsoft Digital Stores’ Tim Mehta on strategies for low and high maturity experimentation programs
Tim shares his tips for running low and high maturity experimentation programs, what it’s like to optimize in-house vs. agency, when it is (and is not) ok to make compromises, and to how make your program’s results actually drive action. Plus: Tim’s take on those controversial UI polls on LinkedIn.
Shopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizers
Tracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers.
Evolved Search’s Simon Clark talks about the importance of UX and his thoughts about Google Optimize
Simon shares how communication and UX are important to any optimization practice.
Microsoft’s Tim Mehta talks about managing an Experimentation Program
Tim Mehta talks about how he leverages both quantitative and quantitative research to find frustration points to optimize.
Rohit Rayala on how he supported over 25 clients and drove an average growth rate of 154% in 12 months
Rohit talks to us about a process called PSIP that hoped him drive 154% growth for over 25 clients.
Aditi Gupta talks about influencing product roadmaps with experimentation
Manage expectation to avoid headaches when adjusting roadmaps based on experiment results.
How Save the Children Italy’s Valerio De Biasio leverages CRO to help save lives
CRO not only helps generate sales, it can help save and improve lives.
Farfetch’s Luis Trindade on how to build a strong Experimentation Culture
Farfetch’s Luis Trindade on how to build a strong Experimentation Culture.
Experiment Nation chats with the folks behind CRO Memes
Who are the people behind CRO Memes? We don’t know either – but Tracy did recently chat with the elusive group to learn a bit about them.
Polestar’s Oliver Wyman on building an Optimization team and Experimentation culture
Learn about how Oliver measures the performance of his team, ensures optimization is connected across functions, and what he’d do if he didn’t run experiments.
ConvertCart’s Shaivi Sahay on figuring out what to test first
Learn about how Shaivi approaches new CRO challenges.
Maulin Shah shares his key elements of an experimentation roadmap
Maulin Shah shares his key elements of an experiment-driven roadmap
Willful’s Tracy Laranjo on how the Experimentation Community has made her a better Experimenter
Tracy also shares a peek behind the curtain of what it’s like to work on Experiment Nation.
Sam Media’s Kudakwashe Shamu on how designers have to get out of their comfort zones
Kudakwashe shares his advice to designers out there who haven’t yet embraced Experimentation.
Amazon’s Joey Herzberg on ensuring that work is always aligned with what the customer wants
Joey talks about how to always be aligned to customer needs, working across functions and his drone work.
Kilo Health’s Lukas Petrauskas on how website copy is costing companies 30% of their website revenue
Lukas shares how he evaluates specialists, and how companies are missing out on 30% of their revenue.
Reprise Digital Spain’s Silvia Serrano on applying Maslow’s hierarchy of needs to CRO
Silvia shares how to apply Maslow’s hierarchy of needs to CRO as well as how to think about testing for value propositions.
Spencer Gray on how CRO is not a standalone service but rather a team sport
Spencer Gray shares how he grew the CRO department at 97th floor and how successful CRO works with other services.
Ana Catarina Cizilio tells us about CRO in Brazil and the mindset needed for CRO
Ana tells us about the differences between the US and Brazil, as well as about the mindset you need to succeed at CRO.
Specsavers’ Melanie Kyrklund on How to run a high-impact optimization program
In this episode, Rommil and Tracy interview Melanie Kyrklund from Specsavers on how to run a high-impact optimization program, how to align the program with a product’s vision, and how she likes black licorice.
SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization
Hi Raphael, thanks so much for taking the time to chat with us! How have you been? I’ve been good! While the COVID situation here in Montreal is making things a bit boring, business has been stronger than ever, and we work with super fun clients, so can’t complain about that side of things –Continue reading “SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization”
Widerfunnel’s Chris Goward on how Experimenters need to focus less on the tools and more on strategy
Experimenters put so much emphasis on tool selection that they forget the importance of taking a step back and thinking about the bigger picture.
AWA digital’s Johann Van Tonder on the experimentation industry’s maturity, approaches, and attitudes
A conversation with AWA digital’s Johann Van Tonder
Softtek’s Angeles Alonso Leverages UX Research to get the most out of Conversion Rate Optimization
A conversation with Softtek’s Angeles Alonso about Experimentation
WeTeachCRO’s Sam Irvine partners with clients and helps them not get bogged down with statistics
A conversation with WeTeachCRO’s Sam Irvine about Experimentation
Podcast: Gartner’s Shiva Manjunath on how Conversion Rate Optimization and Best Practices are terribly named
A podcast with Gartner’s Shiva Manjunath about Experimentation
Bolt’s Gerda Vogt-Thomas shares how to approach standing up a CRO program
A conversation with Bolt’s Gerda Vogt-Thomas about Experimentation
CXL’s Alex Atkins shares the challenges of SEO testing and coordinating a growth program
A Conversation with CXL’s Alex Atkins about Experimentation
Journey Further’s Experimenting in an Agile Environment with Magnolia Carvajal
A chat with Journey Further’s Magnolia Carvajal about Experimentation
Optimization and the human mind with Guido X Jansen
A conversation with CRO.CAFE’s Guido X Jansen about Experimentation
To build or buy? Solving the classic Experimenter’s dilemma with Convoy’s Chad Sanderson
A conversation with Convoy’s Chad Sanderson about Experimentation
Exploring the suitability of t-tests for A/B tests involving RPV with integrate.ai’s Summer Hu
A conversation with integrate.ai’s Summer Hu about Experimentation
BMO’s Claire Yeh: Experimentation is key to Personalization success
A conversation with BMO’s Claire Yeh about Experimentation
The how, what, and why of copy testing with Green Light Copy’s Eden Bidani
A conversation with Green Light Copy’s Eden Bidani about Experimentation
Bithika Mehra on partnering with HiPPOs and leveraging neuromarketing to drive conversion
A conversation with Bithika Mehra about Experimentation
TechTarget’s Renee Thompson on how to effectively test on B2B customer properties
A conversation with TechTarget’s Renee Thompson about experimentation
Designing an Experimentation strategy that supports product-development with Widerfunnel’s Zharina Pelea
A conversation with Widerfunnel’s Zharina Pelea
Nurturing an Experimentation culture by focusing on the process with Specsavers’ Melanie Kyrklund
A Conversation with Specsavers’ Melanie Kyrklund about Experimentation
Words matter: Writing copy that converts with Love Letter Emails’ Kay del Rosario
A Conversation with Love Letter Emails’ Kay del Rosario about Experimentation
Highlighting the need to promote diversity in the CRO industry with Scribe Media’s Michelle Mosher
A Conversation with Scribe Media’s Michelle Mosher about Experimentation
Experimentation strategy with Accenture’s Geetu Mehta: Development and getting buy-in
A Conversation with Accenture’s Geetu Mehta about Experimentation
Concrete tips from CRO veteran Nermin Canik
A Conversation with Nermin Canik about Experimentation
CXL’s Gertrud Vahtra explains how to develop and prioritize hypotheses
A Conversation with CXL’s Gertrud Vahtra about Experimentation
Focusing on solving problems not changing page elements with Getuplift’s Talia Wolf
A Conversation with Getuplift’s Talia Wolf about Experimentation
Nancy Kawatra on delivering value for the long-run
A Conversation with One & Body’s Nancy Kawatra about Experimentation
Hatice Kaya: Balancing making clients happy while being true to the process
A Conversation with Invesp’s Hatice Kaya about Experimentation
How Spiralyze’s Sophie Buonassisi demonstrates the value of Experimentation to clients
Clients are always hungry for ROI on their Experimentation efforts. I recently spoke to Sophie about 2 ways the value of Experimentation can be demonstrated for clients, how to build a Culture of Experimentation at companies, and how Experimentation is important to Growth.
How Jobber’s Connor Bradley enables multi-channel Experimentation
A Conversion with Jobber’s Connor Bradley about Experimentation
Anil Batra on why some companies are data-driven while others are not
A Conversation with Optizent’s Anil Batra about Experimentation
How Intuit’s Mike Loveridge continuously runs experiments without wasting traffic
A Conversation with Intuit’s Mike Loveridge about Experimentation
Photomath’s Jennifer Lui on Experimentation and brand marketing
A Conversation with Photomath’s Jennifer Lui about Experimentation
How Henrik Kahra estimates the annual impact of Experiments
A Conversation with Henrik Kahra about Experimentation
Journey Further’s Jonny Longden: Just test the bloody thing
A Conversation with Journey Further’s Jonny Longden about Experimentation
Webtrends Optimize’s Matt Smith on handling clients’ most common objections
A Conversion Conversation with Webtrends Optimize’s Matt Smith
Raze’s Siobhan Solberg: Going from music to Experimentation
A Conversion Conversation with Raze’s Siobhan Solberg
Circle Media’s Eddie Aguilar on the importance of gaining trust
A Conversion Conversation with Circle Media’s Eddie Aguilar
Naoshi Yamauchi on nurturing an Experimentation culture with clients
A Conversion Conversation with DURMC’s Naoshi Yamauchi
Learn from Experimentation’s statistics leaders: Chris Stucchio, John Meakin, and Georgi Georgiev
A Panel Conversation on A/B Testing Statistics with Chris Stucchio, John Meakin, and Georgi Georgiev
Conversion Studio’s Tracey Reed on making websites work harder
A Conversion Conversation with Conversion Studio’s Tracey Reed
Kaspersky’s Sumantha Shankaranarayana: Communication is key to overcoming skeptics
A Conversion Conversation with Kaspersky’s Sumantha Shankaranarayana
TUI’s Marianne Stjernvall on staying connected and navigating uncertain times
A Conversion Conversation with TUI’s Marianne Stjernvall
Informa Market’s Tony Grant on getting people excited about Experimentation
A Conversion Conversation with Informa Market’s Tony Grant
Dentsu Aegis Network’s Ric Riley on delivering value to clients
A Conversion Conversation with Dentsu Aegis Network’s Ric Riley
Chargebee’s Anirhudh Sridharan on the importance of aligning on goals to Experimentation
A Conversion Conversation with Chargebee’s Anirhudh Sridharan
Salesforce’s Brandon Brackett: Over-communication above all
A Conversion Conversation with Salesforce’s Brandon Brackett
Online Dialogue’s Ton Wesseling shares things to avoid when measuring the impact of a CRO program
A Conversion Conversation with Online Dialogue’s Ton Wesseling
Don’t call us CROs: A panel with Shiva Manjunath, Kenya Davis, Chad Sanderson, Scott Olivares, and Jonas Alves
A Panel Conversation on Experimentation Program Goals
De Nieuwe Zaak’s Marlies Wilms Floet shares 10 tips on how to nurture an Experimentation Culture
A Conversion Conversation with De Nieuwe Zaak’s Marlies Wilms Floet
Alexandra Resnick on living and Experimenting during crazy times
A Conversion Conversation with Discovery’s Alexandra Resnick
Microsoft’s Aleksander Fabijan on the Experimentation Growth Model and Scaling Experimentation
A Conversion Conversation with Microsoft’s Aleksander Fabijan