How to be a good test coder with Jereon Wieresema
Category Archives: Interviews with Experimenters
The problem with the word, “Hypothesis” and the importance of HiPPOs with Nima Yassini
Having mature conversations with immature markets, the problem with the word, “Hypothesis”, the importance of HiPPOs with Nima Yassini
How to adopt a CRO mindset for life optimization with Ruben de Boer
Life optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life.
Zuko Analytics’ Alun Lucas on Why good form design is important and common form optimization myths
Richard talks to Alun Lucas from Zuko Analytics about Form Optimization
Experimenter of the Week: Charlotte April Bomford
Check out our Experimenter of the week!
Online Dialogue’s Ton Wesseling shares his thoughts on how CRO will probably die
Our new podcast host, Richard Joe, speaks to Online Dialog’s Ton Wesseling about how he got started, the lessons he learned during his career, and how the CRO industry will die.
Experimenter of the Week: Dorian Gonzalez
Check out our Experimenter of the week!
How to verify your data truly reflects user behaviour with Florent Buisson
Florent Buisson is a decade-long behavioral economist who published a practical guide to behavioral data analysis in business. It’s the book he wished he had when he started in analytics.
In this episode, he shares:
Why intuition can actually be a good thing in data analytics. If you need to know R or Python to understand your users. Why and when causal analytics are important.
Choosing the right A/B testing tool with Product for Product
Matt Green and Moshe Mikanovsky of Product for Product podcast help you navigate the plethora of A/B testing tools out there.
Whether you’re in product or marketing, listen for a beginner-friendly comparison of tools like Google Optimize, Optimizely, and more.
**This episode, nor those of Product for Product, are endorsements of any of the discussed tools.**
Johann Van Tonder on how to conquer 4 common ideation pitfalls with research-backed methods
eCommerce CRO veteran Johann Van Tonder shares what usually goes wrong when coming up with test ideas and how to fix it. We also discuss the merits of quantity vs. quality of ideas, the problem with brainstorming, and what to do instead for more effective ideation sessions.
Jessica James on optimizing in the online gaming space and what she misses about the UK
CROs follow a lot of the same strategies across industries, but some industries like Online Gaming require some special considerations.
Rachel Harrison on how CROs can work remotely and still remain impactful
CROs that work with clients are always looking to be impactful. But in today’s remote/hybrid work environments – that’s become more challenging. Rachel Harrison shares her tips on how CROs can navigate this new world.
LeanConvert’s Edd Saunders on the importance of web performance and Google’s Core Web Vitals
As the saying goes, every second counts. Edd walks us through Google’s Core Web Vitals as well as how he approaches testing for website performance.
Sina Fak on why CRO is not a person but a multidisciplinary Experimentation team
Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO.
The importance of keeping current: A conversation with Webtrends Optimize’s Sandeep Shah
Webtrends Optimize’s Sandeep Shah was recently crowned CRO Memes’ Funniest CRO of the Year. Find out about his career, how he stays on top of the industry, and his upcoming personal project.
Building a team in a cost-effective way: Tips from Luke McDermott
Luke McDermott on Common CRO Political Obstacles and the most cost-effective ways to stand up a CRO team.
What 13 Years of A/B Testing Revealed with Rishi Rawat
Rishi Rawat is the product page guy. With his 13 years of running A/B tests, Rishi shares what makes an effective product description, his go-to method for segmenting product pages, and how to stand out to your visitors during their most “promiscuous state”.
Symplify’s Mika Sano Janze shares her advice for those looking to get into CRO
Symplify’s Mika Sano Janze shares her advice for those looking to get into CRO
Speero’s Experimentation Maturity Audit with Edgar Spongolts
Speero’s Director of CX Optimization, Edgar Spongolts, dives deep into the influential agency’s Experimentation Maturity Audit and why maturity matters. Learn about the four pillars of a successful experimentation program and what it takes to reach the highest levels of maturity. Take the audit yourself here: https://speero.link/ExperimentNation
Aiven’s Petra Lylander on experimentation documentation and processes
Petra Lylander is a growth marketer who developed the experimentation process at Helsinki-based SaaS company, Aiven. In this episode she talks about process documentation for experimentation and how to get other teammates to care about it.
Perxels’ Olabanji Ewenla on Growth Product Managers vs. Product Managers – and why Experimentation is important to both
Olabanji Ewenla is a mentor, a Growth Product Manager, and a believer in Experimentation. Learn about his new book, “The Blood Money in Tech”.
IU’s Sebastian Bernhardt on Best Approaches and the fun of connecting with the Experimentation Community
Sebastian Bernhardt shares the story behind his new series called Best Approaches, CRO in Germany, and his love for connecting with the Experimentation community.
Curology’s Darian Rusow on App Store Optimization and 2 important traits CROs should have
Curology’s Darian Rusow talks about App Store Optimization and the two important traits CROs should have.
Specsavers’ Steph Le Prevost on growing a top UK CRO program
Steph walks us through the challenges of growing Specsavers’ CRO team and how she overcame them, her experimentation red flags, and her take on if CRO certifications are really worth it. Plus: A comparison of the CRO job market between Canada vs. the UK, including how well you can expect to be paid as an optimizer.
Better Collective’s Luka Nikolic on the importance of hypotheses and “obliquity” to Experimentation
If you didn’t know what the word, “obliquity” meant, read on and discover why it’s so important to Experimentation.
Evelyn EBO talks about the importance of Experimentation to Product Managers
Evelyn EBO shares her thoughts on why Product Managers should Experiment and how she gives back to the Product Community.
Microsoft Digital Stores’ Tim Mehta on strategies for low and high maturity experimentation programs
Tim shares his tips for running low and high maturity experimentation programs, what it’s like to optimize in-house vs. agency, when it is (and is not) ok to make compromises, and to how make your program’s results actually drive action. Plus: Tim’s take on those controversial UI polls on LinkedIn.
Shopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizers
Tracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers.
Evolved Search’s Simon Clark talks about the importance of UX and his thoughts about Google Optimize
Simon shares how communication and UX are important to any optimization practice.
Microsoft’s Tim Mehta talks about managing an Experimentation Program
Tim Mehta talks about how he leverages both quantitative and quantitative research to find frustration points to optimize.
Rohit Rayala on how he supported over 25 clients and drove an average growth rate of 154% in 12 months
Rohit talks to us about a process called PSIP that hoped him drive 154% growth for over 25 clients.
Aditi Gupta talks about influencing product roadmaps with experimentation
Manage expectation to avoid headaches when adjusting roadmaps based on experiment results.
How Save the Children Italy’s Valerio De Biasio leverages CRO to help save lives
CRO not only helps generate sales, it can help save and improve lives.
Farfetch’s Luis Trindade on how to build a strong Experimentation Culture
Farfetch’s Luis Trindade on how to build a strong Experimentation Culture.
Experiment Nation chats with the folks behind CRO Memes
Who are the people behind CRO Memes? We don’t know either – but Tracy did recently chat with the elusive group to learn a bit about them.
Polestar’s Oliver Wyman on building an Optimization team and Experimentation culture
Learn about how Oliver measures the performance of his team, ensures optimization is connected across functions, and what he’d do if he didn’t run experiments.
ConvertCart’s Shaivi Sahay on figuring out what to test first
Learn about how Shaivi approaches new CRO challenges.
Maulin Shah shares his key elements of an experimentation roadmap
Maulin Shah shares his key elements of an experiment-driven roadmap
Willful’s Tracy Laranjo on how the Experimentation Community has made her a better Experimenter
Tracy also shares a peek behind the curtain of what it’s like to work on Experiment Nation.
Sam Media’s Kudakwashe Shamu on how designers have to get out of their comfort zones
Kudakwashe shares his advice to designers out there who haven’t yet embraced Experimentation.
Amazon’s Joey Herzberg on ensuring that work is always aligned with what the customer wants
Joey talks about how to always be aligned to customer needs, working across functions and his drone work.
Kilo Health’s Lukas Petrauskas on how website copy is costing companies 30% of their website revenue
Lukas shares how he evaluates specialists, and how companies are missing out on 30% of their revenue.
Reprise Digital Spain’s Silvia Serrano on applying Maslow’s hierarchy of needs to CRO
Silvia shares how to apply Maslow’s hierarchy of needs to CRO as well as how to think about testing for value propositions.
Spencer Gray on how CRO is not a standalone service but rather a team sport
Spencer Gray shares how he grew the CRO department at 97th floor and how successful CRO works with other services.
Ana Catarina Cizilio tells us about CRO in Brazil and the mindset needed for CRO
Ana tells us about the differences between the US and Brazil, as well as about the mindset you need to succeed at CRO.
Specsavers’ Melanie Kyrklund on How to run a high-impact optimization program
In this episode, Rommil and Tracy interview Melanie Kyrklund from Specsavers on how to run a high-impact optimization program, how to align the program with a product’s vision, and how she likes black licorice.
SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization
Hi Raphael, thanks so much for taking the time to chat with us! How have you been? I’ve been good! While the COVID situation here in Montreal is making things a bit boring, business has been stronger than ever, and we work with super fun clients, so can’t complain about that side of things –Continue reading “SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization”
Widerfunnel’s Chris Goward on how Experimenters need to focus less on the tools and more on strategy
Experimenters put so much emphasis on tool selection that they forget the importance of taking a step back and thinking about the bigger picture.
AWA digital’s Johann Van Tonder on the experimentation industry’s maturity, approaches, and attitudes
A conversation with AWA digital’s Johann Van Tonder
Softtek’s Angeles Alonso Leverages UX Research to get the most out of Conversion Rate Optimization
A conversation with Softtek’s Angeles Alonso about Experimentation
WeTeachCRO’s Sam Irvine partners with clients and helps them not get bogged down with statistics
A conversation with WeTeachCRO’s Sam Irvine about Experimentation
Podcast: Gartner’s Shiva Manjunath on how Conversion Rate Optimization and Best Practices are terribly named
A podcast with Gartner’s Shiva Manjunath about Experimentation
Bolt’s Gerda Vogt-Thomas shares how to approach standing up a CRO program
A conversation with Bolt’s Gerda Vogt-Thomas about Experimentation
CXL’s Alex Atkins shares the challenges of SEO testing and coordinating a growth program
A Conversation with CXL’s Alex Atkins about Experimentation
Journey Further’s Experimenting in an Agile Environment with Magnolia Carvajal
A chat with Journey Further’s Magnolia Carvajal about Experimentation
Optimization and the human mind with Guido X Jansen
A conversation with CRO.CAFE’s Guido X Jansen about Experimentation
To build or buy? Solving the classic Experimenter’s dilemma with Convoy’s Chad Sanderson
A conversation with Convoy’s Chad Sanderson about Experimentation
Exploring the suitability of t-tests for A/B tests involving RPV with integrate.ai’s Summer Hu
A conversation with integrate.ai’s Summer Hu about Experimentation
BMO’s Claire Yeh: Experimentation is key to Personalization success
A conversation with BMO’s Claire Yeh about Experimentation
The how, what, and why of copy testing with Green Light Copy’s Eden Bidani
A conversation with Green Light Copy’s Eden Bidani about Experimentation
Bithika Mehra on partnering with HiPPOs and leveraging neuromarketing to drive conversion
A conversation with Bithika Mehra about Experimentation
TechTarget’s Renee Thompson on how to effectively test on B2B customer properties
A conversation with TechTarget’s Renee Thompson about experimentation
Designing an Experimentation strategy that supports product-development with Widerfunnel’s Zharina Pelea
A conversation with Widerfunnel’s Zharina Pelea
Nurturing an Experimentation culture by focusing on the process with Specsavers’ Melanie Kyrklund
A Conversation with Specsavers’ Melanie Kyrklund about Experimentation
Words matter: Writing copy that converts with Love Letter Emails’ Kay del Rosario
A Conversation with Love Letter Emails’ Kay del Rosario about Experimentation
Highlighting the need to promote diversity in the CRO industry with Scribe Media’s Michelle Mosher
A Conversation with Scribe Media’s Michelle Mosher about Experimentation
Experimentation strategy with Accenture’s Geetu Mehta: Development and getting buy-in
A Conversation with Accenture’s Geetu Mehta about Experimentation
Concrete tips from CRO veteran Nermin Canik
A Conversation with Nermin Canik about Experimentation
CXL’s Gertrud Vahtra explains how to develop and prioritize hypotheses
A Conversation with CXL’s Gertrud Vahtra about Experimentation
Focusing on solving problems not changing page elements with Getuplift’s Talia Wolf
A Conversation with Getuplift’s Talia Wolf about Experimentation
Nancy Kawatra on delivering value for the long-run
A Conversation with One & Body’s Nancy Kawatra about Experimentation
Hatice Kaya: Balancing making clients happy while being true to the process
A Conversation with Invesp’s Hatice Kaya about Experimentation
How Spiralyze’s Sophie Buonassisi demonstrates the value of Experimentation to clients
Clients are always hungry for ROI on their Experimentation efforts. I recently spoke to Sophie about 2 ways the value of Experimentation can be demonstrated for clients, how to build a Culture of Experimentation at companies, and how Experimentation is important to Growth.
How Jobber’s Connor Bradley enables multi-channel Experimentation
A Conversion with Jobber’s Connor Bradley about Experimentation
Anil Batra on why some companies are data-driven while others are not
A Conversation with Optizent’s Anil Batra about Experimentation
How Intuit’s Mike Loveridge continuously runs experiments without wasting traffic
A Conversation with Intuit’s Mike Loveridge about Experimentation
Photomath’s Jennifer Lui on Experimentation and brand marketing
A Conversation with Photomath’s Jennifer Lui about Experimentation
How Henrik Kahra estimates the annual impact of Experiments
A Conversation with Henrik Kahra about Experimentation
Journey Further’s Jonny Longden: Just test the bloody thing
A Conversation with Journey Further’s Jonny Longden about Experimentation
Webtrends Optimize’s Matt Smith on handling clients’ most common objections
A Conversion Conversation with Webtrends Optimize’s Matt Smith
Raze’s Siobhan Solberg: Going from music to Experimentation
A Conversion Conversation with Raze’s Siobhan Solberg
Circle Media’s Eddie Aguilar on the importance of gaining trust
A Conversion Conversation with Circle Media’s Eddie Aguilar
Naoshi Yamauchi on nurturing an Experimentation culture with clients
A Conversion Conversation with DURMC’s Naoshi Yamauchi
Learn from Experimentation’s statistics leaders: Chris Stucchio, John Meakin, and Georgi Georgiev
A Panel Conversation on A/B Testing Statistics with Chris Stucchio, John Meakin, and Georgi Georgiev
Conversion Studio’s Tracey Reed on making websites work harder
A Conversion Conversation with Conversion Studio’s Tracey Reed
Kaspersky’s Sumantha Shankaranarayana: Communication is key to overcoming skeptics
A Conversion Conversation with Kaspersky’s Sumantha Shankaranarayana
TUI’s Marianne Stjernvall on staying connected and navigating uncertain times
A Conversion Conversation with TUI’s Marianne Stjernvall
Informa Market’s Tony Grant on getting people excited about Experimentation
A Conversion Conversation with Informa Market’s Tony Grant
Dentsu Aegis Network’s Ric Riley on delivering value to clients
A Conversion Conversation with Dentsu Aegis Network’s Ric Riley
Chargebee’s Anirhudh Sridharan on the importance of aligning on goals to Experimentation
A Conversion Conversation with Chargebee’s Anirhudh Sridharan
Salesforce’s Brandon Brackett: Over-communication above all
A Conversion Conversation with Salesforce’s Brandon Brackett
Online Dialogue’s Ton Wesseling shares things to avoid when measuring the impact of a CRO program
A Conversion Conversation with Online Dialogue’s Ton Wesseling
Don’t call us CROs: A panel with Shiva Manjunath, Kenya Davis, Chad Sanderson, Scott Olivares, and Jonas Alves
A Panel Conversation on Experimentation Program Goals
De Nieuwe Zaak’s Marlies Wilms Floet shares 10 tips on how to nurture an Experimentation Culture
A Conversion Conversation with De Nieuwe Zaak’s Marlies Wilms Floet
Alexandra Resnick on living and Experimenting during crazy times
A Conversion Conversation with Discovery’s Alexandra Resnick
Microsoft’s Aleksander Fabijan on the Experimentation Growth Model and Scaling Experimentation
A Conversion Conversation with Microsoft’s Aleksander Fabijan
Launching a world-class Experimentation program and how to spot a healthy Experimentation culture with Journey Further’s Jon Crowder
A Conversion Conversation with Journey Further’s Jon Crowder
HubSpot’s Alex Birkett on how Experimentation can be used for Growth and after you’ve established your Content Strategy
A Conversion Conversation with HubSpot’s Alex Birkett
Brent Jensen on driving growth through focused experimentation
A Conversion Conversation with Brent Jensen
Autodesk’s Heather Voden on scaling marketing through Experimentation
A Conversion Conversation with Autodesk’s Heather Voden
How Conversion’s Stephen Pavlovich convinces clients on Experimentation
A Conversion Conversation with Conversion’s Stephen Pavlovich
Fresh Egg’s Sebastian Larsson: Experimentation roadmaps begin with research
A Conversion Conversation with Fresh Egg’s Sebastian Larsson
Elise Maile on the importance of an Experimentation Roadmap and getting buy-in from developers
A Conversion Conversation with Swiftmonkey’s Elise Maile
How Indeed’s Abhishek Rathore runs the world’s biggest job site’s Experimentation Program
A Conversion Conversation with Indeed’s Abhishek Rathore
Vrbo’s John Meakin: A review of Peeking, Post-Hoc Power, and Confidence
A Conversion Conversation with Vrbo’s John Meakin
Vipul Bansal: Experimentation is the right way to be wrong
A Conversion Conversation with VWO’s Vipul Bansal
Gartner’s Shiva Manjunath on championing data over opinion and bias
A Conversion Conversation with Gartner’s Shiva Manjunath
Voiceflow’s Emily Lonetto on powering past things that didn’t work and the importance of focus
A Conversion Conversation with Voiceflow’s Emily Lonetto
Kenya Davis on the challenges of running an Experimentation program at a large corporation
A Conversation Conversation with Lowe’s Kenya Davis
Opencare’s Greg Leach: Experimentation informs decision making
A Conversion Conversation with Opencare’s Greg Leach
Frictionless Commerce’s Rishi Rawat on focusing on buyer psychology to unlock CRO performance
A Conversion Conversation with Frictionless Commerce’s Rishi Rawat
McAfee’s Claire Fitzpatrick: Experimentation isn’t something done at the end of a process?—?it’s part of a continuous customer-obsessed loop
A Conversion Conversation with McAfee’s Claire Fitzpatrick
Exploring organizational design for Experimentation with Alek Toumert
A Conversion Conversation with Optimizely’s Alek Toumert
Learn from Chris Stucchio – the “compulsive gambler” behind VWO’s Bayesian test engine
A Conversion Conversation with Chris Stucchio
How Josh Sookman drives product development through Experimentation
A Conversion Conversation with Ritual’s Josh Sookman
TELUS Digital’s Leila Sayah: Succeeding at Experimentation and Personalization depends on more than just tools
A Conversion Conversation with TELUS Digital’s Leila Sayah
UserConversion’s David Mannheim on how Experimentation fits in with Analytics and Research
A Conversion Conversation with UserConversion’s David Mannheim
Franceska Viray: While often overlooked, don’t underestimate the importance of QA when running Experiments
A Conversion Conversation with Rangle.io’s Franceska Viray
nib Health Funds’ Jess Vandenbruggen: Everyone is going to be in Experimentation
A Conversion Conversation with nib Health Funds’ Jess Vandenbruggen
IBM’s Daniel Martin del Campo: More than skills, the most important thing to have in Experimentation is curiosity
A Conversion Conversation with IBM’s Daniel Martin del Campo
John Ostrowski: The path to a career in CRO is never straight
A Conversion Conversation with LADDER’s John Ostrowski
Emeline Catherine Dit Cariot: Have Experimentation?—?will travel
A Conversion Conversation with Tiqets’ Emeline Catherine Dit Cariot
Georgi Georgiev: As your testing velocity increases —so does the potential impact of Experiment Interaction
A Conversion Conversation with Web Focus LLC’s Georgi Georgiev
Kotn’s Dan Gray: Experimentation doesn’t have to stay online when it comes to Growth
A Conversion Conversation with Kotn’s Dan Gray
Jeff Goldenberg: How to approach clients who are resistant to Experimentation
A Conversion Conversation with Abacus’ Jeff Goldenberg
Natalie Lin on how changing high-visibility core experiences requires substantial stakeholder buy-in
A Conversion Conversation with MailChimp’s Natalie Lin
Learn about Jonas Alves – the mind behind Booking.com’s Experimentation engine
A Conversion Conversation with Ex-Booking.com Product Owner Jonas Alves
Brian David Hall: Sometimes you don’t seek out Experimentation?—?but it seeks you
A Conversion Conversation with Command Return Solutions’ Brian David Hall
Cloudflare’s Scott Olivares: To get personalization right?—?have good manners and experiment
A Conversion Conversation with Cloudflare’s Scott Olivares
Growth Marketing Today’s Ramli John: There is no growth without rigorous experimentation
A Conversion Conversation with Growth Marketing Today’s Ramli John
How Edelman’s Nicola Ambrogio leverages data and experimentation rather than gut feelings to deliver customer-centric products
A Conversion Conversation with Edelman’s Nicola Ambrogio
Grace Du: Things to consider when deciding between building an experimentation platform vs. going with a 3rd party vendor?
A Conversion Conversation with Ritual’s Grace Du
UI design is hard work?—?but Jakub Linowski’s GoodUI is leveraging Experimentation to make that work easier
A Conversion Conversation with GoodUI’s Jakub Linowski
Angela Kang: A firm knowledge of statistics will help you excel at experimentation
A Conversion Conversation with Angela Kang
Josh Lobo on leveraging research and experimentation to drive innovation
A Conversion Conversation with Stabilo Medical’s Josh Lobo
Don’t assume your customers’ motivations?—?only by talking directly to them can you grow
A Conversion Conversation with Coohom’s Kareem Azees
Widerfunnel’s James Flory shares his perspective on how to succeed at Experimentation
A Conversion Conversation with Widerfunnel’s James Flory
Convoy’s Chad Sanderson: Experimentation not only protects your KPIs but your job as well
A Conversion Conversation with Convoy’s Chad Sanderson
A Conversion Conversation with TELUS Digital’s Jason Yang
A semi-regular segment where I chat with experimentation professionals from around the world.