Featured Archives - Experiment Nation

Frequentist & Bayesian: Comparison and Practical Application (R script attached)

By Andrea Corvi Canon vs Nikon and iOS vs Android are just two modern examples of “dualisms” that divide crowds. The long-lasting Frequentist vs Bayesian fight is not any different and like the other two examples above, it’s still far from finding a winner. This doesn’t affect just the CRO world but the same typeContinue reading “Frequentist & Bayesian: Comparison and Practical Application (R script attached)”

The weekly buzz: May 26, 2021

👉 Upsides to Unshipping: The Art of Removing Features and Products by Reforge

👉 Browser Privacy Policy Updates – Optimization Effects by Kelly Wortham and Cory Underwood

👉 Visual Hierarchy: A 2021 Optimization Guide For Marketers by Unbounce

⏰ Two days to go.. If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 28th. 📢

👉 Upsides to Unshipping: The Art of Removing Features and Products by Reforge

👉 Browser Privacy Policy Updates – Optimization Effects by Kelly Wortham and Cory Underwood

👉 Visual Hierarchy: A 2021 Optimization Guide For Marketers by Unbounce

⏰ Two days to go.. If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 28th. 📢

The weekly buzz: May 21, 2021

👉 Multiplication instead of division: Molly Stevens and Lukas Vermeer team up to tell us why research and experimentation are the “peanut butter and jelly” of customer insights.

👉 What you can learn from one extra experiment: Kevin Dunn explains how you may miss out if you are only doing A/B testing, or following the Change One Single Thing (COST) approach to experimentation.

👉 How does Failure help you in Experimentation? Craig Sullivan shares Tesla’s experience with experimentation and failure.

📢 If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 28th. ⏰

The weekly buzz: May 14, 2021

Here’s the latest Weekly Buzz. 🐝 Links in the doc!

👉 Why we use #experimentation quality as the main #KPI for our experimentation platform from Booking.com

👉 A/B Testing and Experimentation: Tactics From Matt Gershoff

📢 If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 21st. ⏰ And remember…

“It’s not about that one experiment, it’s about improving the process, structure, trustworthiness, democratization and motivation for experimentation and data-driven decision making.”

Adventures in Experimentation: The importance of the voice of customer to conversion optimization – as well as to the entire business

Eden and Positive John speak about how recording your sessions with clients helps reduce the need for taking notes, how qualitative research is key to not just CRO but for all things business, and how no one likes pop-up surveys except for Positive John.

SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization

Hi Raphael, thanks so much for taking the time to chat with us! How have you been? I’ve been good! While the COVID situation here in Montreal is making things a bit boring, business has been stronger than ever, and we work with super fun clients, so can’t complain about that side of things –Continue reading “SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization”

Point/Counterpoint: Exploring different experiment prioritization frameworks with Marion Ravel, Patrick Buffum and Trisha Utomi

On today’s episode of Point/Counterpoint, Trish leads Patrick and Marion through a discussion about: Their CRO New Year’s resolutions, and the pros and cons of several experiment prioritization frameworks.

Twilio’s Justin Coons shares what you need to know about SEO Experimentation

Rommil interviews Twilio’s Justin Coons and they talk about: Not only can you run experiments for SEO, but you also should, Which is better, short-form content or long-form content, and What metrics to optimize for when running SEO Experiments

Product Experimentation: Jaya and Siddharth explore how to Experiment during the Product Development Life Cycle

Jaya and Siddharth explore how Experimentation fits into the Product Development Life Cycle, how to work with challenging stakeholders, share stories about how they’ve leveraged Experiments to generate results.

Podcast: Gartner’s Shiva Manjunath on how Conversion Rate Optimization and Best Practices are terribly named

A podcast with Gartner’s Shiva Manjunath about Experimentation CR-No: Balancing between optimizing the entire customer journey vs. just the website This week, the CR-No panel of CRO veterans talk about balancing between optimizing the entire customer journey vs just the Read more Point/Counterpoint: Exploring different experiment prioritization frameworks with Marion Ravel, Patrick Buffum and TrishaContinue reading “Podcast: Gartner’s Shiva Manjunath on how Conversion Rate Optimization and Best Practices are terribly named”

Bolt’s Gerda Vogt-Thomas shares how to approach standing up a CRO program

A conversation with Bolt’s Gerda Vogt-Thomas about Experimentation How Save the Children Italy’s Valerio De Biasio leverages CRO to help save lives CRO not only helps generate sales, it can help save and improve lives. We’ve updated the Directory, the Job Board, and Tools We’ve been busy updating our site – hopefully making it easierContinue reading “Bolt’s Gerda Vogt-Thomas shares how to approach standing up a CRO program”

Podcast: Munir Al-Dajani on running Experiments on Personalization, Machine Learning, and AI

A podcast with Amazon’s Munir Al-Dajani about Experimentation CR-No: Balancing between optimizing the entire customer journey vs. just the website This week, the CR-No panel of CRO veterans talk about balancing between optimizing the entire customer journey vs just the Read more Point/Counterpoint: Exploring different experiment prioritization frameworks with Marion Ravel, Patrick Buffum and TrishaContinue reading “Podcast: Munir Al-Dajani on running Experiments on Personalization, Machine Learning, and AI”

To build or buy? Solving the classic Experimenter’s dilemma with Convoy’s Chad Sanderson

A conversation with Convoy’s Chad Sanderson about Experimentation BMO’s Claire Yeh: Experimentation is key to Personalization success A conversation with BMO’s Claire Yeh about Experimentation Personalization and Experimentation may seem like very unrelated practices — but this can’t be Read more The how, what, and why of copy testing with Green Light Copy’s Eden Bidani A conversationContinue reading “To build or buy? Solving the classic Experimenter’s dilemma with Convoy’s Chad Sanderson”

BMO’s Claire Yeh: Experimentation is key to Personalization success

A conversation with BMO’s Claire Yeh about Experimentation Podcast: Munir Al-Dajani on running Experiments on Personalization, Machine Learning, and AI A podcast with Amazon’s Munir Al-Dajani about Experimentation https://open.spotify.com/episode/3ehHhk81ok2WmJg7bfCMhG?si=kxzEwTpaR_S_wTmEvOIe5g Listen on Spotify The following is an auto-generated transcript of the Read more Kenya Davis on the challenges of running an Experimentation program at a largeContinue reading “BMO’s Claire Yeh: Experimentation is key to Personalization success”

Highlighting the need to promote diversity in the CRO industry with Scribe Media’s Michelle Mosher

A Conversation with Scribe Media’s Michelle Mosher about Experimentation How Save the Children Italy’s Valerio De Biasio leverages CRO to help save lives CRO not only helps generate sales, it can help save and improve lives. We’ve updated the Directory, the Job Board, and Tools We’ve been busy updating our site – hopefully making itContinue reading “Highlighting the need to promote diversity in the CRO industry with Scribe Media’s Michelle Mosher”

De Nieuwe Zaak’s Marlies Wilms Floet shares 10 tips on how to nurture an Experimentation Culture

A Conversion Conversation with De Nieuwe Zaak’s Marlies Wilms Floet BMO’s Claire Yeh: Experimentation is key to Personalization success A conversation with BMO’s Claire Yeh about Experimentation Personalization and Experimentation may seem like very unrelated practices — but this can’t be Read more The how, what, and why of copy testing with Green Light Copy’s Eden BidaniContinue reading “De Nieuwe Zaak’s Marlies Wilms Floet shares 10 tips on how to nurture an Experimentation Culture”

Vipul Bansal: Experimentation is the right way to be wrong

A Conversion Conversation with VWO’s Vipul Bansal BMO’s Claire Yeh: Experimentation is key to Personalization success A conversation with BMO’s Claire Yeh about Experimentation Personalization and Experimentation may seem like very unrelated practices — but this can’t be Read more The how, what, and why of copy testing with Green Light Copy’s Eden Bidani A conversation withContinue reading “Vipul Bansal: Experimentation is the right way to be wrong”

Learn from Chris Stucchio – the “compulsive gambler” behind VWO’s Bayesian test engine

A Conversion Conversation with Chris Stucchio Exploring the suitability of t-tests for A/B tests involving RPV with integrate.ai’s Summer Hu A conversation with integrate.ai’s Summer Hu about Experimentation I recently had the pleasure of catching up with Summer, one of Read more Circle Media’s Eddie Aguilar on the importance of gaining trust A Conversion Conversation withContinue reading “Learn from Chris Stucchio – the “compulsive gambler” behind VWO’s Bayesian test engine”

Natalie Lin on how changing high-visibility core experiences requires substantial stakeholder buy-in

A Conversion Conversation with MailChimp’s Natalie Lin Designing an Experimentation strategy that supports product-development with Widerfunnel’s Zharina Pelea A conversation with Widerfunnel’s Zharina Pelea I recently spoke to Zharina about how she crafts a customer-centric Experimentation strategy that helps Read more How Josh Sookman drives product development through Experimentation A Conversion Conversation with Ritual’s Josh SookmanContinue reading “Natalie Lin on how changing high-visibility core experiences requires substantial stakeholder buy-in”

Learn about Jonas Alves – the mind behind Booking.com’s Experimentation engine

A Conversion Conversation with Ex-Booking.com Product Owner Jonas Alves Photomath’s Jennifer Lui on Experimentation and brand marketing A Conversation with Photomath’s Jennifer Lui about Experimentation I recently caught up with Jennifer to chat about the importance of Read more Brent Jensen on driving growth through focused experimentation A Conversion Conversation with Brent Jensen Growing aContinue reading “Learn about Jonas Alves – the mind behind Booking.com’s Experimentation engine”

UI design is hard work — but Jakub Linowski’s GoodUI is leveraging Experimentation to make that work easier

A Conversion Conversation with GoodUI’s Jakub Linowski We’ve updated the Directory, the Job Board, and Tools We’ve been busy updating our site – hopefully making it easier for you to connect and interact with other Experimenters. Read more CR-No: How to speed up your Experimentation Program Rommil, Kenya, and Shiva discuss the challenges of speedingContinue reading “UI design is hard work — but Jakub Linowski’s GoodUI is leveraging Experimentation to make that work easier”

Convoy’s Chad Sanderson: Experimentation not only protects your KPIs but your job as well

A Conversion Conversation with Convoy’s Chad Sanderson How Josh Sookman drives product development through Experimentation A Conversion Conversation with Ritual’s Josh Sookman There is a lot of literature, courses, and fanfare given to Experimentation around Read more Franceska Viray: While often overlooked, don’t underestimate the importance of QA when running Experiments A Conversion Conversation withContinue reading “Convoy’s Chad Sanderson: Experimentation not only protects your KPIs but your job as well”