Ayat Shukairy emphasizes the importance of addressing the functional, social, and emotional aspects of customer needs when designing websites. She shares seven lessons learned from her experience in conversion rate optimization.
Tag Archives: Featured
CRO Insights from a Meta-analysis of over 1000 A/B Tests with Georgi Georgiev
Georgi Georgiev performed a meta-analysis of over 1000 A/B tests and has a great deal to share about:
– What you should expect your win rate to be
– The benefits of sequential testing
– Why you should report on confidence intervals
Get Executive buy-in for your CRO program with Jonny Longden
Let’s face it, experimentation is completely misunderstood. The power and the benefit and potential of it is to innovate and develop a business. And when you think about it, that’s what experimentation has always been in relation to the scientific method. If you think about spaceflight, medicine, anything great that’s happened in the history of modern civilization, this has all happened as a result of the careful application of the scientific method.
A/B Testing Statistics issues CROs should ignore with Timothy Chan
Experimenters obsess about many A/B Testing Statistics concepts – but not all of them are worth worrying about. Statsig’s Timothy Chan shares his thoughts about test isolation, interaction effects and confidence levels – some of his thoughts may surprise you.
Client Relationship Tips from a CRO Agency Founder with Andra Baragan
In this presentation, Andra Baragan, the Founder of ONTRACK DIGITAL will walk you through what you need to know to build a strong, successful relationship with your clients and with your team.
You will learn:
– how to set expectations with your client from Day 1
– how to leverage operating procedures and automate your work
– how to communicate with clients and get stakeholder buy-in every time
What you need to know about Launching a CRO agency with John Ekman
10 lessons that helped John Ekman in Launching a CRO agency. John learned many lessons when launching his agency – he wants to share them with you.
Optimize Customer Lifetime Value – NOT Conversion Rates with Valentin Radu
After decades of acquisition marketing, companies are waking up to the fact that optimising the entire lifecycle of the customer is the way to go. That happens due to rising acquisition costs, cookie deprecation, siloes, company mentalities, etc.
In this session, Valentin will share insights from his 12 years of experience transitioning from CRO – website optimization to increase the conversion rate to CVO – experimenting towards improving the CLV.
Improve conversions with the Message-market Fit framework With Daphne Tideman
Message-Market fit is the idea that a message, whether it be a product, service or idea, needs to resonate with a specific target market in order to be successful. It involves finding the right message that effectively communicates the value proposition of a product or service to a particular audience, in a way that resonates with them.
Avoid AB Testing Statistics Mistakes with Max LI
A/B testing plays a critical role in decision-making – but so does AB Testing Statistics Mistakes. In data-driven companies, A/B tests not only prove positive impacts of product features (treatments) but also provide evidence to safely roll out neutral features that are not expected to move business metrics. When rolling out a neutral feature, we need to test if the treatment is non-inferior to control, and conventional A/B testing is not suitable in this case.
Stop having bad test ideas – with Bart Schutz
Add Exploration and Validation phases to your testing program – because most of your wins are fake.
How to be a good Experimentation LEADER with Cristina Pujol
Being an Experimentation leader requires a different set of skills. Vistaprint’s Cristina Pujol walks through the lessons she’s learned.
The Best CROs start with RESEARCH with Rommil Santiago
Where should you start testing, like with most processes, starting is usually the most challenging part.
Pragmatists will grow the CRO industry – not purists – with Matt Scaysbrook
This attitude has a negative impact on new entrants to the industry and sets completely the wrong tone for the next generation. The greater the participation in the industry, the stronger it will become – the wider that participation, the more ideas (and the more diverse those ideas) will come through. And that is only a good thing for us all longer-term.
How to be good at coding A/B tests with Jeroen Wiersma
How to be a good test coder with Jereon Wieresema
The CRO Survival guide with Carlos Trujillo
Carlos shares most strategic actions that a new Experimentation Strategist (or Program Manager) can execute during their first three months in the role to increase trust among the stakeholders and clients.
Stop wasting time by having principles with Rommil Santiago
You don’t have to A/B test everything. Be smart by having guiding principles.
The top 3 things CROs forget to do with Alexandra Matheny
Many optimizers are good at using data to craft hypotheses. Great optimizers, however, build data-driven segments, analyze by business goals (not just test KPIs), and importantly, propose how to take action on campaign results.
The problem with the word, “Hypothesis” and the importance of HiPPOs with Nima Yassini
Having mature conversations with immature markets, the problem with the word, “Hypothesis”, the importance of HiPPOs with Nima Yassini
Experiment Nation’s most popular posts of 2022
Here are the most popular posts from the last 12 months!
How to adopt a CRO mindset for life optimization with Ruben de Boer
Life optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life.
How to build a customer journey map with Anthony Wallace
Creating a customer journey map can help stakeholders better understand the customer’s experience, and helps ensure that all stakeholders are working towards the same goal. It can also help identify potential areas of improvement, and provide insights into how customers interact with your product, service, or organization.
The Top 20 Must-Meet CROs of 2022
Earlier this year, we asked the Experiment Nation community who were the CROs that they felt everyone should know because of their welcoming nature, openness to connecting folks with others, willingness to share their expertise, and being just all-around awesome folks. Here are the results along with what the community had to say about them.
How to land a great job in CRO (and earn what you’re worth) with Tracy Laranjo
If you change jobs quickly, will employers think you’re a job-hopper? Tracy shares her opinion.
Zuko Analytics’ Alun Lucas on Why good form design is important and common form optimization myths
Richard talks to Alun Lucas from Zuko Analytics about Form Optimization
Pre-test planning: The Red-Headed Stepchild of Experimentation with Haley Carpenter
Teams are horrible at this! They have no idea it should happen, and if they do, they’re usually lost and the approach is terrible. When you break it down, it’s really not difficult. This shouldn’t be a black box anymore.
Experimenter of the Week: Charlotte April Bomford
Check out our Experimenter of the week!
Why Focus on Skeptical First-time Buyers? with Rishi Rawat
During Experiment Nation’s recent conference, Rishi Rawat shared during his award-winning session why we should focus on Skeptical First-time Buyers.
We asked the CRO community: How do you document your experiments?
If you’ve ever wondered how CROs document their Experiments, we’ve collected some information that might be useful to you.
Loblaw Digital’s Rommil Santiago shares how to create a quick and dirty Learning Agenda
Creating a Learning agenda doesn’t have to be complicated. Loblaw Digital’s Rommil Santiago shares how you can create one – in under 5 minutes.
Online Dialogue’s Ton Wesseling shares his thoughts on how CRO will probably die
Our new podcast host, Richard Joe, speaks to Online Dialog’s Ton Wesseling about how he got started, the lessons he learned during his career, and how the CRO industry will die.
Announcing the 2022 Experiment Nation Conference Award Winners
Here are the best sessions and speakers of our most recent conference!
Test before you build anything or you’ll waste time course-correcting with Rommil Santiago
There’s a lot of talk about how to find things to test, how to analyze tests, and the importance of iterating on tests. This week, I was thinking about how I could add something a little different to the conversation and decided to share my thoughts about when to run a test – particularly when building products.
Not every insight is derived from an A/B Test with Daniela Marquez
Curiosity needs to be a driver in every experimenter’s toolkit. What is going on in the head of my customer? What is really their job-to-be-done? When buying flowers, we typically think of the standard occasions: Mother’s Day, Valentine’s Day, new baby & sympathy. But if we were to structure our ecommerce website on those occasions alone, we may be addressing the majority, but we’d be missing out on the real motivation behind the purchase as well as other reasons people buy flowers.
3 ways to be a better Experimentation leader with Rommil Santiago
Even if you are the best Experimenter at your company, unless you are able to nurture a culture of Experimentation – you’ll end up constantly fighting uphill battles. Here are a few quick pointers on how to be a better Experimentation leader.
Experimenter of the Week: Dorian Gonzalez
Check out our Experimenter of the week!
What Hawaiian Pizza can teach us about creating a more inclusive CRO industry
Pineapple on pizza. If you ever want to have a heated debate with a group of people, ask them if pineapple belongs on pizza. You’ll hear arguments about how people should be allowed to like what they like and that should be OK, as well as, pizza is XYZ and that anything different cannot beContinue reading “What Hawaiian Pizza can teach us about creating a more inclusive CRO industry”
How Europe leverages AI for optimization with Noémie Sauvage
Noémie Sauvage shares her industry knowledge about optimization in Europe. Check it out!
How Wordle proves that Experimentation works
If you haven’t tried it yet, Wordle is a popular online game where you have to guess a 5-letter word within 6 tries – and it’s quite fun and addictive. Every day there is a new word to guess, and everyone gets the same word. It cleverly lets you post how you solved (or didn’t) the daily puzzle – which often sparks some lovely conversation online. Interestingly, there are a lot of parallels between Wordle and the Craft of Experimentation. Find out how.
Pizza Dough CRO with Simon Clark
Optimization and Pizza Making are the same and Simon will help you understand how and why it is beneficial to let your dough prove for longer.
Can you run tests on sites with little traffic?
From a pure experimentation perspective – one absolutely can forego using statistics and just see what happens. We can believe the dictionary, the dictionary definition of an experiment is: “a scientific procedure undertaken to make a discovery, test a hypothesis, or demonstrate a known fact.” A scientific procedure (aka the scientific method) states nothing about having to use a statistical approach for analysis. However…
How to verify your data truly reflects user behaviour with Florent Buisson
Florent Buisson is a decade-long behavioral economist who published a practical guide to behavioral data analysis in business. It’s the book he wished he had when he started in analytics.
In this episode, he shares:
Why intuition can actually be a good thing in data analytics. If you need to know R or Python to understand your users. Why and when causal analytics are important.
How do I change people’s attitudes towards Experimentation?
Of course, there are a million ways to answer this question that range from demonstrating wins, being inclusive, and evangelism. This week, I thought of sharing a couple of the little things you can do that, if done consistently over time, can start to realize gains in the long run. Words matter Experimenters and CROsContinue reading “How do I change people’s attitudes towards Experimentation?”
How to make a better sandwich: An introduction to multivariate testing with Danielle Gunraj
A/B Testing can be intimidating to the uninitiated, but it doesn’t have to be! I want to introduce testing concepts via a real-world scenario that we can all relate to: Dessert. I’ll cover what an MVT is, hypotheses, independent variables, dependent variables, results (of course), and design flaws. And if you need any more convincing, I have four words for you: Monte Cristo Bread Pudding.
Choosing the right A/B testing tool with Product for Product
Matt Green and Moshe Mikanovsky of Product for Product podcast help you navigate the plethora of A/B testing tools out there.
Whether you’re in product or marketing, listen for a beginner-friendly comparison of tools like Google Optimize, Optimizely, and more.
**This episode, nor those of Product for Product, are endorsements of any of the discussed tools.**
Experiment Cartography :: Building the Perfect Roadmap with Kenya Davis and Krissy Tripp
You can do better than testing button colors, but how do you decide what to test when and what type of test to run? Roadmapping. This session teaches you to be the GPS navigator, helping your team optimize experimentation routes. On this journey you will identify how each path can drive desired impacts by turning a formidable trek into a series of attainable milestones.
How to rally your team around Voice of Customer research with Tracy Laranjo
Tracy is a Toronto-based growth marketer with a knack for conversion optimization. In a past life she’s QA tested “adult” eBooks and helped make it easier for Canadians to write their wills online. Tracy is also one of the co-hosts of the Experiment Nation podcast where she chats with optimizers at the top of their game.
Beyond the 9-5, you can catch her knitting, crushing empires in Civ6, or napping with her cats.
Introducing the CRO Qualification Certificate (Open Beta)
We are introducing Experiment Nation’s CRO Qualification Certification – an easy and FREE way for CROs to demonstrate their understanding of the industry that is managed by a neutral party.
Johann Van Tonder on how to conquer 4 common ideation pitfalls with research-backed methods
eCommerce CRO veteran Johann Van Tonder shares what usually goes wrong when coming up with test ideas and how to fix it. We also discuss the merits of quantity vs. quality of ideas, the problem with brainstorming, and what to do instead for more effective ideation sessions.
Developing a Culture of Testing/Experimentation with Anil Batra
Anil is a Digital Marketing and Analytics professional with 18+ years of experience. He has worked with companies ranging from startups to Fortune 500 and has helped them improve marketing results as well as develop data driven culture. He has vast experience in Web, Email, Social, Display, Search, Paid Search, and CRM. He holds a B. Tech in Electronics and Communication Engineering from India and an MBA from the University of Washington, Seattle. He is the founder of https://academy.optizent.com – A Digital Analytics training and education company.
Jessica James on optimizing in the online gaming space and what she misses about the UK
CROs follow a lot of the same strategies across industries, but some industries like Online Gaming require some special considerations.
Where are the users? with Moshe Mikanovsky
When experimenting with our products, we need to find our users but it’s not always that simple! Where do we find the users? In this session Moshe will go over different types of products and different ways to find users for each of them. Coming out of this session, attendees will have some ideas on where to start looking for their users.
Using Chi-Square Analysis for A\B\N Tests with W. Scott Sanders
This presentation provides a quick overview of Chi-square analysis and a discussion of its use cases in marketing experimentation.
Rachel Harrison on how CROs can work remotely and still remain impactful
CROs that work with clients are always looking to be impactful. But in today’s remote/hybrid work environments – that’s become more challenging. Rachel Harrison shares her tips on how CROs can navigate this new world.
LeanConvert’s Edd Saunders on the importance of web performance and Google’s Core Web Vitals
As the saying goes, every second counts. Edd walks us through Google’s Core Web Vitals as well as how he approaches testing for website performance.
Sina Fak on why CRO is not a person but a multidisciplinary Experimentation team
Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO.
The CRO Salary Report: 2022
Are you being paid fairly? Find out. Experiment Nation conducted a CRO Salary survey and we have the results!
The importance of keeping current: A conversation with Webtrends Optimize’s Sandeep Shah
Webtrends Optimize’s Sandeep Shah was recently crowned CRO Memes’ Funniest CRO of the Year. Find out about his career, how he stays on top of the industry, and his upcoming personal project.
Introducing the Weekly CRO Wordle
Do you love CRO? Do you love Wordle? You’re in luck. Every week, we publish a new CRO Wordle. We’ll do our best to keep the words 5 letters long, but we make no promises.
Building a team in a cost-effective way: Tips from Luke McDermott
Luke McDermott on Common CRO Political Obstacles and the most cost-effective ways to stand up a CRO team.
How to make a customer-centric diagnosis with Marion Ravel
Watch the full video.
Reducing the cost of running an experimentation program with Tasin Reza
In this session, Tasin Reza will be covering the areas where the companies can reduce their costs of experimentation, things that they will need to consider to increase their profitability.
What 13 Years of A/B Testing Revealed with Rishi Rawat
Rishi Rawat is the product page guy. With his 13 years of running A/B tests, Rishi shares what makes an effective product description, his go-to method for segmenting product pages, and how to stand out to your visitors during their most “promiscuous state”.
What’s the best time to send an email with Deborah O’Malley
What’s the best time to send an email? A lot of research and data analysis has gone in to answering this question. But yet, there’s no clear, definitive answer. In attempt to resolve this question once-and-for-all, this session will present and interesting and surprising answer.
The challenges nobody talks about with Taz Risma
Taz talks about the challenges around Experimentation that no one talks about.
Where I Started: Dennis van der Heijden
Episode 2 of Where I Started – a new mini-series by Experiment Nation and Ontrack Digital that explores how Experimenters got into the field.
We Need More ART in CRO with Jimmy Barber
This session is about the conundrum that “data is everything” – a mentality circulating at large the past couple years. There’s so much data, and we often find ourselves simply staring at metrics looking for “+” or “-” to make decisions. The objective of this session is to draw on thinking strategies from physics, of how to approach CRO differently, without any real “data”, to then gleam positive impacts to CRO.
Symplify’s Mika Sano Janze shares her advice for those looking to get into CRO
Symplify’s Mika Sano Janze shares her advice for those looking to get into CRO
Moving Beyond Spaghetti Testing with Haley Carpenter
The success of your testing program depends on the quality of your hypotheses. But too many experimentation programs lack the processes and frameworks to move from spaghetti testing to strategic experimentation. Haley shares two practical frameworks to help you form better hypotheses and objectively rank test ideas.
What is product growth? Creating & Navigating the path to product growth with Aditi Gupta
Aditi Gupta covers the creation of a growth roadmap/ how to build alignment with stakeholders/ creating an org-wide impact.
Where I Started: Shiva Manjunath
Episode 1 of Where I Started – a new mini-series by Experiment Nation and Ontrack Digital that explores how Experimenters got into the field.
Speero’s Experimentation Maturity Audit with Edgar Spongolts
Speero’s Director of CX Optimization, Edgar Spongolts, dives deep into the influential agency’s Experimentation Maturity Audit and why maturity matters. Learn about the four pillars of a successful experimentation program and what it takes to reach the highest levels of maturity. Take the audit yourself here: https://speero.link/ExperimentNation
Creating an experimentation program that’s more than A/B testing with Annika Thompson and Paul Randall
Too often experiments are squandered. But if you put customer problems first and design the right type of test you can ensure every experiment is valuable to your business. The following talk will give your experimentation programs guardrails to make sure you’re not testing for testing sake.
Looking back at 2021
Highlights from the last 12 months. Sure it’s a bit of a humblebrag, but it makes us feel good and we love feeling good.
Best practices might be killing your experimentation culture – 3 reasons why with Ana Catarina Cizilio
Everybody is doing it, so you have to do it too, right? As my mom used to say: you’re not everyone! Best practices are not experimentation and you should know that. I want to prove to you this is the easy way, but it’s not the right way for a healthy, profitable and experiment-oriented business. These tactics don’t last long. In this session, we will discuss why, statically, best practices don’t work. It’s fun to know about the competitors, their results and ideas. It may generate new ideas and grab your attention when you’re starting to experiment, but that’s the only good thing. To have a great experiment culture, you need to learn from your tests. Let’s talk more about this?
Ripple Benefits: CRO as the foundation of other digital marketing efforts with Spencer Gray
CRO should be the foundation that all of your other digital marketing efforts rests upon. Through what we call our ‘Ripple Benefits’, I’d love to showcase just how CRO not only improves your conversion rates, but your SEO, Content Marketing, Paid Ads, and more. Testing is key and should be the foundation that drives where your efforts are focused.
Aiven’s Petra Lylander on experimentation documentation and processes
Petra Lylander is a growth marketer who developed the experimentation process at Helsinki-based SaaS company, Aiven. In this episode she talks about process documentation for experimentation and how to get other teammates to care about it.
Perxels’ Olabanji Ewenla on Growth Product Managers vs. Product Managers – and why Experimentation is important to both
Olabanji Ewenla is a mentor, a Growth Product Manager, and a believer in Experimentation. Learn about his new book, “The Blood Money in Tech”.
How to “Hack” Experimentation with Anthropology with Eden Bidani
AKA Why you should approach research like an Anthropologist How ethnographic research helps you understand *why* people think the way they think (not just *what* they think or how they respond to triggers) to create more meaningful hypotheses and experiments.
IU’s Sebastian Bernhardt on Best Approaches and the fun of connecting with the Experimentation Community
Sebastian Bernhardt shares the story behind his new series called Best Approaches, CRO in Germany, and his love for connecting with the Experimentation community.
Experimentation post-conversion: Switching from buying journey to customer journey with Juliana Jackson
Experimentation post-conversion or how to switch from buying journey to customer journey.
Five things that piss me off about eCommerce and how to fix them with Jon Ivanco
A quick and dirty guide to pointing out bad practices that create friction to the customer when brands practice the company journey instead of the customer journey.
CRO não é um profissional e sim um processo (participação especial André Gillich)
Nesse episódio nosso convidado André Gillich, Head of CRO, compartilha sua experiência na Jussi crescendo a cultura de experimentação, começando pela nova abordagem em que “CRO não é um profissional e sim um processo.”Exploramos o impacto da cultura “Agil” e o desafio do foco em outputs não outcomes.Fechamos o podcast de forma prática compartilhando iniciativas tomadas em nossas empresas para acelerar a flywheel de experimentação.
Curology’s Darian Rusow on App Store Optimization and 2 important traits CROs should have
Curology’s Darian Rusow talks about App Store Optimization and the two important traits CROs should have.
The Science of Business with Jonny Longden
Our industry is focused on the individual elements of what we do and how we do it, but not why we do it and the overall philosophy for it. This is part of the reason that businesses don’t give it the traction it deserves; senior business leaders are not interested in the execution, they’re interested in the overall benefit.
Specsavers’ Steph Le Prevost on growing a top UK CRO program
Steph walks us through the challenges of growing Specsavers’ CRO team and how she overcame them, her experimentation red flags, and her take on if CRO certifications are really worth it. Plus: A comparison of the CRO job market between Canada vs. the UK, including how well you can expect to be paid as an optimizer.
Better Collective’s Luka Nikolic on the importance of hypotheses and “obliquity” to Experimentation
If you didn’t know what the word, “obliquity” meant, read on and discover why it’s so important to Experimentation.
Evelyn EBO talks about the importance of Experimentation to Product Managers
Evelyn EBO shares her thoughts on why Product Managers should Experiment and how she gives back to the Product Community.
Strategies are not made every day, improvements are with Siddhartha Kathpalia
Strategies are not made every day, improvements are with Siddhartha Kathpalia
Global experimentation: Problem-solving at scale with Melanie Kyrklund
Global experimentation: Problem-solving at scale with Melanie Kyrklund
Change management for Experimentation Culture – Do’s and Don’ts with Ruben de Boer
In his presentation, Ruben will discuss the importance of change management guided by an understandable model that you can start using today.
Microsoft Digital Stores’ Tim Mehta on strategies for low and high maturity experimentation programs
Tim shares his tips for running low and high maturity experimentation programs, what it’s like to optimize in-house vs. agency, when it is (and is not) ok to make compromises, and to how make your program’s results actually drive action. Plus: Tim’s take on those controversial UI polls on LinkedIn.
How to use data to find hidden insights about customers & opportunities for optimization with Sina Fak
How to use data to find hidden insights about customers & opportunities for optimization with Sina Fak
Tips on running a Test-to-Learn Experimentation Program with Shiva Manjunath
Shiva will run through WHY you want to be running an experimentation program based on insight generation and not simply ‘winning’. He’ll also show you how to structure tests to support the growth of an insight-driven experimentation program.
Making product decisions with bayesian analysis
Positive John dives into the suitability of Bayesian inference for product decisions.
Seven lessons from running 22,000 AB tests with Ayat Shukairy
In this session, Ayat Shukairy will share the lessons learned by analyzing over 22,000 AB tests on 700 CRO projects. These lessons paint the common patterns that helped us deliver upwards of 50% success rates on AB testing programs.
Women in experimentation: What holds us back?
In this session – recommended for women in experimentation and those working with them – Bithika will help identify blind spots and hopes to help women and teams reach their true potential.
Video and Podcast available now!
Migrando para a área de experimentação vindo do Jornalismo (participação especial Fabricio Migues)
Hoje começamos um novo papo em nosso podcast: como migrar para a área de experimentação? Nosso convidado especial é Fabricio Migues, CRO Manager na Small World Financial Services, conta pra gente como foi sair da área de jornalismo e relações públicas e adentrar na experimentação, como aproveitar seus aprendizados e conhecimentos da área de comunicação dentro de CRO e como isso o tem ajudado.
Shopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizers
Tracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers.
Série: Estruturando uma área de CRO na sua empresa – episódio 2
Neste terceiro episódio contamos com a presença de André Vieira, fundador da Looptimize. Ele nos conta um pouco mais da sua visão sobre:
- Qual o ponto de partida para começar a investir em CRO?
- Popularização da experimentação: heurísticas e boas práticas — pontos positivos e negativos
- A qual área CRO melhor pertence dentro de uma empresa?
Comment mesurer le ROI de mon programme d’expérimentation?
How to measure your experimentation
program ROI? (In French)
Evolved Search’s Simon Clark talks about the importance of UX and his thoughts about Google Optimize
Simon shares how communication and UX are important to any optimization practice.
Microsoft’s Tim Mehta talks about managing an Experimentation Program
Tim Mehta talks about how he leverages both quantitative and quantitative research to find frustration points to optimize.
Série – Estruturando uma área de CRO na sua empresa – episódio 3 (Participação especial André Vieira)
Neste terceiro episódio contamos com a presença de André Vieira, fundador da Looptimize. Ele nos conta um pouco mais da sua visão sobre:
- Qual o ponto de partida para começar a investir em CRO?
- Popularização da experimentação: heurísticas e boas práticas — pontos positivos e negativos
- A qual área CRO melhor pertence dentro de uma empresa?
Dexter’s Joris Bryon on Common Practices, Starting a CRO agency, and how to spot a CRO imposter
Tracy Laranjo asks Dexter’s Joris Bryon about how we need to stop saying Best practices and start saying Common Practices His tips on starting a CRO agency and working with a partner And how to spot a CRO imposter.
Rohit Rayala on how he supported over 25 clients and drove an average growth rate of 154% in 12 months
Rohit talks to us about a process called PSIP that hoped him drive 154% growth for over 25 clients.
Aditi Gupta talks about influencing product roadmaps with experimentation
Manage expectation to avoid headaches when adjusting roadmaps based on experiment results.
Série: Estruturando uma área de CRO na sua empresa – episódio 1
Nesse primeiro episódio da série, vamos discutir como caímos no mundo de Otimização de Conversão (CRO), algumas experiências até posições atuais e diferentes perspectivas entre exatas/humanas e seus benefícios.
The weekly buzz: July 30, 2021
? 8 Common Pitfalls of Running A/B Tests by Leihua Ye, Towards Data Science
? A Conversation with Ronny Kohavi hosted by Marylin Montoya on AB Tasty‘s podcast “1,000 Experiments Club”
? Experimentation Culture Awards 2021: Learnings by Bithika Mehra, MBA, MSBA
How Save the Children Italy’s Valerio De Biasio leverages CRO to help save lives
CRO not only helps generate sales, it can help save and improve lives.
We’ve updated the Directory, the Job Board, and Tools
We’ve been busy updating our site – hopefully making it easier for you to connect and interact with other Experimenters. Find out what we’ve been up to!
CR-No: How to speed up your Experimentation Program
Rommil, Kenya, and Shiva discuss the challenges of speeding up a CRO program, as well as some of the ways they overcome them.
Farfetch’s Luis Trindade on how to build a strong Experimentation Culture
Farfetch’s Luis Trindade on how to build a strong Experimentation Culture.
Frequentist & Bayesian: Comparison and Practical Application (R script attached)
By Andrea Corvi Canon vs Nikon and iOS vs Android are just two modern examples of “dualisms” that divide crowds. The long-lasting Frequentist vs Bayesian fight is not any different and like the other two examples above, it’s still far from finding a winner. This doesn’t affect just the CRO world but the same typeContinue reading “Frequentist & Bayesian: Comparison and Practical Application (R script attached)”
Experiment Nation chats with the folks behind CRO Memes
Who are the people behind CRO Memes? We don’t know either – but Tracy did recently chat with the elusive group to learn a bit about them.
Experiment Nation: The Conference
Have you ever wished you could speak at a conference but speaking to a live audience was too intimidating? We’ve got an opportunity for you.
Polestar’s Oliver Wyman on building an Optimization team and Experimentation culture
Learn about how Oliver measures the performance of his team, ensures optimization is connected across functions, and what he’d do if he didn’t run experiments.
ConvertCart’s Shaivi Sahay on figuring out what to test first
Learn about how Shaivi approaches new CRO challenges.
The weekly buzz: June 16, 2021
? How to Measure the Impact of Changes to the Digital Experience by Andrew Millett from Blast Analytics
? Don’t Be Intimidated By Sample Size, Learn About It! by Kelly Wortham from Search Discovery
? It takes a flywheel to fly by Aleksander Fabijan, Benjamin Arai, Pavel Dmitriev & Lukas Vermeer
Maulin Shah shares his key elements of an experimentation roadmap
Maulin Shah shares his key elements of an experiment-driven roadmap
Willful’s Tracy Laranjo on how the Experimentation Community has made her a better Experimenter
Tracy also shares a peek behind the curtain of what it’s like to work on Experiment Nation.
The weekly buzz: June 2, 2021
? How to Measure the Impact of Changes to the Digital Experience by Andrew Millett from Blast Analytics
? Don’t Be Intimidated By Sample Size, Learn About It! by Kelly Wortham from Search Discovery
? It takes a flywheel to fly by Aleksander Fabijan, Benjamin Arai, Pavel Dmitriev & Lukas Vermeer
Sam Media’s Kudakwashe Shamu on how designers have to get out of their comfort zones
Kudakwashe shares his advice to designers out there who haven’t yet embraced Experimentation.
The weekly buzz: May 26, 2021
? Upsides to Unshipping: The Art of Removing Features and Products by Reforge
? Browser Privacy Policy Updates – Optimization Effects by Kelly Wortham and Cory Underwood
? Visual Hierarchy: A 2021 Optimization Guide For Marketers by Unbounce
? Two days to go.. If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 28th. ?
? Upsides to Unshipping: The Art of Removing Features and Products by Reforge
? Browser Privacy Policy Updates – Optimization Effects by Kelly Wortham and Cory Underwood
? Visual Hierarchy: A 2021 Optimization Guide For Marketers by Unbounce
? Two days to go.. If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 28th. ?
Adventures in Experimentation: A deep-dive into CRO tools
John and Marion deep dive into their favorite CRO tools, and the importance of a diverse experimentation portfolio.
The weekly buzz: May 21, 2021
? Multiplication instead of division: Molly Stevens and Lukas Vermeer team up to tell us why research and experimentation are the “peanut butter and jelly” of customer insights.
? What you can learn from one extra experiment: Kevin Dunn explains how you may miss out if you are only doing A/B testing, or following the Change One Single Thing (COST) approach to experimentation.
? How does Failure help you in Experimentation? Craig Sullivan shares Tesla’s experience with experimentation and failure.
? If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 28th. ?
Principais diferenças da atuação de CRO em agência e dentro da empresa
A cultura da otimização de conversão e experimentação tem crescido no Brasil nesses últimos anos e reunimos aqui alguns erros principais de quem está começando a atuar na área.
Amazon’s Joey Herzberg on ensuring that work is always aligned with what the customer wants
Joey talks about how to always be aligned to customer needs, working across functions and his drone work.
The weekly buzz: May 14, 2021
Here’s the latest Weekly Buzz. ? Links in the doc!
? Why we use #experimentation quality as the main #KPI for our experimentation platform from Booking.com
? A/B Testing and Experimentation: Tactics From Matt Gershoff
? If you haven’t already, submit your case in individual, team or organization wide categories for Experimentation Culture Awards by May 21st. ? And remember…
“It’s not about that one experiment, it’s about improving the process, structure, trustworthiness, democratization and motivation for experimentation and data-driven decision making.”
Kilo Health’s Lukas Petrauskas on how website copy is costing companies 30% of their website revenue
Lukas shares how he evaluates specialists, and how companies are missing out on 30% of their revenue.
Reprise Digital Spain’s Silvia Serrano on applying Maslow’s hierarchy of needs to CRO
Silvia shares how to apply Maslow’s hierarchy of needs to CRO as well as how to think about testing for value propositions.
5 erros comuns de iniciantes em otimização de conversão
A cultura da otimização de conversão e experimentação tem crescido no Brasil nesses últimos anos e reunimos aqui alguns erros principais de quem está começando a atuar na área.
Spencer Gray on how CRO is not a standalone service but rather a team sport
Spencer Gray shares how he grew the CRO department at 97th floor and how successful CRO works with other services.
Ana Catarina Cizilio tells us about CRO in Brazil and the mindset needed for CRO
Ana tells us about the differences between the US and Brazil, as well as about the mindset you need to succeed at CRO.
Product Experimentation: A chat with Moshe Mikanovsky about building competency and fluency with data (Part 2)
Jaya and Sid chat with Moshe Mikanovsky, a Product Manager with over 30 years of experience, about the importance of getting closer to the data by getting familiar with data tools and working with business intelligence.
The 2021 Experiment Nation CRO Buzzword Tournament
Can you guess 2021’s most important buzzword? Check our leaderboard to see our best guessers so far!
Product Experimentation: Building a competency and fluency with data (Part 1)
Jaya and Sid chat about building competency with and a fluency with data to get a better idea of what’s happening with systems and how products are helping customers.
Question of the Week: Which of these menu pages would generate more orders?
Find out what our LinkedIn community thinks.
Specsavers’ Melanie Kyrklund on How to run a high-impact optimization program
In this episode, Rommil and Tracy interview Melanie Kyrklund from Specsavers on how to run a high-impact optimization program, how to align the program with a product’s vision, and how she likes black licorice.
Question of the Week: How would you collect emails and why?
Find out what our LinkedIn community thinks.
CR-No: Addressing the lack of direction and primary calls to action on pages
This week, Siobhan Solberg, Kenya Davis, Shiva Manjunath and Eddie Aguilar talk about how to address the lack of direction and primary calls to action on pages.
Question of the Week: Which product description page would drive more orders?
Find out what our LinkedIn community thinks.
CR-No: How to manage stakeholders and HiPPOs
Shiva, Eddie, Siobhan, and Kenya talk about how to manage HiPPOs and stakeholders.
Question of the Week: Which product description page would lead to more cart additions?
Find out what our LinkedIn community thinks.
Adventures in Experimentation: The importance of the voice of customer to conversion optimization – as well as to the entire business
Eden and Positive John speak about how recording your sessions with clients helps reduce the need for taking notes, how qualitative research is key to not just CRO but for all things business, and how no one likes pop-up surveys except for Positive John.
SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization
Hi Raphael, thanks so much for taking the time to chat with us! How have you been? I’ve been good! While the COVID situation here in Montreal is making things a bit boring, business has been stronger than ever, and we work with super fun clients, so can’t complain about that side of things –Continue reading “SplitBase’s Raphael Paulin-Daigle talks about convincing clients to invest resources towards optimization”
Product Experimentation: Aligning the need to deliver and the need to learn with OKRs
Jaya and Sid explore: What does a good product experiment look like;
Aligning the need to deliver and the need to learn with OKRs; Why aren’t companies adopting the practice
Widerfunnel’s Chris Goward on how Experimenters need to focus less on the tools and more on strategy
Experimenters put so much emphasis on tool selection that they forget the importance of taking a step back and thinking about the bigger picture.
CR-No: Balancing between optimizing the entire customer journey vs. just the website
This week, the CR-No panel of CRO veterans talk about balancing between optimizing the entire customer journey vs just the website.
Point/Counterpoint: Exploring different experiment prioritization frameworks with Marion Ravel, Patrick Buffum and Trisha Utomi
On today’s episode of Point/Counterpoint, Trish leads Patrick and Marion through a discussion about: Their CRO New Year’s resolutions, and the pros and cons of several experiment prioritization frameworks.
Twilio’s Justin Coons shares what you need to know about SEO Experimentation
Rommil interviews Twilio’s Justin Coons and they talk about: Not only can you run experiments for SEO, but you also should, Which is better, short-form content or long-form content, and What metrics to optimize for when running SEO Experiments
Product Experimentation: Jaya and Siddharth explore how to Experiment during the Product Development Life Cycle
Jaya and Siddharth explore how Experimentation fits into the Product Development Life Cycle, how to work with challenging stakeholders, share stories about how they’ve leveraged Experiments to generate results.
Adventures in Experimentation: Eden and John answer the question, “How many experiments should I run?”
On today’s episode, John Ostrowski and Eden Bidani talk about how they respond when someone asks them how many experiments they should run and why John keeps a personal list of shame.
CR-No: Experiments should be backed by hypotheses – leave your best practices for your processes
How best practices in CRO should only apply to approaches and workflows and not necessarily what you should test and the danger of copying others’ “best practices”.
2021 sneak preview
I’ve decided to work with Experimenters from around the world to help give Experiment Nation a more intimate and connected feel. Here are the projects that are in the works.