Making the case for data-backed design featuring Brian Massey

Data-backed web design refers to the approach of utilizing empirical evidence and user insights to inform the design and optimization of websites. By analyzing data such as user behavior, click-through rates, conversion rates, and heatmaps, designers can make informed decisions about layout, navigation, content placement, and visual elements. A data-backed approach helps identify user preferences, pain points, and areas for improvement, resulting in enhanced user experiences. A/B testing, user surveys, and analytics tools are commonly employed to gather data and validate design choices. By leveraging data, web designers can create user-centric interfaces that drive engagement, conversions, and overall business success.

How to Maximize Hypotheses Testing ft. Eduardo Marconi Pinheiro Lima

In the world of Conversion Rate Optimization (CRO), Eduardo, a seasoned practitioner, shares his journey and the evolving landscape of CRO in Brazil. He underscores the importance of maintaining a problem-solution mindset and learning from mistakes to drive meaningful impact. One core principle he highlights is the need to focus on hypotheses that yield significant results, comparing them to squeezing fruit for juice. This strategy involves exploring promising hypotheses further and discarding those with neutral or unimpressive outcomes, a practice essential for effective experimentation, whether in-house or at an agency. The key takeaway is to persevere with ideas, akin to squeezing every drop of insight from hypotheses, and leveraging comprehensive data for a deeper understanding, a competitive edge held by in-house roles in the experimentation field.

What you need to know about Landing pages with Claire More

Integrating landing pages is crucial for tailored user experiences. Without it, visitors are directed to generic pages lacking personalized messaging. Landing pages are designed to enhance conversion rates and ROI. E-commerce companies benefit by using various types of landing pages, like the classic hero for focused products, listicle hero for storytelling, collection hero for multiple items, and content advertorials for top-funnel content. Mistakes include using one-size-fits-all pages and lacking customer-oriented content. Improve by collaborating with ads teams, using customer voices, and continuous experimentation. Claire More from Splitbase shared insights on optimizing landing pages for effective campaigns.

Don’t test everything with Oliver Palmer

Don’t test everything. Experimentation isn’t about proving how clever you are. Mistakes in testing ideas from your own head are common; personal bias clouds results. High-performing experimentation needs executive buy-in and integrated roles. Successful teams engage diverse players with vested interest, ensuring hypotheses formation and metric selection are comprehensive. Valuable experimentation saves time by testing what not to do. Rather than just chasing conversion lifts, recognize when improvements won’t make a difference. Cultural shifts, humility, and prioritizing efficient use of time are key components of effective experimentation programs. Test what makes sense.

The truth about building an Experimentation Culture with Mark Eltsefon

In this podcast episode, Mark Eltsefon, a senior data scientist and experimentation evangelist, discusses building an experimentation culture in different companies. He shares his journey from starting as a software developer to becoming passionate about data science and experimentation. He contrasts the experimentation culture at TikTok, where data-driven decisions were central and democratization was encouraged, with his current role at an e-commerce company specializing in print-on-demand. He emphasizes the importance of educating stakeholders about data-driven decision-making, and he highlights the need for strong experimentation infrastructure and high-quality hypothesis testing. He believes that while democratization is valuable, it’s important to balance it with maintaining the quality of ideas and statistical rigor.

How to get Personalization Right with Juliana Amorim

Juliana Amorim emphasizes that personalization is not a silver bullet and recommends its use when aligned with strong hypotheses and business goals. She co-founded Croct, a personalization experimentation platform, focusing on adapting user journeys to context. Examples include tailoring websites for diverse buyer personas within B2B companies and customizing content for users at different stages, like newcomers or existing customers. AI-based personalization and rule-based personalization can coexist. Brands should prioritize personalizing their websites and consider first-party data support.

Stop limiting yourself – build your CRO brand today with Carlos Trujillo

Building a personal brand as a conversion rate optimizer is crucial in today’s competitive digital landscape. Your personal brand serves as a powerful tool to establish credibility, showcase expertise, and attract new opportunities. By cultivating a strong brand identity, you position yourself as an authority in the field, gaining trust from potential clients or employers. A well-developed personal brand helps differentiate you from others, highlighting your unique approach and methodologies. It opens doors to collaborations, speaking engagements, and thought leadership opportunities. Additionally, a strong personal brand creates a lasting impression, leading to increased visibility, a larger professional network, and ultimately, a steady stream of clients or job offers.

Building a CRO Culture & Ideation Strategies with Lucia van den Brink

By implementing ideation strategies and fostering a culture of experimentation, companies can drive innovation and stay ahead of the curve. Building an experimentation culture is crucial for companies that want to innovate and stay ahead of the competition. It starts with creating an environment where experimentation is encouraged and failure is seen as an opportunity to learn and improve. Teams should be given the freedom to try new ideas and test them quickly using small-scale experiments. It’s important to collect and analyze data from these experiments to make informed decisions about what works and what doesn’t. Lucas Vos interviews Lucia van den Brink in this great AMA session.

Learn from Mistakes: What Eddie Aguilar learned from accidentally taking down InVision

Eddie Aguilar, a developer and CRO specialist, shares his experience with experimentation and optimization. He discusses how he started as a developer at a young age and eventually shifted to optimization. He recounts a specific incident while working with Envision App, where he made a global change to the website that caused a significant error, resulting in a spike in error logs. Eddie emphasizes the importance of communication and collaboration in such situations. Despite the error, the test yielded impressive results, with a 227% revenue lift and 70% LTV lift.

Make Personalization Personal with Care and Competence with David Mannheim

David Mannheim, author and expert on personalization, discusses the importance of personalization in marketing. He emphasizes the need for brands to focus on building relationships with customers based on trust and care. Mannheim distinguishes personalization from segmentation, highlighting personalization as a communication principle rather than just a marketing tactic. He also mentions the challenges faced in implementing personalization, such as the pressure for immediate returns and the balance of metrics.

How to use questions in CRO and how to build a Questioning framework with Riccardo Vandra

In this video, Riccardo Vandra discusses the importance of asking powerful questions for conversion rate optimization (CRO). He emphasizes that the quality of our questions determines the quality of our insights and ultimately our success. Riccardo proposes a three-step questioning framework for building effective questions.

Customer Value Optimization Explained with Defiant’s Jason Chappel

We sat down with Jason Chappel, founder of Defiant, a specialist Customer Value Optimization agency, to discuss what sets CVO apart from CRO. Jason shares his insight on the importance of understanding and optimizing the entire customer journey, from acquisition to retention, and how CVO can help businesses increase customer lifetime value and drive sustainable growth in your business strategy.

Do 3-column layouts increase orders? with Nicoleta Danile?

Optimizing forms during checkout is crucial for a seamless user experience. By simplifying and streamlining the process, businesses reduce cart abandonment rates and increase conversions. Shortening form length, utilizing autofill options, and providing clear instructions enhance efficiency, minimize user frustration, and ultimately boost customer satisfaction, loyalty, and revenue.

Nicoleta walks us through a case-study where she explores a 1 column form vs a 3 column form in checkout.

Build or buy your Google Optimize replacement with Kenneth Kutyn

Are you looking to replace Google Optimize? On Experiment Nation’s recent podcast, Charlotte April Bomford chats with Kenneth Kutyn about replacing Google Optimize, how to select a new vendor, and whether it’s worth building your own Experimentation Platform (spoiler alert: the answer is usually no).

Sharing insights, AI and the future of CRO with Tim Thijsse

Tim Thijsse, a senior CRO (Conversion Rate Optimization) consultant at Orange Valley, discusses AI and the future of CRO, and the importance of incorporating qualitative research into company-wide processes. He emphasizes the challenge of linking user behavior and mindset to knowledge and information. Tim shares his background, starting as an interaction designer and later transitioning to UX design and CRO. He highlights the evolution of CRO, the need for a culture of experimentation, and the role of qualitative insights in optimization strategies. Tim also discusses the challenges companies face in adopting an experimentation mindset, such as aligning strategy, operations, and technical aspects, and the importance of having a common metric and collaboration among teams.

Get Executive buy-in for your CRO program with Jonny Longden

Let’s face it, experimentation is completely misunderstood. The power and the benefit and potential of it is to innovate and develop a business. And when you think about it, that’s what experimentation has always been in relation to the scientific method. If you think about spaceflight, medicine, anything great that’s happened in the history of modern civilization, this has all happened as a result of the careful application of the scientific method.

Client Relationship Tips from a CRO Agency Founder with Andra Baragan

In this presentation, Andra Baragan, the Founder of ONTRACK DIGITAL will walk you through what you need to know to build a strong, successful relationship with your clients and with your team.

You will learn:

– how to set expectations with your client from Day 1
– how to leverage operating procedures and automate your work
– how to communicate with clients and get stakeholder buy-in every time

Optimize Customer Lifetime Value – NOT Conversion Rates with Valentin Radu

After decades of acquisition marketing, companies are waking up to the fact that optimising the entire lifecycle of the customer is the way to go. That happens due to rising acquisition costs, cookie deprecation, siloes, company mentalities, etc.

In this session, Valentin will share insights from his 12 years of experience transitioning from CRO – website optimization to increase the conversion rate to CVO – experimenting towards improving the CLV.

Improve conversions with the Message-market Fit framework With Daphne Tideman

Message-Market fit is the idea that a message, whether it be a product, service or idea, needs to resonate with a specific target market in order to be successful. It involves finding the right message that effectively communicates the value proposition of a product or service to a particular audience, in a way that resonates with them.

Avoid AB Testing Statistics Mistakes with Max LI

A/B testing plays a critical role in decision-making – but so does AB Testing Statistics Mistakes. In data-driven companies, A/B tests not only prove positive impacts of product features (treatments) but also provide evidence to safely roll out neutral features that are not expected to move business metrics. When rolling out a neutral feature, we need to test if the treatment is non-inferior to control, and conventional A/B testing is not suitable in this case.

Pragmatists will grow the CRO industry – not purists – with Matt Scaysbrook

This attitude has a negative impact on new entrants to the industry and sets completely the wrong tone for the next generation. The greater the participation in the industry, the stronger it will become – the wider that participation, the more ideas (and the more diverse those ideas) will come through. And that is only a good thing for us all longer-term.

How to adopt a CRO mindset for life optimization with Ruben de Boer

Life optimization involves setting goals and creating plans for reaching them. It also involves improving physical, mental, and emotional well-being. Ruben de Boer shares with our own Richard Joe how he leverages a CRO mindset to engage in activities that bring purpose, satisfaction, and joy to life.

How to build a customer journey map with Anthony Wallace

Creating a customer journey map can help stakeholders better understand the customer’s experience, and helps ensure that all stakeholders are working towards the same goal. It can also help identify potential areas of improvement, and provide insights into how customers interact with your product, service, or organization.

The Top 20 Must-Meet CROs of 2022

Earlier this year, we asked the Experiment Nation community who were the CROs that they felt everyone should know because of their welcoming nature, openness to connecting folks with others, willingness to share their expertise, and being just all-around awesome folks. Here are the results along with what the community had to say about them.

Test before you build anything or you’ll waste time course-correcting with Rommil Santiago

There’s a lot of talk about how to find things to test, how to analyze tests, and the importance of iterating on tests. This week, I was thinking about how I could add something a little different to the conversation and decided to share my thoughts about when to run a test – particularly when building products. 

Not every insight is derived from an A/B Test with Daniela Marquez

Curiosity needs to be a driver in every experimenter’s toolkit. What is going on in the head of my customer? What is really their job-to-be-done? When buying flowers, we typically think of the standard occasions: Mother’s Day, Valentine’s Day, new baby & sympathy. But if we were to structure our ecommerce website on those occasions alone, we may be addressing the majority, but we’d be missing out on the real motivation behind the purchase as well as other reasons people buy flowers.

What Hawaiian Pizza can teach us about creating a more inclusive CRO industry

Pineapple on pizza. If you ever want to have a heated debate with a group of people, ask them if pineapple belongs on pizza. You’ll hear arguments about how people should be allowed to like what they like and that should be OK, as well as, pizza is XYZ and that anything different cannot beContinue reading “What Hawaiian Pizza can teach us about creating a more inclusive CRO industry”

How Wordle proves that Experimentation works

If you haven’t tried it yet, Wordle is a popular online game where you have to guess a 5-letter word within 6 tries – and it’s quite fun and addictive. Every day there is a new word to guess, and everyone gets the same word. It cleverly lets you post how you solved (or didn’t) the daily puzzle – which often sparks some lovely conversation online. Interestingly, there are a lot of parallels between Wordle and the Craft of Experimentation. Find out how.

Can you run tests on sites with little traffic?

From a pure experimentation perspective – one absolutely can forego using statistics and just see what happens. We can believe the dictionary, the dictionary definition of an experiment is: “a scientific procedure undertaken to make a discovery, test a hypothesis, or demonstrate a known fact.” A scientific procedure (aka the scientific method) states nothing about having to use a statistical approach for analysis. However…

Event Wrap-up: CONVERT – Conversion Optimisation Meetup (Bristol & Bath)

July saw the first event of CONVERT – a Conversion Optimisation Meetup in the South West of England. 

Attended by 20 people, the evening was packed with interesting discussions around user behaviour tools and success stories.  As with most events, a lot of valuable discussions came from networking and this was the perfect evening for that. Whether it was reconnecting with ex-colleagues or meeting someone with a similar role, it was brilliant to see. I for one had gotten too comfortable behind the screen!

Where should I start with testing?

Like with most processes, starting is usually the most challenging part. You know the feeling. It’s when you don’t have your flywheel going quite yet and you’re not sure at what stage to jump in. When it comes to Experimentation, the usual places I see people jump in are at the Research, Hypotheses creation, orContinue reading “Where should I start with testing?”

How to verify your data truly reflects user behaviour with Florent Buisson

Florent Buisson is a decade-long behavioral economist who published a practical guide to behavioral data analysis in business. It’s the book he wished he had when he started in analytics.

In this episode, he shares:

Why intuition can actually be a good thing in data analytics. If you need to know R or Python to understand your users. Why and when causal analytics are important.

How do I change people’s attitudes towards Experimentation?

Of course, there are a million ways to answer this question that range from demonstrating wins, being inclusive, and evangelism. This week, I thought of sharing a couple of the little things you can do that, if done consistently over time, can start to realize gains in the long run. Words matter Experimenters and CROsContinue reading “How do I change people’s attitudes towards Experimentation?”

How to make a better sandwich: An introduction to multivariate testing with Danielle Gunraj

A/B Testing can be intimidating to the uninitiated, but it doesn’t have to be! I want to introduce testing concepts via a real-world scenario that we can all relate to: Dessert. I’ll cover what an MVT is, hypotheses, independent variables, dependent variables, results (of course), and design flaws. And if you need any more convincing, I have four words for you: Monte Cristo Bread Pudding.

Choosing the right A/B testing tool with Product for Product 

Matt Green and Moshe Mikanovsky of Product for Product podcast help you navigate the plethora of A/B testing tools out there.

Whether you’re in product or marketing, listen for a beginner-friendly comparison of tools like Google Optimize, Optimizely, and more.

**This episode, nor those of Product for Product, are endorsements of any of the discussed tools.**

Experiment Cartography :: Building the Perfect Roadmap with Kenya Davis and Krissy Tripp

You can do better than testing button colors, but how do you decide what to test when and what type of test to run? Roadmapping. This session teaches you to be the GPS navigator, helping your team optimize experimentation routes. On this journey you will identify how each path can drive desired impacts by turning a formidable trek into a series of attainable milestones.

How to rally your team around Voice of Customer research with Tracy Laranjo

Tracy is a Toronto-based growth marketer with a knack for conversion optimization. In a past life she’s QA tested “adult” eBooks and helped make it easier for Canadians to write their wills online. Tracy is also one of the co-hosts of the Experiment Nation podcast where she chats with optimizers at the top of their game.

Beyond the 9-5, you can catch her knitting, crushing empires in Civ6, or napping with her cats.

Developing a Culture of Testing/Experimentation with Anil Batra

Anil is a Digital Marketing and Analytics professional with 18+ years of experience. He has worked with companies ranging from startups to Fortune 500 and has helped them improve marketing results as well as develop data driven culture. He has vast experience in Web, Email, Social, Display, Search, Paid Search, and CRM. He holds a B. Tech in Electronics and Communication Engineering from India and an MBA from the University of Washington, Seattle. He is the founder of – A Digital Analytics training and education company.

Best Practices are a starting point – not an excuse to avoid testing

You hear it often, “follow Best Practices” – where a best practice is something that has been generally accepted as the standard way of doing things to help maintain a certain level of quality. Interestingly, you’ll also often hear CROs arguing about them. But why would CROs, who are dedicated to improving the quality ofContinue reading “Best Practices are a starting point – not an excuse to avoid testing”

Where are the users? with Moshe Mikanovsky

When experimenting with our products, we need to find our users but it’s not always that simple! Where do we find the users? In this session Moshe will go over different types of products and different ways to find users for each of them. Coming out of this session, attendees will have some ideas on where to start looking for their users.

How many tests should you run per month?

Collin Crowel recently asked the community, “Is test velocity overrated?“. Where test velocity is the number of tests launched over a period of time. About 70% of respondents said “False” and I’m here to tell you that I’m firmly in the “it depends” camp”. Generally speaking, the goal of any Experimentation program should be toContinue reading “How many tests should you run per month?”

Sina Fak on why CRO is not a person but a multidisciplinary Experimentation team

Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO.

Meta-analysis: Do I have to run my test yet again?

Recently, there’s been a bit of buzz within the experimentation community around the concept of meta-analysis. For those unfamiliar with the concept, in a nutshell, it’s about looking at similar experiments altogether to pull insights. In fact, meta-analysis is actually considered the most trustworthy type of analysis out there. That said, it’s still prone toContinue reading “Meta-analysis: Do I have to run my test yet again?”

We Need More ART in CRO with Jimmy Barber

This session is about the conundrum that “data is everything” – a mentality circulating at large the past couple years. There’s so much data, and we often find ourselves simply staring at metrics looking for “+” or “-” to make decisions. The objective of this session is to draw on thinking strategies from physics, of how to approach CRO differently, without any real “data”, to then gleam positive impacts to CRO.

Moving Beyond Spaghetti Testing with Haley Carpenter

The success of your testing program depends on the quality of your hypotheses. But too many experimentation programs lack the processes and frameworks to move from spaghetti testing to strategic experimentation. Haley shares two practical frameworks to help you form better hypotheses and objectively rank test ideas.

Speero’s Experimentation Maturity Audit with Edgar Spongolts

Speero’s Director of CX Optimization, Edgar Spongolts, dives deep into the influential agency’s Experimentation Maturity Audit and why maturity matters. Learn about the four pillars of a successful experimentation program and what it takes to reach the highest levels of maturity. Take the audit yourself here:

Creating an experimentation program that’s more than A/B testing with Annika Thompson and Paul Randall

Too often experiments are squandered. But if you put customer problems first and design the right type of test you can ensure every experiment is valuable to your business. The following talk will give your experimentation programs guardrails to make sure you’re not testing for testing sake.

Best practices might be killing your experimentation culture – 3 reasons why with Ana Catarina Cizilio

Everybody is doing it, so you have to do it too, right? As my mom used to say: you’re not everyone! Best practices are not experimentation and you should know that. I want to prove to you this is the easy way, but it’s not the right way for a healthy, profitable and experiment-oriented business. These tactics don’t last long.  In this session, we will discuss why, statically, best practices don’t work. It’s fun to know about the competitors, their results and ideas. It may generate new ideas and grab your attention when you’re starting to experiment, but that’s the only good thing. To have a great experiment culture, you need to learn from your tests. Let’s talk more about this?

Ripple Benefits: CRO as the foundation of other digital marketing efforts with Spencer Gray

CRO should be the foundation that all of your other digital marketing efforts rests upon. Through what we call our ‘Ripple Benefits’, I’d love to showcase just how CRO not only improves your conversion rates, but your SEO, Content Marketing, Paid Ads, and more. Testing is key and should be the foundation that drives where your efforts are focused.

CRO não é um profissional e sim um processo (participação especial André Gillich)

Nesse episódio nosso convidado André Gillich, Head of CRO, compartilha sua experiência na Jussi crescendo a cultura de experimentação, começando pela nova abordagem em que “CRO não é um profissional e sim um processo.”Exploramos o impacto da cultura “Agil” e o desafio do foco em outputs não outcomes.Fechamos o podcast de forma prática compartilhando iniciativas tomadas em nossas empresas para acelerar a flywheel de experimentação.

The Science of Business with Jonny Longden

Our industry is focused on the individual elements of what we do and how we do it, but not why we do it and the overall philosophy for it. This is part of the reason that businesses don’t give it the traction it deserves; senior business leaders are not interested in the execution, they’re interested in the overall benefit.

Specsavers’ Steph Le Prevost on growing a top UK CRO program

Steph walks us through the challenges of growing Specsavers’ CRO team and how she overcame them, her experimentation red flags, and her take on if CRO certifications are really worth it. Plus: A comparison of the CRO job market between Canada vs. the UK, including how well you can expect to be paid as an optimizer.