Seven lessons from running 22,000 AB tests with Ayat Shukairy - Experiment Nation

Seven lessons from running 22,000 AB tests with Ayat Shukairy

Home / Experiment Nation: The Conference RELOADED / Seven lessons from running 22,000 AB tests with Ayat Shukairy

The average success rate of most AB testing programs hovers around 12%. Yep, for every 100 experiments you run, only 12 of them will generate an increase in conversions. That is worse than a coin toss.

Too many companies start AB testing hoping that it will deliver a great increase in conversions. A few months later, they are bitterly disappointed.

In this session, I will share the lessons we learned by analyzing over 22,000 AB tests on 700 CRO projects. These lessons paint the common patterns that helped us deliver upwards of 50% success rates on AB testing programs.

The lessons provide a strategic roadmap for a CRO project as well as tactical details needed while running the day-to-day operations.

Key takeaways

  • Attendees will learn what it really takes to run a successful CRO program (Time, resource, management, etc).
  • Attendees will learn the right balance between strategy and tactics when running an experimentation program.
  • Attendees will see an actual project management board running a CRO program


Connect with Experimenters from around the world

We’ll highlight our latest members throughout our site, shout them out on LinkedIn, and for those who are interested, include them in an upcoming profile feature on our site.

You may also like

Experiment Nation: The Conference Reloaded :: We Need More ART in CRO with Jimmy Barber

This session is about the conundrum that “data is everything” – a mentality circulating at large the past couple years. Read more

Symplify’s Mika Sano Janze shares her advice for those looking to get into CRO

Symplify's Mika Sano Janze shares her advice for those looking to get into CRO

Experiment Nation: The Conference Reloaded :: Moving Beyond Spaghetti Testing with Haley Carpenter

The success of your testing program depends on the quality of your hypotheses. But too many experimentation programs lack the Read more

Experiment Nation: The Conference Reloaded :: What is product growth? Creating & Navigating the path to product growth with Aditi Gupta

Aditi Gupta covers the creation of a growth roadmap/ how to build alignment with stakeholders/ creating an org-wide impact.