Of course, there are a million ways to answer this question that range from demonstrating wins, being inclusive, and evangelism. This week, I thought of sharing a couple of the little things you can do that, if done consistently over time, can start to realize gains in the long run.
Words matter
Experimenters and CROs often say that learning matters, but at the same time, when seeing a test that didn’t go the way they wanted, say something like “At least we learned something.” Let’s take a second to reflect on that sentence. “At least” implies something minimally acceptable, like a consolation prize. I implore you to think about putting learning at the forefront of how you speak to your clients and stakeholders. Something like, “Now we know” is far more powerful. It implies that experimentation, regardless of the outcome, is a step forward. Running a test is in of itself progress.
Framing can help remove bias
Georgi Georgiev recently posted about the importance of “blinding” – where you essentially don’t share which treatment was the control and which was the challenger. They are rather presented equally as variants. While this won’t work in all cases, there is great value in doing this. More often than not, it helps to remove biases in interpreting results. One should not underestimate an audience’s attachment to solutions – especially those they were involved in building. Blinding helps you facilitate the focus on the proper interpretation of the results – which helps you and your place of work get that much closer to making more evidence-based decisions.
See you in 2 weeks,
Rommil Santiago
Founder, Experiment Nation
Connect with Experimenters from around the world
We’ll highlight our latest members throughout our site, shout them out on LinkedIn, and for those who are interested, include them in an upcoming profile feature on our site.
Advertisment
Categories
- Adventures in Experimentation (9)
- Analysis (2)
- Announcements (48)
- Ask the Experiment Nation (11)
- Certified CROs (193)
- Community (2)
- Conversation Starters (2)
- CR-No (5)
- CRO Handbook (4)
- CRO Memes (18)
- Experiment Nation: The Conference RELOADED (41)
- Experimentation from around the world (2)
- For LinkedIn (121)
- Frameworks (2)
- Growth (14)
- ICYMI (2)
- Interviews with Experimenters (167)
- Management (1)
- Marketing (11)
- Opinion (8)
- Podcasts with Experimenters (15)
- Point/Counterpoint (1)
- Product Experimentation (5)
- Product Management (9)
- Profile (9)
- Question of the week (5)
- Sponsored by Experiment Nation (1)
- The Craft of Experimentation (1)
- The Cultures of Experimentation (1)
- The weekly buzz (13)
- The year in review (1)
- Uncategorized (352)
- Weekly Newsletter (183)
- Where I Started (2)
- Making the case for data-backed design featuring Brian Massey - September 30, 2023
- Announcing the 2023 Conference Awards - September 24, 2023
- How to Maximize Hypotheses Testing ft. Eduardo Marconi Pinheiro Lima - September 9, 2023