Amazon’s Joey Herzberg on ensuring that work is always aligned with what the customer wants

Home / Interviews with Experimenters / Amazon’s Joey Herzberg on ensuring that work is always aligned with what the customer wants

Hi Joey, thanks so much for taking the time to chat with us! How have you been?

Hi Rommil, thanks for having me. I have been doing great, enjoying this beautiful spring weather and of course running lots of experiments.

Let’s start. I’d love to learn more about you. Could you tell us a bit about yourself?

I currently work at Amazon Web Services (AWS) as a website optimization manager. AWS provides on-demand cloud computing services to businesses all over the world. My role serves the marketing website to assist stakeholders in finding ways to optimize the customer experience through data analysis and iterative testing. I have been working in the optimization space since 2015 and prior to that was a front-end web designer. To me, optimization was a perfect segue, which allowed me to validate my designs using A/B testing and qualitative data.

So… I guess you don’t have any issues with traffic then lol. I’m jealous. Obviously, Amazon is well known for its Experimentation culture. Is there something that you feel that they do right (that you can speak about) from a cultural perspective that we can learn from?

Amazon is heavily customer-focused and works hard to earn their trust. We use data in every decision we make on the website to make informed decisions in order to deliver the highest quality product to our customers. The culture at Amazon thrives off of experimentation and finding bold ways to develop products and experiences that delight its customers. 

READ  ConvertCart's Shaivi Sahay on figuring out what to test first

You can never go wrong with a customer focus. In your opinion, how do the worlds of design and experimentation fit together and how can we do a better job in leveraging both in our work?

Design and experimentation work closely together to create better experiences for our customers. It’s critical that designs are validated using experimentation to understand the impact to the business and the customer experience. I enjoy collaborating with the design team to create new experiences for tests that closely follow brand guidelines and UX best practices.


Connect with members of the Experiment Nation Directory
PhotoNameLocationShort Bio / SpecialitiesLinkedIn URL
Jon MacDonald Portland, OR USA Ecommerce conversion rate optimization
Rodrigo Carnicero Ungría Greater Madrid Metropolitan Area I have been working on digital marketing projects since 2015. Always working on get traffic, mainly from search engines, and basing decision-making on data. Since the end of 2019, my work has been focused on generating greater benefits for the companies we work for. Specialities: CRO, Web Analyst, SEO, PPC
Zharina Pelea Vancouver, Canada Self-motivated Digital Strategist and Marketer with an MBA & 5 years’ experience leading digital Conversion Rate Optimization (CRO) strategies, driving business growth for brands across various verticals (e.g. travel, ecommerce, financial services, B2B, transport, entertainment). Digitally savvy with a passion for the digital landscape and making data-informed decisions. Always up to date with market trends and tools, possessing a working knowledge of platforms like Google Analytics, Optimizely, VWO, Maxymiser, etc. Effective communicator known for building strong relationships with clients & collaborating with internal tech teams to develop and implement solid CRO & digital marketing strategies. Skilled at anticipating and addressing clients’ needs with more than 12 years’ experience in account management. Proven experience of leading successful CRO programs, leading to clients increasing their investment in the ongoing programs.
READ  2021 sneak preview

As someone who prides themselves on leveraging Experimentation to improve the customer experience, how do you go about ensuring that your work is always inline with what the customer wants?  

The backbone to every good experiment is using meaningful data to understand the customer’s intent. Having a good mix of quantitative and qualitative data allows me to provide recommendations that keeps the customer top of mind when optimizing the website. User research sessions are a great way to quickly understand what resonates with your website visitors. Many times I will use this research as a foundation for the hypothesis when setting up an experiment.  

Changing gears a bit. I’ve read that you are a FAA-certified drone pilot and shoot commercial footage. Tell us a bit about that and do you have any gigs that you’re particularly proud of?

I have been flying drones for commercial and recreational purposes over the past 5 years. What started out as a hobby ended up being a side hustle that allowed me to flex my creative muscles in a different way. I’m most proud of a promo video that I shot and edited for one of the southeast’s largest real estate companies. The footage was used on their website homepage and on billboards.

Wow, that’s amazing! I’m really interested in drone photography, but I’m always too scared I’ll wreck it. I’m terrible at remote-controlled things.

READ  Don’t call us CROs: A panel with Shiva Manjunath, Kenya Davis, Chad Sanderson, Scott Olivares, and Jonas Alves

Finally, it’s time for the Lightning Round!

Are you a Bayesian or a Frequentist?

That’s kind of a personal question… j/k… Bayesian for sure.

If you couldn’t work in Experimentation, what would you do?

I previously worked in UX design and have a robust background in front-end web development. My passion is experimentation but my fallback is customer-driven UX design. 

Describe Joey in 5 words or less.

Creative, Resourceful, Driven, Funny, Scrappy.

Thanks for taking the time to chat today!

Connect with Experimenters from around the world

We’ll highlight our latest members throughout our site, shout them out on LinkedIn, and for those who are interested, include them in an upcoming profile feature on our site.

You may also like

The weekly buzz: June 16, 2021

👉 How to Measure the Impact of Changes to the Digital Experience by Andrew Millett from Blast Analytics 👉 Don’t Be Intimidated By Read more

ConvertCart’s Shaivi Sahay on figuring out what to test first

Learn about how Shaivi approaches new CRO challenges.

Maulin Shah shares his key elements of an experimentation roadmap

Maulin Shah shares his key elements of an experiment-driven roadmap

Willful’s Tracy Laranjo on how the Experimentation Community has made her a better Experimenter

Tracy also shares a peek behind the curtain of what it's like to work on Experiment Nation.