Results for milesw@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ✓ The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

2. What should you do before you run an experiment?
Answer Provided: ✓ All answers are correct

Correct Answer: All answers are correct

Comments Entered: NA

3. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ✓ An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

4. Which of the following is an example of scarcity?
Answer Provided: ✓ Only 7 left in stock.

Correct Answer: Only 7 left in stock.

Comments Entered: NA

5. In A/B testing, a “control” is generally which of the following?
Answer Provided: ✓ The version where no changes have been made

Correct Answer: The version where no changes have been made

Comments Entered: NA

6. What is Peeking?
Answer Provided: ✓ Looking at test results before the test is complete with the intention of ending the test.

Correct Answer: Looking at test results before the test is complete with the intention of ending the test.

Comments Entered: NA

7. Which of the following does NOT describe what an “Experiment” is?
Answer Provided: ✓ A way to permanently change your website

Correct Answer: A way to permanently change your website

Comments Entered: NA

9. Which of the following is TRUE of best practices?
Answer Provided: ✓ They are a good starting point for ideation and testing

Correct Answer: They are a good starting point for ideation and testing

Comments Entered: NA

10. Heatmaps are what form of data?
Answer Provided: ✓ Quantitative and Qualitative

Correct Answer: Quantitative and Qualitative

Comments Entered: NA

11. Which of the following is an example of social proof?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

12. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ✓ Experiment results do not alter any plans

Correct Answer: Experiment results do not alter any plans

Comments Entered: NA

13. “PMF” stands for which of the following?
Answer Provided: ✓ Product-Market Fit

Correct Answer: Product-Market Fit

Comments Entered: NA

14. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ✓ You are probably not testing something very impactful

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

15. Bayesian and Frequentist are which of the following?
Answer Provided: ✓ Schools of thought in statistics

Correct Answer: Schools of thought in statistics

Comments Entered: NA

16. What does “KPI” stand for?
Answer Provided: ✓ Key Performance Indicator

Correct Answer: Key Performance Indicator

Comments Entered: NA

18. Which of the following is NOT an example of urgency?
Answer Provided: ✕ Save now!

Correct Answer: Customers like you also liked this.

Comments Entered: NA

19. When writing copy, what is your #1 priority?
Answer Provided: ✕ Using the right keywords

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

20. What is a false negative?
Answer Provided: ✓ It is when you don't detect an effect when one exists

Correct Answer: It is when you don’t detect an effect when one exists

Comments Entered: NA

21. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ✕ To clearly set a goal to your experiment

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

22. Which of the following CANNOT help you write copy for conversion?
Answer Provided: ✓ Rewriting competitors' messaging

Correct Answer: Mining customer reviews and testimonials.Rewriting competitors’ messaging

Comments Entered: NA

23. Which generally happens when testing many variants running at once?
Answer Provided: ✓ The power of your experiment decreases drastically

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

24. A test has a >50% lift to your primary metric. What is the first thing you should do?
Answer Provided: ✓ Sanity check your results

Correct Answer: Sanity check your results

Comments Entered: NA

25. Which BEST defines “Baseline Conversion”?
Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

27. Which of the following is a problem with last-touch attribution?
Answer Provided: ✓ It ignores upper-funnel activities

Correct Answer: It ignores upper-funnel activities

Comments Entered: NA

28. Confidence levels must be which of the following?
Answer Provided: ✓ Set based on the needs of an experiment

Correct Answer: Set based on the needs of an experiment

Comments Entered: NA

29. What does “MVT” stand for?
Answer Provided: ✓ Multivariate Test

Correct Answer: Multivariate Test

Comments Entered: NA

30. Which of the following is a reason to document experiments?
Answer Provided: ✓ All the answers are correct

Correct Answer: All the answers are correct

Comments Entered: NA




Lee Bradshaw is an Experiment Nation Certified CRO

Lee Bradshaw has successfully passed the CRO Qualification Exam on August 12 2022 and is a Certified CRO. Learn more Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which of the following is Read more

Anton Graichen is an Experiment Nation Certified CRO

Anton Graichen has successfully passed the CRO Qualification Exam on August 08 2022 and is a Certified CRO. Learn more Read more