Results for thewilson2000@hotmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. Which is NOT a valid reason to run an A/A test?
Answer Provided: ✕ To demonstrate the problem with “peeking”

Correct Answer: To measure the confidence of your control

Comments Entered: NA

2. In A/B testing, a “control” is generally which of the following?
Answer Provided: ✓ The version where no changes have been made

Correct Answer: The version where no changes have been made

Comments Entered: NA

3. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ✓ To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

4. Which is NOT a benefit of having “North Star Metric”?
Answer Provided: ✓ They have no sample size requirements

Correct Answer: They have no sample size requirements

Comments Entered: NA

5. Which of the following describes a “Holdout Group”?
Answer Provided: ✓ A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

6. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ✓ Customers know what it is before landing on your property

Correct Answer: Customers know what it is before landing on your property

Comments Entered: NA

7. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ✓ Experiment results do not alter any plans

Correct Answer: Experiment results do not alter any plans

Comments Entered: NA

9. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ✓ You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

10. What should you do before you run an experiment?
Answer Provided: ✓ All answers are correct

Correct Answer: All answers are correct

Comments Entered: NA

11. What is not a valid CRO option when a site has little traffic?
Answer Provided: ✓ Believe you cannot run any tests

Correct Answer: Believe you cannot run any tests

Comments Entered: NA

12. Which of the following is an example of social proof?
Answer Provided: ✕ Save now!

Correct Answer: Customers like you also liked this.

Comments Entered: NA

13. What is Peeking?
Answer Provided: ✓ Looking at test results before the test is complete with the intention of ending the test.

Correct Answer: Looking at test results before the test is complete with the intention of ending the test.

Comments Entered: NA

14. Which of the following is not a popular prioritization framework?
Answer Provided: ✓ SWOT

Correct Answer: SWOT

Comments Entered: NA

15. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ✓ Only consider best practices

Correct Answer: Only consider best practices

Comments Entered: NA

16. Which of the following is NOT a good strategy for analyzing test results?
Answer Provided: ✓ None of the answers

Correct Answer: None of the answers

Comments Entered: NA

18. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ✕ The CRO is testing on a mature website/product

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

19. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ✓ When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

Comments Entered: NA

20. What is copywriting for conversion?
Answer Provided: ✓ Copywriting that compels the reader to perform a specific action

Correct Answer: Copywriting that compels the reader to perform a specific action

Comments Entered: NA

21. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ✕ Nothing

Correct Answer: What worked for them and their audience

Comments Entered: NA

22. Which of the following is an example of “chunking”?
Answer Provided: ✓ Breaking longer text into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

23. What does “KPI” stand for?
Answer Provided: ✓ Key Performance Indicator

Correct Answer: Key Performance Indicator

Comments Entered: NA

24. Which of the following characterizes Value Propositions and Unique Selling Propositions?
Answer Provided: ✕ It is one of the benefits a product has that other products also have

Correct Answer: It is that very reason which motivates a buyer to purchase that product

Comments Entered: NA

26. Which is NOT a factor in calculating sample size (in Frequentist statistics)?
Answer Provided: ✓ Time

Correct Answer: Time

Comments Entered: NA

27. What is quantitative research NOT used for?
Answer Provided: ✓ Understanding why users are behaving a certain way

Correct Answer: Understanding why users are behaving a certain way

Comments Entered: NA

28. Which generally happens when testing many variants running at once?
Answer Provided: ✓ The power of your experiment decreases drastically

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

29. If there is no meaningful difference between your control and variation in terms of your success metric, which of the following should you decide?
Answer Provided: ✕ The test was inconclusive

Correct Answer: It depends on the hypothesis

Comments Entered: NA

30. “AIDA” stands for which of the following?
Answer Provided: ✓ Attention, Interest, Desire, Action

Correct Answer: Attention, Interest, Desire, Action

Comments Entered: NA




Lee Bradshaw is an Experiment Nation Certified CRO

Lee Bradshaw has successfully passed the CRO Qualification Exam on August 12 2022 and is a Certified CRO. Learn more Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which of the following is Read more

Anton Graichen is an Experiment Nation Certified CRO

Anton Graichen has successfully passed the CRO Qualification Exam on August 08 2022 and is a Certified CRO. Learn more Read more