Results for john_fava@vanguard.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ✓ You should never promise any outcomes

Correct Answer: You should never promise any outcomes

Comments Entered: NA

2. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ✓ An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

3. Which of the following is a problem with last-touch attribution?
Answer Provided: ✓ It ignores upper-funnel activities

Correct Answer: It ignores upper-funnel activities

Comments Entered: NA

4. Which is NOT a factor in calculating sample size (in Frequentist statistics)?
Answer Provided: ✓ Time

Correct Answer: Time

Comments Entered: NA

5. Which of the following is an example of social proof?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

6. What does “ARPU” stand for?
Answer Provided: ✕ Annual Revenue Per User

Correct Answer: Average Revenue Per User

Comments Entered: NA

7. What is a Sample Ratio Mismatch?
Answer Provided: ✕ The expected traffic split does not match sample size requirements

Correct Answer: The observed traffic split is statistically significantly different from what was expected

Comments Entered: NA

8. Which of the following characterizes Value Propositions and Unique Selling Propositions?
Answer Provided: ✓ It is that very reason which motivates a buyer to purchase that product

Correct Answer: It is that very reason which motivates a buyer to purchase that product

Comments Entered: NA

9. Which of the following is an example of scarcity?
Answer Provided: ✓ Only 7 left in stock.

Correct Answer: Only 7 left in stock.

Comments Entered: NA

10. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ✓ The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

You might also like:   Exam answers for: Brad Croasdell for May 30 2022 11:22:30

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

11. Which of the following BEST describes “statistical significance”?
Answer Provided: ✓ The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

12. Which of the following describes a “Holdout Group”?
Answer Provided: ✓ A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

13. What does “KPI” stand for?
Answer Provided: ✓ Key Performance Indicator

Correct Answer: Key Performance Indicator

Comments Entered: NA

14. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ✓ You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

15. What is qualitative research used for ?
Answer Provided: ✓ Understanding why your users are behaving a certain way

Correct Answer: Understanding why your users are behaving a certain way

Comments Entered: NA

16. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ✓ What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

18. In A/B testing, a “control” is generally which of the following?
Answer Provided: ✓ The version where no changes have been made

Correct Answer: The version where no changes have been made

Comments Entered: NA

19. Which of the following is an example of “chunking”?
Answer Provided: ✓ Breaking longer text into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

20. Which BEST describes a CTA / call to action?
Answer Provided: ✓ A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

Comments Entered: NA

21. After you have completed your conversion audit and have a list of hypotheses, what is the next step you need to take?
Answer Provided: ✓ Prioritize the hypotheses based on your framework of choice

Correct Answer: Prioritize the hypotheses based on your framework of choice

Comments Entered: NA

22. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ✓ To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

23. What is a false negative?
Answer Provided: ✓ It is when you don't detect an effect when one exists

Correct Answer: It is when you don’t detect an effect when one exists

Comments Entered: NA

24. Which of the following is not a popular prioritization framework?
Answer Provided: ✓ SWOT

Correct Answer: SWOT

Comments Entered: NA

26. Which of the following is NOT a good strategy for analyzing test results?
Answer Provided: ✓ None of the answers

Correct Answer: None of the answers

Comments Entered: NA

27. What does “MVT” stand for?
Answer Provided: ✓ Multivariate Test

Correct Answer: Multivariate Test

Comments Entered: NA

28. What should you do before you run an experiment?
Answer Provided: ✓ All answers are correct

Correct Answer: All answers are correct

Comments Entered: NA

29. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ✕ Experiment interaction is harder to plan for

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

30. Which BEST defines “Baseline Conversion”?
Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA




Lee Bradshaw is an Experiment Nation Certified CRO

Lee Bradshaw has successfully passed the CRO Qualification Exam on August 12 2022 and is a Certified CRO. Learn more Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which of the following is Read more

Anton Graichen is an Experiment Nation Certified CRO

Anton Graichen has successfully passed the CRO Qualification Exam on August 08 2022 and is a Certified CRO. Learn more Read more