Results for carol.vignoli@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ✓ An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

2. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ✕ Your p-values are likely to decrease

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

3. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ✕ The CRO is testing on a mature website/product

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

4. What is copywriting for conversion?
Answer Provided: ✓ Copywriting that compels the reader to perform a specific action

Correct Answer: Copywriting that compels the reader to perform a specific action

Comments Entered: NA

5. What is qualitative research used for ?
Answer Provided: ✓ Understanding why your users are behaving a certain way

Correct Answer: Understanding why your users are behaving a certain way

Comments Entered: NA

6. In A/B testing, a “control” is generally which of the following?
Answer Provided: ✓ The version where no changes have been made

Correct Answer: The version where no changes have been made

Comments Entered: NA

7. What is “flicker”?
Answer Provided: ✓ When the contents of a variation visibily change during loading because your testing tool is overriding existing code

Correct Answer: When the contents of a variation visibily change during loading because your testing tool is overriding existing code

Comments Entered: NA

8. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ✓ You've saved the business time and money which they might have by implementing this costly feature

You might also like:   Results for fabricio.migues@gmail.com

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

9. Which BEST describes a CTA / call to action?
Answer Provided: ✓ A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

Comments Entered: NA

10. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ✓ What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

11. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ✓ Only consider best practices

Correct Answer: Only consider best practices

Comments Entered: NA

12. Which of the following is an example of social proof?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

13. Which of the following is NOT a benefit of test iteration?
Answer Provided: ✕ With luck, you can reuse some assets – saving you time

Correct Answer: Increased statistical power

Comments Entered: NA

14. Confidence levels must be which of the following?
Answer Provided: ✕ Over 95%

Correct Answer: Set based on the needs of an experiment

Comments Entered: NA

15. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ✕ Ideally, it should be different from your competitors

Correct Answer: Customers know what it is before landing on your property

Comments Entered: NA

17. Which of the following describes a “Holdout Group”?
Answer Provided: ✓ A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

18. Which of the following is an example of “chunking”?
Answer Provided: ✕ Breaking a long funnel into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

19. Which of the following does NOT describe what an “Experiment” is?
Answer Provided: ✕ A method to demonstrate a known fact

Correct Answer: A way to permanently change your website

Comments Entered: NA

20. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ✓ You should never promise any outcomes

Correct Answer: You should never promise any outcomes

Comments Entered: NA

21. Which of the following is NOT an example of urgency?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

22. Heatmaps are what form of data?
Answer Provided: ✓ Quantitative and Qualitative

Correct Answer: Quantitative and Qualitative

Comments Entered: NA

23. In Frequentist statistics, which of the following is the risk of testing too many KPIs?
Answer Provided: ✕ The prior may become invalid

Correct Answer: Increased chance of a false positive

Comments Entered: NA

24. Which of the following is TRUE of best practices?
Answer Provided: ✓ They are a good starting point for ideation and testing

Correct Answer: They are a good starting point for ideation and testing

Comments Entered: NA

26. Which of the following is an example of scarcity?
Answer Provided: ✓ Only 7 left in stock.

Correct Answer: Only 7 left in stock.

Comments Entered: NA

27. Which generally happens when testing many variants running at once?
Answer Provided: ✕ It is harder to measure

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

28. What does “MVT” stand for?
Answer Provided: ✕ Multi-Variation Test

Correct Answer: Multivariate Test

Comments Entered: NA

29. Which of the following is NOT a good strategy for analyzing test results?
Answer Provided: ✓ None of the answers

Correct Answer: None of the answers

Comments Entered: NA

30. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ✕ When a user interacts with a component in a test

Correct Answer: When one experiment impacts the outcome of another

Comments Entered: NA




Lee Bradshaw is an Experiment Nation Certified CRO

Lee Bradshaw has successfully passed the CRO Qualification Exam on August 12 2022 and is a Certified CRO. Learn more Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which of the following is Read more

Anton Graichen is an Experiment Nation Certified CRO

Anton Graichen has successfully passed the CRO Qualification Exam on August 08 2022 and is a Certified CRO. Learn more Read more