Results for hello@ashnarana.co

If you’d like to score higher on your next attempt, consider checking out these resources.

1. Which is a benefit of testing extreme changes?
Answer Provided: ✓ Generating stronger signals to measure

Correct Answer: Generating stronger signals to measure

Comments Entered: NA

2. What is a “hero image”?
Answer Provided: ✓ It is the largest image near the top of a webpage

Correct Answer: It is the largest image near the top of a webpage

Comments Entered: NA

3. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ✓ You should never promise any outcomes

Correct Answer: You should never promise any outcomes

Comments Entered: NA

4. Which of the following describes a “Holdout Group”?
Answer Provided: ✓ A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

5. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ✓ When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

Comments Entered: NA

6. Bayesian and Frequentist are which of the following?
Answer Provided: ✓ Schools of thought in statistics

Correct Answer: Schools of thought in statistics

Comments Entered: NA

7. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ✓ Customers know what it is before landing on your property

Correct Answer: Customers know what it is before landing on your property

Comments Entered: NA

8. What does “ARPU” stand for?
Answer Provided: ✓ Average Revenue Per User

Correct Answer: Average Revenue Per User

Comments Entered: NA

10. What is “bias”?
Answer Provided: ✓ It is a systemic preference towards something

Correct Answer: It is a systemic preference towards something

Comments Entered: NA

11. What is Peeking?
Answer Provided: ✕ Looking at test results before the test is complete.

Correct Answer: Looking at test results before the test is complete with the intention of ending the test.

Comments Entered: NA

12. Heatmaps are what form of data?
Answer Provided: ✓ Quantitative and Qualitative

Correct Answer: Quantitative and Qualitative

Comments Entered: NA

13. Which of the following is not one of Cialdini’s 6 Principles of Persuasion?
Answer Provided: ✕ Liking

Correct Answer: Humour

Comments Entered: NA

14. Which of the following BEST describes “statistical significance”?
Answer Provided: ✓ The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

15. Which BEST describes a CTA / call to action?
Answer Provided: ✓ A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

Comments Entered: NA

16. Which BEST defines “Baseline Conversion”?
Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

17. The “C” in “VOC” stands for which of the following?
Answer Provided: ✕ Confidence

Correct Answer: Customer

Comments Entered: NA

19. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ✕ Your confidence interval becomes narrower

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

20. What should you do before you run an experiment?
Answer Provided: ✓ All answers are correct

Correct Answer: All answers are correct

Comments Entered: NA

21. Which of the following is NOT an example of urgency?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

22. Which is NOT a characteristic of “Novelty effects”?
Answer Provided: ✓ New features always perform the best

Correct Answer: New features always perform the best

Comments Entered: NA

23. Which generally happens when testing many variants running at once?
Answer Provided: ✕ It is harder to measure

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

24. Which of the following is a reason to document experiments?
Answer Provided: ✓ All the answers are correct

Correct Answer: All the answers are correct

Comments Entered: NA

25. Which of the following is an example of “chunking”?
Answer Provided: ✓ Breaking longer text into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

26. What is a Sample Ratio Mismatch?
Answer Provided: ✕ The expected traffic split does not match sample size requirements

Correct Answer: The observed traffic split is statistically significantly different from what was expected

Comments Entered: NA

28. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ✓ What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

29. “AIDA” stands for which of the following?
Answer Provided: ✓ Attention, Interest, Desire, Action

Correct Answer: Attention, Interest, Desire, Action

Comments Entered: NA

30. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ✕ Statistically significant results are better than 'flat' results

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA




Lee Bradshaw is an Experiment Nation Certified CRO

Lee Bradshaw has successfully passed the CRO Qualification Exam on August 12 2022 and is a Certified CRO. Learn more Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Results for lee.bradshaw@gmail.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which of the following is Read more

Anton Graichen is an Experiment Nation Certified CRO

Anton Graichen has successfully passed the CRO Qualification Exam on August 08 2022 and is a Certified CRO. Learn more Read more