Exam answers for: Edd Saunders for May 18 2022 10:40:08 Experiment Nation

Exam answers for: Edd Saunders for May 18 2022 10:40:08


 

 

If you’d like to score higher on your next attempt, consider checking out these resources.

=======

 

 
1. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: βœ“ You’ve saved the business time and money which they might have by implementing this costly feature

 

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

 
2. Which of the following is an example of scarcity?
Answer Provided: βœ“ Only 7 left in stock.

 

Correct Answer: Only 7 left in stock.

Comments Entered: NA

 
3. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: βœ“ To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

 

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

 
4. What should you do if you want to experiment on a website with little traffic
Answer Provided: βœ“ Test high-impact changes

 

Correct Answer: Test high-impact changes

Comments Entered: NA

 
5. What is a “Bonferroni Correction”?
Answer Provided: βœ“ A way to control for false positives when analyzing multiple metrics

 

Correct Answer: A way to control for false positives when analyzing multiple metrics

Comments Entered: NA

 
6. Which is NOT a benefit of having “North Star Metric”?
Answer Provided: βœ“ They have no sample size requirements

 

Correct Answer: They have no sample size requirements

Comments Entered: NA

 
7. The “C” in “VOC” stands for which of the following?
Answer Provided: βœ“ Customer

 

Correct Answer: Customer

Comments Entered: NA

 
8. Which is a benefit of testing extreme changes?
Answer Provided: βœ“ Generating stronger signals to measure
You might also like:   Exam answers for: Juanma Varo for May 30 2022 11:25:39

 

Correct Answer: Generating stronger signals to measure

Comments Entered: NA

 
9. Which BEST describes an experiment “Hypothesis”?
Answer Provided: βœ“ An educated guess as to what will happen during your experiment

 

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

 
10. Which of the following is NOT an example of urgency?
Answer Provided: βœ“ Customers like you also liked this.

 

Correct Answer: Customers like you also liked this.

Comments Entered: NA

 
11. Which of the following is not a popular prioritization framework?
Answer Provided: βœ“ SWOT

 

Correct Answer: SWOT

Comments Entered: NA

 
12. What does “MVT” stand for?
Answer Provided: βœ“ Multivariate Test

 

Correct Answer: Multivariate Test

Comments Entered: NA

 
13. Which of the following BEST describes “statistical significance”?
Answer Provided: βœ“ The probability the result observed was not due to random chance

 

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

 
14. Which is NOT a factor in calculating sample size (in Frequentist statistics)?
Answer Provided: βœ“ Time

 

Correct Answer: Time

Comments Entered: NA

 
15. What can we learn from tests run on sites that aren’t our own?
Answer Provided: βœ“ What worked for them and their audience

 

Correct Answer: What worked for them and their audience

Comments Entered: NA

 
16. Which is a danger of following best practices?
Answer Provided: βœ“ They may not work for you

 

Correct Answer: They may not work for you

Comments Entered: NA

 
17. According to Cialdini, how many Principles of Persuasion are there?
Answer Provided: βœ“ 6

 

Correct Answer: 6

Comments Entered: NA

 
18. Which of the following defines is a Value Proposition / Unique Selling Proposition?
Answer Provided: βœ“ It is that very reason which motivates a buyer to purchase that product even though it might be costlier than other products
You might also like:   Exam answers for: Michael Johnstone for June 23 2022 12:00:27

 

Correct Answer: It is that very reason which motivates a buyer to purchase that product even though it might be costlier than other products

Comments Entered: NA

 
19. Which of the following is a problem with last-touch attribution?
Answer Provided: βœ• It over-represents the impact of brand campaigns

 

Correct Answer: It ignores upper-funnel activities

Comments Entered: NA

 
20. Which of the following describes a “Holdout Group”?
Answer Provided: βœ“ A control group that does not get exposed to a treatment/variation

 

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

 
21. What is a false negative?
Answer Provided: βœ“ It is when you don’t detect an effect when one exists

 

Correct Answer: It is when you don’t detect an effect when one exists

Comments Entered: NA

 
22. Which generally happens when testing many variants running at once?
Answer Provided: βœ“ The power of your experiment decreases drastically

 

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

 
23. What is a Sample Ratio Mismatch?
Answer Provided: βœ• When the ratio of alpha and beta aren’t as expected

 

Correct Answer: The observed traffic split is statistically significantly different from what was expected

Comments Entered: NA

 
24. What is “flicker”?
Answer Provided: βœ“ When the contents of a variation visibily change during loading because your testing tool is overriding existing code

 

Correct Answer: When the contents of a variation visibily change during loading because your testing tool is overriding existing code

Comments Entered: NA

 
25. Bayesian and Frequentist are which of the following?
Answer Provided: βœ“ Schools of thought in statistics
You might also like:   Exam answers for: Nicolai HΓΈg for June 15 2022 13:52:17

 

Correct Answer: Schools of thought in statistics

Comments Entered: NA

 
26. Which of the following does NOT describe what an “Experiment” is?
Answer Provided: βœ“ A way to permanently change your website

 

Correct Answer: A way to permanently change your website

Comments Entered: NA

 
27. What should you do before you run an experiment?
Answer Provided: βœ“ All answers are correct

 

Correct Answer: All answers are correct

Comments Entered: NA

 
28. What does “KPI” stand for?
Answer Provided: βœ“ Key Performance Indicator

 

Correct Answer: Key Performance Indicator

Comments Entered: NA

 
29. Which of the following is not one of Cialdini’s 6 Principles of Persuasion?
Answer Provided: βœ“ Humour

 

Correct Answer: Humour

Comments Entered: NA

 
30. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: βœ“ The CRO is not testing meaningful hypotheses

 

Correct Answer: The CRO is not testing meaningful hypotheses

Comments Entered: NA

 

Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1.Β Which BEST describes why you Read more

Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1.Β What is NOT a sign Read more

Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1.Β Which BEST describes an experiment Read more

Results for callumdreniw@outlook.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1.Β What is NOT a sign Read more

rsadmin3000
Latest posts by rsadmin3000 (see all)
Cart
  • No products in the cart.