Exam answers for: Joyca Kuijpers for June 11 2022 16:26:10 Experiment Nation

Exam answers for: Joyca Kuijpers for June 11 2022 16:26:10

If you’d like to score higher on your next attempt, consider checking out these resources.

=======

1. In Frequentist statistics, which of the following is the risk of testing too many KPIs?
Answer Provided: ✓ Increased chance of a false positive

Correct Answer: Increased chance of a false positive

Comments Entered: NA

2. Which is a danger of following best practices?
Answer Provided: ✓ They may not work for you

Correct Answer: They may not work for you

Comments Entered: NA

3. If a program's ratio of "successful" tests (aka "win rate") to launched tests is constantly 50%, what should you suspect?
Answer Provided: ✓ The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

4. Which of the following does NOT describe what an "Experiment" is?
Answer Provided: ✓ A way to permanently change your website

Correct Answer: A way to permanently change your website

Comments Entered: NA

5. Which is NOT a characteristic of "Novelty effects"?
Answer Provided: ✕ Early results observed generally with new visitors.

Correct Answer: New features always perform the best

Comments Entered: NA

6. Which is NOT a valid reason to run an A/A test?
Answer Provided: ✕ To collect data to calculate sample size

Correct Answer: To measure the confidence of your control

Comments Entered: NA

7. What is not a valid CRO option when a site has little traffic?
Answer Provided: ✓ Believe you cannot run any tests

Correct Answer: Believe you cannot run any tests

Comments Entered: NA

8. What does "ARPU" stand for?
Answer Provided: ✓ Average Revenue Per User

Correct Answer: Average Revenue Per User

Comments Entered: NA

9. What is "bias"?
Answer Provided: ✕ When an experimenter believes something to be true

Correct Answer: It is a systemic preference towards something

You might also like:   Exam answers for: Matic Kasnik for June 11 2022 03:29:14

Comments Entered: NA

10. Which of the following describes a "Holdout Group"?
Answer Provided: ✓ A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

11. What does "MVT" stand for?
Answer Provided: ✓ Multivariate Test

Correct Answer: Multivariate Test

Comments Entered: NA

12. When writing copy, what is your #1 priority?
Answer Provided: ✓ Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

13. What is a "hero image"?
Answer Provided: ✓ It is the largest image near the top of a webpage

Correct Answer: It is the largest image near the top of a webpage

Comments Entered: NA

14. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ✓ You are probably not testing something very impactful

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

15. Which of the following is NOT a benefit of test iteration?
Answer Provided: ✕ You get to build off of past learnings

Correct Answer: Increased statistical power

Comments Entered: NA

16. Which BEST defines "Baseline Conversion"?
Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

17. Which BEST describes an experiment "Hypothesis"?
Answer Provided: ✓ An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

18. Which of the following BEST describes "statistical significance"?
Answer Provided: ✓ The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

You might also like:   Exam answers for: Charles Kim for June 13 2022 19:05:23

Comments Entered: NA

19. Which BEST describes why you should always define a "Test Hypothesis"
Answer Provided: ✕ To clearly set a goal to your experiment

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

20. Which of the following is NOT an example of urgency?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

21. Which of the following is an example of scarcity?
Answer Provided: ✓ Only 7 left in stock.

Correct Answer: Only 7 left in stock.

Comments Entered: NA

22. Which of the following is an example of social proof?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

23. Which of the following CANNOT help you write copy for conversion?
Answer Provided: ✓ Rewriting competitors' messaging

Correct Answer: Mining customer reviews and testimonials.Rewriting competitors' messaging

Comments Entered: NA

24. What can we learn from tests run on sites that aren't our own?
Answer Provided: ✓ What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

25. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ✓ Test high-impact changes

Correct Answer: Test high-impact changes

Comments Entered: NA

26. What is qualitative research used for ?
Answer Provided: ✓ Understanding why your users are behaving a certain way

Correct Answer: Understanding why your users are behaving a certain way

Comments Entered: NA

27. After you have completed your conversion audit and have a list of hypotheses, what is the next step you need to take?
Answer Provided: ✓ Prioritize the hypotheses based on your framework of choice

Correct Answer: Prioritize the hypotheses based on your framework of choice

You might also like:   Exam answers for: Mike Harper for June 24 2022 11:29:44

Comments Entered: NA

28. Which of the following is NOT a good strategy for analyzing test results?
Answer Provided: ✓ None of the answers

Correct Answer: None of the answers

Comments Entered: NA

29. A test has a >50% lift to your primary metric. What is the first thing you should do?
Answer Provided: ✓ Sanity check your results

Correct Answer: Sanity check your results

Comments Entered: NA

30. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a 'win'?
Answer Provided: ✓ You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You've saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA





Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which BEST describes why you Read more

Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which BEST describes an experiment Read more

Results for callumdreniw@outlook.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Rommil Santiago
Cart
  • No products in the cart.