Exam answers for: Mike Harper for June 24 2022 11:29:44 Experiment Nation

Exam answers for: Mike Harper for June 24 2022 11:29:44

If you’d like to score higher on your next attempt, consider checking out these resources.

=======

1. In A/B testing, a "control" is generally which of the following?
Answer Provided: ✓ The version where no changes have been made

Correct Answer: The version where no changes have been made

Comments Entered: NA

2. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ✓ You should never promise any outcomes

Correct Answer: You should never promise any outcomes

Comments Entered: NA

3. Which is NOT a factor in calculating sample size (in Frequentist statistics)?
Answer Provided: ✓ Time

Correct Answer: Time

Comments Entered: NA

4. Which of the following is true about p-values?
Answer Provided: ✓ The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Correct Answer: The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Comments Entered: NA

5. Which of the following describes a "Holdout Group"?
Answer Provided: ✓ A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

6. Which BEST defines "Baseline Conversion"?
Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

7. When writing copy, what is your #1 priority?
Answer Provided: ✓ Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

8. After you have completed your conversion audit and have a list of hypotheses, what is the next step you need to take?
Answer Provided: ✓ Prioritize the hypotheses based on your framework of choice

You might also like:   Mike Harper is an Experiment Nation Certified CRO

Correct Answer: Prioritize the hypotheses based on your framework of choice

Comments Entered: NA

9. Which of the following is NOT a benefit of test iteration?
Answer Provided: ✓ Increased statistical power

Correct Answer: Increased statistical power

Comments Entered: NA

10. What does "MVT" stand for?
Answer Provided: ✓ Multivariate Test

Correct Answer: Multivariate Test

Comments Entered: NA

11. A test has a >50% lift to your primary metric. What is the first thing you should do?
Answer Provided: ✓ Sanity check your results

Correct Answer: Sanity check your results

Comments Entered: NA

12. What should you do before you run an experiment?
Answer Provided: ✓ All answers are correct

Correct Answer: All answers are correct

Comments Entered: NA

13. The "C" in "VOC" stands for which of the following?
Answer Provided: ✓ Customer

Correct Answer: Customer

Comments Entered: NA

14. If a program's ratio of "successful" tests (aka "win rate") to launched tests is constantly 50%, what should you suspect?
Answer Provided: ✓ The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

15. Select the option which BEST completes the following sentence, "Great Experiments ______":
Answer Provided: ✓ Answer business questions

Correct Answer: Answer business questions

Comments Entered: NA

16. Which is NOT a benefit of having "North Star Metric"?
Answer Provided: ✓ They have no sample size requirements

Correct Answer: They have no sample size requirements

Comments Entered: NA

17. Which of the following is an example of "chunking"?
Answer Provided: ✓ Breaking longer text into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

18. Which of the following is a reason to document experiments?
Answer Provided: ✓ All the answers are correct

You might also like:   Results for petar.stefanovic@gmail.com

Correct Answer: All the answers are correct

Comments Entered: NA

19. What is quantitative research NOT used for?
Answer Provided: ✓ Understanding why users are behaving a certain way

Correct Answer: Understanding why users are behaving a certain way

Comments Entered: NA

20. "AIDA" stands for which of the following?
Answer Provided: ✓ Attention, Interest, Desire, Action

Correct Answer: Attention, Interest, Desire, Action

Comments Entered: NA

21. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a 'win'?
Answer Provided: ✓ You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You've saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

22. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ✓ Customers know what it is before landing on your property

Correct Answer: Customers know what it is before landing on your property

Comments Entered: NA

23. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ✓ Test high-impact changes

Correct Answer: Test high-impact changes

Comments Entered: NA

24. Which is NOT a characteristic of "Novelty effects"?
Answer Provided: ✓ New features always perform the best

Correct Answer: New features always perform the best

Comments Entered: NA

25. Which of the following is an example of social proof?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

26. Which of the following is not one of Cialdini's 6 Principles of Persuasion?
Answer Provided: ✓ Humour

Correct Answer: Humour

Comments Entered: NA

27. Which of the following BEST describes "statistical significance"?
Answer Provided: ✓ The probability the result observed was not due to random chance

You might also like:   Exam answers for: Iva Obrovac for June 17 2022 14:39:55

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

28. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ✓ Experiment results do not alter any plans

Correct Answer: Experiment results do not alter any plans

Comments Entered: NA

29. Which of the following is TRUE of best practices?
Answer Provided: ✓ They are a good starting point for ideation and testing

Correct Answer: They are a good starting point for ideation and testing

Comments Entered: NA

30. Heatmaps are what form of data?
Answer Provided: ✓ Quantitative and Qualitative

Correct Answer: Quantitative and Qualitative

Comments Entered: NA





Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which BEST describes why you Read more

Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Results for None

If you'd like to score higher on your next attempt, consider checking out these resources. 1. Which BEST describes an experiment Read more

Results for callumdreniw@outlook.com

If you'd like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign Read more

Rommil Santiago
Cart
  • No products in the cart.