# Results for megankomalley@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. In Frequentist statistics, which of the following is the risk of testing too many KPIs?
Answer Provided: ?Increased chance of a false positive

Correct Answer: Increased chance of a false positive

2. Select the option which BEST completes the following sentence, “Great Experiments ______”:

3. Which is NOT a characteristic of “Novelty effects”?
Answer Provided: ?New features always perform the best

Correct Answer: New features always perform the best

4. What is a Sample Ratio Mismatch?
Answer Provided: ?The observed traffic split is statistically significantly different from what was expected

Correct Answer: The observed traffic split is statistically significantly different from what was expected

5. Which is NOT a valid reason to run an A/A test?

6. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ?What worked for them and their audience

Correct Answer: What worked for them and their audience

7. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ?You are probably not testing something very impactful

Correct Answer: You are probably not testing something very impactful

8. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ?An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

9. What is “flicker”?

10. Which of the following is true about p-values?
Answer Provided: ?p = .05 means that if you reject the null hypothesis, the probability of a type I error (aka false positive) is only 5%

Correct Answer: The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

11. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ?When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

12. What is copywriting for conversion?
Answer Provided: ?Copywriting that compels the reader to perform a specific action

Correct Answer: Copywriting that compels the reader to perform a specific action

13. Which BEST defines “Baseline Conversion”?
Answer Provided: ?The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

14. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ?Only consider best practices

Correct Answer: Only consider best practices

15. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ?You have statistical significance

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

16. Which BEST describes a CTA / call to action?
Answer Provided: ?A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

17. Which of the following is NOT an example of urgency?
Answer Provided: ?Customers like you also liked this.

Correct Answer: Customers like you also liked this.

18. Which of the following CANNOT help you write copy for conversion?

Correct Answer: Mining customer reviews and testimonials.Rewriting competitors’ messaging

19. Which of the following is an example of scarcity?
Answer Provided: ?Only 7 left in stock.

Correct Answer: Only 7 left in stock.

20. When writing copy, what is your #1 priority?
Answer Provided: ?Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

21. What is “bias”?
Answer Provided: ?It is a systemic preference towards something

Correct Answer: It is a systemic preference towards something

22. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ?Experiment results do not alter any plans

Correct Answer: Experiment results do not alter any plans

23. Which generally happens when testing many variants running at once?

24. What does “KPI” stand for?

25. What should you do if you want to experiment on a website with little traffic?

26. Which is a danger of following best practices?
Answer Provided: ?They may not work for you

Correct Answer: They may not work for you

27. Which of the following BEST describes “statistical significance”?
Answer Provided: ?The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

28. Which of the following is a problem with last-touch attribution?
Answer Provided: ?It ignores upper-funnel activities

Correct Answer: It ignores upper-funnel activities

29. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ?Customers know what it is before landing on your property

Correct Answer: Customers know what it is before landing on your property