Results for megankomalley@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. In Frequentist statistics, which of the following is the risk of testing too many KPIs?
Answer Provided: ?Increased chance of a false positive

Correct Answer: Increased chance of a false positive

Comments Entered: NA

2. Select the option which BEST completes the following sentence, “Great Experiments ______”:
Answer Provided: ?Answer business questions

Correct Answer: Answer business questions

Comments Entered: NA

3. Which is NOT a characteristic of “Novelty effects”?
Answer Provided: ?New features always perform the best

Correct Answer: New features always perform the best

Comments Entered: NA

4. What is a Sample Ratio Mismatch?
Answer Provided: ?The observed traffic split is statistically significantly different from what was expected

Correct Answer: The observed traffic split is statistically significantly different from what was expected

Comments Entered: NA

5. Which is NOT a valid reason to run an A/A test?
Answer Provided: ?To measure the confidence of your control

Correct Answer: To measure the confidence of your control

Comments Entered: NA

6. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ?What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

7. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ?You are probably not testing something very impactful

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

8. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ?An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

9. What is “flicker”?
Answer Provided: ?When the contents of a variation visibily change during loading because your testing tool is overriding existing code

Correct Answer: When the contents of a variation visibily change during loading because your testing tool is overriding existing code

Comments Entered: NA

10. Which of the following is true about p-values?
Answer Provided: ?p = .05 means that if you reject the null hypothesis, the probability of a type I error (aka false positive) is only 5%

Correct Answer: The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Comments Entered: NA

11. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ?When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

Comments Entered: NA

12. What is copywriting for conversion?
Answer Provided: ?Copywriting that compels the reader to perform a specific action

Correct Answer: Copywriting that compels the reader to perform a specific action

Comments Entered: NA

13. Which BEST defines “Baseline Conversion”?
Answer Provided: ?The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

14. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ?Only consider best practices

Correct Answer: Only consider best practices

Comments Entered: NA

15. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ?You have statistical significance

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

Comments Entered: NA

16. Which BEST describes a CTA / call to action?
Answer Provided: ?A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

Comments Entered: NA

17. Which of the following is NOT an example of urgency?
Answer Provided: ?Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

18. Which of the following CANNOT help you write copy for conversion?
Answer Provided: ?Rewriting competitors' messaging

Correct Answer: Mining customer reviews and testimonials.Rewriting competitors’ messaging

Comments Entered: NA

19. Which of the following is an example of scarcity?
Answer Provided: ?Only 7 left in stock.

Correct Answer: Only 7 left in stock.

Comments Entered: NA

20. When writing copy, what is your #1 priority?
Answer Provided: ?Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

21. What is “bias”?
Answer Provided: ?It is a systemic preference towards something

Correct Answer: It is a systemic preference towards something

Comments Entered: NA

22. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ?Experiment results do not alter any plans

Correct Answer: Experiment results do not alter any plans

Comments Entered: NA

23. Which generally happens when testing many variants running at once?
Answer Provided: ?The power of your experiment decreases drastically

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

24. What does “KPI” stand for?
Answer Provided: ?Key Performance Indicator

Correct Answer: Key Performance Indicator

Comments Entered: NA

25. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ?Test high-impact changes

Correct Answer: Test high-impact changes

Comments Entered: NA

26. Which is a danger of following best practices?
Answer Provided: ?They may not work for you

Correct Answer: They may not work for you

Comments Entered: NA

27. Which of the following BEST describes “statistical significance”?
Answer Provided: ?The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

28. Which of the following is a problem with last-touch attribution?
Answer Provided: ?It ignores upper-funnel activities

Correct Answer: It ignores upper-funnel activities

Comments Entered: NA

29. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ?Customers know what it is before landing on your property

Correct Answer: Customers know what it is before landing on your property

Comments Entered: NA

30. Which of the following describes a “Holdout Group”?
Answer Provided: ?A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA