# Results for michal.pekarcik@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. Which of the following BEST describes “statistical significance”?
Answer Provided: ✓ The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

2. Which of the following is true about p-values?
Answer Provided: ✓ The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Correct Answer: The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

3. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ✓ You are probably not testing something very impactful

Correct Answer: You are probably not testing something very impactful

4. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ✓ When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

5. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ✓ What worked for them and their audience

Correct Answer: What worked for them and their audience

6. “AIDA” stands for which of the following?
Answer Provided: ✓ Attention, Interest, Desire, Action

Correct Answer: Attention, Interest, Desire, Action

7. What should you do before you run an experiment?

9. Which of the following is NOT a benefit of test iteration?
Answer Provided: ✓ Increased statistical power

10. Heatmaps are what form of data?
Answer Provided: ✓ Quantitative and Qualitative

11. What is a “hero image”?
Answer Provided: ✓ It is the largest image near the top of a webpage

Correct Answer: It is the largest image near the top of a webpage

12. Which of the following is an example of social proof?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

13. Which BEST defines “Baseline Conversion”?
Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

14. Which is a benefit of testing extreme changes?
Answer Provided: ✓ Generating stronger signals to measure

Correct Answer: Generating stronger signals to measure

15. Bayesian and Frequentist are which of the following?
Answer Provided: ✓ Schools of thought in statistics

Correct Answer: Schools of thought in statistics

16. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ✓ You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

18. A test has a >50% lift to your primary metric. What is the first thing you should do?

19. What is copywriting for conversion?
Answer Provided: ✓ Copywriting that compels the reader to perform a specific action

Correct Answer: Copywriting that compels the reader to perform a specific action

20. Which of the following is NOT an example of urgency?
Answer Provided: ✓ Customers like you also liked this.

Correct Answer: Customers like you also liked this.

21. What is “flicker”?

22. “PMF” stands for which of the following?

23. Which of the following is not one of Cialdini’s 6 Principles of Persuasion?

24. What is “bias”?
Answer Provided: ✓ It is a systemic preference towards something

Correct Answer: It is a systemic preference towards something

25. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ✓ You should never promise any outcomes

Correct Answer: You should never promise any outcomes

26. What does “MVT” stand for?

28. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ✓ There is a 5% probability that one would detect this result if there was no difference between variants

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

29. In A/B testing, a “control” is generally which of the following?

30. Which of the following describes a “Holdout Group”?
Answer Provided: ✓ A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Lee Bradshaw is an Experiment Nation Certified CRO