# Results for annaambr@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. In A/B testing, a “control” is generally which of the following?
Answer Provided: ✓The version where no changes have been made

Correct Answer: The version where no changes have been made

2. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ✓You should never promise any outcomes

Correct Answer: You should never promise any outcomes

3. Which of the following BEST describes “statistical significance”?
Answer Provided: ✓The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

4. What is copywriting for conversion?
Answer Provided: ✓Copywriting that compels the reader to perform a specific action

Correct Answer: Copywriting that compels the reader to perform a specific action

5. Which of the following is TRUE of best practices?
Answer Provided: ✓They are a good starting point for ideation and testing

Correct Answer: They are a good starting point for ideation and testing

6. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ✓There is a 5% probability that one would detect this result if there was no difference between variants

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

8. Which of the following is NOT a benefit of test iteration?
Answer Provided: ✓Increased statistical power

Correct Answer: Increased statistical power

9. What does “MVT” stand for?
Answer Provided: ✓Multivariate Test

Correct Answer: Multivariate Test

10. Which of the following is not a popular prioritization framework?

11. Which of the following is an example of scarcity?
Answer Provided: ✓Only 7 left in stock.

Correct Answer: Only 7 left in stock.

12. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ✓To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

13. “AIDA” stands for which of the following?
Answer Provided: ✓Attention, Interest, Desire, Action

Correct Answer: Attention, Interest, Desire, Action

14. Which of the following sources of data has the least amount of bias?
Answer Provided: ✕Randomized Control Trial results

15. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ✕The CRO is testing on a mature website/product

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

17. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ✓When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

18. What does “ARPU” stand for?
Answer Provided: ✓Average Revenue Per User

Correct Answer: Average Revenue Per User

19. When writing copy, what is your #1 priority?
Answer Provided: ✓Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

20. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ✓You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

21. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ✕Your p-values are likely to decrease

Correct Answer: You are probably not testing something very impactful

22. Which generally happens when testing many variants running at once?
Answer Provided: ✕It is harder to measure

Correct Answer: The power of your experiment decreases drastically

24. Heatmaps are what form of data?
Answer Provided: ✓Quantitative and Qualitative

Correct Answer: Quantitative and Qualitative

25. What is a Sample Ratio Mismatch?
Answer Provided: ✕The expected traffic split does not match sample size requirements

Correct Answer: The observed traffic split is statistically significantly different from what was expected

26. If there is no meaningful difference between your control and variation in terms of your success metric, which of the following should you decide?
Answer Provided: ✓It depends on the hypothesis

Correct Answer: It depends on the hypothesis

27. Which of the following is an example of “chunking”?
Answer Provided: ✕Breaking a long funnel into smaller parts

Correct Answer: Breaking longer text into smaller parts

28. Which of the following is NOT a good strategy for analyzing test results?

29. What is quantitative research NOT used for?
Answer Provided: ✓Understanding why users are behaving a certain way

Correct Answer: Understanding why users are behaving a certain way