# Results for taci.serafim@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. Which of the following BEST describes “statistical significance”?
Answer Provided: ?The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

2. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ?You have statistical significance

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

3. What can we learn from tests run on sites that aren’t our own?

Correct Answer: What worked for them and their audience

4. Which of the following is a reason to document experiments?
Answer Provided: ?All the answers are correct

Correct Answer: All the answers are correct

5. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ?Test high-impact changes

Correct Answer: Test high-impact changes

6. Which of the following characterizes Value Propositions and Unique Selling Propositions?
Answer Provided: ?It is that very reason which motivates a buyer to purchase that product

Correct Answer: It is that very reason which motivates a buyer to purchase that product

7. Which of the following sources of data has the least amount of bias?

8. What is the most important step you can take to increase your funnel’s final conversion rate?
Answer Provided: ?Identify the biggest drop-off points and prioritize fixing those

Correct Answer: Identify the biggest drop-off points and prioritize fixing those

9. Which of the following is not one of Cialdini’s 6 Principles of Persuasion?

10. Which is a benefit of testing extreme changes?
Answer Provided: ?The results are easier to calculate

Correct Answer: Generating stronger signals to measure

11. What does “ARPU” stand for?
Answer Provided: ?Average Revenue Per User

Correct Answer: Average Revenue Per User

12. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ?When a user interacts with a component in a test

Correct Answer: When one experiment impacts the outcome of another

13. Which of the following is an example of scarcity?
Answer Provided: ?Only 7 left in stock.

Correct Answer: Only 7 left in stock.

14. Which is a danger of following best practices?
Answer Provided: ?They may not work for you

Correct Answer: They may not work for you

15. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ?You should never promise any outcomes

Correct Answer: You should never promise any outcomes

16. What is Peeking?
Answer Provided: ?Looking at test results before the test is complete with the intention of ending the test.

Correct Answer: Looking at test results before the test is complete with the intention of ending the test.

17. Which is NOT a factor in calculating sample size (in Frequentist statistics)?
Answer Provided: ?Minimum Detectible Effect

18. Which of the following is NOT a benefit of test iteration?
Answer Provided: ?Increased statistical power

Correct Answer: Increased statistical power

19. What should you do before you run an experiment?

20. What does “MVT” stand for?
Answer Provided: ?Multivariate Test

Correct Answer: Multivariate Test

21. Which of the following describes a “Holdout Group”?
Answer Provided: ?A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

22. In A/B testing, a “control” is generally which of the following?
Answer Provided: ?The factor that isn't changed during the test

Correct Answer: The version where no changes have been made

23. When writing copy, what is your #1 priority?
Answer Provided: ?Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

24. What does “KPI” stand for?
Answer Provided: ?Key Performance Indicator

Correct Answer: Key Performance Indicator

25. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ?Take a “Yes and” attitude instead of a “No but” one

Correct Answer: Only consider best practices

26. Which of the following is true about tests that are run during holidays?
Answer Provided: ?Visitors during holidays are not necessarily like visitors during the rest of the year

Correct Answer: Visitors during holidays are not necessarily like visitors during the rest of the year

27. Which of the following is an example of “chunking”?
Answer Provided: ?Breaking a long funnel into smaller parts

Correct Answer: Breaking longer text into smaller parts

28. What is a “Bonferroni Correction”?
Answer Provided: ?A statistical correction to account for novelty effects

Correct Answer: A way to control for false positives when analyzing multiple metrics

29. Which is NOT a valid reason to run an A/A test?
Answer Provided: ?To demonstrate the problem with “peeking”

Correct Answer: To measure the confidence of your control