Results for p.krippendorf@gmail.com Experiment Nation

If you’d like to score higher on your next attempt, consider checking out these resources.

1. Which of the following sources of data has the least amount of bias?
Answer Provided: ?Randomized Control Trial results

Correct Answer: Meta-analyses

Comments Entered: NA

2. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ?Statistically significant results are better than 'flat' results

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

3. Which is NOT a benefit of having “North Star Metric”?
Answer Provided: ?They have no sample size requirements

Correct Answer: They have no sample size requirements

Comments Entered: NA

4. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ?An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

5. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ?Experiment results do not alter any plans

Correct Answer: Experiment results do not alter any plans

Comments Entered: NA

6. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ?What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

7. Which is NOT a characteristic of “Novelty effects”?
Answer Provided: ?Early results observed generally with new visitors.

Correct Answer: New features always perform the best

Comments Entered: NA

8. What does “ARPU” stand for?
Answer Provided: ?Average Revenue Per User

Correct Answer: Average Revenue Per User

Comments Entered: NA

9. “AIDA” stands for which of the following?
Answer Provided: ?Attention, Interest, Desire, Action

Correct Answer: Attention, Interest, Desire, Action

Comments Entered: NA

10. In A/B testing, a “control” is generally which of the following?
Answer Provided: ?The version where no changes have been made

Correct Answer: The version where no changes have been made

Comments Entered: NA

11. Heatmaps are what form of data?
Answer Provided: ?Quantitative and Qualitative

Correct Answer: Quantitative and Qualitative

Comments Entered: NA

12. Which is NOT a valid reason to run an A/A test?
Answer Provided: ?To collect data to calculate sample size

Correct Answer: To measure the confidence of your control

Comments Entered: NA

13. Which of the following is not a popular prioritization framework?
Answer Provided: ?SWOT

Correct Answer: SWOT

Comments Entered: NA

14. What is a Sample Ratio Mismatch?
Answer Provided: ?The observed traffic split is statistically significantly different from what was expected

Correct Answer: The observed traffic split is statistically significantly different from what was expected

Comments Entered: NA

15. Which of the following is NOT a good strategy for analyzing test results?
Answer Provided: ?None of the answers

Correct Answer: None of the answers

Comments Entered: NA

16. What is quantitative research NOT used for?
Answer Provided: ?Understanding why users are behaving a certain way

Correct Answer: Understanding why users are behaving a certain way

Comments Entered: NA

17. What is copywriting for conversion?
Answer Provided: ?Copywriting that compels the reader to perform a specific action

Correct Answer: Copywriting that compels the reader to perform a specific action

Comments Entered: NA

18. Which of the following is NOT a benefit of test iteration?
Answer Provided: ?With luck, you can reuse some assets – saving you time

Correct Answer: Increased statistical power

Comments Entered: NA

19. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ?Test high-impact changes

Correct Answer: Test high-impact changes

Comments Entered: NA

20. In Frequentist statistics, which of the following is the risk of testing too many KPIs?
Answer Provided: ?Increased chance of a false positive

Correct Answer: Increased chance of a false positive

Comments Entered: NA

21. Which of the following does NOT describe what an “Experiment” is?
Answer Provided: ?A way to permanently change your website

Correct Answer: A way to permanently change your website

Comments Entered: NA

22. The “C” in “VOC” stands for which of the following?
Answer Provided: ?Customer

Correct Answer: Customer

Comments Entered: NA

23. Which generally happens when testing many variants running at once?
Answer Provided: ?The power of your experiment decreases drastically

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

24. Which of the following is an example of social proof?
Answer Provided: ?Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

25. Which is a benefit of testing extreme changes?
Answer Provided: ?Generating stronger signals to measure

Correct Answer: Generating stronger signals to measure

Comments Entered: NA

26. Which BEST defines “Baseline Conversion”?
Answer Provided: ?The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

27. When writing copy, what is your #1 priority?
Answer Provided: ?Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

28. Which of the following is an example of “chunking”?
Answer Provided: ?Breaking longer text into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

29. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ?The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

30. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ?To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

Author
Recent Posts

rsadmin3000