Results for javier@lipuzcoa.com Experiment Nation

If you’d like to score higher on your next attempt, consider checking out these resources.

1. The “C” in “VOC” stands for which of the following?
Answer Provided: ?Customer

Correct Answer: Customer

Comments Entered: NA

2. Which of the following CANNOT help you write copy for conversion?
Answer Provided: ?Rewriting competitors' messaging

Correct Answer: Mining customer reviews and testimonials.Rewriting competitors’ messaging

Comments Entered: NA

3. Heatmaps are what form of data?
Answer Provided: ?Quantitative and Qualitative

Correct Answer: Quantitative and Qualitative

Comments Entered: NA

4. Which of the following is a reason to document experiments?
Answer Provided: ?All the answers are correct

Correct Answer: All the answers are correct

Comments Entered: NA

5. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ?Only consider best practices

Correct Answer: Only consider best practices

Comments Entered: NA

6. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ?Customers know what it is before landing on your property

Correct Answer: Customers know what it is before landing on your property

Comments Entered: NA

7. Which of the following is NOT an example of urgency?
Answer Provided: ?Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

8. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ?Experiment results do not alter any plans

Correct Answer: Experiment results do not alter any plans

Comments Entered: NA

9. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ?There is a 5% probability that one would detect this result if there was no difference between variants

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

Comments Entered: NA

10. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ?What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

11. What is “bias”?
Answer Provided: ?It is a systemic preference towards something

Correct Answer: It is a systemic preference towards something

Comments Entered: NA

12. Select the option which BEST completes the following sentence, “Great Experiments ______”:
Answer Provided: ?Answer business questions

Correct Answer: Answer business questions

Comments Entered: NA

13. Which generally happens when testing many variants running at once?
Answer Provided: ?The power of your experiment decreases drastically

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

14. Which of the following is an example of scarcity?
Answer Provided: ?Only 7 left in stock.

Correct Answer: Only 7 left in stock.

Comments Entered: NA

15. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ?Test high-impact changes

Correct Answer: Test high-impact changes

Comments Entered: NA

16. What is a “Bonferroni Correction”?
Answer Provided: ?A statistical correction to account for novelty effects

Correct Answer: A way to control for false positives when analyzing multiple metrics

Comments Entered: NA

17. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ?When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

Comments Entered: NA

18. “AIDA” stands for which of the following?
Answer Provided: ?Attention, Interest, Desire, Action

Correct Answer: Attention, Interest, Desire, Action

Comments Entered: NA

19. Which of the following characterizes Value Propositions and Unique Selling Propositions?
Answer Provided: ?It is that very reason which motivates a buyer to purchase that product

Correct Answer: It is that very reason which motivates a buyer to purchase that product

Comments Entered: NA

20. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ?The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

21. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ?You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

22. Which of the following describes a “Holdout Group”?
Answer Provided: ?A control group that does not get exposed to a treatment/variation

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

23. Which BEST describes a CTA / call to action?
Answer Provided: ?A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

Comments Entered: NA

24. After you have completed your conversion audit and have a list of hypotheses, what is the next step you need to take?
Answer Provided: ?Prioritize the hypotheses based on your framework of choice

Correct Answer: Prioritize the hypotheses based on your framework of choice

Comments Entered: NA

25. What is Peeking?
Answer Provided: ?Looking at test results before the test is complete with the intention of ending the test.

Correct Answer: Looking at test results before the test is complete with the intention of ending the test.

Comments Entered: NA

26. Confidence levels must be which of the following?
Answer Provided: ?Set based on the needs of an experiment

Correct Answer: Set based on the needs of an experiment

Comments Entered: NA

27. What is a “hero image”?
Answer Provided: ?It is the largest image near the top of a webpage

Correct Answer: It is the largest image near the top of a webpage

Comments Entered: NA

28. Which of the following BEST describes “statistical significance”?
Answer Provided: ?The probability the result observed was not due to random chance

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

29. Which of the following is true about tests that are run during holidays?
Answer Provided: ?Visitors during holidays are not necessarily like visitors during the rest of the year

Correct Answer: Visitors during holidays are not necessarily like visitors during the rest of the year

Comments Entered: NA

30. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ?To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

Author
Recent Posts

rsadmin3000