Results for alex.mason@widerfunnel.com Experiment Nation

If you’d like to score higher on your next attempt, consider checking out these resources.

1. Which of the following sources of data has the least amount of bias?
Answer Provided: ?Randomized Control Trial results

Correct Answer: Meta-analyses

Comments Entered: NA

2. In A/B testing, a “control” is generally which of the following?
Answer Provided: ?The version where no changes have been made

Correct Answer: The version where no changes have been made

Comments Entered: NA

3. Which BEST defines “Baseline Conversion”?
Answer Provided: ?The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

4. Which of the following CANNOT help you write copy for conversion?
Answer Provided: ?Rewriting competitors' messaging

Correct Answer: Mining customer reviews and testimonials.Rewriting competitors’ messaging

Comments Entered: NA

5. Which of the following does NOT describe what an “Experiment” is?
Answer Provided: ?A way to permanently change your website

Correct Answer: A way to permanently change your website

Comments Entered: NA

6. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ?An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

7. What is a false negative?
Answer Provided: ?It is when you don't detect an effect when one exists

Correct Answer: It is when you don’t detect an effect when one exists

Comments Entered: NA

8. What is the most important step you can take to increase your funnel’s final conversion rate?
Answer Provided: ?Identify the biggest drop-off points and prioritize fixing those

Correct Answer: Identify the biggest drop-off points and prioritize fixing those

Comments Entered: NA

9. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ?Test high-impact changes

Correct Answer: Test high-impact changes

Comments Entered: NA

10. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ?You have a 5% chance of a false positive

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

Comments Entered: NA

11. Which of the following is an example of “chunking”?
Answer Provided: ?Breaking longer text into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

12. What is quantitative research NOT used for?
Answer Provided: ?Prioritizing your backlog

Correct Answer: Understanding why users are behaving a certain way

Comments Entered: NA

13. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ?The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

14. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ?To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

15. What of the following is NOT true about a Unique Selling (or Value) Proposition?
Answer Provided: ?Customers know what it is before landing on your property

Correct Answer: Customers know what it is before landing on your property

Comments Entered: NA

16. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ?You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

17. What does “ARPU” stand for?
Answer Provided: ?Average Revenue Per User

Correct Answer: Average Revenue Per User

Comments Entered: NA

18. Which of the following is NOT a good strategy for analyzing test results?
Answer Provided: ?None of the answers

Correct Answer: None of the answers

Comments Entered: NA

19. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ?You should never promise any outcomes

Correct Answer: You should never promise any outcomes

Comments Entered: NA

20. When writing copy, what is your #1 priority?
Answer Provided: ?Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

21. Which BEST describes a CTA / call to action?
Answer Provided: ?A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

Comments Entered: NA

22. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ?Experiment interaction is harder to plan for

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

23. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ?When one experiment impacts the outcome of another

Correct Answer: When one experiment impacts the outcome of another

Comments Entered: NA

24. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ?What worked for them and their audience

Correct Answer: What worked for them and their audience

Comments Entered: NA

25. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ?Only consider best practices

Correct Answer: Only consider best practices

Comments Entered: NA

26. Which of the following is TRUE of best practices?
Answer Provided: ?They are a good starting point for ideation and testing

Correct Answer: They are a good starting point for ideation and testing

Comments Entered: NA

27. Which of the following is an example of social proof?
Answer Provided: ?Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

28. Which of the following is NOT an example of urgency?
Answer Provided: ?Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

29. Which of the following is NOT a benefit of test iteration?
Answer Provided: ?Increased statistical power

Correct Answer: Increased statistical power

Comments Entered: NA

30. Which of the following is true about p-values?
Answer Provided: ?p = .05 means that if you reject the null hypothesis, the probability of a type I error (aka false positive) is only 5%

Correct Answer: The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Comments Entered: NA

Author
Recent Posts

rsadmin3000