Exam answers for: Brad Croasdell for May 30 2022 11:22:30

Posted byrsadmin3000Posted inUncategorizedTags:

If you’d like to score higher on your next attempt, consider checking out these resources.

=======

 

 
1. What is a safe increase in conversion rate that one can promise to a client/stakeholder?
Answer Provided: ? You should never promise any outcomes

 

Correct Answer: You should never promise any outcomes

Comments Entered: NA

 
2. Which is NOT a factor in calculating sample size (in Frequentist statistics)?
Answer Provided: ? Time

 

Correct Answer: Time

Comments Entered: NA

 
3. Which BEST describes experiment “Interaction Effects” ?
Answer Provided: ? When one experiment impacts the outcome of another

 

Correct Answer: When one experiment impacts the outcome of another

Comments Entered: NA

 
4. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ? Only consider best practices

 

Correct Answer: Only consider best practices

Comments Entered: NA

 
5. What is NOT a sign of a healthy Experimentation Culture?
Answer Provided: ? Experiment results do not alter any plans

 

Correct Answer: Experiment results do not alter any plans

Comments Entered: NA

 
6. Which is NOT a valid reason to run an A/A test?
Answer Provided: ? To collect data to calculate sample size

 

Correct Answer: To measure the confidence of your control

Comments Entered: NA

 
7. Select the option which BEST completes the following sentence, “Great Experiments ______”:
Answer Provided: ? Answer business questions

 

Correct Answer: Answer business questions

Comments Entered: NA

 
8. Which of the following is a problem with last-touch attribution?
Answer Provided: ? It ignores upper-funnel activities

 

Correct Answer: It ignores upper-funnel activities

Comments Entered: NA

 
9. What is not a valid CRO option when a site has little traffic?
Answer Provided: ? Believe you cannot run any tests

 

Correct Answer: Believe you cannot run any tests

Comments Entered: NA

 
10. What is a “Bonferroni Correction”?
Answer Provided: ? A way to control for false positives when analyzing multiple metrics

 

Correct Answer: A way to control for false positives when analyzing multiple metrics

Comments Entered: NA

 
11. What does “ARPU” stand for?
Answer Provided: ? Average Revenue Per User

 

Correct Answer: Average Revenue Per User

Comments Entered: NA

 
12. “PMF” stands for which of the following?
Answer Provided: ? Product-Market Fit

 

Correct Answer: Product-Market Fit

Comments Entered: NA

 
13. When writing copy, what is your #1 priority?
Answer Provided: ? Converting multiple target audiences

 

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

 
14. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ? You are probably not testing something very impactful

 

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

 
15. Which of the following is NOT a benefit of test iteration?
Answer Provided: ? Increased statistical power

 

Correct Answer: Increased statistical power

Comments Entered: NA

 
16. Which generally happens when testing many variants running at once?
Answer Provided: ? The power of your experiment decreases drastically

 

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

 
17. Which BEST defines “Baseline Conversion”?
Answer Provided: ? The most recently recorded conversion rate of the metric you want to measure

 

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

 
18. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ? An educated guess as to what will happen during your experiment

 

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

 
19. Which of the following BEST describes “statistical significance”?
Answer Provided: ? Achieved when the p-value is less than 0.05

 

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

 
20. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ? To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

 

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA

 
21. What is copywriting for conversion?
Answer Provided: ? Copywriting that compels the reader to perform a specific action

 

Correct Answer: Copywriting that compels the reader to perform a specific action

Comments Entered: NA

 
22. Which of the following CANNOT help you write copy for conversion?
Answer Provided: ? Rewriting competitors’ messaging

 

Correct Answer: Mining customer reviews and testimonials.Rewriting competitors’ messaging

Comments Entered: NA

 
23. Which of the following is not one of Cialdini’s 6 Principles of Persuasion?
Answer Provided: ? Humour

 

Correct Answer: Humour

Comments Entered: NA

 
24. What can we learn from tests run on sites that aren’t our own?
Answer Provided: ? What worked for them and their audience

 

Correct Answer: What worked for them and their audience

Comments Entered: NA

 
25. What should you do if you want to experiment on a website with little traffic?
Answer Provided: ? Test high-impact changes

 

Correct Answer: Test high-impact changes

Comments Entered: NA

 
26. Which of the following is true about p-values?
Answer Provided: ? The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

 

Correct Answer: The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Comments Entered: NA

 
27. Which of the following characterizes Value Propositions and Unique Selling Propositions?
Answer Provided: ? It is that very reason which motivates a buyer to purchase that product

 

Correct Answer: It is that very reason which motivates a buyer to purchase that product

Comments Entered: NA

 
28. What should you do before you run an experiment?
Answer Provided: ? All answers are correct

 

Correct Answer: All answers are correct

Comments Entered: NA

 
29. If there is no meaningful difference between your control and variation in terms of your success metric, which of the following should you decide?
Answer Provided: ? The test was inconclusive

 

Correct Answer: It depends on the hypothesis

Comments Entered: NA

 
30. A test has a >50% lift to your primary metric. What is the first thing you should do?
Answer Provided: ? Sanity check your results

 

Correct Answer: Sanity check your results

Comments Entered: NA

 




 

 

 

rsadmin3000
Latest posts by rsadmin3000 (see all)