Results for heitorselman@gmail.com

If you’d like to score higher on your next attempt, consider checking out these resources.

1. When collecting test ideas, which of the following should NOT be done?
Answer Provided: ?Take a “Yes and” attitude instead of a “No but” one

Correct Answer: Only consider best practices

Comments Entered: NA

2. Confidence levels must be which of the following?
Answer Provided: ?Set based on the needs of an experiment

Correct Answer: Set based on the needs of an experiment

Comments Entered: NA

3. Which of the following characterizes Value Propositions and Unique Selling Propositions?
Answer Provided: ?It is that very reason which motivates a buyer to purchase that product

Correct Answer: It is that very reason which motivates a buyer to purchase that product

Comments Entered: NA

4. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?
Answer Provided: ?You've saved the business time and money which they might have by implementing this costly feature

Correct Answer: You’ve saved the business time and money which they might have by implementing this costly feature

Comments Entered: NA

5. When writing copy, what is your #1 priority?
Answer Provided: ?Writing for clarity, not cleverness

Correct Answer: Writing for clarity, not cleverness

Comments Entered: NA

6. Bayesian and Frequentist are which of the following?
Answer Provided: ?Schools of thought in statistics

Correct Answer: Schools of thought in statistics

Comments Entered: NA

7. What does “MVT” stand for?
Answer Provided: ?Multivariate Test

Correct Answer: Multivariate Test

Comments Entered: NA

8. Which of the following describes a “Holdout Group”?
Answer Provided: ?A group that is set aside for a survey

Correct Answer: A control group that does not get exposed to a treatment/variation

Comments Entered: NA

9. Which of the following best describes why letting a test run longer than planned may not be beneficial?
Answer Provided: ?Your confidence interval becomes narrower

Correct Answer: You are probably not testing something very impactful

Comments Entered: NA

10. Which of the following does NOT describe what an “Experiment” is?
Answer Provided: ?A method to demonstrate a known fact

Correct Answer: A way to permanently change your website

Comments Entered: NA

11. Which BEST describes a CTA / call to action?
Answer Provided: ?A prompt telling the user to take an action

Correct Answer: A prompt telling the user to take an action

Comments Entered: NA

12. Which of the following is an example of “chunking”?
Answer Provided: ?Breaking longer text into smaller parts

Correct Answer: Breaking longer text into smaller parts

Comments Entered: NA

13. If your p-value is 0.05 then which of the following is TRUE?
Answer Provided: ?You have a 5% chance of a false positive

Correct Answer: There is a 5% probability that one would detect this result if there was no difference between variants

Comments Entered: NA

14. Which of the following is an example of scarcity?
Answer Provided: ?Only 7 left in stock.

Correct Answer: Only 7 left in stock.

Comments Entered: NA

15. If a program’s ratio of “successful” tests (aka “win rate”) to launched tests is constantly 50%, what should you suspect?
Answer Provided: ?The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Correct Answer: The CRO is not testing meaningful hypotheses or picking the KPI after the experiment has concluded

Comments Entered: NA

16. Which BEST describes an experiment “Hypothesis”?
Answer Provided: ?An educated guess as to what will happen during your experiment

Correct Answer: An educated guess as to what will happen during your experiment

Comments Entered: NA

17. Which generally happens when testing many variants running at once?
Answer Provided: ?The power of your experiment decreases drastically

Correct Answer: The power of your experiment decreases drastically

Comments Entered: NA

18. Which BEST defines “Baseline Conversion”?
Answer Provided: ?The most recently recorded conversion rate of the metric you want to measure

Correct Answer: The most recently recorded conversion rate of the metric you want to measure

Comments Entered: NA

19. Which of the following is not a popular prioritization framework?
Answer Provided: ?RICE

Correct Answer: SWOT

Comments Entered: NA

20. Select the option which BEST completes the following sentence, “Great Experiments ______”:
Answer Provided: ?Are randomized control trials

Correct Answer: Answer business questions

Comments Entered: NA

21. Which of the following is TRUE of best practices?
Answer Provided: ?They are a good starting point for ideation and testing

Correct Answer: They are a good starting point for ideation and testing

Comments Entered: NA

22. What is not a valid CRO option when a site has little traffic?
Answer Provided: ?Lower your bar for confidence

Correct Answer: Believe you cannot run any tests

Comments Entered: NA

23. Which of the following is a problem with last-touch attribution?
Answer Provided: ?It ignores upper-funnel activities

Correct Answer: It ignores upper-funnel activities

Comments Entered: NA

24. Which of the following BEST describes “statistical significance”?
Answer Provided: ?Achieved when the p-value is less than 0.05

Correct Answer: The probability the result observed was not due to random chance

Comments Entered: NA

25. What is qualitative research used for ?
Answer Provided: ?Avoiding biased answers

Correct Answer: Understanding why your users are behaving a certain way

Comments Entered: NA

26. Which of the following sources of data has the least amount of bias?
Answer Provided: ?Meta-analyses

Correct Answer: Meta-analyses

Comments Entered: NA

27. Which is NOT a valid reason to run an A/A test?
Answer Provided: ?To demonstrate the problem with “peeking”

Correct Answer: To measure the confidence of your control

Comments Entered: NA

28. Which of the following is true about p-values?
Answer Provided: ?The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Correct Answer: The p-value is the probability of obtaining a result equal to or more extreme than what was observed, assuming that the Null hypothesis is true.

Comments Entered: NA

29. Which of the following is NOT an example of urgency?
Answer Provided: ?Customers like you also liked this.

Correct Answer: Customers like you also liked this.

Comments Entered: NA

30. Which BEST describes why you should always define a “Test Hypothesis”
Answer Provided: ?To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Correct Answer: To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis

Comments Entered: NA