Category Archives: Uncategorized

If you’d like to score higher on your next attempt, consider checking out these resources. 1. Which BEST describes why you should always define a “Test Hypothesis”Answer Provided: ✓ To ensure you learn, no matter what the test outcome because the experiment will either prove or disprove your hypothesis Correct Answer: To ensure you learn, noContinue reading “Results for None”

If you’d like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign of a healthy Experimentation Culture?Answer Provided: ✓ Experiment results do not alter any plans Correct Answer: Experiment results do not alter any plans Comments Entered: NA 2. What of the following is NOT true about aContinue reading “Results for None”

If you’d like to score higher on your next attempt, consider checking out these resources. 1. Which BEST describes an experiment “Hypothesis”?Answer Provided: ✓ An educated guess as to what will happen during your experiment Correct Answer: An educated guess as to what will happen during your experiment Comments Entered: NA 2. Which BEST describes experiment “InteractionContinue reading “Results for None”

If you’d like to score higher on your next attempt, consider checking out these resources. 1. What is NOT a sign of a healthy Experimentation Culture?Answer Provided: ✓ Experiment results do not alter any plans Correct Answer: Experiment results do not alter any plans Comments Entered: NA 2. Which of the following BEST describes “statistical significance”?Answer Provided:Continue reading “Results for callumdreniw@outlook.com”

If you’d like to score higher on your next attempt, consider checking out these resources. 1. Which of the following is NOT a good strategy for analyzing test results?Answer Provided: ✓ None of the answers Correct Answer: None of the answers Comments Entered: NA 2. What does “KPI” stand for?Answer Provided: ✓ Key Performance Indicator Correct Answer:Continue reading “Results for dawniype@gmail.com”

If you’d like to score higher on your next attempt, consider checking out these resources. 1. Which of the following describes a “Holdout Group”?Answer Provided: ✓ A control group that does not get exposed to a treatment/variation Correct Answer: A control group that does not get exposed to a treatment/variation Comments Entered: NA 2. Which of theContinue reading “Results for petar.stefanovic@gmail.com”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. In A/B testing, a "control" is generally which of the following?Answer Provided: ✓ The version where no changes have been made Correct Answer: The version where no changes have been made Comments Entered: NA 2. What is a safe increaseContinue reading “Exam answers for: Mike Harper for June 24 2022 11:29:44”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is qualitative research used for ?Answer Provided: ✓ Understanding why your users are behaving a certain way Correct Answer: Understanding why your users are behaving a certain way Comments Entered: NA 2. What is Peeking?Answer Provided: ✓ Looking atContinue reading “Exam answers for: Francesca Magana for June 24 2022 14:57:21”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is Peeking?Answer Provided: ✕ Checking to see if you've hit sample size before the test is complete with the intention of ending the test. Correct Answer: Looking at test results before the test is complete with the intentionContinue reading “Exam answers for: Levon Galstyan for June 24 2022 15:50:23”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is quantitative research NOT used for?Answer Provided: ✓ Understanding why users are behaving a certain way Correct Answer: Understanding why users are behaving a certain way Comments Entered: NA 2. Which of the following best describes why letting aContinue reading “Exam answers for: Stane Zabot for June 23 2022 11:19:50”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which of the following is an example of scarcity?Answer Provided: ✓ Only 7 left in stock. Correct Answer: Only 7 left in stock. Comments Entered: NA 2. What should you do if you want to experiment on a website withContinue reading “Exam answers for: Michael Johnstone for June 23 2022 12:00:27”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which of the following is NOT a good strategy for analyzing test results?Answer Provided: ✓ None of the answers Correct Answer: None of the answers Comments Entered: NA 2. What does "ARPU" stand for?Answer Provided: ✓ Average Revenue Per UserContinue reading “Exam answers for: Craig Kistler for June 23 2022 13:16:40”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which of the following describes a "Holdout Group"?Answer Provided: ✓ A control group that does not get exposed to a treatment/variation Correct Answer: A control group that does not get exposed to a treatment/variation Comments Entered: NA 2. Which BESTContinue reading “Exam answers for: Sander Huisman for June 23 2022 14:29:09”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which BEST defines "Baseline Conversion"?Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure Correct Answer: The most recently recorded conversion rate of the metric you want to measure Comments Entered: NA 2. WhatContinue reading “Exam answers for: Gabriel Amzallag for June 23 2022 22:34:16”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which is a benefit of testing extreme changes?Answer Provided: ✓ Generating stronger signals to measure Correct Answer: Generating stronger signals to measure Comments Entered: NA 2. Which of the following is TRUE of best practices?Answer Provided: ✓ They are aContinue reading “Exam answers for: Paul Barden for June 22 2022 21:55:39”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which BEST defines "Baseline Conversion"?Answer Provided: ✓ The most recently recorded conversion rate of the metric you want to measure Correct Answer: The most recently recorded conversion rate of the metric you want to measure Comments Entered: NA 2. WhatContinue reading “Exam answers for: Jacob Hartung for June 20 2022 11:14:21”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. "PMF" stands for which of the following?Answer Provided: ✓ Product-Market Fit Correct Answer: Product-Market Fit Comments Entered: NA 2. If a program's ratio of "successful" tests (aka "win rate") to launched tests is constantly 50%, what should you suspect?Answer Provided:Continue reading “Exam answers for: Iva Obrovac for June 17 2022 14:39:55”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What does "ARPU" stand for?Answer Provided: ✓ Average Revenue Per User Correct Answer: Average Revenue Per User Comments Entered: NA 2. What does "MVT" stand for?Answer Provided: ✓ Multivariate Test Correct Answer: Multivariate Test Comments Entered: NA 3. Which of theContinue reading “Exam answers for: Deborah O’Malley for June 16 2022 02:40:04”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What can we learn from tests run on sites that aren't our own?Answer Provided: ✓ What worked for them and their audience Correct Answer: What worked for them and their audience Comments Entered: NA 2. Which of the following characterizesContinue reading “Exam answers for: Nicolai Høg for June 15 2022 13:52:17”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which is NOT a factor in calculating sample size (in Frequentist statistics)?Answer Provided: ✓ Time Correct Answer: Time Comments Entered: NA 2. Which of the following does NOT describe what an "Experiment" is?Answer Provided: ✓ A way to permanently changeContinue reading “Exam answers for: Cameron Robbins for June 15 2022 14:54:38”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which of the following is not one of Cialdini's 6 Principles of Persuasion?Answer Provided: ✓ Humour Correct Answer: Humour Comments Entered: NA 2. A test has a >50% lift to your primary metric. What is the first thing you shouldContinue reading “Exam answers for: Matheus Rocha for June 15 2022 19:35:01”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What should you do before you run an experiment?Answer Provided: ✓ All answers are correct Correct Answer: All answers are correct Comments Entered: NA 2. What does "ARPU" stand for?Answer Provided: ✓ Average Revenue Per User Correct Answer: Average RevenueContinue reading “Exam answers for: Fábio Roberto Borges for June 14 2022 17:01:18”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What does "KPI" stand for?Answer Provided: ✓ Key Performance Indicator Correct Answer: Key Performance Indicator Comments Entered: NA 2. Which of the following is NOT a good strategy for analyzing test results?Answer Provided: ✓ None of the answers Correct Answer:Continue reading “Exam answers for: Izabella Bueno for June 14 2022 14:42:35”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is the most important step you can take to increase your funnel's final conversion rate?Answer Provided: ✓ Identify the biggest drop-off points and prioritize fixing those Correct Answer: Identify the biggest drop-off points and prioritize fixing those CommentsContinue reading “Exam answers for: Charles Kim for June 13 2022 19:05:23”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is qualitative research used for ?Answer Provided: ✓ Understanding why your users are behaving a certain way Correct Answer: Understanding why your users are behaving a certain way Comments Entered: NA 2. Which is NOT a benefit of havingContinue reading “Exam answers for: Arjan Singh for June 12 2022 13:12:47”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is Peeking?Answer Provided: ✓ Looking at test results before the test is complete with the intention of ending the test. Correct Answer: Looking at test results before the test is complete with the intention of ending the test.Continue reading “Exam answers for: Adrian Timar for June 11 2022 03:28:30”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which of the following sources of data has the least amount of bias?Answer Provided: ✕ Randomized Control Trial results Correct Answer: Meta-analyses Comments Entered: NA 2. Which is NOT a benefit of having "North Star Metric"?Answer Provided: ✕ Avoiding undoingContinue reading “Exam answers for: Mario Breser for June 11 2022 03:28:49”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which of the following sources of data has the least amount of bias?Answer Provided: ✓ Meta-analyses Correct Answer: Meta-analyses Comments Entered: NA 2. What is a Sample Ratio Mismatch?Answer Provided: ✓ The observed traffic split is statistically significantly different fromContinue reading “Exam answers for: Davi Alcantara Nunes for June 11 2022 03:29:00”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is Peeking?Answer Provided: ✓ Looking at test results before the test is complete with the intention of ending the test. Correct Answer: Looking at test results before the test is complete with the intention of ending the test.Continue reading “Exam answers for: Matic Kasnik for June 11 2022 03:29:14”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which of the following sources of data has the least amount of bias?Answer Provided: ✓ Meta-analyses Correct Answer: Meta-analyses Comments Entered: NA 2. Which of the following is a reason to document experiments?Answer Provided: ✓ All the answers are correctContinue reading “Exam answers for: Arthur Ribeiro for June 11 2022 03:29:23”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. Which generally happens when testing many variants running at once?Answer Provided: ✓ The power of your experiment decreases drastically Correct Answer: The power of your experiment decreases drastically Comments Entered: NA 2. An experiment demonstrates a 10% decrease in conversionContinue reading “Exam answers for: Shiva Manjunath for June 11 2022 03:29:34”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. In A/B testing, a "control" is generally which of the following?Answer Provided: ✓ The version where no changes have been made Correct Answer: The version where no changes have been made Comments Entered: NA 2. Which of the following isContinue reading “Exam answers for: Storm Jarvie for June 11 2022 10:36:23”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. In Frequentist statistics, which of the following is the risk of testing too many KPIs?Answer Provided: ✓ Increased chance of a false positive Correct Answer: Increased chance of a false positive Comments Entered: NA 2. Which is a danger ofContinue reading “Exam answers for: Joyca Kuijpers for June 11 2022 16:26:10”

If you’d like to score higher on your next attempt, consider checking out these resources. =======   1. Which of the following sources of data has the least amount of bias?Answer Provided: ✕ Randomized Control Trial results Correct Answer: Meta-analyses Comments Entered: NA   2. Which of the following is not a popular prioritization framework?Answer Provided: ✓Continue reading “Exam answers for: Raluca Tanase for June 08 2022 10:49:11”

If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. Which of the following sources of data has the least amount of bias?Answer Provided: ✓ Meta-analyses   Correct Answer: Meta-analyses Comments Entered: NA   2. What is a Sample Ratio Mismatch?Answer Provided: ✓ The observed traffic split isContinue reading “Exam answers for: Mike Tildsley for June 08 2022 10:49:40”

If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. Which of the following is TRUE of best practices?Answer Provided: ✓ They are a good starting point for ideation and testing   Correct Answer: They are a good starting point for ideation and testing Comments Entered: NAContinue reading “Exam answers for: Michael McCann for June 07 2022 14:02:31”

If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. Heatmaps are what form of data?Answer Provided: ✓ Quantitative and Qualitative   Correct Answer: Quantitative and Qualitative Comments Entered: NA   2. What is a “hero image”?Answer Provided: ✓ It is the largest image near the top ofContinue reading “Exam answers for: Niklas Bräutigam for June 01 2022 15:04:05”

If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. What is Peeking?Answer Provided: ✓ Looking at test results before the test is complete with the intention of ending the test.   Correct Answer: Looking at test results before the test is complete with the intention ofContinue reading “Exam answers for: Luísa Campos for June 01 2022 21:25:06”

If you’d like to score higher on your next attempt, consider checking out these resources.     1. What is a Sample Ratio Mismatch?Answer Provided: ✓ The observed traffic split is statistically significantly different from what was expected   Correct Answer: The observed traffic split is statistically significantly different from what was expected Comments Entered: NAContinue reading “Exam answers for: for June 01 2022 13:46:09”

If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. What is Peeking?Answer Provided: ✓ Looking at test results before the test is complete with the intention of ending the test.   Correct Answer: Looking at test results before the test is complete with the intention ofContinue reading “Exam answers for: Bas Buiting for June 01 2022 13:45:51”

If you’d like to score higher on your next attempt, consider checking out these resources. ======= 1. What is Peeking?Answer Provided: ✓ Looking at test results before the test is complete with the intention of ending the test. Correct Answer: Looking at test results before the test is complete with the intention of ending the test.Continue reading “Exam answers for: Tobias Feldmann-Wüstefeld for May 31 2022 11:32:26”

If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. What is a safe increase in conversion rate that one can promise to a client/stakeholder?Answer Provided: ✓ You should never promise any outcomes   Correct Answer: You should never promise any outcomes Comments Entered: NA   2. WhichContinue reading “Exam answers for: Brad Croasdell for May 30 2022 11:22:30”

If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. Which of the following describes a “Holdout Group”?Answer Provided: ✓ A control group that does not get exposed to a treatment/variation   Correct Answer: A control group that does not get exposed to a treatment/variation Comments Entered:Continue reading “Exam answers for: Juanma Varo for May 30 2022 11:25:39”

    If you’d like to score higher on your next attempt, consider checking out these resources. =======     1. An experiment demonstrates a 10% decrease in conversion rate at a 99% confidence level. In what way is this still a ‘win’?Answer Provided: ✓ You’ve saved the business time and money which they might haveContinue reading “Exam answers for: Edd Saunders for May 18 2022 10:40:08”