Guide-linked quiz · Hard Level
Incrementality Testing and Uplift Modeling Quiz
Understand how holdouts estimate campaign incrementality, what uplift models predict, and why treatment effects need experiments and uncertainty checks.
Question 1 of 8
What does incrementality estimate?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- What does incrementality estimate?
- Additional outcome caused by a treatment relative to a counterfactual
- Total conversions attributed to a channel
- The number of customers reached
- The average response probability
- Why randomize a holdout group?
- To ensure every customer receives the offer
- To increase the campaign’s attribution credit
- To create comparable treatment and control groups
- To identify each person’s exact treatment effect
- What does uplift modeling estimate?
- The number of times an ad was displayed
- Variation in treatment effects across customers or groups
- The total value of historical sales
- The probability a customer will buy regardless of treatment
- Why can individual treatment effects not be directly observed?
- Experiments do not record outcomes
- Treatment is always assigned by the model
- Customers never behave differently
- Each person receives either treatment or control, not both states
- What does intent-to-treat compare?
- Outcomes by randomized assignment, even if exposure differs
- Only customers who clicked
- Only conversions attributed to ads
- The best and worst individual score
- Why report uncertainty around an experiment estimate?
- Confidence intervals prove causation in all contexts
- Uncertainty makes outcomes irrelevant
- The measured difference may reflect sampling variation
- A point estimate is always exact
- What can invalidate a simple treatment-control comparison?
- Equal measurement windows
- Different selection into treatment or substantial spillovers
- Random assignment
- A predeclared outcome
- How should teams use an uplift score?
- As a guarantee an individual will benefit
- As a replacement for experimental data
- As proof of customer preference
- As a hypothesis for prospective testing under consent and safeguards
Keep testing yourself
More quizzes picked for your level.