Guide-linked quiz · Hard Level

Incrementality Testing and Uplift Modeling Quiz

Understand how holdouts estimate campaign incrementality, what uplift models predict, and why treatment effects need experiments and uncertainty checks.

Question 1 of 8

What does incrementality estimate?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. What does incrementality estimate?
    • Additional outcome caused by a treatment relative to a counterfactual
    • Total conversions attributed to a channel
    • The number of customers reached
    • The average response probability
  2. Why randomize a holdout group?
    • To ensure every customer receives the offer
    • To increase the campaign’s attribution credit
    • To create comparable treatment and control groups
    • To identify each person’s exact treatment effect
  3. What does uplift modeling estimate?
    • The number of times an ad was displayed
    • Variation in treatment effects across customers or groups
    • The total value of historical sales
    • The probability a customer will buy regardless of treatment
  4. Why can individual treatment effects not be directly observed?
    • Experiments do not record outcomes
    • Treatment is always assigned by the model
    • Customers never behave differently
    • Each person receives either treatment or control, not both states
  5. What does intent-to-treat compare?
    • Outcomes by randomized assignment, even if exposure differs
    • Only customers who clicked
    • Only conversions attributed to ads
    • The best and worst individual score
  6. Why report uncertainty around an experiment estimate?
    • Confidence intervals prove causation in all contexts
    • Uncertainty makes outcomes irrelevant
    • The measured difference may reflect sampling variation
    • A point estimate is always exact
  7. What can invalidate a simple treatment-control comparison?
    • Equal measurement windows
    • Different selection into treatment or substantial spillovers
    • Random assignment
    • A predeclared outcome
  8. How should teams use an uplift score?
    • As a guarantee an individual will benefit
    • As a replacement for experimental data
    • As proof of customer preference
    • As a hypothesis for prospective testing under consent and safeguards

Keep testing yourself

More quizzes picked for your level.

View all quizzes