Grunnleggende GUIDE
Simpson's Paradox
Simpson’s paradox occurs when a trend seen within subgroups reverses or disappears after the subgroups are combined.
På denne siden3 minutters lesing
Oversikt
The reversal can result from different group sizes or compositions, but deciding which comparison is meaningful requires understanding the data-generating and causal question. Stratifying data is informative; it does not automatically prove bias, remove confounding, or identify a causal effect.
Dypdykk
Simpson’s paradox describes a reversal or disappearance of an association when data are aggregated over subgroups. For example, a treatment can show a higher success rate than a comparison within each severity group, yet a lower overall rate if the treated group contains more high-risk cases. Differences in the weights assigned to subgroups can change the aggregate. The pattern is an arithmetic property of the rates; it does not by itself say which comparison answers the decision question. The Berkeley graduate-admissions analysis by Bickel, Hammel, and O’Connell is a classic case. Aggregate acceptance rates appeared to favor male applicants, but department-level analysis showed much of the overall difference reflected application patterns across departments with different admission rates. The authors analyzed department-level data and discussed the limits of drawing a discrimination conclusion from aggregate proportions. This is not resolved simply by declaring that aggregate or stratified data are always correct. The relevant comparison depends on the question and causal structure. When a reversal appears, inspect denominators, subgroup composition, and the process assigning treatment or exposure. Consider whether the subgroup variable is a confounder, mediator, collider, or simply descriptive. Conditioning on a variable can reduce, create, or distort bias depending on the data-generating process. Report both aggregate and stratified estimates, explain their weights, and use study design or causal assumptions to choose an estimand. The paradox warns against inferring a causal story from a single summary table.
Strategisk innvirkning
Tydeligere avgjørelser
Det hjelper deg å skille klare tekniske påstander fra markedsføringsspråk.
Kostnad og budsjett
Du kan stille bedre implementeringsspørsmål før du bruker penger eller tid.
Team og arbeidsflyt
Team med delt forståelse tar bedre produkt-, policy- og læringsbeslutninger.
The Future of Simpson's Paradox
Simpson-type reversals remain important in dashboards, clinical studies, hiring, and A/B tests as datasets combine populations with different compositions. Better analytics can make subgroup views easier to inspect, but causal interpretation still requires domain knowledge and design assumptions. Teams should predefine meaningful strata and report denominator weights alongside aggregate outcomes. No single aggregation rule answers every question. Researchers should preserve analysis plans and report how alternative stratifications change conclusions, especially when findings inform high-stakes decisions. Define important subgroup comparisons before results are examined.
Real-World Implementering
A treatment appears more successful overall but less successful within both severity groups because assignment and group sizes differ.
A product conversion rate reverses after segments are combined because traffic volume differs across device types.
A reviewer compares aggregate and department-level admission rates and avoids treating either table alone as a causal conclusion.
A researcher uses a causal diagram and study design to decide whether a subgroup variable is a confounder, mediator, collider, or descriptive factor.
Risikoer og rekkverk
Ulike team kan bruke samme begrep forskjellig, så definer omfang tidlig.
Benchmarks kan se sterke ut mens ytelsen i den virkelige verden er ujevn.
Å ignorere datakvalitet og evalueringsplaner skaper ofte skjøre resultater.
Veikart for implementering
Start med en klarspråklig definisjon av resultatet du trenger.
Velg én suksessberegning og én feilbetingelse før testing.
Kjør en liten pilot med representative data, ikke et polert demosett.
Document where Simpson's Paradox helps and where simpler methods are better.
Fortsett å utforske
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Simpson's Paradox quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ofte stilte spørsmål
What is Simpson's Paradox?
Simpson’s paradox occurs when a trend seen within subgroups reverses or disappears after the subgroups are combined. The reversal can result from different group sizes or compositions, but deciding which comparison is meaningful requires understanding the data-generating and causal question. Stratifying data is informative; it does not automatically prove bias, remove confounding, or identify a causal effect.
What pattern defines Simpson’s paradox?
The paradox concerns changes between subgroup and aggregate associations.
How can different subgroup sizes contribute to a reversal?
Aggregate rates weight subgroup rates by their denominator composition.
What did the Berkeley admissions analysis illustrate?
Bickel et al. showed aggregation can be misleading and interpreted department-level data with context.
When a treatment effect reverses by subgroup and overall, what should an analyst inspect?
Direction and interpretation depend on weighting and data-generating structure.
How should analysts interpret a Simpson-type reversal?
The pattern itself does not identify the causal explanation.
Fortsett å lære
Relaterte guider
Flere guider valgt for dette emnet