Basisprincipes GIDS
Simpson's Paradox
Simpson’s paradox occurs when a trend seen within subgroups reverses or disappears after the subgroups are combined.
Op deze pagina3 minuten lezen
Overzicht
The reversal can result from different group sizes or compositions, but deciding which comparison is meaningful requires understanding the data-generating and causal question. Stratifying data is informative; it does not automatically prove bias, remove confounding, or identify a causal effect.
Diepe duik
Simpson’s paradox describes a reversal or disappearance of an association when data are aggregated over subgroups. For example, a treatment can show a higher success rate than a comparison within each severity group, yet a lower overall rate if the treated group contains more high-risk cases. Differences in the weights assigned to subgroups can change the aggregate. The pattern is an arithmetic property of the rates; it does not by itself say which comparison answers the decision question. The Berkeley graduate-admissions analysis by Bickel, Hammel, and O’Connell is a classic case. Aggregate acceptance rates appeared to favor male applicants, but department-level analysis showed much of the overall difference reflected application patterns across departments with different admission rates. The authors analyzed department-level data and discussed the limits of drawing a discrimination conclusion from aggregate proportions. This is not resolved simply by declaring that aggregate or stratified data are always correct. The relevant comparison depends on the question and causal structure. When a reversal appears, inspect denominators, subgroup composition, and the process assigning treatment or exposure. Consider whether the subgroup variable is a confounder, mediator, collider, or simply descriptive. Conditioning on a variable can reduce, create, or distort bias depending on the data-generating process. Report both aggregate and stratified estimates, explain their weights, and use study design or causal assumptions to choose an estimand. The paradox warns against inferring a causal story from a single summary table.
Strategische impact
Duidelijkere beslissingen
Het helpt u duidelijke technische claims te scheiden van marketingtaal.
Kosten en budget
U kunt betere implementatievragen stellen voordat u geld of tijd uitgeeft.
Team en workflow
Teams met gedeeld begrip nemen betere product-, beleids- en leerbeslissingen.
The Future of Simpson's Paradox
Simpson-type reversals remain important in dashboards, clinical studies, hiring, and A/B tests as datasets combine populations with different compositions. Better analytics can make subgroup views easier to inspect, but causal interpretation still requires domain knowledge and design assumptions. Teams should predefine meaningful strata and report denominator weights alongside aggregate outcomes. No single aggregation rule answers every question. Researchers should preserve analysis plans and report how alternative stratifications change conclusions, especially when findings inform high-stakes decisions. Define important subgroup comparisons before results are examined.
Implementatie in de echte wereld
A treatment appears more successful overall but less successful within both severity groups because assignment and group sizes differ.
A product conversion rate reverses after segments are combined because traffic volume differs across device types.
A reviewer compares aggregate and department-level admission rates and avoids treating either table alone as a causal conclusion.
A researcher uses a causal diagram and study design to decide whether a subgroup variable is a confounder, mediator, collider, or descriptive factor.
Risico's en vangrails
Verschillende teams kunnen dezelfde term verschillend gebruiken, dus definieer de reikwijdte vroeg.
Benchmarks kunnen er sterk uitzien, terwijl de prestaties in de echte wereld ongelijkmatig zijn.
Het negeren van datakwaliteit en evaluatieplannen zorgt vaak voor fragiele resultaten.
Implementatie routekaart
Begin met een definitie in duidelijke taal van het gewenste resultaat.
Kies één successtatistiek en één faalconditie voordat u gaat testen.
Voer een kleine pilot uit met representatieve gegevens, niet met een gepolijste demoset.
Document where Simpson's Paradox helps and where simpler methods are better.
Blijf verkennen
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Simpson's Paradox quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Veelgestelde vragen
What is Simpson's Paradox?
Simpson’s paradox occurs when a trend seen within subgroups reverses or disappears after the subgroups are combined. The reversal can result from different group sizes or compositions, but deciding which comparison is meaningful requires understanding the data-generating and causal question. Stratifying data is informative; it does not automatically prove bias, remove confounding, or identify a causal effect.
What pattern defines Simpson’s paradox?
The paradox concerns changes between subgroup and aggregate associations.
How can different subgroup sizes contribute to a reversal?
Aggregate rates weight subgroup rates by their denominator composition.
What did the Berkeley admissions analysis illustrate?
Bickel et al. showed aggregation can be misleading and interpreted department-level data with context.
When a treatment effect reverses by subgroup and overall, what should an analyst inspect?
Direction and interpretation depend on weighting and data-generating structure.
How should analysts interpret a Simpson-type reversal?
The pattern itself does not identify the causal explanation.
Blijf leren
Gerelateerde gidsen
Er zijn meer handleidingen voor dit onderwerp geselecteerd