LegközelebbKövetkező útmutató
Elfogultság a tartalommoderálási algoritmusokban
Társadalom
Társadalom ÚTMUTATÓ
A 2019 Science study found racial bias in a widely used population-health algorithm because it predicted future healthcare costs as a proxy for health need.
Hallgassa meg ezt az útmutatótAI-narrált · ~3 min
At the same risk score, Black patients were sicker than White patients; changing the proxy increased Black patients selected for extra support from 17.7% to 46.5% in that study. The result concerns a specific algorithm and sample, not every healthcare model.
Obermeyer and coauthors’ 2019 Science study examined a commercial algorithm used to identify patients with complex health needs for extra care-management support. The tool predicted future healthcare spending as a proxy for health need. The authors found that, at a given risk score, Black patients were considerably sicker than White patients, as measured by uncontrolled illness. The study’s mechanism was structural: because Black patients had historically received less care and generated lower costs at similar levels of illness, a cost-prediction target understated their need. The proxy appeared predictive of spending while encoding unequal access to care. In the study population, replacing the cost target with a measure more closely related to illness would have increased the proportion of Black patients receiving additional help from 17.7% to 46.5%. That figure describes the study’s reallocation result, not a nationwide estimate or a general expected correction rate. The research affected an algorithm used across multiple health systems and drew attention to how proxies can transmit inequity without explicitly including race. It did not show that every use of cost data is biased or that the same pattern appears in every model. The broader lesson is to examine whether a target variable represents the desired construct. Expenditure reflects illness, but also insurance, access, clinician decisions, service availability and historical patterns. A model can be statistically accurate for its proxy and still fail the operational objective of identifying people who need care. Follow-up audits should assess patient-level health outcomes, access to interventions and subgroup effects, while recognizing that the 2019 result is specific to one algorithm, intended use and dataset.
A health system audits whether historical spending reflects unequal access to care before using cost to allocate extra disease-management support.
A model team compares predicted cost with clinical need and outcomes across racial groups rather than treating spending as a neutral health label.
A reviewer checks whether a risk score under-selects Black patients who have comparable or greater illness burden.
A governance committee repeats an evaluation after changing the target from cost to a clinically grounded measure of need.
The study remains an important example of proxy-target bias, while later systems and datasets require their own evaluation. Health systems should periodically recheck targets, access patterns and outcomes as models or care programs change; do not generalize a 2019 result to a different algorithm without evidence. Keep a dated record of the primary source or study behind each claim and revisit conclusions when new evidence or implementation details emerge. As care pathways and insurance coverage change, cost and utilization data may shift independently from underlying disease burden.
Ingyenes hírlevél
Minden hétköznap reggel három ellenőrzött AI történet, egyszerű angol nyelven. Örökké ingyen, hirdetések nélkül.
Minden hétköznap egy e-mail. Egy kattintással lemondhat. Soha nem értékesítjük vagy osztjuk meg az Ön címét.
Teszteld magad
Azonnali visszajelzés minden válaszra, és megosztható tanúsítvány egy ellenőrizhető azonosítóval, miután sikeresen teljesít egy kurzust.
Támogassa az ingyenes AI oktatást. AI Understanding egy 501(c)(3) nonprofit – nincs hirdetés, nincs fizetőfal, soha. Tegyen adományt
A 2019 Science study found racial bias in a widely used population-health algorithm because it predicted future healthcare costs as a proxy for health need. At the same risk score, Black patients were sicker than White patients; changing the proxy increased Black patients selected for extra support from 17.7% to 46.5% in that study. The result concerns a specific algorithm and sample, not every healthcare model.
The study reports the algorithm predicted healthcare costs, which were used as a proxy for health need.
The paper found Black patients were sicker at a given score, based on signs of uncontrolled illness.
The authors link the proxy’s bias to lower spending on Black patients relative to White patients with similar illness.
The authors report the proportion would rise from 17.7% to 46.5% under the alternative target.
The paper identifies cost as a proxy for health, which did not capture unequal access and illness burden.
Tanulj tovább
További útmutatók készültek ehhez a témához
LegközelebbKövetkező útmutató
Elfogultság a tartalommoderálási algoritmusokban
Társadalom