āĻĒāϰāĻŦāϰā§āϤ⧠āĻāĻĒāĻĒāϰāĻŦāϰā§āϤ⧠āĻāĻžāĻāĻĄ
āĻāύā§āĻā§āύā§āĻ āĻŽāĻĄāĻžāϰā§āĻļāύ āĻ ā§āϝāĻžāϞāĻāϰāĻŋāĻĻāĻŽā§ āĻĒāĻā§āώāĻĒāĻžāϤ
āϏāĻŽāĻžāĻ
āϏā§āϏāĻžāĻāĻāĻŋ āĻāĻžāĻāĻĄ
A 2019 Science study found racial bias in a widely used population-health algorithm because it predicted future healthcare costs as a proxy for health need.
āĻāĻ āύāĻŋāϰā§āĻĻā§āĻļāĻŋāĻāĻž āĻļā§āύā§āύāĻāĻāĻ-āĻŦāϰā§āĻŖāĻŋāϤ ¡ ~3 min
At the same risk score, Black patients were sicker than White patients; changing the proxy increased Black patients selected for extra support from 17.7% to 46.5% in that study. The result concerns a specific algorithm and sample, not every healthcare model.
Obermeyer and coauthorsâ 2019 Science study examined a commercial algorithm used to identify patients with complex health needs for extra care-management support. The tool predicted future healthcare spending as a proxy for health need. The authors found that, at a given risk score, Black patients were considerably sicker than White patients, as measured by uncontrolled illness. The studyâs mechanism was structural: because Black patients had historically received less care and generated lower costs at similar levels of illness, a cost-prediction target understated their need. The proxy appeared predictive of spending while encoding unequal access to care. In the study population, replacing the cost target with a measure more closely related to illness would have increased the proportion of Black patients receiving additional help from 17.7% to 46.5%. That figure describes the studyâs reallocation result, not a nationwide estimate or a general expected correction rate. The research affected an algorithm used across multiple health systems and drew attention to how proxies can transmit inequity without explicitly including race. It did not show that every use of cost data is biased or that the same pattern appears in every model. The broader lesson is to examine whether a target variable represents the desired construct. Expenditure reflects illness, but also insurance, access, clinician decisions, service availability and historical patterns. A model can be statistically accurate for its proxy and still fail the operational objective of identifying people who need care. Follow-up audits should assess patient-level health outcomes, access to interventions and subgroup effects, while recognizing that the 2019 result is specific to one algorithm, intended use and dataset.
A health system audits whether historical spending reflects unequal access to care before using cost to allocate extra disease-management support.
A model team compares predicted cost with clinical need and outcomes across racial groups rather than treating spending as a neutral health label.
A reviewer checks whether a risk score under-selects Black patients who have comparable or greater illness burden.
A governance committee repeats an evaluation after changing the target from cost to a clinically grounded measure of need.
The study remains an important example of proxy-target bias, while later systems and datasets require their own evaluation. Health systems should periodically recheck targets, access patterns and outcomes as models or care programs change; do not generalize a 2019 result to a different algorithm without evidence. Keep a dated record of the primary source or study behind each claim and revisit conclusions when new evidence or implementation details emerge. As care pathways and insurance coverage change, cost and utilization data may shift independently from underlying disease burden.
āĻĢā§āϰāĻŋ āύāĻŋāĻāĻāϞā§āĻāĻžāϰ
āĻĒā§āϰāϤāĻŋ āϏāĻĒā§āϤāĻžāĻšā§āϰ āĻāĻžāĻā§āϰ āĻĻāĻŋāύ āϏāĻāĻžāϞ⧠āϤāĻŋāύāĻāĻŋ āϝāĻžāĻāĻžāĻāĻā§āϤ āĻāĻāĻ āϏā§āĻā§āϰāĻŋ, āϏāĻšāĻ āĻāĻāϰā§āĻāĻŋāϤ⧠āϞā§āĻāĻžāĨ¤ āĻāĻŋāϰāĻāĻžāϞā§āϰ āĻāύā§āϝ āĻĢā§āϰāĻŋ, āĻā§āύ⧠āĻŦāĻŋāĻā§āĻāĻžāĻĒāύ āύā§āĻāĨ¤
āĻĒā§āϰāϤāĻŋ āϏāĻĒā§āϤāĻžāĻšā§āϰ āĻāĻžāĻā§āϰ āĻĻāĻŋāύ⧠āĻāĻāĻāĻŋ āĻāĻŽā§āϞāĨ¤ āĻāĻ āĻā§āϞāĻŋāĻā§āĻ āĻāύāϏāĻžāĻŦāϏā§āĻā§āϰāĻžāĻāĻŦ āĻāϰā§āύāĨ¤ āĻāĻŽāϰāĻž āĻāĻāύā§āĻ āĻāĻĒāύāĻžāϰ āĻ āĻŋāĻāĻžāύāĻž āĻŦāĻŋāĻā§āϰāĻŋ āĻŦāĻž āĻļā§ā§āĻžāϰ āĻāϰāĻŋ āύāĻžāĨ¤
āύāĻŋāĻā§āĻā§ āĻĒāϰā§āĻā§āώāĻž āĻāϰā§āύ
āĻĒā§āϰāϤāĻŋāĻāĻŋ āĻāϤā§āϤāϰā§āϰ āϤāĻžā§āĻā§āώāĻŖāĻŋāĻ āĻĢāĻŋāĻĄāĻŦā§āϝāĻžāĻ, āĻāĻŦāĻ āĻā§āϰā§āϏ āĻĒāĻžāϏ āĻāϰāĻžāϰ āĻĒāϰ āϝāĻžāĻāĻžāĻāϝā§āĻā§āϝ āĻāĻāĻĄāĻŋ āϏāĻš āĻāĻāĻāĻŋ āĻļā§ā§āĻžāϰāϝā§āĻā§āϝ āϏāĻžāϰā§āĻāĻŋāĻĢāĻŋāĻā§āĻāĨ¤
āĻĢā§āϰāĻŋ āĻāĻāĻ āĻļāĻŋāĻā§āώāĻžāĻā§ āϏāĻŽāϰā§āĻĨāύ āĻāϰā§āύāĨ¤ AI Understanding āĻāĻāĻāĻŋ 501(c)(3) āĻ āϞāĻžāĻāĻāύāĻ āĻĒā§āϰāϤāĻŋāώā§āĻ āĻžāύ â āĻā§āύ⧠āĻŦāĻŋāĻā§āĻāĻžāĻĒāύ āύā§āĻ, āĻā§āύ⧠āĻĒā§āĻā§āĻžāϞ āύā§āĻ, āĻāĻāύā§āĻ āύāĻžāĨ¤ āĻāĻāĻāĻŋ āĻĻāĻžāύ āĻāϰā§āύ
A 2019 Science study found racial bias in a widely used population-health algorithm because it predicted future healthcare costs as a proxy for health need. At the same risk score, Black patients were sicker than White patients; changing the proxy increased Black patients selected for extra support from 17.7% to 46.5% in that study. The result concerns a specific algorithm and sample, not every healthcare model.
The study reports the algorithm predicted healthcare costs, which were used as a proxy for health need.
The paper found Black patients were sicker at a given score, based on signs of uncontrolled illness.
The authors link the proxyâs bias to lower spending on Black patients relative to White patients with similar illness.
The authors report the proportion would rise from 17.7% to 46.5% under the alternative target.
The paper identifies cost as a proxy for health, which did not capture unequal access and illness burden.
āĻļāĻŋāĻāϤ⧠āĻĨāĻžāĻā§āύ
āĻāĻ āĻŦāĻŋāώāϝāĻŧā§āϰ āĻāύā§āϝ āĻŦāĻžāĻāĻžāĻ āĻāϰāĻž āĻāϰāĻ āĻāĻžāĻāĻĄ
āĻĒāϰāĻŦāϰā§āϤ⧠āĻāĻĒāĻĒāϰāĻŦāϰā§āϤ⧠āĻāĻžāĻāĻĄ
āĻāύā§āĻā§āύā§āĻ āĻŽāĻĄāĻžāϰā§āĻļāύ āĻ ā§āϝāĻžāϞāĻāϰāĻŋāĻĻāĻŽā§ āĻĒāĻā§āώāĻĒāĻžāϤ
āϏāĻŽāĻžāĻ