Back to News
InnovationAI Understanding briefing

AI in Healthcare Raises Health Equity, Algorithmic Bias and Disability Risks

A recent study by Georgetown University found that only 22 of 166 peer-reviewed articles addressing AI and health equity provided an explicit definition of health equity. Researchers also identified limited attention to individual medical conditions and a substantial concentration of research in the United States.

4 min readRead the linked source
Source-provided image accompanying AI in Healthcare Raises Health Equity, Algorithmic Bias and Disability Risks
Source referenceSource recorded
Publisher
beinsure.com
Source type
Linked source — primary-source status has not been established.
ContextUnderstand this in 60 seconds

Key terms

Algorithmic Bias
Systematic unfairness in model outputs caused by skewed data, assumptions, or modeling choices.
Bias
A consistent pattern of error or unfairness in data or model behavior.
AI Governance
Policies, standards, and oversight mechanisms that guide how AI is developed and used in society.

What happened

Researchers at Georgetown University examined 166 articles published between 2018 and early 2025, including commentaries, editorials, literature reviews, and other publications providing guidance on equitable AI use in healthcare delivery, health systems, and health services research. They found that only 22 articles explicitly defined health equity, and most of those definitions followed the World Health Organization's description of health equity as the absence of unfair, avoidable, or remediable differences between population groups.

The researchers searched four academic databases in January 2025 and found that just 22 articles explicitly defined health equity.

Most of those definitions followed the World Health Organization's description of health equity as the absence of unfair, avoidable, or remediable differences between population groups.

The review also identified substantial geographic differences in the research, with first authors affiliated with US institutions accounting for 116 articles, or 70% of the total.

The researchers argued that more condition-specific expertise is needed because AI can reproduce disparities already present in medical evidence.

They recommended involving radiologists, oncologists, gynaecologists, neurologists, and other clinicians alongside programmers and health equity specialists throughout model design, development, implementation, and evaluation.

Source details: beinsure.com

Why it matters

The study highlights the need for more condition-specific expertise in AI development to reduce the risk of worsening health disparities. It also emphasizes the importance of involving clinicians alongside programmers and health equity specialists throughout model design, development, implementation, and evaluation. The researchers recommended that healthcare organisations establish equity-focused programmes with continuous oversight and that national regulators incorporate frameworks based on the WHO definition of health equity into their evaluations.

The study highlights the need for more condition-specific expertise in AI development to reduce the risk of worsening health disparities.

It also emphasizes the importance of involving clinicians alongside programmers and health equity specialists throughout model design, development, implementation, and evaluation.

The researchers recommended that healthcare organisations establish equity-focused programmes with continuous oversight and that national regulators incorporate frameworks based on the WHO definition of health equity into their evaluations.

They also urged researchers to report results for population subgroups and marginalised communities rather than relying exclusively on aggregated performance measures.

Such reporting could help identify circumstances in which average improvements conceal deteriorating outcomes for particular patients.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Thinking Budget (Test-Time Tokens):1,024 tokens
Complex Accuracy79%Math & Code Logic
Latency3.2sTime to first full output
Inference Cost$0.0092Per query estimated
Reasoning StyleStep VerificationInternal chain depth
Active Thinking Trace:
1Deconstruct user problem into formal constraints
2Propose candidate hypotheses & step-by-step calculation
3Self-correction: Backtrack and refute subtle edge cases
4Exhaustive consistency check & final output synthesis
Core takeaway: Test-time compute fundamentally changes AI economics. Instead of only scaling during pre-training, giving reasoning models more tokens at inference time allows them to systematically solve PhD-level STEM problems.
Interactive Concept Check+10 Points
What is AI? Quiz

A route planner searches possible journeys using explicit rules. What does this illustrate about AI?

What to watch next

The study's findings have significant implications for the development and deployment of AI in healthcare. It highlights the need for greater transparency about how AI is used in healthcare decisions and patient communications, particularly for applications affecting privacy, safety, or legal rights. Patient involvement during development may help identify problems that would otherwise become apparent only after deployment.

The study's findings have significant implications for the development and deployment of AI in healthcare.

It highlights the need for greater transparency about how AI is used in healthcare decisions and patient communications, particularly for applications affecting privacy, safety, or legal rights.

Patient involvement during development may help identify problems that would otherwise become apparent only after deployment.

The evidence from predictive algorithms, clinical decision-support experiments, and disability research indicates that healthcare AI requires evaluation beyond aggregate technical accuracy.

Its effects also depend on the outcomes selected for prediction, the populations represented in training data, and the clinical decisions made using its recommendations.

Related guides & quizzes

Found this useful?