GUIA DA SOCIEDADE

IA na previsão de risco de suicídio

AI suicide risk prediction uses statistical and machine learning models built on health records to estimate which patients have a higher chance of a suicide attempt or death in the coming months, so health systems can prioritize outreach and assessment.

  • 4 minutos de leitura
  • Última atualização
Nesta página4 minutos de leitura
  1. Visão geral
  2. Mergulho profundo
  3. Impacto Estratégico
  4. The Future of AI in Suicide Risk Prediction
  5. Implementação no mundo real
  6. Riscos e guarda-corpos
  7. Roteiro de implementação
  8. Continue explorando
  9. Perguntas frequentes

Visão geral

It matters because many people who die by suicide saw a health care provider in the year before, and clinicians' unaided predictions have proven only slightly better than chance. Even strong models flag far more people who will not attempt suicide than people who will.

Mergulho profundo

Most health system models draw on data already in the electronic health record: prior suicide attempts and self-harm diagnoses, mental health and substance use diagnoses, prescriptions, emergency visits and inpatient stays, and screening answers such as item 9 of the PHQ-9, which asks about thoughts of death or self-harm. Methods range from penalized logistic regression to random forests and gradient-boosted trees. Well-known efforts include models from the Mental Health Research Network, which includes Kaiser Permanente sites, work at Vanderbilt University Medical Center, and the VA's REACH VET, launched in 2017, which flags roughly the top 0.1 percent of risk scores for review. Several large studies report good discrimination, meaning the models rank higher-risk patients above lower-risk ones reasonably well. The main misconception is that these models predict who will die. They do not. Suicide is rare in any given month, so even an accurate model produces mostly false positives; most flagged patients will never attempt. The models are best understood as tools for prioritizing limited clinical attention. That makes the response to a flag the real ethical question. Good practice treats a flag as a reason for caring, voluntary outreach: a check-in, a review of the care plan, safety planning, and discussing limits on access to lethal means such as safe firearm storage. Poor practice uses flags punitively or coercively, shares them outside clinical care, or leaves them unexplained to patients. Health systems also need to test performance across racial, ethnic, age and sex groups, because a model trained on past records inherits gaps in who was diagnosed and treated. Outside health care, platforms such as Facebook have used automated detection of suicidal posts since 2017, with much less public validation.

Impacto Estratégico

Risco e segurança

Os danos catastróficos e diários da IA ​​dependem de quem entende os riscos e de quem pode agir.

Decisões mais claras

A literacia pública e profissional determina se uma política de segurança forte é politicamente possível.

Cortando o hype

Explicações claras reduzem a captura por exageros, relações públicas de laboratório e teatro de ética vaga.

The Future of AI in Suicide Risk Prediction

Researchers are exploring richer inputs, such as clinical notes processed with language models, alongside traditional structured data, though more inputs raise privacy concerns and do not guarantee better outcomes. The central open question is less about accuracy than about impact: whether flag-driven programs reduce suicide attempts and deaths compared with good usual care. Expect more emphasis on fairness audits, transparency with patients and pairing models with proven interventions such as safety planning and follow-up contacts. Claims of dramatic accuracy gains should be judged by prospective results, not retrospective ones.

Implementação no mundo real

The US Department of Veterans Affairs' REACH VET program scores veterans in VA care each month, and a local coordinator reviews the highest-risk group with their providers to check care plans and arrange contact.

A health system shows a risk score at outpatient mental health visits, prompting the clinician to run a structured assessment such as the Columbia Suicide Severity Rating Scale instead of relying on the score alone.

An emergency department uses a model flag to trigger a safety planning intervention before discharge, followed by caring contacts such as brief follow-up messages.

A health system audits its model, finds it performs worse for one demographic group, and recalibrates it before expanding its use.

Riscos e guarda-corpos

  • Tratar o risco existencial como ficção científica enquanto aumenta a capacidade.

  • Confundir segurança do produto de superfície com alinhamento sob alta autonomia.

  • Deixando o público não-inglês e não especializado com apenas fontes de baixa qualidade.

Roteiro de implementação

  1. Separe os riscos de danos ao produto, uso indevido e perda de controle/desalinhamento.

  2. Pergunte quais evidências mudariam sua visão sobre prazos e gravidade.

  3. Prefira fontes primárias e avaliações concretas em vez de afirmações de marketing.

  4. Identifique um caminho de ação: carreira, política, financiamento ou habilidades – não apenas conscientização.

Continue explorando

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the AI in Suicide Risk Prediction quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Iniciar teste

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Perguntas frequentes

What is AI in Suicide Risk Prediction?

AI suicide risk prediction uses statistical and machine learning models built on health records to estimate which patients have a higher chance of a suicide attempt or death in the coming months, so health systems can prioritize outreach and assessment. It matters because many people who die by suicide saw a health care provider in the year before, and clinicians' unaided predictions have proven only slightly better than chance. Even strong models flag far more people who will not attempt suicide than people who will.

A model with 90 percent sensitivity and specificity is applied where 100 of 100,000 patients attempt suicide. Roughly what share of flagged patients will actually attempt?

It catches about 90 true cases but also flags about 9,990 people who will not attempt, so positive predictive value falls below 1 percent.

According to the guide, what are suicide risk models best understood as?

Because suicide is rare, even accurate models mostly flag people who will not attempt. They help decide where to focus outreach, not who will die.

Roughly what share of risk scores does the VA's REACH VET program flag for review?

REACH VET, launched in 2017, flags roughly the top 0.1 percent of scores for review by a local coordinator and providers.

Why do health systems often set flagging thresholds by capacity?

A flag is only useful if someone can act on it, so thresholds are matched to the outreach staff available.

Which response to a risk flag fits the ethical practice described in the guide?

Good practice treats a flag as a reason for caring, voluntary contact, including means safety, rather than punitive or coercive action.