이 페이지에서4분 읽기
개요
It matters because many people who die by suicide saw a health care provider in the year before, and clinicians' unaided predictions have proven only slightly better than chance. Even strong models flag far more people who will not attempt suicide than people who will.
심층 분석
Most health system models draw on data already in the electronic health record: prior suicide attempts and self-harm diagnoses, mental health and substance use diagnoses, prescriptions, emergency visits and inpatient stays, and screening answers such as item 9 of the PHQ-9, which asks about thoughts of death or self-harm. Methods range from penalized logistic regression to random forests and gradient-boosted trees. Well-known efforts include models from the Mental Health Research Network, which includes Kaiser Permanente sites, work at Vanderbilt University Medical Center, and the VA's REACH VET, launched in 2017, which flags roughly the top 0.1 percent of risk scores for review. Several large studies report good discrimination, meaning the models rank higher-risk patients above lower-risk ones reasonably well. The main misconception is that these models predict who will die. They do not. Suicide is rare in any given month, so even an accurate model produces mostly false positives; most flagged patients will never attempt. The models are best understood as tools for prioritizing limited clinical attention. That makes the response to a flag the real ethical question. Good practice treats a flag as a reason for caring, voluntary outreach: a check-in, a review of the care plan, safety planning, and discussing limits on access to lethal means such as safe firearm storage. Poor practice uses flags punitively or coercively, shares them outside clinical care, or leaves them unexplained to patients. Health systems also need to test performance across racial, ethnic, age and sex groups, because a model trained on past records inherits gaps in who was diagnosed and treated. Outside health care, platforms such as Facebook have used automated detection of suicidal posts since 2017, with much less public validation.
전략적 영향
위험과 안전
치명적인 AI 피해와 일상적인 AI 피해는 누가 위험을 이해하고 누가 조치를 취할 수 있는지에 따라 달라집니다.
더 명확한 결정들
공공 및 전문 지식은 강력한 안전 정책이 정치적으로 가능한지 여부를 결정합니다.
과장된 과장을 뚫고 나가기
명확한 설명은 과대광고, 연구실 홍보, 모호한 윤리 연극에 의한 포착을 줄입니다.
The Future of AI in Suicide Risk Prediction
Researchers are exploring richer inputs, such as clinical notes processed with language models, alongside traditional structured data, though more inputs raise privacy concerns and do not guarantee better outcomes. The central open question is less about accuracy than about impact: whether flag-driven programs reduce suicide attempts and deaths compared with good usual care. Expect more emphasis on fairness audits, transparency with patients and pairing models with proven interventions such as safety planning and follow-up contacts. Claims of dramatic accuracy gains should be judged by prospective results, not retrospective ones.
실제 구현
The US Department of Veterans Affairs' REACH VET program scores veterans in VA care each month, and a local coordinator reviews the highest-risk group with their providers to check care plans and arrange contact.
A health system shows a risk score at outpatient mental health visits, prompting the clinician to run a structured assessment such as the Columbia Suicide Severity Rating Scale instead of relying on the score alone.
An emergency department uses a model flag to trigger a safety planning intervention before discharge, followed by caring contacts such as brief follow-up messages.
A health system audits its model, finds it performs worse for one demographic group, and recalibrates it before expanding its use.
위험 및 가드레일
실존적 위험을 공상과학처럼 다루면서 능력을 합성합니다.
높은 자율성 하에서 정렬과 표면 제품 안전성을 혼동합니다.
영어가 아니거나 전문가가 아닌 청중에게는 품질이 낮은 소스만 남겨 둡니다.
구현 로드맵
제품 손상, 오용, 통제력 상실/잘못 정렬 위험을 분리합니다.
일정과 심각도에 대한 귀하의 견해를 바꿀 수 있는 증거가 무엇인지 물어보십시오.
마케팅 주장보다 기본 소스와 구체적인 평가를 선호하세요.
인식뿐만 아니라 경력, 정책, 자금 조달 또는 기술 등 하나의 행동 경로를 식별하십시오.
계속 탐색하세요
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AI in Suicide Risk Prediction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
자주 묻는 질문
What is AI in Suicide Risk Prediction?
AI suicide risk prediction uses statistical and machine learning models built on health records to estimate which patients have a higher chance of a suicide attempt or death in the coming months, so health systems can prioritize outreach and assessment. It matters because many people who die by suicide saw a health care provider in the year before, and clinicians' unaided predictions have proven only slightly better than chance. Even strong models flag far more people who will not attempt suicide than people who will.
A model with 90 percent sensitivity and specificity is applied where 100 of 100,000 patients attempt suicide. Roughly what share of flagged patients will actually attempt?
It catches about 90 true cases but also flags about 9,990 people who will not attempt, so positive predictive value falls below 1 percent.
According to the guide, what are suicide risk models best understood as?
Because suicide is rare, even accurate models mostly flag people who will not attempt. They help decide where to focus outreach, not who will die.
Roughly what share of risk scores does the VA's REACH VET program flag for review?
REACH VET, launched in 2017, flags roughly the top 0.1 percent of scores for review by a local coordinator and providers.
Why do health systems often set flagging thresholds by capacity?
A flag is only useful if someone can act on it, so thresholds are matched to the outreach staff available.
Which response to a risk flag fits the ethical practice described in the guide?
Good practice treats a flag as a reason for caring, voluntary contact, including means safety, rather than punitive or coercive action.
계속 학습하세요
관련 가이드
이 주제에 대해 선택된 추가 가이드