ToepassingenGIDS

AI-Drafted Replies to Patient Portal Messages

AI-drafted replies are responses that a language model writes inside a clinician's EHR inbox for a patient's portal message.

  • 4 minuten lezen
  • Laatst bijgewerkt
Op deze pagina4 minuten lezen
  1. Overzicht
  2. Diepe duik
  3. Strategische impact
  4. The Future of AI-Drafted Replies to Patient Portal Messages
  5. Implementatie in de echte wereld
  6. Risico's en vangrails
  7. Implementatie routekaart
  8. Blijf verkennen
  9. Veelgestelde vragen

Overzicht

A clinician must review, edit and send each one. Early studies suggest the drafts can reduce the mental burden of inbox work and are often seen as empathetic, but they have not reliably saved time, and their safety depends on careful human review.

Diepe duik

Large-scale use started in 2023, when Epic and Microsoft began offering GPT-4-based draft replies through Azure OpenAI. Early adopters included UC San Diego Health, UW Health and Stanford Health Care. In a typical setup, the system reads a patient message and some chart context, then shows a suggested reply. The clinician can start from the draft or start blank. Nothing goes to the patient automatically. The research is mixed. A 2023 study by Ayers and colleagues in JAMA Internal Medicine compared ChatGPT answers with physician answers to public health questions posted on Reddit. Evaluators preferred the chatbot answers in most comparisons and rated them higher for quality and empathy. That setting was not a real clinical inbox. Studies inside health systems give a more modest picture. A Stanford study by Garcia and colleagues in JAMA Network Open in 2024 found clinicians used drafts for about a fifth of messages, with reductions in task load and burnout scores but no significant time savings. A 2024 UC San Diego study by Tai-Seale and colleagues found no drop in reply time, longer time spent reading messages, and longer replies. Safety research shows why review matters. A 2024 simulation study at Mass General Brigham, published in Lancet Digital Health, found that a small share of unedited GPT-4 drafts could have caused severe harm if sent. Physicians who used drafts sometimes left the model's content in place. That is automation bias: people tend to accept a fluent draft. The main misconception is that drafting is mainly a time-saver. The evidence so far points more to reduced mental burden than to saved minutes. Disclosure is becoming a legal issue too. California's AB 3030, effective in 2025, requires health providers to disclose AI-generated patient communications unless a licensed provider reviewed them.

Strategische impact

Bouwkeuzes

Ontwerp op applicatieniveau bepaalt of AI de werkelijke resultaten verbetert.

Team en workflow

Een goede workflowintegratie zorgt voor productiviteitswinst waar gebruikers op kunnen vertrouwen.

Risico en veiligheid

Goed gedefinieerde gebruiksscenario's verminderen de veranderingsmoeheid en het implementatierisico.

The Future of AI-Drafted Replies to Patient Portal Messages

Inbox drafting is likely to spread because message volume keeps rising, but the reasons to adopt it are shifting from saved minutes to reduced strain on clinicians. That claim needs longer follow-up to confirm. Better use of chart context and more careful triage of which messages get drafts may improve accuracy. The bigger risk remains automation bias, so training, audits and interface designs that make editing easy will matter as much as the model. Expect more attention to patient disclosure and consent as states and health systems set rules. The open research question is whether drafts change outcomes for patients, not only for clinicians.

Implementatie in de echte wereld

A nurse opens a patient's message about a cough that has lasted three weeks. She finds a pre-written draft asking about fever and shortness of breath, edits it to offer a same-week visit, and sends it.

A physician discards a draft that told a patient to double a blood pressure medication, because the model did not see yesterday's lab results showing high potassium.

A health system adds a line to replies saying the message was drafted with AI help and reviewed by a clinician, so patients know how their care team uses the tool.

An organization turns off drafting for test result messages and possible emergencies, sending those to nurse triage with no AI draft.

Risico's en vangrails

  • Het automatiseren van een kapot proces kan bestaande problemen versterken.

  • Teams kunnen overautomatiseren en het benodigde menselijke oordeel wegnemen.

  • De kwaliteit kan afwijken als de resultaten niet voortdurend worden geëvalueerd.

Implementatie routekaart

  1. Breng de huidige workflow in kaart en identificeer de stap met de hoogste wrijving.

  2. Definieer menselijke controlepunten vóór volledige automatisering.

  3. Train gebruikers op het gebied van prompts, escalatiepaden en kwaliteitsnormen.

  4. Volg de resultaten op taakniveau om duurzame waarde te bevestigen.

Blijf verkennen

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the AI-Drafted Replies to Patient Portal Messages quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Quiz starten

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Veelgestelde vragen

What is AI-Drafted Replies to Patient Portal Messages?

AI-drafted replies are responses that a language model writes inside a clinician's EHR inbox for a patient's portal message. A clinician must review, edit and send each one. Early studies suggest the drafts can reduce the mental burden of inbox work and are often seen as empathetic, but they have not reliably saved time, and their safety depends on careful human review.

What did the 2024 Stanford study by Garcia and colleagues find about AI-drafted inbox replies?

Clinicians used drafts for about a fifth of messages. Burden measures improved, but time did not change significantly.

Why does the Ayers 2023 study not prove AI drafts beat physicians in real clinical inboxes?

The study rated chatbot and physician answers to public forum questions, which lack real chart context and patient relationships.

The UC San Diego study by Tai-Seale and colleagues found which pattern?

Reply time did not fall, reading time rose, and replies got longer. That undercuts the idea that drafting mainly saves time.

A physician leaves a fluent draft mostly unchanged even though it contains an error. What is this tendency called?

Automation bias is the tendency to accept machine output, especially fluent output, without enough scrutiny.

A draft tells a patient to double a blood pressure medication, missing yesterday's high potassium result. What risk does this show?

If key data such as a new lab result is not in the prompt, the model can give a confident but unsafe answer.