Ikibazo gihuza ibibazo · Biragoye Urwego

Gukoresha ChatGPT kubibazo bitandukanye byo gusuzuma

Gerageza icyo ubushakashatsi bwa Kanjee na Goh bwabonye kubijyanye no gusuzuma GPT-4, kuki ibipimo bya vignette byerekana neza uburiri bwigitanda, nuburyo inanga igira ingaruka kubitekerezo.

Inzira zijyanye no kuyoboraChatGPT Kubisuzuma Bitandukanye
Ikibazo 1 Bya 8

Mu kizamini cya Kanjee na bagenzi be 2023 cya GPT-4 kubibazo bya Clinicopathologique ya NEJM, ni kangahe wasuzumaga bwa nyuma ahantu hose hatandukanye?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Mu kizamini cya Kanjee na bagenzi be 2023 cya GPT-4 kubibazo bya Clinicopathologique ya NEJM, ni kangahe wasuzumaga bwa nyuma ahantu hose hatandukanye?
    • About 39 percent
    • About 64 percent
    • About 92 percent
    • About 15 percent
  2. Ni izihe ngaruka nyamukuru za 2024 Goh n'abandi. ikigeragezo cyateganijwe?
    • Physicians given GPT-4 scored far higher than those without it
    • GPT-4 alone performed worse than every physician
    • Giving physicians GPT-4 did not significantly improve their diagnostic reasoning scores, although GPT-4 alone scored higher
    • The trial was stopped for patient harm
  3. Ni ukubera iki ibipimo bya vignette byerekana uburyo urugero rwakora neza kubarwayi nyabo?
    • Vignettes arrive with the relevant findings already chosen and cleaned up, and published cases may be in training data
    • Vignettes are always written in another language
    • Real patients have fewer symptoms than vignettes
    • Models cannot read case descriptions longer than a paragraph
  4. Umuganga umwe arabaza ati: "Ibi birashobora kuba lupus?" mugitangira ikibazo cye. Ni ubuhe buryo bwo gutsindwa butumira?
    • Invented laboratory reference ranges
    • Refusing to answer medical questions
    • Losing the conversation history
    • Sycophantic anchoring toward the diagnosis the user suggested
  5. Kuki gutanga amanota "kwisuzumisha neza aho ariho hose kurutonde" ni igipimo kibi?
    • It rewards long lists, which can prompt unnecessary testing
    • It ignores the patient's age
    • It only works for pediatric cases
    • It requires the model to cite references
  6. Getting two differently ordered lists from nearly identical prompts shows what about the model's ranking?
    • The model is broken and should not be used
    • The second answer is always the correct one
    • The ranking is not a calibrated probability estimate and shifts with wording
    • The model is searching the live internet
  7. What is the main privacy concern with pasting a patient's chart into a consumer chatbot?
    • The chatbot will refuse clinical questions
    • Entering identifiable information without a business associate agreement can breach HIPAA
    • Consumer chatbots cannot read lab values
    • It automatically bills the patient's insurer
  8. Which prompt request best helps a clinician act on a model's differential?
    • "Give me the single correct diagnosis"
    • "Confirm my diagnosis is right"
    • "Write the discharge summary"
    • "List supporting and contradicting features for each item and the test that best separates the top candidates"