Kuiz berkaitan panduan · Keras Tahap

Menggunakan ChatGPT untuk Kuiz Diagnosis Perbezaan

Menguji perkara yang ditemui oleh kajian Kanjee dan Goh tentang diagnosis GPT-4, sebab penanda aras vignet melebih-lebihkan ketepatan sisi katil dan cara berlabuh mempengaruhi gesaan.

Laluan panduan yang berkaitanChatGPT Untuk Diagnosis Pembezaan
soalan 1 daripada 8

Dalam ujian Kanjee dan rakan-rakannya pada tahun 2023 terhadap GPT-4 pada kes klinikopatologi NEJM, kira-kira berapa kerapkah diagnosis akhir berada di mana-mana bahagian dalam diagnosis perbezaan model tersebut?

Pratonton setiap soalan8 soalan

Jawapan dan penjelasan muncul semasa anda mengambil kuiz.

  1. Dalam ujian Kanjee dan rakan-rakannya pada tahun 2023 terhadap GPT-4 pada kes klinikopatologi NEJM, kira-kira berapa kerapkah diagnosis akhir berada di mana-mana bahagian dalam diagnosis perbezaan model tersebut?
    • About 39 percent
    • About 64 percent
    • About 92 percent
    • About 15 percent
  2. Apakah keputusan utama daripada kajian berstrata rawak Goh et al. 2024?
    • Physicians given GPT-4 scored far higher than those without it
    • GPT-4 alone performed worse than every physician
    • Giving physicians GPT-4 did not significantly improve their diagnostic reasoning scores, although GPT-4 alone scored higher
    • The trial was stopped for patient harm
  3. Mengapa penanda aras vignette boleh melebih-lebihkan prestasi model dengan pesakit sebenar?
    • Vignettes arrive with the relevant findings already chosen and cleaned up, and published cases may be in training data
    • Vignettes are always written in another language
    • Real patients have fewer symptoms than vignettes
    • Models cannot read case descriptions longer than a paragraph
  4. Seorang klinik bertanya, "Bolehkah ini lupus?" pada permulaan arahan mereka. Mod kegagalan apa yang ini mengundang?
    • Invented laboratory reference ranges
    • Refusing to answer medical questions
    • Losing the conversation history
    • Sycophantic anchoring toward the diagnosis the user suggested
  5. Mengapa menilai "diagnosis betul di mana-mana dalam senarai" merupakan ukuran yang cacat?
    • It rewards long lists, which can prompt unnecessary testing
    • It ignores the patient's age
    • It only works for pediatric cases
    • It requires the model to cite references
  6. Getting two differently ordered lists from nearly identical prompts shows what about the model's ranking?
    • The model is broken and should not be used
    • The second answer is always the correct one
    • The ranking is not a calibrated probability estimate and shifts with wording
    • The model is searching the live internet
  7. What is the main privacy concern with pasting a patient's chart into a consumer chatbot?
    • The chatbot will refuse clinical questions
    • Entering identifiable information without a business associate agreement can breach HIPAA
    • Consumer chatbots cannot read lab values
    • It automatically bills the patient's insurer
  8. Which prompt request best helps a clinician act on a model's differential?
    • "Give me the single correct diagnosis"
    • "Confirm my diagnosis is right"
    • "Write the discharge summary"
    • "List supporting and contradicting features for each item and the test that best separates the top candidates"