AI for Medical Students and USMLE Prep Quiz

Answers and explanations appear as you take the quiz.

1. How has USMLE Step 1 been reported since January 2022?
   • As a three-digit score
   • As pass/fail
   • As an optional exam
   • It was merged into Step 2 CK
2. Why does AI's strong performance on USMLE-style questions not make its own practice questions exam-quality?
   • The studies used only pediatric questions
   • AI performance studies were retracted
   • AI cannot write in a vignette format
   • Answering questions well does not guarantee that the questions or explanations it writes are correct
3. What does the NBME cover-the-options rule require of a well-written question?
   • A prepared student can answer from the vignette and lead-in without seeing the choices
   • The answer options are hidden until the timer ends
   • The question has exactly two options
   • The options cover every organ system
4. What should a student do with an AI-written vignette that has two defensible answers?
   • Memorize the keyed answer anyway
   • Choose the longer option
   • Discard or fix the item instead of learning from it
   • Report it to the NBME
5. Which resource does the guide recommend for judging readiness for Step 1?
   • The number of AI questions completed
   • NBME self-assessments
   • A chatbot's estimate of your score
   • Social media study groups
6. Which technique does the guide describe for checking whether an AI question is keyed correctly?
   • Ask the same chat to confirm its answer
   • Count the words in each option
   • Look for the option with the most technical term
   • Answer the question blind in a fresh chat and investigate any disagreement with a trusted resource
7. What sycophancy risk does the guide warn about when studying with AI?
   • The model may drop a correct answer when the student pushes back
   • The model refuses to answer medical questions
   • The model always asks for payment
   • The model deletes the student's notes
8. Which error mode in AI-made USMLE questions relates to clinical guidelines?
   • Vignettes that are too short
   • Options listed alphabetically
   • Relying on outdated or non-US guidelines
   • Using lab values with units