Gids-gekoppelde quiz · Middelmatig Niveau

Hoe AI presteert tijdens de balie-examenquiz

Test de structuur van het Uniform Bar Exam, de kritiek op de 90e-percentielclaim van GPT-4 en waarom besmettings- en beoordelingskeuzes de AI-scores beïnvloeden.

Gerelateerde gidspadenAI en het balie-examen
Vraag 1 van 8

Welk onderdeel van het Uniform Bar Examen heeft 200 meerkeuzevragen en telt mee voor de helft van de totaalscore?

Bekijk elke vraag8 vragen

Antwoorden en uitleg verschijnen terwijl je de quiz doet.

  1. Welk onderdeel van het Uniform Bar Examen heeft 200 meerkeuzevragen en telt mee voor de helft van de totaalscore?
    • The Multistate Performance Test (MPT)
    • The Multistate Essay Examination (MEE)
    • The Multistate Bar Examination (MBE)
    • The Multistate Professional Responsibility Examination (MPRE)
  2. Welke gesimuleerde Uniform Bar Exam-score werd genoemd in het technische rapport GPT-4 van OpenAI in 2023?
    • About 298 out of 400
    • About 250 out of 400
    • About 350 out of 400
    • About 198 out of 400
  3. According to Eric Martínez's 2024 critique, why was GPT-4's 90th-percentile figure misleading?
    • The model was shown the answer key before testing
    • It was compared with February test takers, a group that includes many repeat takers
    • Only the performance test section was used
    • The comparison group was law professors, not applicants
  4. Wie beoordeelde de essay-antwoorden van GPT-4 op het gesimuleerde bar-examen van 2023, volgens de kritiek die in de gids wordt beschreven?
    • Official NCBE-trained bar graders
    • A committee of a state bar
    • The researchers themselves, using published sample answers
    • A second AI model working as an automatic grader
  5. Wat ontdekten Bommarito en Katz toen ze eind 2022 GPT-3.5 testten op MBE-oefenvragen?
    • It answered every question correctly
    • It refused to answer legal questions
    • It scored below random chance
    • It answered about half correctly: above chance, below passing
  6. Why is training-data contamination a specific concern for AI bar exam results?
    • Past bar questions circulate online and may have been in the model's training data
    • Bar exams are only given in printed form, so models cannot read them
    • The NCBE deliberately publishes wrong answers
    • Models are forbidden from seeing legal text during training
  7. Why do researchers simulating a bar exam score have to approximate the conversion from raw to scaled scores?
    • Scaled scores are chosen at random each year
    • Models produce answers that cannot be scored
    • Each jurisdiction uses a completely different set of questions
    • The NCBE's full equating process is not public
  8. What does the guide say the NCBE's NextGen bar exam gives more weight to?
    • Memorizing a longer list of rules
    • Integrated skills such as research and drafting
    • Speed on multiple-choice questions
    • Oral argument before a panel of judges