Bài kiểm tra có liên kết hướng dẫn · Trung bình Cấp độ
AI thể hiện như thế nào trong bài kiểm tra thanh
Kiểm tra cấu trúc của Bài kiểm tra thanh thống nhất, phê bình tuyên bố về tỷ lệ phần trăm thứ 90 của GPT-4 và lý do tại sao các lựa chọn về ô nhiễm và phân loại lại ảnh hưởng đến điểm số AI.
Câu hỏi 1 của 8
Which Uniform Bar Exam component has 200 multiple-choice questions and counts for half the total score?
Xem trước mọi câu hỏi8 câu hỏi
Câu trả lời và giải thích xuất hiện khi bạn làm bài kiểm tra.
- Which Uniform Bar Exam component has 200 multiple-choice questions and counts for half the total score?
- The Multistate Performance Test (MPT)
- The Multistate Essay Examination (MEE)
- The Multistate Bar Examination (MBE)
- The Multistate Professional Responsibility Examination (MPRE)
- What simulated Uniform Bar Exam score did OpenAI's GPT-4 technical report cite in 2023?
- About 298 out of 400
- About 250 out of 400
- About 350 out of 400
- About 198 out of 400
- According to Eric Martínez's 2024 critique, why was GPT-4's 90th-percentile figure misleading?
- The model was shown the answer key before testing
- It was compared with February test takers, a group that includes many repeat takers
- Only the performance test section was used
- The comparison group was law professors, not applicants
- Who graded GPT-4's essay answers in the 2023 simulated bar exam, according to the critique described in the guide?
- Official NCBE-trained bar graders
- A committee of a state bar
- The researchers themselves, using published sample answers
- A second AI model working as an automatic grader
- What did Bommarito and Katz find when they tested GPT-3.5 on MBE practice questions in late 2022?
- It answered every question correctly
- It refused to answer legal questions
- It scored below random chance
- It answered about half correctly: above chance, below passing
- Why is training-data contamination a specific concern for AI bar exam results?
- Past bar questions circulate online and may have been in the model's training data
- Bar exams are only given in printed form, so models cannot read them
- The NCBE deliberately publishes wrong answers
- Models are forbidden from seeing legal text during training
- Why do researchers simulating a bar exam score have to approximate the conversion from raw to scaled scores?
- Scaled scores are chosen at random each year
- Models produce answers that cannot be scored
- Each jurisdiction uses a completely different set of questions
- The NCBE's full equating process is not public
- What does the guide say the NCBE's NextGen bar exam gives more weight to?
- Memorizing a longer list of rules
- Integrated skills such as research and drafting
- Speed on multiple-choice questions
- Oral argument before a panel of judges