Guide-linked quiz · Medium Level
Why AI Refuses Harmless Requests Quiz
Recognize false refusals, clarify legitimate context, and preserve safety boundaries without trying to bypass protections for harmful requests.
Question 1 of 8
How would you define over-refusal?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- How would you define over-refusal?
- Answering a harmful request fully
- Declining a benign request because it is incorrectly treated as unsafe
- Asking a clarifying question
- Refusing a request that would enable serious harm
- What was the scope of OR-Bench’s 2024 evaluation?
- Every user conversation across all current chatbots
- Only 25 harmless prompts
- A test of image-generation quality
- 80,000 seemingly toxic benign prompts, a hard subset, toxic controls, and 25 models across eight families
- Why should an OR-Bench refusal rate not be treated as universal?
- It depends on benchmark categories, model versions, and how prompts were labeled
- The benchmark contains no prompts
- All models have identical safety behavior
- Refusals cannot be counted
- What may help when a legitimate request is misunderstood?
- Claiming the model must ignore all safeguards
- Hiding the real purpose
- Clarifying the benign goal, context, and safe boundaries
- Adding instructions to bypass policy
- Is the goal of over-refusal mitigation to answer every request?
- Yes, all refusals are errors
- No; the system should reduce false refusals while still refusing harmful assistance
- Yes, if a user says it is safe
- No, because all benign requests should be refused
- Why test benign and harmful prompts that share vocabulary?
- It checks whether the model uses context rather than only surface words
- It guarantees zero false refusals
- It tests response formatting only
- It removes the need for safety tests
- What should a product team measure along with false refusals?
- Only average answer length
- Only positive user ratings
- The number of words in the policy
- Unsafe compliance on genuinely harmful requests
- If a request remains unsafe after clarification, how should a user proceed?
- Use a jailbreak to force an answer
- Repeat the request with coded wording
- Accept the boundary and ask for a safe alternative
- Assume every refusal is mistaken
Keep testing yourself
More quizzes picked for your level.