Kvíz spojený s průvodcem · Střední úroveň
Why AI Refuses Harmless Requests Quiz
Recognize false refusals, clarify legitimate context, and preserve safety boundaries without trying to bypass protections for harmful requests.
Otázka 1 z 8
Jak byste definovali nadměrné odmítání?
Náhled každé otázky8 otázky
Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.
- Jak byste definovali nadměrné odmítání?
- Answering a harmful request fully
- Declining a benign request because it is incorrectly treated as unsafe
- Asking a clarifying question
- Refusing a request that would enable serious harm
- What was the scope of OR-Bench’s 2024 evaluation?
- Every user conversation across all current chatbots
- Only 25 harmless prompts
- A test of image-generation quality
- 80,000 seemingly toxic benign prompts, a hard subset, toxic controls, and 25 models across eight families
- Proč by se míra odmítnutí v OR-Bench neměla považovat za univerzální?
- It depends on benchmark categories, model versions, and how prompts were labeled
- The benchmark contains no prompts
- All models have identical safety behavior
- Refusals cannot be counted
- Co může pomoci, když je oprávněný požadavek špatně pochopen?
- Claiming the model must ignore all safeguards
- Hiding the real purpose
- Clarifying the benign goal, context, and safe boundaries
- Adding instructions to bypass policy
- Je cílem zmírnění nadměrného odmítání zodpovědět každý požadavek?
- Yes, all refusals are errors
- No; the system should reduce false refusals while still refusing harmful assistance
- Yes, if a user says it is safe
- No, because all benign requests should be refused
- Why test benign and harmful prompts that share vocabulary?
- It checks whether the model uses context rather than only surface words
- It guarantees zero false refusals
- It tests response formatting only
- It removes the need for safety tests
- Co by měl produktový tým měřit spolu s falešnými odmítnutími?
- Only average answer length
- Only positive user ratings
- The number of words in the policy
- Unsafe compliance on genuinely harmful requests
- If a request remains unsafe after clarification, how should a user proceed?
- Use a jailbreak to force an answer
- Repeat the request with coded wording
- Accept the boundary and ask for a safe alternative
- Assume every refusal is mistaken