Kvíz spojený s průvodcem · Střední úroveň

Why AI Refuses Harmless Requests Quiz

Recognize false refusals, clarify legitimate context, and preserve safety boundaries without trying to bypass protections for harmful requests.

Související vodicí cestyOver Refusal In AI Chatbots
Otázka 1 z 8

Jak byste definovali nadměrné odmítání?

Náhled každé otázky8 otázky

Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.

  1. Jak byste definovali nadměrné odmítání?
    • Answering a harmful request fully
    • Declining a benign request because it is incorrectly treated as unsafe
    • Asking a clarifying question
    • Refusing a request that would enable serious harm
  2. What was the scope of OR-Bench’s 2024 evaluation?
    • Every user conversation across all current chatbots
    • Only 25 harmless prompts
    • A test of image-generation quality
    • 80,000 seemingly toxic benign prompts, a hard subset, toxic controls, and 25 models across eight families
  3. Proč by se míra odmítnutí v OR-Bench neměla považovat za univerzální?
    • It depends on benchmark categories, model versions, and how prompts were labeled
    • The benchmark contains no prompts
    • All models have identical safety behavior
    • Refusals cannot be counted
  4. Co může pomoci, když je oprávněný požadavek špatně pochopen?
    • Claiming the model must ignore all safeguards
    • Hiding the real purpose
    • Clarifying the benign goal, context, and safe boundaries
    • Adding instructions to bypass policy
  5. Je cílem zmírnění nadměrného odmítání zodpovědět každý požadavek?
    • Yes, all refusals are errors
    • No; the system should reduce false refusals while still refusing harmful assistance
    • Yes, if a user says it is safe
    • No, because all benign requests should be refused
  6. Why test benign and harmful prompts that share vocabulary?
    • It checks whether the model uses context rather than only surface words
    • It guarantees zero false refusals
    • It tests response formatting only
    • It removes the need for safety tests
  7. Co by měl produktový tým měřit spolu s falešnými odmítnutími?
    • Only average answer length
    • Only positive user ratings
    • The number of words in the policy
    • Unsafe compliance on genuinely harmful requests
  8. If a request remains unsafe after clarification, how should a user proceed?
    • Use a jailbreak to force an answer
    • Repeat the request with coded wording
    • Accept the boundary and ask for a safe alternative
    • Assume every refusal is mistaken