Guide-linked quiz · Hard Level
Letting AI Say I Don't Know Quiz
Tests what abstention means, why permission is not self-knowledge, answerability evaluations, source-grounded workflows, and over-refusal risks.
Question 1 of 8
What does abstention mean in an AI answer workflow?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- What does abstention mean in an AI answer workflow?
- Declining to give a definitive answer when support or sufficient information is missing
- Deleting the user’s question
- Always returning an empty string
- Automatically asking another model
- What does an “it is okay to say I don’t know” instruction provide?
- A database of verified facts
- A guaranteed internal uncertainty detector
- A requested response behavior, not dependable self-knowledge
- Proof that any refusal is correct
- Which evaluation set best measures abstention behavior?
- Only questions where the model refuses
- A set without answer labels
- Only answerable trivia questions
- A mix of answerable and unanswerable cases with clear expected decisions
- Why should evaluations track unnecessary abstentions as well as unsupported answers?
- Because all abstentions are errors
- Because coverage never matters
- Because unsupported answers are impossible
- Because an assistant can over-refuse even while avoiding guesses
- How can an application ground an abstention decision in a document assistant?
- Check whether allowed source passages support the requested answer
- Ask for a higher confidence percentage
- Hide the retrieved text from reviewers
- Assume every retrieval result is sufficient
- What does the Abstain-QA study contribute, as described in the guide?
- A legal standard for refusing questions
- A black-box evaluation dataset spanning answerable/unanswerable questions and varied domains and task types
- A universal model that never hallucinates
- A new prompt syntax required by all APIs
- Why is a refusal phrase not proof that an answer is safe?
- The model cannot produce text after refusing
- It proves sources were checked
- The phrase itself can be wrong or inappropriate for the situation
- A refusal always reveals secrets
- What should happen when a consequential question lacks adequate source support?
- Use a documented abstention or route the case to qualified review
- Remove the source citation
- Increase the temperature
- The system should guess confidently
Keep testing yourself
More quizzes picked for your level.