引導式測驗 · 硬 等級
讓人工智慧說我不知道測驗
測試棄權意味著什麼、為什麼許可不是自知之明、可回答性評估、基於來源的工作流程以及過度拒絕風險。
問題 1 的 8
What does abstention mean in an AI answer workflow?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- What does abstention mean in an AI answer workflow?
- Declining to give a definitive answer when support or sufficient information is missing
- Deleting the user’s question
- Always returning an empty string
- Automatically asking another model
- What does an “it is okay to say I don’t know” instruction provide?
- A database of verified facts
- A guaranteed internal uncertainty detector
- A requested response behavior, not dependable self-knowledge
- Proof that any refusal is correct
- Which evaluation set best measures abstention behavior?
- Only questions where the model refuses
- A set without answer labels
- Only answerable trivia questions
- A mix of answerable and unanswerable cases with clear expected decisions
- Why should evaluations track unnecessary abstentions as well as unsupported answers?
- Because all abstentions are errors
- Because coverage never matters
- Because unsupported answers are impossible
- Because an assistant can over-refuse even while avoiding guesses
- How can an application ground an abstention decision in a document assistant?
- Check whether allowed source passages support the requested answer
- Ask for a higher confidence percentage
- Hide the retrieved text from reviewers
- Assume every retrieval result is sufficient
- What does the Abstain-QA study contribute, as described in the guide?
- A legal standard for refusing questions
- A black-box evaluation dataset spanning answerable/unanswerable questions and varied domains and task types
- A universal model that never hallucinates
- A new prompt syntax required by all APIs
- Why is a refusal phrase not proof that an answer is safe?
- The model cannot produce text after refusing
- It proves sources were checked
- The phrase itself can be wrong or inappropriate for the situation
- A refusal always reveals secrets
- What should happen when a consequential question lacks adequate source support?
- Use a documented abstention or route the case to qualified review
- Remove the source citation
- Increase the temperature
- The system should guess confidently