引導式測驗 · 中等 等級
長對話測驗中的指令漂移
識別早期約束何時丟失,區分偏差與更改的請求,並跨輪測試持久規則。
問題 1 的 8
When does instruction drift occur in a long conversation?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- When does instruction drift occur in a long conversation?
- A user clearly replaces one instruction with another
- A later response stops following a still-applicable earlier instruction
- The model repeats a correct answer
- A conversation ends after one turn
- What did the 2024 instruction-stability study report?
- That every current model fails after exactly eight turns
- That drift occurs only in image generation
- That users never change instructions
- Drift in tested instructed-chatbot self-chats within eight rounds
- When is a change in response not necessarily instruction drift?
- When the user explicitly updates or replaces the earlier instruction
- When a persistent constraint is ignored without explanation
- When the assistant violates a still-active rule
- When a format disappears after more turns
- Why should evaluation define which instructions persist?
- To guarantee every model answer is correct
- To reduce the number of test cases to one
- To distinguish true drift from legitimate changes or conflicts
- To prevent users from changing goals
- What can help a user check constraints during a long task?
- Add unrelated context every turn
- Ask for a concise recap of active requirements and verify against a checklist
- Assume all earlier rules are always followed
- Avoid reviewing the output
- How should critical access or safety rules be implemented in an agent workflow?
- Enforce them in code or tool permissions where possible
- Rely only on a reminder in chat
- Let retrieved documents override them
- Remove audit logs
- What variables should an instruction-drift test vary?
- Only font size
- Only file extension
- Only final answer length
- Turn count, topic changes, context length, and corrections
- Do reminder prompts guarantee that instruction drift cannot happen?
- Yes, when repeated twice
- Yes, if the conversation is about writing
- No; they are helpful checks, not guarantees
- No, because reminders never help