引導式測驗 · 中等 等級

長對話測驗中的指令漂移

識別早期約束何時丟失,區分偏差與更改的請求,並跨輪測試持久規則。

問題 1 的 8

When does instruction drift occur in a long conversation?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. When does instruction drift occur in a long conversation?
    • A user clearly replaces one instruction with another
    • A later response stops following a still-applicable earlier instruction
    • The model repeats a correct answer
    • A conversation ends after one turn
  2. What did the 2024 instruction-stability study report?
    • That every current model fails after exactly eight turns
    • That drift occurs only in image generation
    • That users never change instructions
    • Drift in tested instructed-chatbot self-chats within eight rounds
  3. When is a change in response not necessarily instruction drift?
    • When the user explicitly updates or replaces the earlier instruction
    • When a persistent constraint is ignored without explanation
    • When the assistant violates a still-active rule
    • When a format disappears after more turns
  4. Why should evaluation define which instructions persist?
    • To guarantee every model answer is correct
    • To reduce the number of test cases to one
    • To distinguish true drift from legitimate changes or conflicts
    • To prevent users from changing goals
  5. What can help a user check constraints during a long task?
    • Add unrelated context every turn
    • Ask for a concise recap of active requirements and verify against a checklist
    • Assume all earlier rules are always followed
    • Avoid reviewing the output
  6. How should critical access or safety rules be implemented in an agent workflow?
    • Enforce them in code or tool permissions where possible
    • Rely only on a reminder in chat
    • Let retrieved documents override them
    • Remove audit logs
  7. What variables should an instruction-drift test vary?
    • Only font size
    • Only file extension
    • Only final answer length
    • Turn count, topic changes, context length, and corrections
  8. Do reminder prompts guarantee that instruction drift cannot happen?
    • Yes, when repeated twice
    • Yes, if the conversation is about writing
    • No; they are helpful checks, not guarantees
    • No, because reminders never help