Guide-linked quiz · Medium Level

Instruction Drift in Long Conversations Quiz

Identify when earlier constraints are lost, distinguish drift from a changed request, and test persistent rules across turns.

Question 1 of 8

When does instruction drift occur in a long conversation?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. When does instruction drift occur in a long conversation?
    • A user clearly replaces one instruction with another
    • A later response stops following a still-applicable earlier instruction
    • The model repeats a correct answer
    • A conversation ends after one turn
  2. What did the 2024 instruction-stability study report?
    • That every current model fails after exactly eight turns
    • That drift occurs only in image generation
    • That users never change instructions
    • Drift in tested instructed-chatbot self-chats within eight rounds
  3. When is a change in response not necessarily instruction drift?
    • When the user explicitly updates or replaces the earlier instruction
    • When a persistent constraint is ignored without explanation
    • When the assistant violates a still-active rule
    • When a format disappears after more turns
  4. Why should evaluation define which instructions persist?
    • To guarantee every model answer is correct
    • To reduce the number of test cases to one
    • To distinguish true drift from legitimate changes or conflicts
    • To prevent users from changing goals
  5. What can help a user check constraints during a long task?
    • Add unrelated context every turn
    • Ask for a concise recap of active requirements and verify against a checklist
    • Assume all earlier rules are always followed
    • Avoid reviewing the output
  6. How should critical access or safety rules be implemented in an agent workflow?
    • Enforce them in code or tool permissions where possible
    • Rely only on a reminder in chat
    • Let retrieved documents override them
    • Remove audit logs
  7. What variables should an instruction-drift test vary?
    • Only font size
    • Only file extension
    • Only final answer length
    • Turn count, topic changes, context length, and corrections
  8. Do reminder prompts guarantee that instruction drift cannot happen?
    • Yes, when repeated twice
    • Yes, if the conversation is about writing
    • No; they are helpful checks, not guarantees
    • No, because reminders never help

Keep testing yourself

More quizzes picked for your level.

View all quizzes