Guide-linked quiz · Medium Level
Instruction Drift in Long Conversations Quiz
Identify when earlier constraints are lost, distinguish drift from a changed request, and test persistent rules across turns.
Question 1 of 8
When does instruction drift occur in a long conversation?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- When does instruction drift occur in a long conversation?
- A user clearly replaces one instruction with another
- A later response stops following a still-applicable earlier instruction
- The model repeats a correct answer
- A conversation ends after one turn
- What did the 2024 instruction-stability study report?
- That every current model fails after exactly eight turns
- That drift occurs only in image generation
- That users never change instructions
- Drift in tested instructed-chatbot self-chats within eight rounds
- When is a change in response not necessarily instruction drift?
- When the user explicitly updates or replaces the earlier instruction
- When a persistent constraint is ignored without explanation
- When the assistant violates a still-active rule
- When a format disappears after more turns
- Why should evaluation define which instructions persist?
- To guarantee every model answer is correct
- To reduce the number of test cases to one
- To distinguish true drift from legitimate changes or conflicts
- To prevent users from changing goals
- What can help a user check constraints during a long task?
- Add unrelated context every turn
- Ask for a concise recap of active requirements and verify against a checklist
- Assume all earlier rules are always followed
- Avoid reviewing the output
- How should critical access or safety rules be implemented in an agent workflow?
- Enforce them in code or tool permissions where possible
- Rely only on a reminder in chat
- Let retrieved documents override them
- Remove audit logs
- What variables should an instruction-drift test vary?
- Only font size
- Only file extension
- Only final answer length
- Turn count, topic changes, context length, and corrections
- Do reminder prompts guarantee that instruction drift cannot happen?
- Yes, when repeated twice
- Yes, if the conversation is about writing
- No; they are helpful checks, not guarantees
- No, because reminders never help
Keep testing yourself
More quizzes picked for your level.