Guide-yakabatana mibvunzo · Pakati Nhanho
Instruction Drift in Long Conversations Quiz
Identify when earlier constraints are lost, distinguish drift from a changed request, and test persistent rules across turns.
Mubvunzo 1 ye 8
Ndirini panoitika kukukurwa kwemurayiridzo mukukurukurirana kwenguva refu?
Tarisa mubvunzo wese8 mibvunzo
Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.
- Ndirini panoitika kukukurwa kwemurayiridzo mukukurukurirana kwenguva refu?
- A user clearly replaces one instruction with another
- A later response stops following a still-applicable earlier instruction
- The model repeats a correct answer
- A conversation ends after one turn
- What did the 2024 instruction-stability study report?
- That every current model fails after exactly eight turns
- That drift occurs only in image generation
- That users never change instructions
- Drift in tested instructed-chatbot self-chats within eight rounds
- Ndeipi apo shanduko mumhinduro isingareve hazvo kukukurwa?
- When the user explicitly updates or replaces the earlier instruction
- When a persistent constraint is ignored without explanation
- When the assistant violates a still-active rule
- When a format disappears after more turns
- Sei kuongorora kuchifanira kutsanangura kuti ndeipi mirairo inoenderera?
- To guarantee every model answer is correct
- To reduce the number of test cases to one
- To distinguish true drift from legitimate changes or conflicts
- To prevent users from changing goals
- What can help a user check constraints during a long task?
- Add unrelated context every turn
- Ask for a concise recap of active requirements and verify against a checklist
- Assume all earlier rules are always followed
- Avoid reviewing the output
- Maitiro akakosha ekuwana kana mitemo yekuchengetedza inofanirwa kuitiswa sei mukufambiswa kweagent?
- Enforce them in code or tool permissions where possible
- Rely only on a reminder in chat
- Let retrieved documents override them
- Remove audit logs
- Ndeapi akasiyana-siyana anofanira kudzidziswa-kudonha bvunzo kusiyanisa?
- Only font size
- Only file extension
- Only final answer length
- Turn count, topic changes, context length, and corrections
- Do reminder prompts guarantee that instruction drift cannot happen?
- Yes, when repeated twice
- Yes, if the conversation is about writing
- No; they are helpful checks, not guarantees
- No, because reminders never help