Quiz collegato alla guida · Medio Livello
Instruction Drift in Long Conversations Quiz
Identify when earlier constraints are lost, distinguish drift from a changed request, and test persistent rules across turns.
Domanda 1 di 8
Quando si verifica la deriva delle istruzioni in una conversazione lunga?
Anteprima di ogni domanda8 domande
Le risposte e le spiegazioni vengono visualizzate mentre rispondi al quiz.
- Quando si verifica la deriva delle istruzioni in una conversazione lunga?
- A user clearly replaces one instruction with another
- A later response stops following a still-applicable earlier instruction
- The model repeats a correct answer
- A conversation ends after one turn
- What did the 2024 instruction-stability study report?
- That every current model fails after exactly eight turns
- That drift occurs only in image generation
- That users never change instructions
- Drift in tested instructed-chatbot self-chats within eight rounds
- Quando un cambiamento nella risposta non è necessariamente una deriva delle istruzioni?
- When the user explicitly updates or replaces the earlier instruction
- When a persistent constraint is ignored without explanation
- When the assistant violates a still-active rule
- When a format disappears after more turns
- Perché la valutazione dovrebbe definire quali istruzioni persistono?
- To guarantee every model answer is correct
- To reduce the number of test cases to one
- To distinguish true drift from legitimate changes or conflicts
- To prevent users from changing goals
- What can help a user check constraints during a long task?
- Add unrelated context every turn
- Ask for a concise recap of active requirements and verify against a checklist
- Assume all earlier rules are always followed
- Avoid reviewing the output
- Come dovrebbero essere implementate le regole di accesso critico o di sicurezza in un flusso di lavoro di un agente?
- Enforce them in code or tool permissions where possible
- Rely only on a reminder in chat
- Let retrieved documents override them
- Remove audit logs
- Quali variabili dovrebbe variare un test di deviazione delle istruzioni?
- Only font size
- Only file extension
- Only final answer length
- Turn count, topic changes, context length, and corrections
- Do reminder prompts guarantee that instruction drift cannot happen?
- Yes, when repeated twice
- Yes, if the conversation is about writing
- No; they are helpful checks, not guarantees
- No, because reminders never help