Quiz collegato alla guida · Medio Livello
When Chain-of-Thought Hurts Quiz
Tests the definition of chain-of-thought, bounded research results, model-specific guidance, and task-based comparisons including latency.
Domanda 1 di 8
Cosa chiede il prompt di catena di pensiero di produrre a un modello?
Anteprima di ogni domanda8 domande
Le risposte e le spiegazioni vengono visualizzate mentre rispondi al quiz.
- Cosa chiede il prompt di catena di pensiero di produrre a un modello?
- Intermediate reasoning text before its answer
- Only an image input
- A guaranteed proof of correctness
- A list of training examples
- Cosa ha riportato lo studio ICML del 2025 su tutti e sei i compiti selezionati?
- The study tested every task category
- CoT reduced performance on every task
- Performance drops on three tasks and mixed effects on the others
- CoT always improved performance
- Cosa stabilisce quel studio su CoT in tutti i compiti di IA?
- It guarantees better performance for reasoning models
- It applies only to image generation
- It is universally harmful
- It can reduce performance in some settings but does not establish a universal rule
- Perché un ragionamento esplicito potrebbe aggiungere costi operativi?
- It reduces all input context
- It automatically stops tool use
- It eliminates evaluation needs
- It can use additional output tokens and increase latency
- Come dovrebbe essere trattata un’ spiegazione generata dal modello come prova?
- As proof the answer is correct
- As insufficient by itself to prove correctness or faithfully trace the internal process
- As confirmation the model used a source
- As a guarantee of transparency
- What does OpenAI’s current guidance recommend for its API reasoning models?
- Never state constraints
- Always demand a long chain of thought
- Generally avoid explicit “think step by step” requests
- Use identical prompts across every model
- How should a team decide whether CoT helps its own application?
- Compare different models and prompts at once
- Judge by which answer is longer
- Compare it with direct prompting on representative cases using defined scoring
- Assume the research paper covers its task
- Which factors should a team include when comparing prompt variants?
- Output quality and relevant costs such as latency or token use
- Only model marketing claims
- Whether the explanation sounds confident
- Only response length