Quiz collegato alla guida · Medio Livello

When Chain-of-Thought Hurts Quiz

Tests the definition of chain-of-thought, bounded research results, model-specific guidance, and task-based comparisons including latency.

Percorsi guida correlatiWhen Chain Of Thought Hurts
Domanda 1 di 8

Cosa chiede il prompt di catena di pensiero di produrre a un modello?

Anteprima di ogni domanda8 domande

Le risposte e le spiegazioni vengono visualizzate mentre rispondi al quiz.

  1. Cosa chiede il prompt di catena di pensiero di produrre a un modello?
    • Intermediate reasoning text before its answer
    • Only an image input
    • A guaranteed proof of correctness
    • A list of training examples
  2. Cosa ha riportato lo studio ICML del 2025 su tutti e sei i compiti selezionati?
    • The study tested every task category
    • CoT reduced performance on every task
    • Performance drops on three tasks and mixed effects on the others
    • CoT always improved performance
  3. Cosa stabilisce quel studio su CoT in tutti i compiti di IA?
    • It guarantees better performance for reasoning models
    • It applies only to image generation
    • It is universally harmful
    • It can reduce performance in some settings but does not establish a universal rule
  4. Perché un ragionamento esplicito potrebbe aggiungere costi operativi?
    • It reduces all input context
    • It automatically stops tool use
    • It eliminates evaluation needs
    • It can use additional output tokens and increase latency
  5. Come dovrebbe essere trattata un’ spiegazione generata dal modello come prova?
    • As proof the answer is correct
    • As insufficient by itself to prove correctness or faithfully trace the internal process
    • As confirmation the model used a source
    • As a guarantee of transparency
  6. What does OpenAI’s current guidance recommend for its API reasoning models?
    • Never state constraints
    • Always demand a long chain of thought
    • Generally avoid explicit “think step by step” requests
    • Use identical prompts across every model
  7. How should a team decide whether CoT helps its own application?
    • Compare different models and prompts at once
    • Judge by which answer is longer
    • Compare it with direct prompting on representative cases using defined scoring
    • Assume the research paper covers its task
  8. Which factors should a team include when comparing prompt variants?
    • Output quality and relevant costs such as latency or token use
    • Only model marketing claims
    • Whether the explanation sounds confident
    • Only response length