Kvíz spojený s průvodcem · Střední úroveň

Kvíz kdy Chain-of-Thought škodí

Tests the definition of chain-of-thought, bounded research results, model-specific guidance, and task-based comparisons including latency.

Související vodicí cestyKdy Chain Of Thought škodí
Otázka 1 z 8

Co vyžaduje myšlenkový řetězec, aby model vyrobil?

Náhled každé otázky8 otázky

Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.

  1. Co vyžaduje myšlenkový řetězec, aby model vyrobil?
    • Intermediate reasoning text before its answer
    • Only an image input
    • A guaranteed proof of correctness
    • A list of training examples
  2. Co přinesla studie 2025 ICML v rámci svých šesti vybraných úkolů?
    • The study tested every task category
    • CoT reduced performance on every task
    • Performance drops on three tasks and mixed effects on the others
    • CoT always improved performance
  3. Co tato studie dokládá o CoT napříč všemi úkoly AI?
    • It guarantees better performance for reasoning models
    • It applies only to image generation
    • It is universally harmful
    • It can reduce performance in some settings but does not establish a universal rule
  4. Proč by explicitní zdůvodnění mohlo zvýšit provozní náklady?
    • It reduces all input context
    • It automatically stops tool use
    • It eliminates evaluation needs
    • It can use additional output tokens and increase latency
  5. Jak by se mělo s vysvětlením vytvořeným modelem zacházet jako s důkazem?
    • As proof the answer is correct
    • As insufficient by itself to prove correctness or faithfully trace the internal process
    • As confirmation the model used a source
    • As a guarantee of transparency
  6. What does OpenAI’s current guidance recommend for its API reasoning models?
    • Never state constraints
    • Always demand a long chain of thought
    • Generally avoid explicit “think step by step” requests
    • Use identical prompts across every model
  7. How should a team decide whether CoT helps its own application?
    • Compare different models and prompts at once
    • Judge by which answer is longer
    • Compare it with direct prompting on representative cases using defined scoring
    • Assume the research paper covers its task
  8. Which factors should a team include when comparing prompt variants?
    • Output quality and relevant costs such as latency or token use
    • Only model marketing claims
    • Whether the explanation sounds confident
    • Only response length