Kvíz spojený s průvodcem · Střední úroveň
Kvíz kdy Chain-of-Thought škodí
Tests the definition of chain-of-thought, bounded research results, model-specific guidance, and task-based comparisons including latency.
Otázka 1 z 8
Co vyžaduje myšlenkový řetězec, aby model vyrobil?
Náhled každé otázky8 otázky
Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.
- Co vyžaduje myšlenkový řetězec, aby model vyrobil?
- Intermediate reasoning text before its answer
- Only an image input
- A guaranteed proof of correctness
- A list of training examples
- Co přinesla studie 2025 ICML v rámci svých šesti vybraných úkolů?
- The study tested every task category
- CoT reduced performance on every task
- Performance drops on three tasks and mixed effects on the others
- CoT always improved performance
- Co tato studie dokládá o CoT napříč všemi úkoly AI?
- It guarantees better performance for reasoning models
- It applies only to image generation
- It is universally harmful
- It can reduce performance in some settings but does not establish a universal rule
- Proč by explicitní zdůvodnění mohlo zvýšit provozní náklady?
- It reduces all input context
- It automatically stops tool use
- It eliminates evaluation needs
- It can use additional output tokens and increase latency
- Jak by se mělo s vysvětlením vytvořeným modelem zacházet jako s důkazem?
- As proof the answer is correct
- As insufficient by itself to prove correctness or faithfully trace the internal process
- As confirmation the model used a source
- As a guarantee of transparency
- What does OpenAI’s current guidance recommend for its API reasoning models?
- Never state constraints
- Always demand a long chain of thought
- Generally avoid explicit “think step by step” requests
- Use identical prompts across every model
- How should a team decide whether CoT helps its own application?
- Compare different models and prompts at once
- Judge by which answer is longer
- Compare it with direct prompting on representative cases using defined scoring
- Assume the research paper covers its task
- Which factors should a team include when comparing prompt variants?
- Output quality and relevant costs such as latency or token use
- Only model marketing claims
- Whether the explanation sounds confident
- Only response length