引導式測驗 · 中等 等級

大型語言模式的新興能力測驗

測試報告了尺度跳躍、度量效應、部分信用、替代措施以及對證據的仔細解釋。

問題 1 的 8

早期出現報告描述了什麼?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. 早期出現報告描述了什麼?
    • Some measured tasks appeared to jump from near-chance to strong performance at larger scale
    • Every model skill improved at an identical rate
    • All capabilities appeared at one fixed parameter count
    • Performance declined smoothly with scale
  2. 謝弗和他的同事提出了什麼替代方案?
    • Model scaling never changes performance
    • Benchmarks cannot measure language models
    • Only larger models can use continuous metrics
    • Metric choice can make gradual changes look like sudden emergence
  3. 為什麼精確匹配的計分會讓循序漸進的技巧顯得突兀?
    • It measures partial correctness in detail
    • It removes sampling noise
    • An answer receives no credit until every part matches exactly
    • It records only model size
  4. 如果使用部分分數或連續指標,可能會發生什麼情況?
    • Every curve becomes flat
    • Some apparently sharp curves may look smoother
    • The model’s outputs change retroactively
    • All abilities become emergent
  5. 在斷定規模門檻出現新能力之前,需要什麼?
    • Only compare model parameter counts
    • 使用一個大型檢查點
    • Rely on a product announcement
    • Examine the task, metric, model family, and statistical evidence
  6. What is the relationship between measured emergence and underlying capability growth?
    • The observed curve can reflect both model behavior and the scoring metric
    • The metric has no role
    • The capability claim is always false
    • Only model size matters
  7. Why test multiple model sizes and multiple metrics?
    • To make one score look larger
    • To see whether the apparent jump persists under alternative measurements
    • To avoid reporting uncertainty
    • To guarantee a threshold exists
  8. What is a careful takeaway from the emergence debate?
    • All sudden capability gains are artifacts
    • Large models have no novel abilities
    • Claims depend on task and measurement; report the metric and scope
    • A single benchmark predicts all future abilities