引導式測驗 · 中等 等級

Perplexity 與語言指標測驗

查看參考標記可能性、交叉熵、統一基準、可比較標記化、BLEU、品質限制、上下文視窗和屏蔽模型。

相關引導路徑Perplexity 與語言指標
問題 1 的 8

在相同的自回歸文本評分設定下,較低的困惑度代表什麼?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. 在相同的自回歸文本評分設定下,較低的困惑度代表什麼?
    • Lower average negative log-likelihood for the reference tokens
    • A guarantee of more factually correct generated answers
    • A guarantee of a larger parameter count
    • A requirement that every top-choice prediction be correct
  2. 使用自然對數的負對數似然時,如何從其平均值計算自回歸困惑度?
    • By multiplying the parameter count by the context length
    • By subtracting the average from the number of attention heads
    • By taking the average learning rate
    • By exponentiating the average negative log-likelihood
  3. 模型在不進行學習的情況下為 10,000 個單字的詞彙分配統一的機率。它的困惑是什麼?
    • 1
    • 10,000
    • 0
    • 100
  4. 為什麼在直接比較每個詞的困惑度值時,斷詞器與語料庫設定很重要?
    • Perplexity ignores every scored reference token
    • All corpora necessarily produce the same likelihood
    • They change the units or reference data over which probabilities are averaged
    • Only model parameter count determines the score
  5. 哪一種翻譯參考指標使用修改過的 n-gram 精度與簡短懲罰?
    • Perplexity
    • 均方像素誤差
    • 模型參數個數
    • 藍線
  6. 是什麼關鍵限制讓研究人員擺脫了判斷現實世界品質的困惑?
    • Perplexity 測量下一個單字的預測,而不是輸出是否有用、真實或有幫助
    • Perplexity 的運算成本太高
    • Perplexity 無法對文字資料進行計算
    • Perplexity 僅在推理期間有效,在訓練期間無效
  7. When scoring a long text with a fixed-context model, what can a sliding-window procedure provide that disjoint chunks lose near boundaries?
    • A new vocabulary learned automatically at every boundary
    • A guarantee that generated answers are factually correct
    • More preceding context for the scored target tokens
    • A requirement to count each overlapping target repeatedly
  8. Why is conventional left-to-right perplexity not directly the same score for a BERT-style masked language model?
    • BERT has no learned parameters
    • The masked model does not directly define the same autoregressive sequence factorization
    • Every masked-token probability is necessarily zero
    • Perplexity is defined only for image pixels