引導式測驗 · 中等 等級

KL 散度測驗

計算位元 KL 散度並推理不對稱性,支援不匹配、交叉熵和參考分佈方向。

相關引導路徑Kl 散度
問題 1 的 8

在 D_KL(p||q) 中,哪一個分佈對對數比項進行加權?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. 在 D_KL(p||q) 中,哪一個分佈對對數比項進行加權?
    • p
    • q
    • Their unweighted average
    • The distribution with larger entropy
  2. 為什麼KL散度不是普通的對稱距離?
    • It can only be negative
    • Swapping p and q generally changes the value
    • It has no logarithms
    • It is always exactly one
  3. 對於 p(x)>0 且 q(x)=0,對應的前向 KL 貢獻會發生什麼事?
    • It is always one bit
    • 就變成零了
    • 它發散至無窮大
    • It is omitted regardless of p
  4. 在公平與偏向硬幣的例子中,為什麼一個被加數可以為負,而總 KL 仍然為非負?
    • The log base makes negative terms invalid
    • Every term is required to be positive
    • The formula takes an absolute value after summing
    • Individual log ratios can be negative, though the weighted total is nonnegative
  5. 使用以 2 為底的對數會產生什麼單位?
    • Nats
    • Bits
    • Meters
    • Percent points
  6. How does cross-entropy relate to entropy and forward KL?
    • It is always zero when q differs
    • It equals D_KL(Q||P) minus entropy
    • H(P,Q) = H(P) + D_KL(P||Q)
    • It is the reciprocal of KL
  7. In SciPy's entropy(pk, qk), what does supplying qk request?
    • A test of whether probabilities are independent
    • Only Shannon entropy of qk
    • A symmetric distance between both arrays
    • Relative entropy using pk relative to qk
  8. Which statement about continuous KL is accurate?
    • It integrates a log density ratio under P and is infinite if P puts positive mass where Q has zero density
    • It sums point probabilities at every real-valued outcome
    • It is always finite whenever both distributions have densities
    • It has no support condition for the compared distributions