引導式測驗 · 中等 等級
KL 散度測驗
計算位元 KL 散度並推理不對稱性,支援不匹配、交叉熵和參考分佈方向。
問題 1 的 8
在 D_KL(p||q) 中,哪一個分佈對對數比項進行加權?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- 在 D_KL(p||q) 中,哪一個分佈對對數比項進行加權?
- p
- q
- Their unweighted average
- The distribution with larger entropy
- 為什麼KL散度不是普通的對稱距離?
- It can only be negative
- Swapping p and q generally changes the value
- It has no logarithms
- It is always exactly one
- 對於 p(x)>0 且 q(x)=0,對應的前向 KL 貢獻會發生什麼事?
- It is always one bit
- 就變成零了
- 它發散至無窮大
- It is omitted regardless of p
- 在公平與偏向硬幣的例子中,為什麼一個被加數可以為負,而總 KL 仍然為非負?
- The log base makes negative terms invalid
- Every term is required to be positive
- The formula takes an absolute value after summing
- Individual log ratios can be negative, though the weighted total is nonnegative
- 使用以 2 為底的對數會產生什麼單位?
- Nats
- Bits
- Meters
- Percent points
- How does cross-entropy relate to entropy and forward KL?
- It is always zero when q differs
- It equals D_KL(Q||P) minus entropy
- H(P,Q) = H(P) + D_KL(P||Q)
- It is the reciprocal of KL
- In SciPy's entropy(pk, qk), what does supplying qk request?
- A test of whether probabilities are independent
- Only Shannon entropy of qk
- A symmetric distance between both arrays
- Relative entropy using pk relative to qk
- Which statement about continuous KL is accurate?
- It integrates a log density ratio under P and is infinite if P puts positive mass where Q has zero density
- It sums point probabilities at every real-valued outcome
- It is always finite whenever both distributions have densities
- It has no support condition for the compared distributions