Bài kiểm tra lấy mẫu dựa trên Entropy

Câu trả lời và giải thích xuất hiện khi bạn làm bài kiểm tra.

1. What does next-token entropy measure in an entropy-aware decoder?
   • How spread out probability is across the model’s possible next tokens
   • Whether the model’s factual claim is true
   • Số lượng tham số trong mô hình
   • The total number of tokens already generated
2. A low-entropy next-token distribution most directly indicates that:
   • The predicted answer is guaranteed factual
   • Probability is concentrated on a small set of tokens
   • The model has no uncertainty about the entire conversation
   • Every token in the vocabulary is equally likely
3. Entropy Shannon của phân phối mã thông báo tiếp theo được tính như sau:
   • Tổng số log
   • Xác suất tối đa trừ đi xác suất tối thiểu
   • -sum p_i đăng nhập p_i qua mã thông báo
   • Số lượng mã thông báo trong từ vựng
4. What does varentropy measure in some entropy-aware decoding schemes?
   • The variance of model parameter counts
   • The factual accuracy of the next sentence
   • Số đợt đào tạo
   • Variation in token-level surprisal values under the distribution
5. When an entropy-aware system sees a high-entropy next-token distribution, what can it reasonably conclude?
   • The distribution is more spread out and may merit a task-specific decoding policy
   • The model is certainly hallucinating
   • The highest-probability token is false
   • The output must be stopped immediately
6. What is a practical limit of using entropy to guide generation?
   • Entropy cannot be computed from probabilities
   • A chosen entropy policy does not by itself guarantee fewer factual errors
   • Entropy removes the need for model weights
   • Entropy forces all tokens to have equal probability
7. A low-entropy model answer agrees with a user’s false claim. What does the entropy value establish?
   • That the claim has been independently verified
   • That every other candidate is impossible
   • Only that the model’s next-token distribution is concentrated, not that the claim is true
   • That the answer came from a reliable source
8. How should a team choose thresholds for an entropy-triggered retrieval policy?
   • Assume one threshold works for all models and contexts
   • Choose the threshold from the model name
   • Treat every high-entropy token as a proven error
   • Evaluate the policy on representative tasks and measure whether retrieval improves outcomes