引导式测验 · 中等 等级

温度和采样测验

测试 Logit 温度缩放、贪婪解码、top-k 和核心候选过滤器、数值截止以及可预测生成的限制。

相关引导路径温度和采样
问题 1 的 8

升高温度对模型的输出有何影响?

预览每个问题8 问题

当您参加测验时,就会出现答案和解释。

  1. 升高温度对模型的输出有何影响?
    • 使其更具确定性和重复性
    • 永久更改模型的权重
    • 禁用softmax函数
    • 使其更加随机和多样化,有更多机会出现不寻常的标记
  2. 在采样之前,模型的原始标记分数 (logits) 通过以下方式转换为概率:
    • top-k 过滤器
    • Softmax函数
    • 反向传播
    • 分词器
  3. What determines the candidate set in top-p sampling, compared with top-k?
    • Top-p always keeps exactly ten tokens
    • Both methods always keep every vocabulary token
    • Top-p uses the smallest leading set reaching a cumulative probability threshold; top-k uses a count
    • Top-k uses a cumulative threshold while top-p uses a fixed count
  4. 从力学上来说,温度实际上对逻辑有什么影响?
    • 在softmax之前将每个logit除以T
    • 为每个 logit 添加一个随机数
    • 删除最低的 logits
    • 将最终概率乘以 T
  5. For a structured-data task, what does choosing more predictable token selection fail to establish?
    • That a decoding setting was chosen
    • That the generated content is correct or valid
    • That token scores can be compared
    • That a model can produce an output
  6. How does greedy decoding choose the next token?
    • It literally divides every logit by zero
    • It uniformly samples every vocabulary token
    • It permanently retrains the model
    • It selects a highest-scoring eligible token rather than sampling
  7. Two token logits differ by six before temperature scaling. With positive temperature two, what is their scaled difference?
    • 三
    • Twelve
    • 六
    • 零
  8. For probabilities 0.55, 0.30, 0.10, and 0.05, how many leading tokens does top-p 0.80 keep?
    • 一
    • 三
    • 两个
    • 四