引导式测验 · 中等 等级

测试时培训测验

比较测试时间适应和 TTT 序列层,包括自监督损失、内部模型状态、线性缩放和外循环学习。

相关引导路径测试时间训练
问题 1 的 8

What happens in the cited classic test-time training adaptation procedure before the main prediction?

预览每个问题8 问题

当您参加测验时,就会出现答案和解释。

  1. What happens in the cited classic test-time training adaptation procedure before the main prediction?
    • The unknown main-task label is supplied as a correct training target
    • The model must delete all parameters
    • Every earlier training example is reloaded without adaptation
    • Model parameters are updated using the incoming unlabeled sample
  2. 为什么经典 TTT 依赖于自我监督的辅助任务?
    • 因为自我监督总是比主要任务更准确
    • 因为标签在测试时不可用,所以它需要一个可以在没有标签的情况下计算的损失
    • 因为它消除了对任何神经网络的需要
    • 对测试数据进行加密
  3. What forms the recurrent hidden state of a TTT sequence layer?
    • The parameters of an inner model updated through learning
    • Only an unchanging raw input filename
    • A mandatory list of all previous full attention matrices
    • The vocabulary sorted alphabetically
  4. Under fixed inner-model dimensions and update work, how does TTT sequence-layer complexity scale with sequence length?
    • Quadratically for every possible implementation
    • Independently of processing any tokens
    • Linearly in sequence length
    • Exponentially because every token retrains from all possible sequences
  5. What problem motivated the cited classic test-time adaptation study?
    • A requirement to increase the alphabet size
    • A difference between training and test input distributions
    • A guarantee that all deployment inputs match training
    • A need to sort source filenames faster
  6. Why is a decrease in an auxiliary adaptation loss insufficient by itself to establish a successful main-task update?
    • Every auxiliary loss is the unknown main-label accuracy
    • A loss value proves perfect safety on every future sample
    • The auxiliary objective and the intended prediction measure are different
    • An auxiliary task cannot be computed on unlabeled input
  7. What inner models distinguish the studied TTT-Linear and TTT-MLP layer variants?
    • A decision tree and a mandatory image tokenizer
    • Two copies of the same fixed dictionary with no parameters
    • A full historical attention matrix and an alphabetical index
    • A linear model and a two-layer multilayer perceptron
  8. In the sequence-layer framework, which loop learns the parameters defining the inner self-supervised task?
    • The outer training loop
    • Only the unknown future test label
    • A required manual dictionary edit at every token
    • Neither loop can learn any task parameters