引导式测验 · 中等 等级

彩票假设测验

检查您对彩票、初始化、剪枝以及稀疏神经网络声明限制的理解。

相关引导路径彩票假说
问题 1 的 8

这个假设中的“中奖彩票”是什么？

预览每个问题8 问题

当您参加测验时，就会出现答案和解释。

  1. 这个假设中的“中奖彩票”是什么？
    • 稀疏子网络，从其原始 init 开始训练，与完整网络相匹配
    • 具有比平常更多参数的网络
    • 从网上下载的预训练模型
    • 一组随机猜测的超参数
  2. In the original lottery-ticket experiments, what was paired with the discovered sparse mask when retraining a ticket?
    • Fresh random values for every surviving weight
    • The surviving weights’ matched original initialization
    • A different architecture for each pruning round
    • The final trained weights with no resetting
  3. 彩票假说是谁提出的？
    • 古德费罗 (2014)
    • 克里热夫斯基、苏茨克韦尔、辛顿 (2012)
    • 弗兰克尔和卡宾 (2018)
    • 西尔弗和同事 (2016)
  4. Which procedure did the original Lottery Ticket Hypothesis paper use to identify winning tickets?
    • Randomly remove a fixed half of all weights once
    • Iterative magnitude pruning with a reset to the original initialization
    • Add dropout after each pruning round
    • Increase the learning rate after every epoch
  5. How should the idea that overparameterization helps optimization find a trainable sparse structure be described?
    • A conjecture or proposed explanation, not a result established by the original experiments
    • A theorem proven for every neural-network architecture
    • A guarantee that all weights can be removed without loss
    • A claim that pruning eliminates the need for training data
  6. What does a strong lottery-ticket result claim in its theoretical setting?
    • Every randomly initialized network already solves any task
    • A sufficiently overparameterized randomly initialized network can contain a pruned subnetwork that approximates a target without further weight training
    • Pruning always preserves the trained model’s accuracy
    • A sparse network never needs data
  7. What does iterative magnitude pruning remove at each pruning step?
    • The training examples with the lowest labels
    • The neurons with the most outgoing connections
    • Weights with the smallest magnitudes
    • All weights in the final layer
  8. Which datasets were used in the original paper’s reported lottery-ticket experiments?
    • ImageNet and COCO only
    • LibriSpeech and Common Voice
    • SQuAD and GLUE
    • MNIST and CIFAR-10