引導式測驗 · 中等 等級
摸索和延遲泛化測驗
透過權重衰減實驗、傅立葉電路分析、模加法和資料集大小效應來探索演算法資料的延遲泛化。
問題 1 的 8
Which performance pattern characterizes the studied grokking phenomenon?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- Which performance pattern characterizes the studied grokking phenomenon?
- Held-out accuracy must improve before any training example is learned
- Training accuracy can never become high
- Every model loses all training information at once
- Held-out generalization improves substantially after the training examples have already been fit
- Which tasks did the original grokking paper use as a controlled setting?
- Only large-scale photorealistic image generation
- Small algorithmically generated tasks such as modular arithmetic
- Only real-time online advertising auctions
- Only unlabelled random filenames
- Which regularization intervention was among those examined in the original grokking experiments?
- Weight decay
- Mandatory deletion of every activation function
- A proof that all test labels must be randomized
- Automatic enlargement of the vocabulary on every step
- What computation did the cited modular-addition mechanistic study identify in its trained small transformers?
- A universal rule for every large deployed model
- Only a table containing every held-out answer
- A Fourier-based algorithm using trigonometric relationships
- No identifiable structured computation
- Which phase ordering does Progress Measures for Grokking describe in the studied training dynamics?
- Cleanup, deletion of all data, then no computation
- Memorization, circuit formation, then cleanup
- Perfect held-out performance before any circuit formation
- A mandatory switch to image-only inputs
- 格羅克法對練習者提出了哪些實際注意事項?
- 訓練準確率達 100% 時始終停止訓練
- 驗證準確性無關
- 早期驗證停滯並不總是意味著模型無法學習
- 永遠不應該使用正規化
- For the modular-addition task, what is (6+5) modulo 7?
- 11
- 7
- 1
- 4
- What dataset-size trend did the original grokking paper report in its studied setups?
- Smaller training datasets required more optimization to reach generalization
- Smaller datasets always generalized immediately with no optimization
- Dataset size was never varied
- Every larger dataset prevented all training accuracy