Gids-gekoppelde quiz · Middelmatig Niveau
Grokking en vertraagde generalisatiequiz
Ontdek vertraagde generalisatie van algoritmische gegevens, met gewichtsverval-experimenten, Fourier-circuitanalyse, modulaire optelling en effecten op de grootte van datasets.
Vraag 1 van 8
Which performance pattern characterizes the studied grokking phenomenon?
Bekijk elke vraag8 vragen
Antwoorden en uitleg verschijnen terwijl je de quiz doet.
- Which performance pattern characterizes the studied grokking phenomenon?
- Held-out accuracy must improve before any training example is learned
- Training accuracy can never become high
- Every model loses all training information at once
- Held-out generalization improves substantially after the training examples have already been fit
- Which tasks did the original grokking paper use as a controlled setting?
- Only large-scale photorealistic image generation
- Small algorithmically generated tasks such as modular arithmetic
- Only real-time online advertising auctions
- Only unlabelled random filenames
- Which regularization intervention was among those examined in the original grokking experiments?
- Weight decay
- Mandatory deletion of every activation function
- A proof that all test labels must be randomized
- Automatic enlargement of the vocabulary on every step
- What computation did the cited modular-addition mechanistic study identify in its trained small transformers?
- A universal rule for every large deployed model
- Only a table containing every held-out answer
- A Fourier-based algorithm using trigonometric relationships
- No identifiable structured computation
- Which phase ordering does Progress Measures for Grokking describe in the studied training dynamics?
- Cleanup, deletion of all data, then no computation
- Memorization, circuit formation, then cleanup
- Perfect held-out performance before any circuit formation
- A mandatory switch to image-only inputs
- Welke praktische voorzichtigheid suggereert grokking voor beoefenaars?
- Stop altijd met trainen zodra de trainingsnauwkeurigheid 100% bereikt
- De nauwkeurigheid van de validatie is niet relevant
- Een vroeg validatieplateau betekent niet altijd dat het model niet heeft geleerd
- Er mag nooit gebruik worden gemaakt van regularisatie
- For the modular-addition task, what is (6+5) modulo 7?
- 11
- 7
- 1
- 4
- What dataset-size trend did the original grokking paper report in its studied setups?
- Smaller training datasets required more optimization to reach generalization
- Smaller datasets always generalized immediately with no optimization
- Dataset size was never varied
- Every larger dataset prevented all training accuracy