quiz bu lëkkale ak tegtal · Dëgër Niveau

Data-Constrained Scaling Laws Quiz

Reason about limited unique data, repeated training tokens, epoch budgets, diminishing returns, held-out evaluation, and changes in data mixtures.

Yooni njiit yu jëm ciData Constrained Scaling Laws
Laaj 1 de 8

A corpus contains ten billion unique tokens and is processed for three complete epochs. Which accounting is correct?