Ikibazo gihuza ibibazo · Hagati Urwego

Inverse Scaling in Language Models Quiz

Interpret inverse scaling with task scores, model-series controls, memorized patterns, distractors, uncertainty, and possible trend reversals.

Inzira zijyanye no kuyoboraInverse Scaling In Language Models
Ikibazo 1 Bya 8

Three increasingly large models in a comparable series score 80%, 70%, and 60% on the same accuracy task. What does this show?