← Back to all quizzesGuide-linked quiz • Medium Level • 6 Questions

Induction Heads in Transformers Quiz

Check your grasp of how induction heads enable in-context pattern completion.

Related guide pathsInduction Heads In Transformers
Question 1 of 6

What rule does an induction head essentially implement?

Keep testing yourself

More quizzes picked for your level.

View all quizzes
Medium · 6 questionsLength Normalization in Preference Optimization QuizTake quizMedium · 6 questionsModel Extraction and Stealing Attacks QuizTake quizMedium · 6 questionsWatermarking Language Model Outputs QuizTake quiz