← Back to all quizzesGuide-linked quiz • Hard Level • 6 Questions
SwiGLU and Gated Activations Quiz
Check your grasp of gated activations and why SwiGLU became the standard transformer feed-forward layer.
Question 1 of 6
What core operation defines a Gated Linear Unit?
Keep testing yourself
More quizzes picked for your level.