← Back to all quizzesGuide-linked quiz • Hard Level • 6 Questions
SwiGLU and Gated Activations Quiz
Check your grasp of gated activations and why SwiGLU became the standard transformer feed-forward layer.
Question 1 of 6Correct: 0
Check your grasp of gated activations and why SwiGLU became the standard transformer feed-forward layer.