Back to all quizzesGuide-linked quizHard Level6 Questions

Block-Sparse and Native Sparse Attention Quiz

Assess your understanding of how sparse attention reduces transformer cost on long sequences.

Question 1 of 6Correct: 0

Why is standard self-attention expensive for long sequences?