Kediska Feejignaanta Daaqadda simbiriirixaya

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

1. With fixed window W, how does the pairwise attention term N times W scale as sequence length N increases?
   • Quadratically in N despite W being fixed
   • Exponentially in the vocabulary size by definition
   • It never changes as any tokens are added
   • Linearly in N
2. How can stacked local attention layers propagate information beyond one layer’s direct neighborhood?
   • By guaranteeing perfect recall of every earlier token
   • Through intermediate representations passed across successive layers
   • By randomly moving the original input’s coordinates
   • By eliminating the need for all learned weights
3. For a purely local causal attention layer, why can cache policy discard keys older than its active window?
   • Those keys are outside that layer’s allowed direct attention links
   • Every model layer must therefore have an identical whole-model memory bound
   • Older tokens are always irrelevant to every possible task
   • The model’s original weights have been deleted
4. What attention pattern does the Gemma 2 report describe across its layers?
   • Only one permanently disconnected input token
   • No positional or attention computation anywhere
   • Alternating local sliding-window and global attention
   • A mandatory single identical local neighborhood for all models
5. Daaqad simbiriirixan sabab u ah cabbirka W, furayaalkee ayaa weydiin kara booska aan xaadiro?
   • Dhammaan jagooyinka mustaqbalka ka dib i
   • Jagooyinka i laga jaray W lagu daray 1 ilaa i
   • Kaliya booska 0
   • Qayb hoose oo random ah ee jagooyinka oo dhan
6. In the Mistral report’s rolling cache, which slot stores the keys and values for timestep i with buffer size W?
   • A new permanent slot numbered i+W with no reuse
   • Only slot zero for every timestep
   • The slot at i modulo W
   • A slot chosen by the output token’s alphabetical order
7. Waa maxay qiimaha context_len ee ku qoran miiska qaab-dhismeedka Mistral 7B, oo ka madax-bannaan ballaadhan ee aragtida guud ee la isku xidhay?
   • 4096 tokens
   • 131072 tokens
   • 32 tokens
   • 8192 tokens
8. Sida uu naqshadeynta siman ee guud ee Longformer uu sheegay, sidee ayuu token-ka guud ee la doortay ugu xiran yahay tokens kale ee taxanaha?
   • Wuxuu ku fiiqayaa oo ay ku fiiqaan isaga
   • Wuxuu ka heli karaa fiiqid ka mid ah token kale
   • Wuxuu u baahan yahay in uu iska indho-tiro dhammaan token-ka ka baxsan daaqadiisa maxalliga ah
   • Wuxuu u baahan yahay in dhammaan token-ka aan guud ahayn la tirtiro