quiz bu lëkkale ak tegtal · Diggante Niveau

Laaj ak tontu yu bari

Saytu ni Multi-Query Attention di séddoo boppu valeur-caabi yi, wàññi trafik cache bi, ba noppi di jëflante ak laaj yu bari yi ci xeetu dekodeer yi.

Yooni njiit yu jëm ciLaajte yu bari
Laaj 1 de 8

Lan mooy Multi-Query Attention bokk ci bépp boppu bàyyi xel?

Xoolaatal laaj bu nekk8 laaj

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

  1. Lan mooy Multi-Query Attention bokk ci bépp boppu bàyyi xel?
    • Benn xeetu caabi ak valeur
    • Projection laaj yi
    • Tamperatiir softmax bi
    • poids de couche de sortie
  2. Lan mooy jafe-jafe bi njëkk bi MQA di saafara ci jamonoy defar autoregressive?
    • Reputation calcul à point flottant
    • Yaatuwaayu mémoire biy joge ci yobbu cache KV
    • limu jamonoy tàggat yaram
    • Dayo vokabileer tokenizer
  3. Ci ban facteur la MQA di wàññi cache KV bi?
    • Guddaayi fi ñuy toppalante
    • ci dayo lote bi
    • ci limu nit ñiy bàyyi seen xel ci
    • Soppiwul dayo cache KV
  4. Lan mooy njariñ li gëna am solo ci jëfandikoo MQA?
    • Inference bu gëna yeex
    • Mënul jëfandikoo bopp yu bari
    • Dafay laaj done yu gëna bari
    • Kalite model bi wàññeeku tuuti
  5. Ban anam moo nekk ci digganté bàyyi xel ci bopp yu bari ak MQA?
    • Laajte buñ boole
    • Palanteer buy gliise
    • Flash Fexe
    • Fexe lu néew
  6. Kan moo tàmbale bàyyi xel ci laaj yu bari?
    • Jeofrey Hinton
    • Noam Shasier
    • Yann Lekun
    • Andréj Karpati
  7. In Multi-Query Attention, what remains separate for each attention head?
    • The shared key projection
    • The shared value projection
    • The query projection
    • The token sequence itself
  8. How does Grouped-Query Attention differ from standard MQA?
    • It shares query projections but gives every head separate keys and values
    • It removes attention and replaces it with a recurrent layer
    • It groups output vocabulary tokens instead of attention heads
    • It shares keys and values within several groups of query heads rather than across all heads at once