quiz bu lëkkale ak tegtal · Diggante Niveau
Laaj ak tontu yu bari
Saytu ni Multi-Query Attention di séddoo boppu valeur-caabi yi, wàññi trafik cache bi, ba noppi di jëflante ak laaj yu bari yi ci xeetu dekodeer yi.
Laaj 1 de 8
Lan mooy Multi-Query Attention bokk ci bépp boppu bàyyi xel?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- Lan mooy Multi-Query Attention bokk ci bépp boppu bàyyi xel?
- Benn xeetu caabi ak valeur
- Projection laaj yi
- Tamperatiir softmax bi
- poids de couche de sortie
- Lan mooy jafe-jafe bi njëkk bi MQA di saafara ci jamonoy defar autoregressive?
- Reputation calcul à point flottant
- Yaatuwaayu mémoire biy joge ci yobbu cache KV
- limu jamonoy tàggat yaram
- Dayo vokabileer tokenizer
- Ci ban facteur la MQA di wàññi cache KV bi?
- Guddaayi fi ñuy toppalante
- ci dayo lote bi
- ci limu nit ñiy bàyyi seen xel ci
- Soppiwul dayo cache KV
- Lan mooy njariñ li gëna am solo ci jëfandikoo MQA?
- Inference bu gëna yeex
- Mënul jëfandikoo bopp yu bari
- Dafay laaj done yu gëna bari
- Kalite model bi wàññeeku tuuti
- Ban anam moo nekk ci digganté bàyyi xel ci bopp yu bari ak MQA?
- Laajte buñ boole
- Palanteer buy gliise
- Flash Fexe
- Fexe lu néew
- Kan moo tàmbale bàyyi xel ci laaj yu bari?
- Jeofrey Hinton
- Noam Shasier
- Yann Lekun
- Andréj Karpati
- In Multi-Query Attention, what remains separate for each attention head?
- The shared key projection
- The shared value projection
- The query projection
- The token sequence itself
- How does Grouped-Query Attention differ from standard MQA?
- It shares query projections but gives every head separate keys and values
- It removes attention and replaces it with a recurrent layer
- It groups output vocabulary tokens instead of attention heads
- It shares keys and values within several groups of query heads rather than across all heads at once