Laajte cache KV

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

1. Luy denc ci cache KV?
   • Caabi ak vecteur valeur yiñ xayma ci jeton yi njëkk
   • matrix yu mat sëkk ci model bi
   • Taarixu waxtaanu jëfandikukat bi nekk mbind bu leer
   • Probabilite yi mujj
2. Ban jafe-jafe la cache KV di njëkka saafara?
   • Dafay gëna suqali nàqaru mbind miñ defar
   • Dafay moytu xaymaat caabi yi ak valeur yi ngir bépp token bu njëkk ci jéego bu nekk
   • Dafay yokk vocabulaire model bi
   • Dafay encrypter waxtaan wi
3. Lan mooy njariñu cache KV?
   • Dafay yeexal jamono ji
   • Dafay wàññi kalite biy génne
   • Jëfandikoo mémoire bi dafay màgg lineairement ak guddaayi contexte bi
   • Ci CPU yi kese lay dox
4. Ban pexe mooy wàññi dayo cache KV ci séddoo caabi ak valeur ci boppu attention yi?
   • Dàddu
   • Seetug limyéer
   • Tokenisasioŋ
   • Laajte buñ boole wala laajte yu bari
5. Lan mooy ñaari fase yi ci transformateur bi méngoo ak cache KV bi?
   • Prefill (defar laaj bi) ak decode (defar benn jeton benn yoon)
   • Taggat ak saytu
   • Enkode ak komprime
   • Yebbi ak yebbi
6. Lan la pagedAttention bu vLLM di def ci cache KV bi?
   • efaase cache bi ginaaw jeton bu nekk
   • Dafay xaaj cache bi ci ay blok yu jegewul ngir wàññi xaajalug mémoire bi
   • Soppi cache bi ci mbind
   • Ñaari yoon limu parametru model bi
7. Why can KV-cache memory limit how many requests a GPU serves concurrently?
   • The cache stores all training examples on the GPU
   • Each request creates a new model copy
   • Each active sequence retains key and value tensors that grow with its generated context
   • The cache stores only final text on disk
8. What is one benefit of sharing KV-cache blocks among requests with a common prefix?
   • It makes unrelated prefixes identical
   • It removes the need to compute attention
   • It guarantees lower latency in every workload
   • It can avoid storing duplicate prefix state and reduce memory use