What is KV Cache? Definition | AI Understanding

Maanaam

Caabi yuñ denc ak tensor valeur yu bawoo ci jeton yu njëkk yi may transformateur yi ñu defar ay token yu bees te duñu delloosi seen xel ci jamono yi weesu.

Term yu ci méngoo

Xeetu tàggat yaram buy may model bi mu wéy di jàng ci done yu bees te du fàtte xam-xam bimu amoon bu njëkk.

Top-k jël misaal

Pexem dekodaas buy jël misaal ci k token yi ci topp.

Jàng bu kenn duko saytu

Modèlu jàng ci done yuñu etiketewul te amul benn njariñ bu leer.

Palanteer buy gliise

Modèlu attention boo xamni token bu nekk dafay bàyyi xel ci palanteer bu yam ci token yi ci wetam ngir wàññi calcul bi.

Tokenizer bu xamul làkk, di jàng ay subword ci bind bu ñor te duko njëkka xaaj ci espace bu weex.

Reglage decodage buy wàññi probabilite token yi feeñ, di ñaax topic yu bees.

Nekk leen ci sunuy tegtal yu amul fayda

KV Cache KV Cache Optimization

Xoolal itam

Speculative Decoding MCP (Model Context Protocol)Zero Data Retention Agentic Loop Usage-Based Billing ReAct Trust Calibration Tree of Thoughts

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda