Kuvugururwa buri munsi4681 inkuru zagenzuwe

Amakuru ya AI. Nta rusaku.

Inkomoko yagenzuwe na AI yerekana ibicuruzwa, guhindura politiki, ubushakashatsi ku mutekano, hamwe n’inganda zigenda, byasobanuwe mu Cyongereza cyoroshye nitsinda ry’uburezi ridaharanira inyungu.

Amasoko yagenzuwe

Buri nkuru ihuza ibimenyetso bikomeye biboneka: inkomoko yumwimerere iyo iboneka, naho ubundi raporo yatanzwe neza.

Icyongereza

Ibyabaye, impamvu bifite akamaro, nicyo kureba - nta jargon.

Nta wuzuza

Iyo ikimenyetso ari gito, ntacyo dusohora aho gukanda ibiryo.

9 inkuru
  1. Guhanga udushyaGuhanga udushya5 min soma

    PuzzleKV ishyiraho uburyo bwo kugabanya ingano ya LLM KV-cache buri rupapuro

    Ishusho nshya ya arXiv yemeza PuzzleKV, uburyo butagomba kurema cyangwa gupima (training- and calibration-free) bwagabanya ubukana bw'amapaji yuzuye ya KV cache ya mudasobwa zikomeye (large language models). Iyo yerekana ko igabanya ubukana bwa KV cache yose (Full KV) kugeza ku 96% cyangwa hejuru, mu gihe ikoresha hafi 60% y'ubukana bwo guhagarika (storage) bwari bwo mbere, kandi ko igabanya ubukana bwa KV cache yose kugeza ku 93% cyangwa hejuru, mu gihe ikoresha 18.7% y'ubukana bwo guhagarika bwari bwo mbere, iyo ikoresha uburyo bwo kugabanya ubukana (quantization).arxiv.org
Jump to a page

Imyitozo imwe y'ingirakamaro buri cyumweru

Komeza hamwe na AI utabayeho mubiryo.

Shakisha icyumweru cyagenzuwe amakuru ya AI, amakuru yumwimerere, ibikoresho byingirakamaro, gutoranya imyigire, nakazi gashya ka AI.

Send me
One email a week. Switch any time.

Shikira abantu biga AI

Guha akazi umwuga wa AI cyangwa gutangiza ibicuruzwa bya AI bifite akamaro? Shyira imbere yabantu baje hano kwiga no gukora.

Kohereza akazi ka AITanga igikoresho cya AI