Ururimi AI
Multi-Umutwe Utinze Kwitonda
Multi-Head Latent Attention (Umudepite) nuburyo bwo kwitondera, bwatangijwe muri DeepSeek-V2, bugabanya kwibuka-ushonje urufunguzo-agaciro cache mukantu gato gasangiwe rwihishwa.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
It lets large language models run with far less GPU memory while keeping quality close to standard attention.
Kwibira cyane
Iyo transformateur itanga inyandiko, ibika urufunguzo nagaciro ka vector kuri buri kimenyetso cyashize muri 'KV cache.' Iyo cache ikura hamwe nuburebure bwimiterere kandi yiganjemo gukoresha kwibuka mugihe cyo gufata umwanzuro. Umudepite asimbuye byinshi byuzuye-urufunguzo / agaciro indangagaciro hamwe numurongo umwe wo hasi urwego rwihishwa rwerekanwa kuri buri kimenyetso, hanyuma imishinga ihita isubira mumfunguzo zumutwe hamwe nagaciro kuguruka. Kuberako ibice byihishe byihishe gusa, DeepSeek-V2 yatangaje ko igabanya ububiko bwa KV-cache hejuru ya 90% ugereranije nibisanzwe-imitwe yitabwaho, bigatuma ibice birebire hamwe nubunini bunini. Icy'ingenzi, matrices yo hejuru-ishobora gutegekwa mubindi bipimo, bityo rero Umudepite agera kuri compression hamwe nigihombo gito cyangwa ntagereranywa muburyo bwiza bwo kwerekana.
Gushyira mu bikorwa Isi
Gukora DeepSeek-V2 / V3 moderi yo kuganira hamwe na GPU yibuke yibirenge byibisobanuro kuri buri cyifuzo
Gukoresha inyandiko ndende ikibazo gisubiza aho cache nini ya KV ubundi yarangiza VRAM
Kongera ingano yicyiciro cya GPU ihamye kuko buri ruhererekane rubika gusa agace gato kihishe
Gushoboza imirongo miremire ya Windows kubikoresho byibicuruzwa kubisubiramo-byongerewe abafasha
Kazoza ka Multi-Umutwe Utinze Kwitonda
Umudepite yafashije gukora DeepSeek-V2 na V3 mu bukungu kugira ngo akorere ku rugero, kandi tekinike iragenda ikwirakwira mu gihe amakipe yirukanka bihendutse. Tegereza imiterere-yinteko ishinga amategeko yihishe kugirango ihuze hamwe gake-Uruvange-rw-Impuguke, cashe zingana, hamwe na decoding yibishushanyo mbonera bizaza. Abashakashatsi kandi barimo gushakisha uburyo urugero rwihishwa rushobora kugabanuka mbere yo kugabanuka kwiza, kandi niba igitekerezo kimwe cyo hasi gishobora guhagarika ibitekerezo mugihe cyamahugurwa, ntabwo ari umwanzuro gusa.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Umuvuduko n'igipimo. Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
- Kugera no kugera. Yagura uburyo bwindimi nuburyo bwo gutumanaho.
- Ibyemezo bisobanutse. Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Witondere
- Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
- Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
- Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Intambwe ikurikira
- Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
- Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
- Komeza kugenzura abantu kugenzura ibisubizo byinshi.
- Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Take the Multi-Head Latent Attention quiz
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
What is Multi-Head Latent Attention?
Multi-Head Latent Attention (Umudepite) nuburyo bwo kwitondera, bwatangijwe muri DeepSeek-V2, bugabanya kwibuka-ushonje urufunguzo-agaciro cache mukantu gato gasangiwe rwihishwa. Kureka ururimi runini rwimikorere ikora hamwe na GPU yibuke mugihe ukomeza ubuziranenge hafi yo kwitabwaho bisanzwe.
Ni ikihe kibazo cyibanze Multi-Head Latent Attention yagenewe kugabanya?
Umudepite yibasiye Kache cache, ikura hamwe nuburebure bwimiterere kandi ikagenga kwibuka mugihe cyo gutanga inyandiko.
Nigute Umudepite agabanya cache ya KV?
Umudepite yihishe icyerekezo kimwe cyihishwa kuri buri kimenyetso kandi yubaka urufunguzo nindangagaciro biva muri up-projection.
Niyihe moderi yabanje kwerekana Multi-Head Yatinze Kwitonda?
Umudepite yatangijwe na DeepSeek muburyo bwa DeepSeek-V2 hanyuma ajyanwa muri DeepSeek-V3.
Ni ukubera iki Umudepite akeneye inzira 'decoupled' itandukanye yo guhinduranya imyanya?
Guhinduranya kuzenguruka ntibishobora kwinjizwa mubindi bipimo byuburemere, bityo rero Umudepite agumana ikintu gito cyibanze cyibanze kugirango atware amakuru yumwanya.
Hafi ya KV-cache yo kugabanya ububiko bwa DeepSeek-V2 bwatanzwe na Depite hamwe nibisanzwe imitwe myinshi?
DeepSeek-V2 yatangaje ko igabanya ububiko bwa KV-cache hejuru ya 90%, bigatuma ibice birebire hamwe nitsinda rinini.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo