Ururimi AI

Multi-Umutwe Utinze Kwitonda

Multi-Head Latent Attention (Umudepite) nuburyo bwo kwitondera, bwatangijwe muri DeepSeek-V2, bugabanya kwibuka-ushonje urufunguzo-agaciro cache mukantu gato gasangiwe rwihishwa.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka Multi-Umutwe Utinze Kwitonda
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

It lets large language models run with far less GPU memory while keeping quality close to standard attention.

Kwibira cyane

Iyo transformateur itanga inyandiko, ibika urufunguzo nagaciro ka vector kuri buri kimenyetso cyashize muri 'KV cache.' Iyo cache ikura hamwe nuburebure bwimiterere kandi yiganjemo gukoresha kwibuka mugihe cyo gufata umwanzuro. Umudepite asimbuye byinshi byuzuye-urufunguzo / agaciro indangagaciro hamwe numurongo umwe wo hasi urwego rwihishwa rwerekanwa kuri buri kimenyetso, hanyuma imishinga ihita isubira mumfunguzo zumutwe hamwe nagaciro kuguruka. Kuberako ibice byihishe byihishe gusa, DeepSeek-V2 yatangaje ko igabanya ububiko bwa KV-cache hejuru ya 90% ugereranije nibisanzwe-imitwe yitabwaho, bigatuma ibice birebire hamwe nubunini bunini. Icy'ingenzi, matrices yo hejuru-ishobora gutegekwa mubindi bipimo, bityo rero Umudepite agera kuri compression hamwe nigihombo gito cyangwa ntagereranywa muburyo bwiza bwo kwerekana.

Gushyira mu bikorwa Isi

Gukora DeepSeek-V2 / V3 moderi yo kuganira hamwe na GPU yibuke yibirenge byibisobanuro kuri buri cyifuzo

Gukoresha inyandiko ndende ikibazo gisubiza aho cache nini ya KV ubundi yarangiza VRAM

Kongera ingano yicyiciro cya GPU ihamye kuko buri ruhererekane rubika gusa agace gato kihishe

Gushoboza imirongo miremire ya Windows kubikoresho byibicuruzwa kubisubiramo-byongerewe abafasha

Kazoza ka Multi-Umutwe Utinze Kwitonda

Umudepite yafashije gukora DeepSeek-V2 na V3 mu bukungu kugira ngo akorere ku rugero, kandi tekinike iragenda ikwirakwira mu gihe amakipe yirukanka bihendutse. Tegereza imiterere-yinteko ishinga amategeko yihishe kugirango ihuze hamwe gake-Uruvange-rw-Impuguke, cashe zingana, hamwe na decoding yibishushanyo mbonera bizaza. Abashakashatsi kandi barimo gushakisha uburyo urugero rwihishwa rushobora kugabanuka mbere yo kugabanuka kwiza, kandi niba igitekerezo kimwe cyo hasi gishobora guhagarika ibitekerezo mugihe cyamahugurwa, ntabwo ari umwanzuro gusa.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Umuvuduko n'igipimo. Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
  • Kugera no kugera. Yagura uburyo bwindimi nuburyo bwo gutumanaho.
  • Ibyemezo bisobanutse. Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Witondere

  • Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
  • Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
  • Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Intambwe ikurikira

  1. Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
  2. Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
  3. Komeza kugenzura abantu kugenzura ibisubizo byinshi.
  4. Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Multi-Head Latent Attention quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Multi-Head Latent Attention?

Multi-Head Latent Attention (Umudepite) nuburyo bwo kwitondera, bwatangijwe muri DeepSeek-V2, bugabanya kwibuka-ushonje urufunguzo-agaciro cache mukantu gato gasangiwe rwihishwa. Kureka ururimi runini rwimikorere ikora hamwe na GPU yibuke mugihe ukomeza ubuziranenge hafi yo kwitabwaho bisanzwe.

Ni ikihe kibazo cyibanze Multi-Head Latent Attention yagenewe kugabanya?

Umudepite yibasiye Kache cache, ikura hamwe nuburebure bwimiterere kandi ikagenga kwibuka mugihe cyo gutanga inyandiko.

Nigute Umudepite agabanya cache ya KV?

Umudepite yihishe icyerekezo kimwe cyihishwa kuri buri kimenyetso kandi yubaka urufunguzo nindangagaciro biva muri up-projection.

Niyihe moderi yabanje kwerekana Multi-Head Yatinze Kwitonda?

Umudepite yatangijwe na DeepSeek muburyo bwa DeepSeek-V2 hanyuma ajyanwa muri DeepSeek-V3.

Ni ukubera iki Umudepite akeneye inzira 'decoupled' itandukanye yo guhinduranya imyanya?

Guhinduranya kuzenguruka ntibishobora kwinjizwa mubindi bipimo byuburemere, bityo rero Umudepite agumana ikintu gito cyibanze cyibanze kugirango atware amakuru yumwanya.

Hafi ya KV-cache yo kugabanya ububiko bwa DeepSeek-V2 bwatanzwe na Depite hamwe nibisanzwe imitwe myinshi?

DeepSeek-V2 yatangaje ko igabanya ububiko bwa KV-cache hejuru ya 90%, bigatuma ibice birebire hamwe nitsinda rinini.