Ubuyobozi bwa tekiniki

Guhagarika-Ntibisanzwe na Kavukire Ntibisanzwe

Guhagarika-gake kandi kavukire gake reka reka abahindura bitabira gusa ibice byingenzi byurwego rurerure aho kuba ikimenyetso cyose, kugabanya ibiciro bya quadratic yo kwitabwaho bisanzwe.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Ejo hazaza hahagaritswe-Ntibisanzwe na Kavukire Ntibisanzwe
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

This is what makes efficient long-context models practical on real hardware.

Kwibira cyane

Kwiyitaho bisanzwe kugereranya buri kimenyetso nikindi kimenyetso, bityo igiciro kikura inshuro enye hamwe nuburebure bwikurikiranya, bigahinduka kubuza inyandiko ndende cyane. Kwitonda gake kugabanya buri kimenyetso kumurongo wabandi. Guhagarika-gake inzira igabanya urukurikirane mubice hanyuma ubare ibitekerezo gusa kubice byatoranijwe byombi, bishushanya neza kuri GPU tensor. Kavukire ya Sparse Attention (NSA), kuva muri DeepSeek, iragenda ikomeza: irashobora gutozwa impera-iherezo-iherezo kandi igahuza ibyuma, igahuza amashami atatu, guhunika-token-token compression, guhitamo neza-guhitamo neza byingenzi, hamwe nidirishya ryo kunyerera kurwego rwaho. Kuberako uburyo butandukanye bwigishwa mugihe cyo kwitegura aho guhinduka nyuma, NSA ibika neza mugihe itanga umuvuduko munini kumurongo muremure.

Gushyira mu bikorwa Isi

Gukoresha icyitegererezo hejuru ya codebase yose cyangwa amasezerano maremare yemewe aho kwitabwaho byuzuye byananiza GPU yibuka.

NSA ya DeepSeek yihutisha kwitegura no gufata intera ndende mugihe ihuye cyangwa ikubita neza-ibitekerezo byuzuye.

Incamake yibitabo byuburebure witabira kwitabira incamake yo guhagarika wongeyeho ibice bifitanye isano.

Kwihutisha imiterere-ndende yo gufasha abafasha intambwe ya decoding intambwe ijyanye no kwibuka kugabanya buri kimenyetso kumurongo wo hejuru.

Ejo hazaza hahagaritswe-Ntibisanzwe na Kavukire Ntibisanzwe

Gutoza, ibyuma-bimenyesha sparsity birahinduka inzira ya miriyoni-token imiterere idaturika ikiguzi. Witege ko bidakunze kwitabwaho kugirango uhuze hamwe na kernel na yihuta, uhujwe n'umurongo-wo kwitaho hamwe n'ibitekerezo bya leta-umwanya, kandi bigakoreshwa mumipaka miremire-ndende hamwe n'ibitekerezo. Mugihe ibishushanyo bigenda byigwa kandi bigahinduka, icyitegererezo kizagenera ingengo yimari ijyanye nibibazo kuri buri kibazo, kandi ibipimo bizagenda bipima decoding yinjira kumurongo muremure, ntabwo ari ubuziranenge gusa.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Block-Sparse and Native Sparse Attention quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Block-Sparse and Native Sparse Attention?

Guhagarika-gake kandi kavukire gake reka reka abahindura bitabira gusa ibice byingenzi byurwego rurerure aho kuba ikimenyetso cyose, kugabanya ibiciro bya quadratic yo kwitabwaho bisanzwe. Nibyo bituma moderi ikora neza-ndende igaragara mubikorwa byuma nyabyo.

Ni ukubera iki kwiyitaho bisanzwe bihenze kumurongo muremure?

Ikimenyetso cyose cyitabira ikindi kimenyetso, kubara rero no kwibuka umunzani hamwe na kare yuburebure bwikurikiranya.

Ni ikihe gitekerezo cyibanze cyo guhagarika ibitekerezo?

Urukurikirane rwacitsemo ibice kandi kwitabwaho kubarwa gusa kubice byatoranijwe byombi, nabyo bishushanya neza kuri GPU tensor.

Niki gituma Kavukire idasanzwe (NSA) itandukana nuburyo bwinshi bwambere?

NSA yiga uburyo bworoshye mugihe cyo kwitegura kandi igenewe guhuza ibyuma, bityo ikabika neza mugihe ikora byihuse.

Ni ayahe mashami atatu NSA ihuza urufunguzo n'indangagaciro?

NSA ihuza ikomatanya rito, guhitamo neza, hamwe nidirishya ryanyerera ukoresheje amarembo yize.

Ni ukubera iki NSA ikoresha ibikorwa byo guhagarika urwego aho gukoresha ibimenyetso-buke buke?

Guhagarika urwego rwo kugera kubikoresho bya GPU, kubwibyo kuzigama kwa FLOP bihinduka urukuta-isaha yihuta.