Ubuyobozi bwa tekiniki
Guhagarika-Ntibisanzwe na Kavukire Ntibisanzwe
Guhagarika-gake kandi kavukire gake reka reka abahindura bitabira gusa ibice byingenzi byurwego rurerure aho kuba ikimenyetso cyose, kugabanya ibiciro bya quadratic yo kwitabwaho bisanzwe.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
This is what makes efficient long-context models practical on real hardware.
Kwibira cyane
Kwiyitaho bisanzwe kugereranya buri kimenyetso nikindi kimenyetso, bityo igiciro kikura inshuro enye hamwe nuburebure bwikurikiranya, bigahinduka kubuza inyandiko ndende cyane. Kwitonda gake kugabanya buri kimenyetso kumurongo wabandi. Guhagarika-gake inzira igabanya urukurikirane mubice hanyuma ubare ibitekerezo gusa kubice byatoranijwe byombi, bishushanya neza kuri GPU tensor. Kavukire ya Sparse Attention (NSA), kuva muri DeepSeek, iragenda ikomeza: irashobora gutozwa impera-iherezo-iherezo kandi igahuza ibyuma, igahuza amashami atatu, guhunika-token-token compression, guhitamo neza-guhitamo neza byingenzi, hamwe nidirishya ryo kunyerera kurwego rwaho. Kuberako uburyo butandukanye bwigishwa mugihe cyo kwitegura aho guhinduka nyuma, NSA ibika neza mugihe itanga umuvuduko munini kumurongo muremure.
Gushyira mu bikorwa Isi
Gukoresha icyitegererezo hejuru ya codebase yose cyangwa amasezerano maremare yemewe aho kwitabwaho byuzuye byananiza GPU yibuka.
NSA ya DeepSeek yihutisha kwitegura no gufata intera ndende mugihe ihuye cyangwa ikubita neza-ibitekerezo byuzuye.
Incamake yibitabo byuburebure witabira kwitabira incamake yo guhagarika wongeyeho ibice bifitanye isano.
Kwihutisha imiterere-ndende yo gufasha abafasha intambwe ya decoding intambwe ijyanye no kwibuka kugabanya buri kimenyetso kumurongo wo hejuru.
Ejo hazaza hahagaritswe-Ntibisanzwe na Kavukire Ntibisanzwe
Gutoza, ibyuma-bimenyesha sparsity birahinduka inzira ya miriyoni-token imiterere idaturika ikiguzi. Witege ko bidakunze kwitabwaho kugirango uhuze hamwe na kernel na yihuta, uhujwe n'umurongo-wo kwitaho hamwe n'ibitekerezo bya leta-umwanya, kandi bigakoreshwa mumipaka miremire-ndende hamwe n'ibitekerezo. Mugihe ibishushanyo bigenda byigwa kandi bigahinduka, icyitegererezo kizagenera ingengo yimari ijyanye nibibazo kuri buri kibazo, kandi ibipimo bizagenda bipima decoding yinjira kumurongo muremure, ntabwo ari ubuziranenge gusa.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
- Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
- Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Witondere
- Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
- Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
- Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Intambwe ikurikira
- Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
- Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
- Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
- Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Take the Block-Sparse and Native Sparse Attention quiz
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
What is Block-Sparse and Native Sparse Attention?
Guhagarika-gake kandi kavukire gake reka reka abahindura bitabira gusa ibice byingenzi byurwego rurerure aho kuba ikimenyetso cyose, kugabanya ibiciro bya quadratic yo kwitabwaho bisanzwe. Nibyo bituma moderi ikora neza-ndende igaragara mubikorwa byuma nyabyo.
Ni ukubera iki kwiyitaho bisanzwe bihenze kumurongo muremure?
Ikimenyetso cyose cyitabira ikindi kimenyetso, kubara rero no kwibuka umunzani hamwe na kare yuburebure bwikurikiranya.
Ni ikihe gitekerezo cyibanze cyo guhagarika ibitekerezo?
Urukurikirane rwacitsemo ibice kandi kwitabwaho kubarwa gusa kubice byatoranijwe byombi, nabyo bishushanya neza kuri GPU tensor.
Niki gituma Kavukire idasanzwe (NSA) itandukana nuburyo bwinshi bwambere?
NSA yiga uburyo bworoshye mugihe cyo kwitegura kandi igenewe guhuza ibyuma, bityo ikabika neza mugihe ikora byihuse.
Ni ayahe mashami atatu NSA ihuza urufunguzo n'indangagaciro?
NSA ihuza ikomatanya rito, guhitamo neza, hamwe nidirishya ryanyerera ukoresheje amarembo yize.
Ni ukubera iki NSA ikoresha ibikorwa byo guhagarika urwego aho gukoresha ibimenyetso-buke buke?
Guhagarika urwego rwo kugera kubikoresho bya GPU, kubwibyo kuzigama kwa FLOP bihinduka urukuta-isaha yihuta.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo