Ku laabo Warka
Hal-abuurnimoAI Understanding warbixin kooban

Habka furista degdega ah wuxuu bartilmaansadaa ciribtirka xusuusta ee moodooyinka AI ee muddada-dheer

Warqad cusub oo arXiv ah waxay soo bandhigaysaa Decoding Degdega ah, oo ah hab tababar-la'aan ah oo ay qorayaashu sheegeen inay yareyn karaan xisaabinta-fiirsashada ee moodooyinka luqadda muddada-dheer iyadoo la ilaalinayo saxnaanta cabbirka.

4 min readRead the primary source
Source-provided image accompanying Faster decoding method targets the memory bottleneck in long-context AI models
Dukumeentiga isha aasaasiga ahIsha la duubay
Daabacaha
arxiv.org
Xidhiidhka isha
arxiv.orghttps://arxiv.org/abs/2609.00097
Nooca isha
Dukumeentiga aasaasiga ah - ogeysiis rasmi ah, warqad, xereyn, ama bogga xisbiga koowaad waxaan si toos ah u akhrinay.
Dulucda sheekadaKu fahan tan 60 ilbiriqsi gudahood

Halkan ka bilow

Qodobbada muhiimka ah

Xusuusta (Xusuusta Wakiilka)
Macnaha guud ee la kaydiyay wakiilka AI wuxuu isticmaalaa dhammaan tillaabooyinka ama fadhiyada si uu u horumariyo sii wadida.
Tirada
Miisaanka moodeelka oo loo beddelo qaababka saxda ah ee hoose sida 8-bit ama 4-bit.
Algorithm
Nidaam qeexan ama tillaabooyin uu kombuyuutarku raaco si uu u xalliyo mushkilad ama uu hawl u dhammaystiro.
Is tijaabiMoodooyinka AI Kedis La Sharaxay

Maxaa dhacay

Cilmi baadhayaashu waxay soo bandhigeen Degdega Degdegga ah ee Flash Decoding (FFD), oo ah qaab-naqshad wadaaga hardware- ee dardargelinta qaabaynta luqadda-tusmeedka-dheer. Wargeysku wuxuu leeyahay FFD waxay fiyuusyada iyo xisaabinta u dirtaa hal kernel, waxay isticmaashaa qiyaas yar si ay u baarto nuxurka xog-ogaalka ah, waxayna si firfircoon u shaandheysaa xannibaadaha dareenka iyada oo loo marayo istaraatiijiyad-sare-delta. Qorayaashu waxay ka warbixiyaan ilaa 11.6x heerka kernel xawaaraha, taageerada 256K-token, iyo 2.37x dhamaadka-ilaa-dhamaadka hagaajinta wax soo saarka.

Waraaqda, oo loo gudbiyay arXiv Agoosto 31, 2026 oo lagu aqoonsaday sida loo aqbalay ICML 2026, waxay wax ka qabanaysaa xusuusta-bandwidth-geeska iyo qiimaha dareenka quadratic ee la xidhiidha go'aaminta macnaha dheer. Qaab-dhismeedkeeda Degdegga ah ee Go'aaminta Filashka ee ay soo jeedisay waxay isku daraysaa ilbaxnimada -ka iyo kernel-ka qalabka isku-dhafan halkii ay ku tiirsanaan lahayd tusmooyinka xog-ururinta badan ee dibadda ama marxalad doorasho la-qabsi gaar ah.

Marka loo eego qoraalka aan la soo koobi karin, FFD waxay qabataa iskaanka xog-oggolaanshaha leh iyada oo la adeegsanayo qiyaas yar, ka dib waxay dib u isticmaashaa natiijooyinka iskaanka inta lagu jiro xisaabinta. Istaraatiijiyadeeda sare-delta waxay si firfircoon u shaandheysaa xannibaadyada dareenka iyadoo loo eegayo qaybinta la arkay waxayna ka fogaataa wada-shaqeynta caalamiga ah. Qorayaashu waxay ku sifeeyeen habka inuu yahay mid aan tabobar lahayn iyo ciyaar-ciyaar. Waxay soo sheegaan ilaa 11.6x xawaaruhu heerka kernel-ka, iyaga oo u miisaamaya xaaladaha 256K-token, iyo 2.37x sare-ilaa-dhamaadka wax soo saarka. Qoraalku wuxuu leeyahay qiimaynta RULER iyo LongBench waxay ilaaliyeen saxnaanta moodeelka iyagoo soo saaraya saami-yaraan, laakiin ma tilmaamayso moodooyinka la tijaabiyay, qalabka, saldhigyada, ama natiijooyinka saxnaanta saxda ah.

Faahfaahinta isha: arxiv.org ↗

Maxay muhiim u tahay

Nidaamyada muddada-dheer ee AI waa qaali in la ordo sababtoo ah dejinta si isdaba joog ah ayaa loo akhriyaa qadar badan oo xog ah, taas oo ka dhigaysa xajmiga xusuusta xaddidan la taaban karo. Haddii faa'iidooyinka la soo sheegay ay dhaafsiisan yihiin imtixaannada qorayaasha, FFD waxay yarayn kartaa qalabka iyo kharashyada daahitaanka codsiyada ee farsameeya dukumeentiyada aadka u waaweyn, saldhigyada koodka, ama taariikhda wada sheekaysiga. Naqshadeeda bilaashka ah ee tabobarka, fur-iyo-ciyaarta waxay sidoo kale ka dhigi kartaa hagaajinta fikradda mid sahlan in la qaato, in kasta oo isha aysan dejin u-diyaargarowga wax-soo-saarka ama ku habboonaanta qalabka ballaaran.

Shaqadu waxay beegsanaysaa dhibaatada kaabayaasha taas oo si toos ah u saameynaysa kharashka iyo ka jawaab celinta muddada dheer ee AI. Go'aaminta degdega ah waxay muhiim u tahay falanqaynta dukumeentiyada, kaydinta software-ka, kaaliyeyaasha culus ee soo celinta, iyo nidaamyada kale halkaas oo qaabku uu si isdaba joog ah uga qaybgalo waxyaabo badan. Sababtoo ah FFD uma baahna dib u tabobar, hawl wadeenada moodeelku waxa ay ku dabaqi karaan wakhtiga la qiyaasi karo halkii ay dib u dhisi lahaayeen miisaanka moodeelka ama ay tababari lahaayeen noocyo cusub.

Natiijooyinka la soo sheegay ayaa weli ah natiijooyinka qoraaga laga soo sheegay warqad cilmi-baaris, ma aha natiijo si madax-bannaan loo soo saaray. Isha ma cadeeyneyso in habka uu si siman ugu shaqeeyo qaab dhismeedka moodeelka, dardar-geliyayaasha, cabbirka dufcada, ama culeyska shaqada ee aduunka dhabta ah. Sidoo kale ma qiyaasto kaydadka xusuusta, isticmaalka tamarta, wadarta qiimaha adeega, ama iibinta tayada leh ee ka baxsan bartilmaameedyada la magacaabay.

Interactive Mechanism

Farsamaynta Is-dhexgalka: Sida Dhabta Ay U Shaqeyso

U baadh tignoolajiyada hoose ee ka dambeeya horumarkan si isdhexgal leh.

Document Size:128K tokens
Needle Placement Depth (Location in document):50% into text
Attention Context Buffer Map:
Target Fact (50%)
Equivalent Pages~320Standard book pages
Retrieval Accuracy99.9%Needle recall score
RAM / KV Cache5.1 GBMemory overhead
Prompt CachingActive~80% discount on reuse
Core takeaway: Million-token context windows allow querying whole codebases or legal archives in one prompt. However, KV cache memory scales with context length, making prompt caching crucial for real-time production.
Hubinta Fikradda Is-dhexgalka+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Maxaa la daawan doona xiga

Su'aalaha muhiimka ah waa in FFD ay ilaalinayso saxnaanta noocyo badan, hawlo, dhererka macnaha guud, iyo qaabaynta qalabka; Inta faa'iidooyinkeedu waxay ku xiran yihiin saldhigyo gaar ah ama kernels; iyo in koodka la sii daayay lagu isticmaali karo shati cad. Isha ma bixiso xiriirka fulinta, qalabka la taageeray, shuruudaha geynta, natiijooyinka tamarta, ama qiime kasta ama macluumaadka la heli karo.

Baadhitaan dheeraad ah waa in ay diiradda saaraan habaynta tijaabada buuxda ee warqada iyo siidaynta koodka: qalabka la taageeray iyo kaydinta software-ka, isbarbardhigga saldhigyada, xadka xaddidan, cabbirada saxda ah, iyo shatiga. Waxa kale oo aan la garanayn in FFD ay la jaan qaadayso moodooyinka muddada-dheer ee si ballaadhan loo geeyay iyada oo aan lahayn injineer gaar ah, haddii faa'iidooyinkeeda wax-soo-saarka ay ku sii jiraan adeegga adeegsadaha badan, iyo haddii natiijada 256K ee la soo sheegay ay ka tarjumayso culeysyo shaqo oo la taaban karo ama qaabeynta bartilmaameedka la xakameeyey.

Tilmaamaha la xidhiidha & su'aalaha

Moodooyinka AI ayaa la sharaxayTransformersTababarka AIMustaqbalka AITijaabi waxaad taqaan - isku day kedis AI oo bilaash ahKa raadi erey AI qaamuuskeenaRaac qaabka AI raadraaca sii deynta
Tan faa'iido ma u heshay?