TOPAS itanga gahunda yo kumenya-gahunda yo kugabanya imirimo myinshi ya LLM

Byagenze bite

Abashakashatsi batanga TOPAS, Igenamigambi-Igenamigambi-Kumenyekanisha gahunda yo gukorera abakozi benshi bigana ururimi rwicyitegererezo. Ihitamo byombi prefixes igumaho mugusangira urufunguzo-agaciro cache kandi nibisabwa bigomba gukora, kuringaniza cache kongera gukoresha iterambere binyuze mubikorwa rusange.

Urupapuro rwibanze ku kibazo cya sisitemu yihariye muri agent-LLM ikorera: prefix cishing. Iyo umukozi akoresheje inshuro nyinshi sisitemu ndende cyangwa izindi prefix zisangiwe, kugumana urufunguzo-agaciro cache irashobora kwihutisha guhamagarwa nyuma. Ariko cache imwe ifata ububiko bwa GPU ubundi bushobora gukoreshwa muguhuza ibyifuzo hamwe. Abanditsi basobanura ibi nkubucuruzi hagati yimbere yimbere yimbere niterambere binyuze mubikorwa byinshi. Muri uko gushushanya, cache ibirimo nibice bigize gahunda aho kuba ibisobanuro birambuye byo gushyira mubikorwa.

TOPAS ikemura ibyo gucuruza ifata ibyemezo bibiri hamwe. Ihitamo agent ibanziriza kugumana munsi yingengo yimari-agaciro-cache yingengo yimishinga kandi itegereje ibyifuzo byo guteganya kurangiza. Uburyo bwayo bwo gutanga amanota busuzuma ibyashobotse nyuma yicyemezo muguhuza kugabanuka guteganijwe muri buri gikorwa cyigihe kirekire gisigaye inzira ya serivise irwanya inyungu yigihe gito cyo kongera gukoresha epfo na ruguru. Iharurwa kandi riharura ibiciro byimbere nigiciro cyo kubanziriza. Gahunda ikubiyemo imirimo-yo gusaza uburyo bugamije kubuza imirimo imwe n'imwe gutegereza igihe kitazwi. Ibi bice bihuza kwibuka gutura, gusaba gahunda, hamwe niterambere ryakazi muri politiki imwe.

Abanditsi bashyize mu bikorwa TOPAS mu rwego rwa SGLang kandi barayisuzuma ku buryo butatu bwa syntetique yerekanwe acyclic grafike yimirimo hamwe na MetaGPT ebyiri-iterambere rya software. Uru rupapuro rutangaza ko, ugereranije n’ibikorwa byitwaye neza kuri buri murimo wakazi na metero, TOPAS yagabanije bivuze na 99-ku ijana-igihe cyo kurangiza akazi ku kigero cya 39.8% na 49.4% kumurimo wogukora. Kumurimo wa MetaGPT-SOP, ivuga ko 9.8% yagabanutse mugihe cyo kurangiza akazi. Kuri MetaGPT-TL, ivuga ko igabanuka rya 22.0% mugihe cyo kurangiza na 26,6% kuri 99%. Iyi mibare ni ibisabwa byakozwe nimpapuro, ntabwo bigenzuwe byigenga ibisubizo byatanzwe. Isuzuma rero risobanura imyitwarire yatangajwe yo gushyira mu bikorwa urutonde rwibikorwa byakazi.

Icyifuzo kirazwi muguhuza cache guhitamo hamwe noguhitamo kurwego rwakazi. Ihuriro niterambere rya sisitemu nkuru yasobanuwe mu mpapuro, mugihe ijanisha ryavuzwe ritanga ibimenyetso byatanzwe kubikorwa byaryo mugihe cyo kurangiza.

Ibisobanuro birambuye: arxiv.org ↗

Impamvu ari ngombwa

Sisitemu nyinshi-itanga sisitemu akenshi itanga icyitegererezo cyo guhamagarwa, bityo icyemezo cyo guteganya gifasha icyifuzo kimwe gishobora gutinza ibyiciro nyuma. Uru rupapuro ruvuga ko igabanuka ryinshi mu gihe cyo kurangiza akazi n'umurizo ku gihe cyo gusuzuma akazi, byerekana ko gukora ibikorwa remezo - atari ubwiza bw'icyitegererezo gusa - bishobora kugira ingaruka ku mikorere n'ibiciro bya sisitemu y'abakozi.

Akamaro gafatika kari muburyo bwimikorere yabakozi. Igikorwa-cyibikorwa byinshi ntabwo aricyitegererezo kimwe ahubwo ni urunigi cyangwa igishushanyo cyo guhamagara, hamwe nyuma yo guhamagarira gutegereza ibisubizo byambere. Gahunda itezimbere icyifuzo gikurikira gusa cyangwa cache yongeye gukoreshwa irashobora kunoza ibipimo byaho mugihe utinze inzira ikomeye. TOPAS ahubwo ifata inzira yumurimo isigaye nkigice cyicyemezo cyo guteganya, nikigeragezo kiziguye cyo guhuza imyitwarire ya serivise hamwe no kurangiza umurimo rusange wumukoresha. Ibi bituma igice cyo gutezimbere akazi keza aho guhamagarwa wenyine.

Igabanywa ryatangajwe rishobora kuba rifite ireme kuko igihe cyo kurangiza akazi kigira ingaruka kuburyo umukozi ashobora gusubiza byihuse hamwe nakazi gahuriweho hamwe na sisitemu yo gutanga serivisi ishobora gutera inkunga. Gutezimbere mugukoresha cache na gahunda birashobora kandi kugabanya igitutu cyo kongeramo ibyuma kumurimo runaka wakazi, nubwo isoko idapima kuzigama ibikorwa remezo, gukoresha ingufu, igiciro cyibikorwa, ubwiza bwibisubizo, cyangwa kunyurwa kwabakoresha. Uru rupapuro rero rutanga ibimenyetso byerekeranye no guteganya ubukererwe mu igeragezwa ryarwo, ntabwo ari urubanza rwuzuye rwo kohereza ubukungu. Ibyo bipimo bidapimwe bikomeza gutandukana nibisubizo byubukererwe.

Akazi karerekana kandi imbogamizi yo gusuzuma imikorere yabakozi gusa kurwego rwo guhamagarwa. Kuri sisitemu nyinshi, sisitemu irashobora gutanga umusaruro umwe mugihe abakoresha bahura nubukererwe butandukanye kuko ibyifuzo birushanwe kubibuka no gukora. Mugukora prefix leta hamwe nakazi gashingiye kubikorwa, impapuro zitanga sisitemu icyerekezo gishobora kuba ingirakamaro kubashakashatsi bashushanya ibikorwa remezo bikorera abakozi. Nubwo bimeze bityo, isoko ntisobanura ko TOPAS itezimbere kwizerwa, ubunyangamugayo, ubutabera mubakoresha, cyangwa umutekano; intego yatangajwe ni igihe cyo kurangiza akazi. Itandukaniro rifite akamaro kuko kurangiza byihuse ntabwo ubwabyo byerekana ubuziranenge bwa sisitemu.

Mubisanzwe, impapuro zihuza imyitwarire yibikorwa byumukoresha-ugaragara igihe cyibikorwa bya AI. Ihuza rifasha gusobanura impamvu gahunda-yakazi-gahunda-gahunda irashobora kugira akamaro nubwo icyitegererezo cyibanze hamwe nibisubizo byatanzwe bitagihinduka, mugihe ibimenyetso byinkomoko bigarukira kubisuzuma byatangajwe.

Ibyo kureba

Ibisubizo biva muri progaramu imwe ya arXiv hamwe nisuzuma rito: ibishushanyo bitatu byerekanwe byerekanwa bya acyclic hamwe na MetaGPT ebyiri zakazi. Ibibazo byingenzi byafunguye birimo imikorere yumuhanda utanga umusaruro, uburyo butandukanye bwo gutanga serivise, ibikorwa binini cyangwa byinshi bitandukanye byakazi, hamwe ningaruka zo gushyira mubikorwa hejuru na cache politiki hanze yimiterere yageragejwe.

Ikibazo cya mbere nukumenya niba inyungu zivugwa zifata ibirenze imiryango itanu yimirimo. Imirimo itatu ikora ni synthique, mugihe ibiri isigaye izwi nka MetaGPT software-iterambere ryakazi. Inkomoko ntabwo itanga ingano yumurimo, kugabura ibinyabiziga, ibishushanyo mbonera, ibisobanuro birambuye, amazina y'ibanze, cyangwa itandukaniro mugusubiramo kenshi mumyandiko yatanzwe. Ibyo bisobanuro nibyingenzi mugusuzuma uburyo ijanisha rikoreshwa. Bitabaye ibyo, kugereranya kumibare biragoye kwimurira ahandi hantu hakorera.

Isuzuma ryerekana umusaruro nyawo ryaba ritanga amakuru cyane. Sisitemu yo kubyaza umusaruro irashobora kugira uburyo bwo kuhagera bidasanzwe, guhagarika, uburebure bwihuse butandukanye, moderi nyinshi, guhindura cache gutura, hamwe nintego-urwego rwa serivisi bitagaragajwe nigishushanyo mbonera cyakazi. Byaba byiza kandi umenye uko TOPAS yitwara mugihe prefix igenda na preemption bihenze, mugihe ingengo yimari ya cache ari nto cyane, cyangwa mugihe akazi karimo amashami adakora muburyo buteganijwe. Ibizamini nkibi byakurikirana ubucuruzi bumwe mubihe bitandukanye cyane nibisobanuwe mubisuzuma byatanzwe.

Uru rupapuro ni inyandiko ya arXiv yo ku ya 26 Kanama 2026, kandi inkomoko igaragaza ko ari impapuro z'impapuro umunani. Inyandiko yatanzwe ntabwo ishyiraho urungano rusubirwamo, kwigana byigenga, kode rusange iboneka, cyangwa koherezwa nuwabitanze. Ibikorwa byo gukurikirana bigomba kugerageza ibyo bibazo, kugereranya TOPAS na gahunda ziyongera, gutanga raporo yumutungo nubucuruzi bwiza, no gusuzuma niba uburyo bwo gusaza butangiza ubukererwe butandukanye kubikorwa. Kugeza icyo gihe, umwanzuro ushigikiwe cyane nuko abanditsi batangaza uburyo buteganijwe buteganijwe mugusuzuma imbibi. Ingano yuwo mwanzuro igomba kuguma ihujwe nibimenyetso nibisobanuro byakazi biboneka hano.

Ibimenyetso byingirakamaro cyane ubutaha rero byahuza imirimo yagutse hamwe nibisobanuro birambuye byubushakashatsi hamwe n'ibipimo birenze igihe cyo kurangiza. Ibyo byongeweho byasobanura neza imyororokere nimbibi zifatika zuburyo bwateganijwe buteganijwe udahinduye ibyo impapuro zisabwa.

Ibijyanye nuyobora & ibibazo