Chii chaitika
Pepa rakatumirwa kuarXiv musi waNyamavhuvhu 22 rinokurudzira ToSCA, nhanho-mbiri yekusimbisa-yekudzidza yevashandisi vekutaura. Inogadzirisa chizvarwa chekupindura kwechiratidzo-ne-token pane imwe nzira yezvinyorwa zvekutaura, kubatanidza kuronga kwepamusoro-soro nekugadzirwa kwemutauro wakaderera.
Sosi irekodhi rearXiv re "ToSCA: Kusimudzira Hierarchical Reinforcement Kudzidza pane Temporal uye Strategic Abstractions yeConversal Agents," nevanyori vasere. Inoti bepa rakatumirwa muna Nyamavhuvhu 22, 2026, uye rakagamuchirwa kuEMNLP 2026 Zvakawanikwa. Nyaya yakananga yebepa ndeye kudzidziswa uye kuongororwa kweAI vamiririri vekukurukurirana, pane kukurukura kwakajairika kwekusimbisa kudzidza kana mhando dzemitauro. Mune mamwe mazwi, rekodhi inotsanangura yakasarudzika mumiriri wekuvaka uye kudzidza, nehutungamiriri hunogadzira zano rekuronga bepa.
Iyo yakarongwa sisitimu inoshandisa maviri mazinga enguva. Padanho repamusoro, mumiririri anosarudza zano remavara rakajeka padanho rekutaura. Pachinhanho chepasi, mumiririri anosarudza tokeni yekupindura nechiratidzo ichigadzirisa chizvarwa ichocho pane yakasarudzwa zano. Vanyori vanoronga dhizaini iyi sebhiriji pakati penzira dzekutanga dzekusimbisa-kudzidza dzinoshanda chete pamatokeni uye nzira dzinoshanda chete pakutaura kwakazara. Musiyano uri pakati pekusarudza zano rakanangwa rekutaura uye kuona iyo sarudzo kuburikidza nemhinduro yezviratidzo zvega.
Iro bepa rinoenzanisira basa sematanho maviri-nhanho Markov maitiro. Zvinoenderana neabstract, vaongorori vanoshandisa yakadzika Q-network, kana DQN, kune yepamusoro-level mutsoropodzi uye proximal policy optimization, kana PPO, kune yakaderera-level actor-critic. Kwakabva kunotsanangura kupatsanurwa uku sekuchirudzirwa nekutorwa kwedzidziso uye netarisiro yehunyanzvi, asi haipe mabviro kana ruzivo rwekuita mune izvo zvakapihwa.
Kugadzirisa mibairo mishoma, vanyori vanosuma maviri-granularity mubairo maitiro. Iyo inosanganisa yekutaura-chikamu chekugutsikana chibodzwa ne-token-level intrinsic motivation uye chirango cheK-L. Iyo abstract mishumo miyedzo pakukurukurirana kwezuva nezuva uye nhaurirano-yekutsigira manzwiro, uko ToSCA yakapfuura seti yezvisina kutaurwa zvekutanga mukutsunga kwemaitiro uye mhando yekupindura. Tsime zvakare rinoti kuita kuripo, kunyangwe rekodhi rakapihwa risingasanganisire chinongedzo chekuenda.
Nei zvichikosha
Iro basa rinogadzirisa dambudziko repakati mukukurukurirana kweAI: kubatanidza zvinangwa zvekudyidzana zvakafara nemazwi ega ega anoburitswa nemumiririri. Kana yakasimbiswa kupfuura zviyedzo zvakashumwa, kupatsanurwa uku kunogona kupa imwe nzira yakarongeka yekudzidzisa vamiririri vehurukuro-nhanho dzakawanda uye kuita kuti sarudzo dzavo dzive nyore kuongorora.
Musiyano unofungidzirwa pakati pemaitiro nemanyorerwo unoratidza dambudziko rinoshanda muhurongwa hwekutaurirana. Mhinduro inogona kutsetseka uchitsvaga chinangwa chekudyidzana chisiri icho, kana kuti inogona kusarudza chinangwa chine musoro asi chichitaura zvisina kunaka. Nekuita kuti zano rive rakajeka repakati chiito, ToSCA inoedza kupatsanura aya maviri ekukundikana mapoinzi panguva yekudzidziswa uye kuongororwa.
Chimiro ichocho chinogona kubatsira kune masisitimu anotarisirwa kusimudzira nhaurirano pamusoro pekutendeuka kwakawanda. Urongwa hwepamusoro-soro hunogona kumiririra chinangwa chekudyidzana, ukuwo chizvarwa-chepamusoro-soro chinobata sarudzo dzemitauro yemunharaunda inodiwa kuti utaure. Kwakabva hakuratidze kuti ToSCA inoshanda pamusoro penhaurirano refu, asi dhizaini yehutongi inoenderana nekuedza kuita kuti vamiririri vekutaura vataure nemaune uye kushoma kutsamira pane ega-chiratidzo sarudzo.
Iyo mibairo dhizaini zvakare inogona kukosha. Kusimbisa kudzidza kwechizvarwa chemutauro kunogona kugamuchira mhinduro chete mushure memhinduro yakakwana, zvichiita kuti zviome kuziva kuti ndedzipi sarudzo dzakabatsira kana kukuvadza mhedzisiro. Iyo pepa yehuviri-granularity meshini inoedza kupa mhinduro pane ese matauriro uye zviratidzo. Iyo abstract hairatidze kana izvi zvichiburitsa kudzidziswa kwakadzikama, mutengo wakaderera, kana maitiro ari nani pasi pekurudziro yakaoma kana yeanopikisa.
Migumisiro yakataurwa inokurudzira asi inosungirirwa. Ivo vane hanya nemiedzo munhaurirano dzemazuva ese uye dzekutsigira manzwiro uye dzinounzwa nevanyori vepepa. Nzvimbo yakapihwa haipe mhedzisiro yenhamba, nguva dzekuvimba, saizi yedataset, protocol yekuongorora kwevanhu, kana kudzokorora kwakazvimiririra. Naizvozvo inotsigira kutaurira nzira uye kuenzanisa kunonzi nevanyori, asi kwete mhedziso yakafara yekuti kudzidza kwesimba rekusimbisa kazhinji kunovandudza kutaurirana AI.
Interactive Mechanism: Iyo Inonyatsoshanda
Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.
crm_get_transaction(id='4092').An agent must create a draft calendar event for Tuesday at 2 p.m. Which evidence would establish the requested result?
Zvekutarisa zvinotevera
Mhedzisiro yacho inoramba iri zvirevo kubva pabepa rimwe uye inofanirwa kuongororwa yakazvimirira. Zvinokosha zvisingazivikanwe zvinosanganisira iwo chaiwo maseti edhata, nheyo, nhanho dzekuongorora, masaizi emhedzisiro, mutengo wekombuta, kuita mumitauro yese nemadhomeini, uye kuti zvinowaniswa zvinoramba zviripo munhaurirano dzepasirese kana zvigadziriso zvisingatarisirwi.
Nyaya yekutanga kutarisa ndeye reproducibility. Tsime rinoti kuita kuripo, asi chinyorwa chakapihwa arXiv hachione nzvimbo yacho kana kutsanangura rezinesi rayo, zvinoenderana, data rekudzidzisa, kana hardware zvinodiwa. Vatsvagiri vakazvimiririra vangada iwo ruzivo kuti vaone kana izvo zvakashumwa zviwanikwa zvinogona kuburitswa uye kana nzira yacho inoshanda kunze kwekumisikidzwa kwevanyori.
Iyo yekuongorora dhizaini ichave yakakosha. Mazita emazuva ese uye erutsigiro rwemanzwiro asi haaratidze madhata, mitauro, huwandu hwekutendeuka, huwandu hwevatori vechikamu, kana tsananguro ye "mhando yekupindura." Izvo hazvitauri zvakare kuti kutema kwehurongwa kwakayerwa sei kana kuti vaongorori vaiziva kuti ndeipi system yakaburitsa mhinduro. Izvo zvakasiiwa zvinosiya zvakavhurika mukana wekuti kuita kunosiyana zvakanyanya nebasa, domain, kana nzira yekuongorora.
Kuchengeteka uye kuvimbika kunofanirwa kuongororwa zvakanyanya mumamiriro ekutsigira manzwiro. Nzira inonatsa zvibodzwa zvekugutsikana ingasagona kuvandudza chokwadi, kugadzirisa dambudziko, kudzivirira kuvanzika, kana kukwira kwakakodzera kune rubatsiro rwevanhu. Iyo sosi haiite zvichemo zvekuchengetedza uye haina miyedzo yezvikumbiro zvinokuvadza, vashandisi vari munjodzi, kugovera mashifiti, kana kutadza kunokonzerwa neiyo isiriyo yepamusoro-level zano.
Rimwezve basa rinofanirwa kuyedza kana iro rakajeka zano layer rinovandudza utariri pamwe nekuita. Humbowo hunobatsira hunosanganisira kubviswa kweDQN, PPO, zvikamu zvemubairo, uye chirango cheK-L; kuenzanisa nehurongwa hwakasimba hwemazuva ano; zviyero zve latency uye ; uye ongororo pamusoro pehurukuro refu, yemitauro yakawanda, uye yepasirese chaiyo. Kusvikira humbowo hwakadaro hwavepo, ToSCA inonzwisiswa zvakanyanya sechikumbiro chekutsvagisa ine yakashumwa yekuedza kuwana, kwete yakaratidzwa budiriro yekugadzira.