Chii chaitika
Vatsvakurudzi Hamed Khosravi naXiaoming Huo vanokurudzira hurongwa hwekugovera mabasa pakati pemhando dzemitauro mikuru apo sangano rine bhajeti rakagadziriswa reAI asi humbowo husina kukwana kana husingavimbiki pamusoro pemhando yemhando. Iro bepa rinopatsanura dambudziko rekugadzirisa basa kubva padambudziko rakaoma rekufungidzira kuti modhi yega yega inoita sei pamhando yega yega yebasa.
Rekodhi yearXiv inonyora bepa sezvakatumirwa musi wa30 Nyamavhuvhu 2026. Nyaya yaro ikambani inosarudza kuti ndeupi modhi yemutauro mikuru inofanira kubata basa rega rega rinogara richiitwa pasi pebhajeti rehungwaru rakagadziriswa. Vanyori vanotsanangura dambudziko rekugovera seyakatwasuka kana tafura yemhando yakavimbika iripo: yega yega yekupinda tafura inomiririra kuti imwe modhi inoita sei pane imwe mhando yebasa. Nharo yavo ndeyokuti kuvaka tafura iyo chikamu chakaoma, kwete kugadzirisa dambudziko rekugoverwa.
Vanyori vanozivisa manyuko maviri ekusava nechokwadi. Kutanga, mamodheru kazhinji haaenzaniswe pabasa rimwechete, izvo zvinoita kuti kuenzanisa kwekuita kwakananga kuve kwakaoma. Chechipiri, marekodhi ekuongorora zvibodzwa anogona kuyera proxy pane mhedzisiro iyo kambani inokoshesa. Iyo abstract inoti causal uye off-policy nzira dzinogona kugadzirisa nyaya yekutanga zvichiri zvichienderana neproxy, nepo muongorori-yekusimbisa nzira dzinogona kugadzirisa yechipiri pasina kupedzisa sarudzo yekugovera. Bepa rinoenderera mberi richipokana kuti kutenga mamwe maongororo ekuongorora zvakare hakugadzirise kusavimbika pamusoro pekuti chibodzwa chinogadzirwa sei, nekuti randomisation inoshandura izvo zvikumbiro zvinopihwa pane zvinorehwa nezvibodzwa zvacho.
Muedzo wesarudzo wakarongwa unobvunza kana basa rimwe chete rebasa richiramba rakakwana patafura yese yemhando inoenderana nehumbowo huripo. Nekumisikidzwa-bhajeti, vanyori vanotsanangura chitupa chekugadzirisa-mbiri: imwe optimization inoshandisa tafura yemhando inofungidzirwa, uye yechipiri inoshandisa tafura-inofarirwa. Chibvumirano pakati pezvigadziriso zviviri zvinosimbisa kugoverwa mukati mehurongwa hwepepa. Kusabvumirana kunozivisa modhi-mutoro webasa iro humbowo hunogona kushandura sarudzo.
Iro bepa zvakare rinokurudzira CASE, kana causal inoshanda sequential kuyedza. Iyo nzira inotungamira yekuwedzera kuongororwa kune iyo modhi-yebasa pairs iyo inonyanya kukosha kune isina chokwadi sarudzo, yobva yadzokorora kuyedza kwakasimba sezvo humbowo hutsva hunosvika. Iyo abstract mishumo inobuda kubva kudhizaini yekugadzira uye yakabhadharwa software mabasa, asi haiburitse zvakaringana muzvinyorwa zvekwakabva kuti iongorore yakazvimirira chiyero kana dhizaini yezviyedzo izvozvo. Inoti kururamisa basa racho kuchiri kwakasiya kurasika kwakawanda mukugadzira-log marongero, kuti kuongororwazve kwakarongeka hakuna kubvisa dambudziko rekuyera, uye humbowo huripo hunowanzotadza kuona basa rakasiyana.
Nei zvichikosha
Chirevo chepakati chebepa ndechekuti kuyerwa kuri nani kunogona kuburitsa kukosha kwakawanda pane kudzokorodza kugadzirisa sarudzo dzakavakirwa pafungidziro dzisina kusimba. Kana yakasimbiswa kupfuura zviedzo zvakashumwa, hurongwa hunogona kubatsira masangano kusarudza kana humbowo hwavo hwakasimba zvakakwana kuti vazvipire kune yemuenzaniso-mutoro webasa uye kana kumwe kuyedzwa kuchibvumidzwa.
Mupiro unoshanda ishanduko mune izvo sangano rinokumbirwa kuti rigadzirise. Chikwata chinosarudza mamodheru chinogona kutarisisa kutsvaga basa remasvomhu rakanakisa rezvibodzwa zvaro zvebhenji. Pepa iri rinoti basa rinogona kusanyanya kukosha pane kuona kuti zvibodzwa izvi zvakavimbika here uye zvinoenderana nechinangwa chesangano. Musiyano iwoyo une basa kana modhi ikaita yakasimba pachiyero asi ichiita zvakasiyana pabasa rinounza mutengo, mari, kunonoka, kana njodzi.
Chitupa chataurwa chinogona kupa mutemo wekumisa wakarongeka. Chibvumirano pakati peinofungidzirwa-tafura mhinduro uye shoma-inofarirwa-tafura mhinduro yaizoratidza kuti basa rimwe chetero rinopukunyuka bepa rakatsanangurwa kusava nechokwadi seti. Kusabvumirana kwaisazoratidza modhi inokunda, asi yaizodzikisa kusavimbika kune mamwe maenzanisi-mutoro webasa. Muchidimbu, izvo zvinogona kuita kuti mari yekuongorora iwedzere kutariswa uye kudzivirira masangano kubva kuunganidza huwandu hwakawanda hweruzivo rwusingakwanise kukanganisa sarudzo yekutumirwa.
Zviyedzo zvakashumwa zvinonongedza kuchidzidzo chingangokosha chekushanda, kunyangwe kwakabva kwacho kuchisina hukuru hwekuita. Pamabasa esoftware akabhadharwa, vanyori vanoti kuwana ruzivo rwakanaka nezvemhando yemhando kwakaburitsa mari yakawanda kupfuura kuwedzera optimize basa uchishandisa fungidziro yakafanana. Kana mhedzisiro yacho ichiwanda, masangano anogona kubatsirwa nekudyara muyero yakanangana nebasa, kusimbiswa kwemhedzisiro, uye miyedzo inofananidzwa vasati vaita sarudzo dzakanyatsonaka. Mhedzisiro yacho hairatidzi kuti imwe modhi yakakura zvakanyanya; ine chekuita nekukosha kweruzivo mudambudziko rekugoverwa kwebhajeti.
Izvo zvakawanikwa zvinosimbisawo muganho wevanotungamira-maitiro ekufananidza. Chibodzwa chinobatsira chete kusvika pakutevera mhedzisiro yesangano, uye kuenzanisa kunonetsa kana mamodheru akaedzwa pabasa rakasiyana. Iro bepa saka rinogadzira kusarudzwa kwemuenzaniso seyero uye dambudziko resarudzo pane kungoita zvimiro zvakapfava. Iko kuumbwa kwakakodzera kumabhizinesi anoshandisa akati wandei mamodheru, asi sosi haaratidze kuti yakawanda sei kuita basa CASE yaizoda kana kuti fungidziro dzayo dzinokodzera kutenga chaiko uye masisitimu ekutumira.
Interactive Mechanism: Iyo Inonyatsoshanda
Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.
What is a common training objective for an autoregressive language model?
Zvekutarisa zvinotevera
Iro basa ndere arXiv preprint, uye sosi yacho haipe saizi dzemuenzaniso, mazita emhando, kuverenga kwebasa, nhamba dzemitengo, saizi yemhedzisiro, kodhi, kana yakazvimiririra kusimbiswa. Kumwe kuongorora kunofanirwa kuongorora kana chitupa chakatsanangurwa uye nzira yeCASE inobata pamabasa akasiyana, vanopa modhi, zvimiro zvemitengo, uye metrics ekuongorora.
Chikuru chisingazivikanwe humbowo kuseri kweiyo yakashumwa yekugadzira-log uye yakabhadharwa-software-basa mhinduro. Manyoro ekwakabva haatauri kuti zvingani zvikumbiro, mutoro webasa, modhi, kana ongororo dzakabatanidzwa; kuti bhajeti yeAI yakatsanangurwa sei; izvo mari nemigumisiro zvakayerwa; kana kuti yakakura zvakadii zvakachengetwa zvakachengetwa uye kurasikirwa kwakasara. Pasina iwo ruzivo, gwara rezviwanikwa rakajeka kubva kune abstract, asi hukuru hwavo hunoshanda hausi.
Kumwe kuongorora kunofanirwa kuyedza fungidziro kuseri kwekusavimbika kwakaiswa uye tafura-inofarirwa tafura. Chitupa chakanangana nedambudziko rakagadziriswa-bhajeti sekutsanangurwa kwazvinoitwa, asi kubatsira kwaro kunoenderana nekuti seti yematafura emhando inonyatso tora kusavimbika kwakatarisana nechikwata chekuendesa. Kana nzira dzakakosha dzekuchinja kwekugovera, kushandura mitoro yebasa, magadzirirwo emhando, kana shanduko yemitengo ikasabatanidzwa, chibvumirano pakati pezvigadziriso zviviri zvinogona kupa vimbiso shoma pane yazvino mhedzisiro inoratidza.
Izvo zvakarongwa zvakatevedzana zviedzo zvinodawo kuongororwa. CASE inoitirwa kusarudza ongororo dzinogona kushandura sarudzo yekugovera, asi kwainozobva hakutsananguri bumbiro rekuedza, mutemo wekumisa, vimbiso dzenhamba, kana dziviriro pakudhirowa mhedziso kubva kune mashoma anoona. Vatsvagiri nevarapi vanofanirwa kutsvaga nzira dzebepa rakazara, data rakaburitswa kana kodhi, ongororo yekunzwa, uye kuenzanisa nemaitiro akareruka ekuongorora.
Chekupedzisira, basa racho rinofanirwa kubatwa seyakafanodhindwa kwete yakazvimiririra yakazvimiririra indasitiri mwero. Kwanobva kunozivisa chitupa uye kunoshuma zvichemo zvekuyedza, asi haritauri wongororo kana kudzokorora kwekunze. Mibvunzo yakakosha yekutevera inosanganisira kana iyo nzira inoshanda kune isiri-software basa, ingave inobata zvinangwa zvakawanda semhando, latency, uye chengetedzo, uye kana masangano anogona kushandura zvibodzwa zveproxy kuita mhedzisiro inoyerwa uye ine sarudzo.