Chii chaitika
Iyo itsva arXiv preprint ongororo kana LLM-yakagadzirwa autobiography inofanana nerekodhi yakanyorwa yehupenyu hwainotsanangura. Mubhuku remazuva 366 peji-zuva, mazuva mazana matatu nemakumi mashanu nemana akatadza kuva nechiitiko chakatsigirwa nekambani yakazvimirira yekuongorora, zvichiburitsa mwero wakashumwa wekutadza we96.7%.
The preprint, yakatumirwa kuarXiv muna Aug. 23, inotsanangura imwe-chidzidzo nyaya yekudzidza umo munyori uye munhu ane hupenyu hwakagadzirwa munhu mumwe chete. Tsime rinoti LLM yekukurukurirana yakagamuchira template chete, mazuva maviri emuenzaniso uye kotesheni yezuva rega rega-kwete iyo yemusoro wenyaya-pakunyora bhuku remazuva makumi matatu nematanhatu remunhu wekutanga. Zuva rega rega raiongororwa padanho reanecdote richipesana neyakazvimirira yekusimbisa corpus.
Bepa rinotsanangura kukundikana kwekuona sezuva risina kupihwa VERIFIED, zvichireva kuti chiitiko charo chakatsigirwa. Nechiyero ichocho, 354 yemazuva 366 yakakundikana, kana 96.7%, ine Wilson 95% nguva yekuvimba ye94.4% kusvika 98.1%. Mazuva gumi nemaviri chete aive nechiitiko chakatsigirwa. Ongororo iyi inoshumawo kuti mazuva gumi nemapfumbamwe akasimbisa zvichemo zvinopokana nerekodhi.
Chikanganiso chakanyanya kutaurwa chaive chakavakirwa: zviitiko zvakagadzirwa zvakasanganisira vanhu chaivo, vashandirwi uye marongero kubva kuhupenyu hwechinyorwa. Iyo pateni yakakosha nekuti ndima inogadzirwa inogona kuita seyakajeka uchikwereta ruzivo rwechokwadi kubva kune yakatenderedza rekodhi. Bepa rinoti mugove wakayerwa weiyi modhi yekutadza wakasiyana pakati pemareta, saka zvakawanikwa zvinofanirwa kuverengwa sepateni yakashumwa kwete chikamu chakanyatsogadziriswa.
Iye munyori akagadzira zvakare mazuva mamwe chete nemamodhi azvino ane mazita pasi pemapupu akafanana uye anoshuma 100% kutadza kwechokwadi. Chizvarwa pachakaiswa mugwaro renyaya, mwero wekusimbisa wakavandudzwa, asi bepa rinoti kutadza kwakasara kwakaramba kuri 83.3%. Sosi yacho hairatidze mamodheru mune abstract kana kuratidza kuti mhedzisiro inoshanda kune yega LLM kana autobiography mafambiro.
Nei zvichikosha
Chidzidzo ichi chinopa nzira yechokwadi yekuyera chiitiko-chikamu chekugadzirisa pane kubata iyo yese yakagadzirwa biography seyakarurama kana isiriyo. Mhedzisiro dzayo dzinoratidza kuti kutsetseka kwekunyora kweautobiographical kunogona kusanganisa vanhu chaivo, vashandirwi uye zvigadziriso nezviitiko zvakagadzirwa, zvichigadzira yakanyanya kuoma nzira yekukanganisa kuona.
Chidzidzo ichi chinoshandura kushushikana kwakakura nezvekufungidzira kuve dambudziko rekuita kuyerwa. Panzvimbo pekubvunza kana memoir yose "inonzwika sechokwadi," inoongorora zvimiro zvemunhu zvichipesana nerekodhi yakanangana nezvidzidzo. Maitiro iwayo anogona kubatsira vaongorori nevatsikisi kusiyanisa chiitiko chakanyatso tsigiro kubva kune chinongo nzwisisika, chinotsigirwa zvisina simba kana kupokana.
Maitiro ekukanganisa akashumwa anonyanya kukosha kunhoroondo dzehupenyu, nhoroondo dzemuromo, zvinyorwa zvemhuri uye mamwe maitiro ekutaura ngano. Muenzaniso haufanire kugadzira zita rega rega kana nzvimbo kuti umiriri hupenyu; inogona kuisa mashoko echokwadi mukati mechiitiko chisina kumboitika. Vaverengi vanogona kuwana rudzi urwu rwekubuda rwakaoma kupikisa nekuti chiitiko chakagadzirwa chakavakirwa kune zvinozivikanwa chokwadi.
Kuedza kwepasi kunopawo bepa mhedzisiro inoshanda kupfuura kuongororwa. Kupa iyo yenyaya corpus yakagadziridza zvakanyanya kusimbiswa kana ichienzaniswa nechizvarwa kubva kune sparse kukurudzira, maererano nekwakabva. Asi iyo yasara 83.3% yekutadza mwero inoratidza kuti kuwana sosi yezvinyorwa chete hakuna kuita kuti kuburitsa kuvimbike mune iyi kesi. Saka kugadzika kunofanira kutorwa senzira yekuderedza iyo kushanda kwayo kunofanirwa kuyerwa, kwete sechivimbiso chechokwadi.
Iro bepa rawo maitiro ekunyevera ari pakati pekududzira mupiro waro. Kuzvimiririra kudzokororwa kwakaburitsa zvakare musoro wekutadza chiyero, icho munyori anoti hachipi humbowo hwekuti chiyero chepakutanga chakawedzera. Panguva imwecheteyo, iyo yechina-nhanho taxonomy yaingova nekuvimbika-kusvika-yepakati, uye muganho pakati peWEAK neUNVERIFIED wakanga usingavimbike. Chidzidzo ichi chinoratidza kukosha kwekuongorora uku ichiratidzawo kuti chishandiso chekuongorora chinoda kunatswa.
Interactive Mechanism: Iyo Inonyatsoshanda
Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.
crm_get_transaction(id='4092').What is a common training objective for an autoregressive language model?
Zvekutarisa zvinotevera
Zvakawanikwa nebepa zvinoda kuyedzwa kune zvimwe zvidzidzo, corpora, kukurudzira uye modhi shanduro. Basa remangwana rinofanirwawo kujekesa kuti marekodhi ekusimbisa akakwana sei, ingave iyo yakarongwa yekuongorora rubriki inogona kuitwa yakavimbika, uye kuti yakawanda sei mashandiro anovandudza kana mamodheru agamuchira zvakarongwa zvepasi.
Chikuru chisingazivikanwe ndeye generalizability. Uhwu hupenyu hwemunyori mumwechete, bhuku remazuva makumi matatu nematanhatu uye rimwe rakanyorwa rekuongorora corpus. Kwakabva hakuratidze kuti mwero wekutadza wakafanana waizoonekwa kana nyaya yacho yakanyorwa zvakanyanya, isina kunyorwa zvakanaka, inomiririrwa mumhando dzakasiyana dzemarekodhi, kana kuti isingawanikwe kuti iongorore zvabuda ivo pachavo.
Model uye nekukurumidza ruzivo zvinodawo kuongororwa kwakadzama. Iyo abstract inoreva "mamodheru azvino ane mazita" asi asingaatumidze mazita, inopa ruzivo rweshanduro kana kushuma mhedzisiro yekufananidza. Izvo zvinosiya zvakavhurika kana kutadza kunoratidza imwe chizvarwa setup, modhi maitiro, sampling maitiro kana musanganiswa wezvinhu. Kudzokorora kunofanirwa kushambadza izvo zvinhu uye kuyedza akawanda mamodheru pasi pemamiriro anoenderana.
Kuvimbika kwemaitiro ekusimbisa kunofanirwa kuenderera mberi. Bepa rinoshuma kuti yakazvimirira kudzokorora chiyero chakadzokorora chiyero chemusoro asi kuti mimwe miganhu yemapoka yakanga isina kugadzikana. Ongororo yenguva yemberi inofanirwa kuongorora chibvumirano padanho rechiitiko, tsanangura zvinoonekwa sehumbowo hwakakwana, uye nhoroondo yemarekodhi asina kukwana kana asina kujeka. Pasina basa iroro, zvikamu zvechokwadi zvinogona kutaridzika zvakanyanya pane izvo zviri pasi pezvikamu zvinopembedza.
Vashandisi vanoshanda vanofanirwa kutarisa kana chizvarwa chakavakirwa chinoongororwa pamabasa anopfuura memoir kunyora uye ane masimba anodzora. Miedzo inokodzera ingafananidza kuwana corpus, zvinodikanwa zvekududza, nzira dzekudzoreredza uye wongororo yevanhu, uchitarisa zvese zvakagadziriswa zviitiko uye zvakasiiwa. Iyo sosi inotsigira kudiwa kwekuyedzwa kwakadaro, asi hairatidze kuti mushonga wakarongwa wakakwana kushambadza, kuchengetedza kana kumwe kushandiswa kwepamusoro-soro. Izvi zvinochengeta mhedzisiro yakashumwa yakasungirirwa kune yakataurwa yekumisikidzwa uye chiyero, pane kuiwedzera kupfuura humbowo hwakatsanangurwa.