Kwenzekeni
Abacwaningi bahlongoza i-DirEAG, indlela ye-Dirichlet Evidence Aggregation yokulinganisa ukuzethemba kwamazwi kumamodeli olimi axazulula izinkinga zezibalo. Iphepha libika ukulinganisa okungcono kunokulinganisa okuqondile kanye nokuhlanganisa i-heuristic kuwo wonke amadathasethi amathathu nemindeni emithathu yamamodeli, kuyilapho kugcinwa ukukhethwa kwezimpendulo ezincintisanayo.
Iphepha elithunyelwe ku-arXiv ngomhla ka-Aug. 21, 2026, liphakamisa i-DirEAG, okufushane kwe-Dirichlet Evidence Aggregation. Isihloko saso siwubuthakathaka obuthile kumamodeli amakhulu olimi asetshenziselwa ukucabanga kwezibalo: ukubuza imodeli ukuthi iqiniseka kangakanani akukhiqizi ngokuzenzakalelayo amaphuzu wokuzethemba ahambisana nokwethembeka. Ababhali bachaza ukuzethemba kwebhokisi elimnyama njengokungathi kunzima ukukukala ngenxa yokuthi incazelo yenombolo yempendulo yemodeli ingashintsha ngokuya kokwaziswa, imodeli, noma idathasethi.
Indlela isebenzisa imiyalo eminingi yokuqondisa ukuzethemba enkingeni efanayo. Ukwaziswa ngakunye kuveza umbono wokuzethemba impendulo. Kunokuba imane ilinganisele lawo manani okuzethemba, i-DirEAG iguqula ukubuka ngakunye kube ubufakazi obuthambile obusatshalaliswa kuzo zonke izimpendulo zekhandidethi ezikhiqizwe phakathi nenqubo. Futhi yengeza i-null state emele ukuthi kungenzeka ukuthi abekho abalungile. Lo mklamo ubalulekile ngoba uphatha imibiko yokuzethemba njengobufakazi mayelana nezimpendulo ezincintisanayo esikhundleni sokuthatha ukuthi wonke amaphesenti abikiwe asevele esezingeni elifanayo, elinengqondo.
Iphepha libika izivivinyo ku-GSM8K, SVAMP, ne-GSM-Hard, amadathasethi amathathu edatha okucabanga ezibalo ashiwo emthonjeni. Ihlola amamodeli avela ku-Qwen, Mistral, kanye nemindeni yakwaGemma. Ngokusho kwababhali, i-DirEAG ivamise ukukhiqiza ukulinganisa okungcono kunokulinganisa okuqondile kokuzethemba kanye ne-heuristic confidence-steering aggregation, kuyilapho ilondoloza ukusebenza okuncintisanayo ekukhetheni impendulo. Umthombo awusho amaphuzu aqondile okulinganisa, amaphuzu okukhetha impendulo, izinguqulo zamamodeli, noma izilungiselelo zokuhlola.
Ababhali baphinde babike imiphumela yokwehliswa kwemali ekhombisa ukuthi izingxenye ezimbili zendlela yokubhekana nezinkinga ezahlukene. Ukuhlanganiswa kobufakazi kuhlanganisa ulwazi oluvela ekuqapheliseni ukuzethemba kwempendulo, kuyilapho isinyathelo sokugcina sokulinganisa kanambambili siphatha enye ingxenye yomsebenzi wokulinganisa. Iphepha linamakhasi ayi-16 ubude, liqukethe izibalo ezintathu, ithi ikhodi iyatholakala, futhi ifakwe ohlwini njengokwamukelwa yi-PRICAI 2026. Umthombo ukhomba umsebenzi njengokuphrinta kwangaphambili futhi awuchazi ukuphindaphinda okuzimele noma imiphumela ebuyekezwe ngontanga ngale kwalesi sitatimende sokwamukela.
Imininingwane yomthombo: arxiv.org ↗
Kungani kubalulekile
Izitatimende zokuzethemba zemodeli yolimi zingaba nzima ukuzitolika, ikakhulukazi uma zikhuthaza ukushintsha isikali sokuqiniseka okuzibikayo kwemodeli. Indlela ehlukanisa kangcono ukukhetha kwempendulo kusukela ekulinganisweni kokungaqiniseki ingasiza onjiniyela bakhombe lapho impendulo yezibalo idinga ukuhlolwa okwengeziwe, nakuba umthombo unganikezi bufakazi bokusetshenziswa ngale kokuhlolwa okubikiwe.
Udaba olusebenzayo akukhona nje ukuthi imodeli yolimi ingayiveza yini impendulo yezibalo. Ukuthi umsebenzisi noma isistimu engezansi ingakwazi ukuhumusha isiqiniseko esishiwo semodeli lapho inquma ukuthi ithembe ini. Uma amanani okuzethemba eshintsha incazelo kuyo yonke imiyalo, inombolo ephezulu kusilungiselelo esisodwa ingase ingafaniswa nenombolo ephezulu kwesinye. Umnikelo oyinhloko wephepha umzamo wokuxazulula leyo nkinga yokuqhathanisa ngendlela ehlelekile.
I-null state ye-DirEAG iyisici esiwusizo sesiphakamiso ngoba ivumela indlela ukumela ukungaqiniseki okungaxazululwa yizimpendulo zekhandidethi elicutshungulwayo. Isistimu okufanele ikhethe phakathi kwezimpendulo ezisohlwini ingase ibonakale iqiniseke kakhulu ngoba nje ayinayo indawo ecacile yokuveza ukuthi wonke amakhandidethi atholakalayo angase abe nephutha. Umthombo wethula lokhu njengengxenye yendlela; ayibonisi ukuthi i-null state ithuthukisa ukuphepha noma ukwenza izinqumo kumasistimu asetshenzisiwe.
Ukwehlukaniswa phakathi kokukhethwa kwezimpendulo nokulinganiswa kunikeza ucwaningo i-engeli yokuxilonga engase ibe wusizo. Imodeli ingakhetha impendulo elungile kaningi ngenkathi iveza ukuzethemba kabi, noma ingase ilinganise ukuzethemba kuyilapho ikhetha izimpendulo ngendlela engasebenzi kahle. Ukukhishwa okubikiwe kuphakamisa ukuthi ababhali abaphathi lezo njengenhloso efanayo. Lowo mehluko ungaba ofanele kubathuthukisi abahlola amasistimu adinga kokubili okuphumayo okulungile namasignali athembekile ukuze acele ukubuyekezwa.
Ubufakazi buhlala bukhawulelwe ekuhlolweni kwephepha uqobo. Umthombo ubika imiphumela kumabhentshimakhi ezibalo kanye nemindeni yamamodeli ambalwa, kodwa ayiqinisekisi ukuthi i-DirEAG ithuthukisa izilinganiso zokuzithemba zokubhala amakhodi, ukuhlaziya kwesayensi, imibuzo yezokwelapha, noma eminye imisebenzi. Futhi ayibiki ukuthi indlela iqhathaniswa kanjani nayo yonke enye indlela yokulinganisa ukungaqiniseki, kungakhathaliseki ukuthi yengeza izindleko ezizwakalayo zokubala noma ukubambezeleka, noma ukuthi izinzuzo zayo zinkulu ngokwanele yini ukushintsha izinqumo zokusebenza. Leyo mikhawulo igcina umphumela esigabeni socwaningo oluthembisayo esikhundleni sokubonisa ikhono lokukhiqiza.
I-Interactive Mechanism: Indlela Esebenza Ngayo Ngempela
Hlola ubuchwepheshe obuyisisekelo ngemuva kwalokhu kuthuthukiswa ngokuhlanganyela.
What is a common training objective for an autoregressive language model?
Ongakubuka ngokulandelayo
Imibuzo esemqoka elandelayo ukuthi ingabe i-DirEAG ibambelele ngaphandle kwamabhentshimakhi ezibalo ahloliwe, ukuthi zinkulu kangakanani izinzuzo zayo zokulinganiswa, nokuthi ingabe ihlala iwusizo kuwo wonke amamodeli amamodeli, amasu okwazisa, nezinhlelo zokusebenza zangempela. Umthombo awunikezi imiphumela yezinombolo, imininingwane yokusetshenziswa, noma ubufakazi obuvela kumasistimu okusebenza.
Iphoyinti lokuqinisekisa lokuqala liwubuningi. I-abstract ithi i-DirEAG ivame ukuzuza ukulinganisa okungcono nokukhethwa kwezimpendulo ezincintisanayo, kodwa ayinikezi usayizi, ukungaguquguquki, noma ukubaluleka kwezibalo zalezo zinzuzo. Abafundi kufanele babheke ephepheni eligcwele kanye nekhodi ekhishiwe yamamethrikhi athile okulinganisa, ububanzi bokuzethemba, izisekelo, ukuhlukaniswa kwamasethi edatha, izindawo zokuhlola amamodeli, nemiphumela ephindaphindwayo edingekayo ukuze kuhlolwe ukuthi isimangalo siqine kangakanani.
Umbuzo wesibili uwukuthi jikelele. I-GSM8K, SVAMP, ne-GSM-Hard konke kuthinta ukucabanga kwezibalo, ngakho ubufakazi obubikiwe abubonisi ukuthi indlela isebenza uma izimpendulo zivuliwe, ubufakazi abuphelele, noma ukulunga kunzima ukukuchaza. Ukuhlola kuzo zonke izizinda ezengeziwe kuzocacisa ukuthi ingabe i-DirEAG ithwebula indawo evamile yokwethembeka kwemodeli yamazwi noma ikakhulukazi ibhekana nesakhiwo salezi zilinganiso.
Indlela ingase futhi incike ekutheni izimpendulo zekhandidethi kanye nokwaziswa kokuqondisa ukuzethemba kwenziwa kanjani. Umthombo awusho ukuthi zingaki iziyalezo ezisetshenzisiwe, ukuthi izimpendulo zekhandidethi zikhethwa kanjani, ukuthi i-null state yenziwa kanjani ipharamitha, noma ukuthi ukulinganisa kokugcina kanambambili kuqeqeshwa kanjani. Leyo mininingwane ingathinta izindleko, ukukhiqizwa kabusha, nokusebenza. Kuzobaluleka ukubona ukuthi indlela ihlala isebenza yini uma ukwaziswa, izinguqulo zamamodeli, noma amasethi edatha eshintsha.
Okokugcina, ukuhlola okusebenzayo okuhlobene ukuthi ingabe ukuzethemba okulinganiselwe kuthuthukisa izinqumo kunokuba kube amamethrikhi ebhentshimakhi kuphela. Umthombo awubiki ukusetshenziswa, izifundo zabasebenzisi, imiphumela yokubuyekezwa komuntu, noma ukuhlanganiswa namathuluzi ezibalo. Umsebenzi owengeziwe kufanele uhlole ukuthi i-DirEAG iyabasiza yini abantu ukuhlonza izimpendulo ezingalungile, banikeze umzamo wokuqinisekisa, noma bagweme ukwethemba ngokweqile imodeli, kuyilapho ikala noma yibuphi ubunkimbinkimbi obungeziwe kanye namacala okuhluleka.