Gupima ibizamini niba abakozi ba LLM bazi igihe cyo kwibuka, kugenzura cyangwa kubaza

Byagenze bite

Icapiro rya arXiv ryerekana ibipimo ngenderwaho bya Memory Clarification Boundary, bipima niba abakozi ba LLM bafata ibyemezo bikwiye kubijyanye no kwibuka. Ubushakashatsi bugaragaza imiterere ya Claude na Qwen kubijyanye no guhitamo ibikorwa byavuzwe hamwe no guhamagarira ibikoresho byubatswe, ugasanga itandukaniro rinini hagati yicyitegererezo kivuga ko bazakora nibikoresho bahisemo.

Icapiro, ryashyikirijwe arXiv ku ya 20 Kanama 2026, ryiga icyo ryita imipaka yo gusobanura kwibuka: niba amakuru avuye mu mikoranire agomba gukomeza, akoreshwa gusa muri iki gihe, yongeye kugenzurwa cyangwa gusobanurwa n’umukoresha. Ibipimo byayo, MCB, ikubiyemo ibintu 140 by'ibanze bigabanijwemo ibintu 70 by'iterambere hamwe na 70 byafashwe, hiyongereyeho ibintu 70 bitandukanye bitandukanye. Isuzuma rikubiyemo ibirango byibikorwa hamwe nuburyo bwo guhitamo ibikoresho-guhamagarwa, bigatuma imyitwarire yimikorere yumukozi igice cyikizamini aho gufata igisubizo cyanditse nkibimenyetso bihagije byerekana ko byubahirijwe.

Inkomoko ivuga ko abantu babiri batari abanditsi bigenga banditse ibintu 70 byafashwe mbere n’ibintu 70 bitandukanye. Bumvikanye kuri 97.1% bya labels, hamwe na kappa ya Cohen ya 0.962. Impumyi ya gatatu isubiramo yakemuye ibintu bine batumvikanyeho, kandi ibirango umunani byabanditsi byasimbuwe nabatari benshi. Ubu buryo butangwa muburyo budasubirwaho nkintambwe zigamije kugabanya kwishingikiriza ku mpapuro zabanditsi banditse, nubwo isoko yatanzwe idatanga ibintu byihariye cyangwa protocole yuzuye.

Hirya no hino muri Claude na Qwen, abashakashatsi bavuga ko icyitegererezo cyizewe mu kugenzura ukuri guhinduka kuruta gusaba abakoresha gukemura ibidasobanutse. Mu gisubizo kimwe cyerekanwe, iboneza rya Qwen ridafashijwe ryasabye ibisobanuro kuri zeru yibintu 12 bisobanutse, mugihe hagenzurwa 12 kuri 18 bishya. Bake barashwe byongeweho amakuru yukuri kuva 0.557 kugeza 0.771, iterambere rya 0.214, hamwe na Holm yahinduwe neza na McNemar p-agaciro ka 0.002. Ariko, kwibutsa ibisobanuro byakomeje 0.333. Politiki yihuse yagabanije gutsimbarara ku makosa kuva kuri 0.243 ikagera kuri 0.100, hamwe na p-agaciro ya Holm yahinduwe na 0.038, ariko kunonosora ukuri kwayo ntabwo byari bifite imibare. Ibisobanuro ntibisobanura verisiyo yicyitegererezo kugiti cye cyangwa gusobanura ibisobanuro muburyo burambuye bwo kubyara ibisubizo bivuye mumyandiko yatanzwe wenyine.

Ibisobanuro birambuye: arxiv.org ↗

Impamvu ari ngombwa

Kwibuka guhoraho birashobora kwihindura umukozi wa AI, ariko ivugurura rirambye rirashobora guhindura imyitwarire nyuma nta nteguza igaragara. Ibisubizo byerekana ko isuzuma ryumutekano wibuke ridakeneye kugerageza gusa politiki yavuzwe numukozi gusa ahubwo no kumenya niba igikoresho cyacyo guhamagarira gihuye niyi politiki, cyane cyane iyo amakuru adasobanutse cyangwa ashobora kuba yarahindutse.

Kwibuka guhoraho bihindura imyitwarire yigihe kizaza cyumukozi wa AI. Impapuro nyamukuru zihangayikishijwe nuko ivugurura ryibeshye rishobora kuba rirambye kandi rikagira ingaruka bucece imikoranire nyuma. Ibyo bitera ikibazo cyihariye cyo kwizerwa uhereye kubisubizo bisanzwe bitari byo: ikosa ntirishobora kuguma kugarukira kumurongo umwe, kandi igisubizo nyuma gishobora kwerekana amakuru yabitswe inkomoko cyangwa ukutamenya neza bitakigaragara kubakoresha. Inkomoko ikora nkimpanvu yo gutandukanya kwibuka, kugenzura, kubaza no kubika amakuru byigihe gito.

Ikinyuranyo cyatangajwe hagati yo kugenzura no gusobanura ni ngombwa kuko ibikorwa byombi bikemura ingaruka zitandukanye. Kugenzura birashobora gufasha kubintu bishobora kuba byarahindutse, mugihe ibisobanuro birakenewe mugihe umukoresha yifuza cyangwa ibisobanuro bidasobanutse. Ukurikije abstract, moderi yakunze kugenzura neza gushya kuruta gukemura bidasobanutse. Igisubizo cyerekanwe kuri Qwen cyerekana impamvu igiteranyo cyuzuye cyonyine gishobora guhisha intege nke zijyanye n’umutekano: sisitemu irashobora kunoza amanota rusange mugihe ikomeje kunanirwa gusaba abakoresha ibisobanuro mugihe icyemezo kireba igikwiye kubikwa kuri bo.

Igikoresho-guhamagarira ibisubizo kongeramo urundi rwego rufatika. Inkomoko ivuga amasezerano 57% hagati yikirango no guhitamo ibikoresho kuri buri moderi ya Claude, ugereranije na 23% kuri Qwen. Qwen ubunyangamugayo bwaragabanutse buva kuri 0.557 munsi yisuzuma ryibikorwa-label bugera kuri 0.343 mugihe hasuzumwe imyitwarire yo guhamagarira ibikoresho, hamwe na Holm yahinduwe p-agaciro ka 0.047. Abashakashatsi rero banzuye ko isuzuma ryo kwibuka rigomba gusuzuma ibyemezo byavuzwe hamwe no guhitamo ibikoresho. Kubateza imbere, bivuze amagambo ya politiki cyangwa kwanga mu magambo ntibishobora kwerekana ko umukozi azirinda igikorwa cyo gutitiriza umutekano muke. Inkomoko yatanzwe ntabwo yerekana uburyo ibyo bivumbuwe bihindura ibicuruzwa byoherejwe, amakuru yabakoresha cyangwa ububiko bwihariye bwo kwibuka, bityo izo ngaruka zikomeza kuba ahantu ho kwipimisha kuruta ibisubizo byashyizweho.

Ibyo kureba

Urupapuro ni progaramu ya arXiv, kandi isoko yatanzwe ni abstract aho kuba isuzuma ryigenga ryigenga. Ubundi bugenzuzi bugomba gusuzuma ibipimo ngenderwaho, verisiyo yicyitegererezo, ibihe byihutirwa, gushyira mubikorwa ibikoresho hamwe nibikorwa hanze ya sisitemu Claude na Qwen.

Ikibazo cya mbere cyo kureba ni imyororokere. Ibisobanuro bitanga ibipimo byibintu bibarwa, ibipimo byinshi byapimwe kumutwe hamwe nimiryango yintangarugero yapimwe, ariko ntabwo itanga amagambo yerekana ibintu, ibyiciro byicyitegererezo, kugenzura icyitegererezo, amabwiriza ya sisitemu, ingero nke zarashwe cyangwa igishushanyo mbonera. Ibyo bisobanuro bifite akamaro kuko ibyemezo byo kwibuka birashobora kumva neza interuro, uburebure bwimiterere, ibikoresho bihari nibisobanuro nyabyo byo gutsimbarara ku makosa. Abashakashatsi bigenga bazakenera ibyo bikoresho kugirango bamenye niba icyuho kivugwa muri rusange kirenze ubushakashatsi.

Ikibazo cya kabiri ni ukumenya niba icyitegererezo kimwe kigaragara mumiryango myinshi yicyitegererezo hamwe nibisabwa nyabyo. Inkomoko yatanzwe itanga ibisubizo muri Claude na Qwen, ariko ntabwo ishyiraho imikorere kubandi batanga, sisitemu yuburemere, sisitemu ya multimodal cyangwa ibikorwa byo kwibuka mubikorwa. Ntabwo itanga raporo yubushakashatsi bwabakoresha, igihe kirekire cyo kureba cyangwa ingaruka ziterwa nigihe kirekire nyuma yimikoranire ikurikira. Isuzuma ry'ejo hazaza rishobora gusuzuma niba abakozi bagaragaza ibyo babitse, kwemerera gukosora cyangwa gusiba, kubika ibidashidikanywaho no gushaka ibyemezo mbere yo kubika amakuru yoroheje cyangwa adasobanutse.

Ikibazo cya gatatu nuburyo abashushanya isuzuma baringaniza neza, ubwitonzi nuburemere bwabakoresha. Bake barashwe byateye imbere cyane amakuru yatangajwe, mugihe politiki yihuse yagabanije gutsimbarara ku makosa ariko ntabwo byatanze inyungu zifatika zishingiye ku mibare. Ihuriro ryerekana ko imyitwarire myiza yo kwibuka ishobora gusaba ibirenze amabwiriza amwe, ariko inkomoko ntisuzuma intervention ishinzwe cyangwa niba ibisobanuro byisubiramo byababaza abakoresha. Uru rupapuro narwo rucapa, bityo ibyifuzo byayo bigomba gufatwa nkibyavuye mu bushakashatsi bitegereje kwemezwa kwagutse. Ibizakurikiranwa cyane ni ukugerageza kumenya niba iterambere ryapimwe kuri MCB rikomeza mugihe abakozi bakoresha ibikoresho byo kwibuka mubikorwa bifatika, bihindura ibiganiro kandi niba ibyemezo byabo byavuzwe bikomeza guhuza nibikorwa byabo.

Ibijyanye nuyobora & ibibazo