Ubushakashatsi busanga imiyoboro ya LLM ishobora kuguma ifite imiterere mugihe ibimenyetso byifashe nabi

Byagenze bite

Igicapo gishya cya arXiv cyerekana ibimenyetso-bya Leta byizewe (ESR), urwego rwo gusuzuma ibyiciro byinshi-imiyoboro minini-yerekana imiyoboro. ESR ibaza niba ibimenyetso biciriritse bikomeza kuba byuzuye, bifite ishingiro, imbere imbere kandi bikoreshwa murwego rukurikira, aho kugenzura gusa niba ibisohoka bikurikiza imiterere iteganijwe.

Urupapuro rusuzuma umuyoboro munini wa LLM uyobowe no kwangirika. Iragereranya ibimenyetso bisukuye nibintu bitatu byahinduwe: ibimenyetso bifatika-byatakaye, guta igice hamwe nibimenyetso bivuguruzanya. Umuyoboro urimo ibyemezo, ubugenzuzi no kuzamura ibyiciro, kandi abanditsi basuzuma imiterere yimiterere yimiterere itandukanye niba ibimenyetso bikomeza kuba byiza kubikorwa byateganijwe.

Abanditsi bavuga ko guhamagarwa 720 byateganijwe kandi byayobowe, muri byo hakaba hasigaye imirongo 713 y’isuku. Isuzuma ryakoresheje GLM-5.2 na 60 byimanza zifite isuku. Kugereranya hafi icyenda cyagereranijwe hagati yimiterere yangiritse kandi isukuye, buri cyiciro cyibikorwa-byagereranijwe byari bibi, kandi intera ya 95% ya bootstrap yagumye munsi ya zeru, nkuko byavuzwe.

Parser yemewe yimukiye muburyo bunyuranye: igereranyo cyamanota icyenda yose yari nziza, nubwo intera yo kugereranya ibice bitatu-bigabanijwe harimo zeru. Muyandi magambo, ibisubizo byumuyoboro birashobora kuguma-cyangwa bisa nkaho bishoboka ko bigumaho - muburyo bwubaka nubwo igipimo cyerekana ibimenyetso byubutsinzi cyarushijeho kuba bibi.

Uru rupapuro rutandukanya kandi kumenya ibimenyetso byangiritse no kubikuramo. Mubisubizo byemewe-byagenzuwe byagenzuwe, byagaragaye ko gutesha agaciro byagaragaye ko ari 1.0 muri buri kintu cyangiritse, ariko igipimo cy’ibinyoma cyari kitari zeru. Muri parser-yemewe yataye agaciro kuzamuka, gukira kwari 0.0 muri buri kintu cyangiritse. Abanditsi basobanura ibi nkumupaka wizewe-urwego rutandukanijwe muburyo bwasuzumwe.

Ufatiye hamwe, igishushanyo gikomeza ibibazo bibiri bitandukanye mugusuzuma: niba umusaruro ushobora kwemerwa muburyo buteganijwe, kandi niba ibimenyetso bishyigikira ibyo bisohoka biracyakoreshwa mubyiciro byagenwe. Kugereranya byatangajwe bireba ko itandukaniro mubihe byavuzwe. Basobanura rero uburyo ingamba zifashe muri iri suzuma, mugihe hasigara intera nini yo gutandukana ifunguye ibindi bizamini.

Ibisobanuro birambuye: arxiv.org ↗

Impamvu ari ngombwa

Ubushakashatsi bwerekana uburyo bunoze bwo kunanirwa kuri sisitemu ya AI itanga igenzura ryimiterere mugihe ishingiye kubimenyetso bituzuye, bikomye cyangwa bivuguruzanya. Itandukaniro rifite akamaro aho icyiciro cyose cyicyitegererezo gitanga amakuru kubindi, harimo ibyemezo, kugenzura no kuzamura ibikorwa.

Sisitemu nyinshi za AI zikoresha imiterere na cheque igenzura nkuburinzi bwambere. Iri genzura rishobora kwemeza ko ibisohoka bishobora gukoreshwa - urugero, ko bikubiyemo imirima iteganijwe - bitagaragaje ko ibimenyetso bifatika byuzuye, bihamye cyangwa bikwiranye nicyemezo gikurikira. ESR igamije gupima uwo mutungo wa kabiri.

Itandukanyirizo rifite akamaro cyane cyane mumiyoboro aho icyitegererezo cyambere cyerekana incamake cyangwa igashyira amakuru hanyuma ibyiciro bigenzurwa nyuma, gufata icyemezo cyangwa kuzamuka ukurikije ibisubizo bigereranijwe. Niba ibimenyetso byangiritse bihinduwe mubisohoka-bisukuye, software yo hasi irashobora kubyemera utazi ko amakuru akenewe kubikorwa yacitse intege.

Impapuro zo kuzamuka kwimpapuro ningirakamaro cyane nkimbogamizi kubyo gutahura bishobora gukora. Raporo idasubirwaho ivuga ko icyiciro cyo kuzamuka cyasuzumwe kitigeze gikira mu buryo ubwo ari bwo bwose bwangiritse, nubwo ibisubizo byemewe. Ibyo ntibigaragaza ko sisitemu zose zo kuzamura LLM zananiranye, ariko irerekana impamvu kumenya ikibazo no kugarura ibimenyetso byizewe nibisabwa bitandukanye mubuhanga.

Ibyagaragaye birashobora gufasha amashyirahamwe gutegura isuzuma ripima ibirenze imiterere. Sisitemu irashobora gukenera ingamba zitandukanye kubimenyetso byuzuye, gushingira, guhuza imbere, gutsindira imirimo no kugarura imyitwarire, hamwe na gahunda isanzwe cyangwa igenzura rya parser. Uru rupapuro ntirugaragaza ko ESR ari urwego rusange rwinganda cyangwa ko rutezimbere ibyagezweho nisi; irerekana kandi ikora urwego murwego rumwe rwasuzumwe.

Inshingano yagutse rero ireba icyo kugenzura kwizerwa bigomba gusabwa gupima. Guhuza imiterere birashobora gukomeza kuba ingirakamaro nkumutungo wubwubatsi, ariko ntisubiza ikibazo-cyiza cyibibazo byonyine. Urwego rwubushakashatsi rushyira iyo mitungo iruhande rwundi kugirango umuyoboro ushobora gusuzumwa kumpapuro zombi zikoreshwa ndetse ninkunga ikoreshwa, utiriwe ufata ingamba zombi nka konti yuzuye yo kwizerwa.

Ibyo kureba

Igisubizo gikeneye kwipimisha kurenza impapuro imwe yimiterere yimiterere, gushushanya imiyoboro hamwe nisuku. Akazi kazoza kagomba gusuzuma niba ESR hamwe na raporo yatandukanijwe ifata imiterere, imirimo, ubwoko bwibimenyetso hamwe nisuzuma rinini cyangwa ryigenga.

Kwigana nikibazo gikinguye. Abanditsi bagaruye ku buryo bweruye imyanzuro yabo ku isuzuma ry'icyitegererezo cyasuzumwe, igishushanyo mbonera, imanza zatoranijwe zifite isuku, uburyo bwo gutanga amanota hamwe no gukora igipimo kimwe. Ibisobanuro ntabwo byerekana uburyo ibisubizo byahinduka hamwe nizindi ngero zururimi, imibare minini, inyandiko zerekana imishinga nzima cyangwa imyubakire itandukanye.

Uru rupapuro ruvuga ko kode n'ibikoresho byororoka bihari, ariko isoko yatanzwe ntabwo isobanura ibiyirimo, ibisobanuro birambuye cyangwa niba abashakashatsi bigenga batanze ibisubizo. Ibyo bikoresho nibisubirwamo hanze bizaba ingenzi mugusuzuma uburyo bwo gutanga amanota, isesengura rya bootstrap hamwe nubusobanuro bwingamba zavuzwe.

Isuzuma ry'ejo hazaza rigomba gusuzuma niba itandukaniro rimwe rigaragara mubikorwa bifatika hamwe n'ibimenyetso bitandukanye byatsinzwe. Inkomoko iriho yerekana amazina yo kwikuramo, gutakaza igice namakimbirane, ariko ntabwo itanga ibisobanuro bihagije mubisobanuro byerekana ubwoko bwibimenyetso byangiritse cyane, niba ubukana bwo gutesha agaciro bwari butandukanye kuri gahunda cyangwa uburyo imanza zatoranijwe.

Basomyi bagomba kandi kureba uburyo ESR igereranwa nubwizerwe buriho, kalibrasi, kugarura-ishingiro hamwe ningamba zidashidikanywaho. Inkomoko ishyigikira umwanzuro mugufi ko gusesengura agaciro hamwe nibimenyetso-byerekana ibyiciro byatsinze muri ubu bushakashatsi. Ntabwo ishigikira ibirego byerekeranye no kunanirwa kwagutse, ingaruka zumusaruro cyangwa kwizerwa kwimiyoboro ya LLM muri rusange.

Imipaka ni igice cyo gusobanura ibisubizo. Ibipimo byatangajwe byerekana ibyabaye muburyo bwasobanuwe kandi ntibikemure niba uburyo bumwe bwakomeza ahandi. Ibikoresho byororoka, isuzuma ryigenga no kugereranya ningamba zijyanye nabyo birashobora gusobanura uburemere bwo gushyira kumurongo no kubitandukanya byagaragaye mubushakashatsi bwatanzwe.

Ibijyanye nuyobora & ibibazo