Byagenze bite
Abashakashatsi berekanye GLANCE, igishushanyo mbonera kimwe cyo gushushanya kubishushanyo mbonera byerekana imvugo-yerekana. Uburyo busoma intego yicyitegererezo yamaze guhuzwa n'amashusho yerekana ururimi, bitanga umurongo wumukandida ibimenyetso byabakandida mumurongo umwe wimbere, kandi ufite intego yerekana kugenzura abo bakandida mumurongo umwe. Abanditsi batangaje ko igenzura ryakozwe ryerekana umururumba wuzuye kandi ko GLANCE yageze kuri 2,93 × umuvuduko wa decode de autoregressive mugihe cyibizamini byavuzwe.
Urupapuro rwashyikirijwe arXiv ku ya 31 Kanama rwerekana GLANCE, rusobanura ko rwashushanyaga inzira imwe yo gushushanya ibitekerezo byerekana uburyo bwo kwerekana imvugo. Gukoresha decoding yibisanzwe ikoresha umuto muto kugirango utange ibimenyetso byinshi hanyuma usabe icyitegererezo kinini cyo kugenzura. Uru rupapuro ruvuga ko iki gishushanyo gitera ikibazo kuri sisitemu-yerekana ururimi: umuto muto utera autoregressive ushobora kudashobora gutunganya ishusho kuri buri ntambwe, nubwo amakuru agaragara ashobora gutuma ibimenyetso bikurikira byerekana ibimenyetso.
GLANCE ihindura uruhare rwuwateguye. Nkuko inkomoko ibivuga, umutwe-wo-gukwirakwiza umutwe usoma intego yerekana intego-yamaze guhuza imvugo-yerekana imvugo kandi ikuzuza abakandida bose mumurongo umwe. Igiti kinini cyabakandida igenzurwa mugihe kimwe-cyitegererezo. Iki nicyo cyifuzo cya tekiniki nkuru: amakuru yibonekeje asanzwe aboneka muri leta yahawe uwashushanyije, mugihe ibimenyetso byatanzwe byakozwe nkibibuza aho bikurikirana. Uru rupapuro rwita inzira idafite igihombo kuko ireba icyitegererezo cyururimi rudahinduwe kandi ikavuga ko buri kintu cyagenzuwe cyabyaye umururumba wuzuye.
Abanditsi batangaza kugereranya byinshi mubyo bita moteri imwe na bije imwe. GLANCE yashushanyije inshuro zigera kuri 2,93 kurenza decode ya autoregressive, yakoresheje umushinga umwe wambukiranya uruziga aho umusaruro EAGLE3-VL wakoreshaga umunani, kandi ukemera guhagarika inshuro 2,7 kurenza umutwe wa EAGLE-3 watojwe kumurambo umwe. Uru rupapuro rutangaza kandi isano iri hagati yuburebure bwemewe hamwe nicyitegererezo cyicyerekezo gikurikira- entropy. Iyo mibanire yarushijeho gukomera kuko imirimo yashingiraga cyane ku gushingira, ku mirimo itanu, kandi abanditsi bavuga ko yimuye ku ntego no mu buryo. Ibi nibisabwa kuva mbere, ntabwo ibisubizo byigenga byigenga.
Ibisobanuro birambuye: arxiv.org ↗
Impamvu ari ngombwa
Akazi gakemura ikibazo gifatika muri AI ya multimodal: gutanga inyandiko ikimenyetso kimwe icyarimwe birashobora gutuma ibisubizo-shusho bishingiye kubishusho bihenze kandi bitinda. Niba ibisubizo byatangajwe muri rusange, GLANCE irashobora kugabanya ubukererwe bwimbitse no kubara imirimo ikoporora cyangwa ikurikiranira hafi ibiri mumashusho, mugihe uzigama umusaruro wicyitegererezo aho kugurisha ubucuruzi bwihuse.
Ubusobanuro bwihuse ni kubara. Icyerekezo-cyururimi rwicyitegererezo gihuza gutunganya amashusho nibisekuru byururimi, ariko urwego rwibisekuru rushobora gukomeza kwerekana ibimenyetso. Kubisubizo bisubiramo inyandiko igaragara mumashusho cyangwa gukurikiza imbogamizi igaragara cyane, inzira ikurikiranye irashobora gukora intambwe hafi ya zose ziteganijwe. Uburyo butegura igihe kirekire muri pass imwe irashobora kugabanya ubukererwe nubunini bwintego-moderi yo kubara isabwa kuri buri gisubizo.
Inkomoko yo gutandukanya inyandiko ishingiye kandi yubuntu-ikoresha ni ngombwa. GLANCE ntabwo itangwa nkuwasimbuwe kwisi yose ya decode ya autoregressive. Abanditsi bavuga ko inyungu zayo zikomeye cyane mu “butegetsi bwo gukoporora mu magambo,” aho usanga amashusho atuma urutonde rurerure ruteganijwe, mu gihe inyandiko-yubuntu ikomeza gushyigikira urunigi. Urwo rubibi rutanga ibisubizo ibisobanuro bifatika: imikorere irashobora guterwa cyane nuburyo icyitegererezo ari multimodal muri rusange kuruta uko umurimo runaka ubuza igisubizo ukoresheje ibimenyetso bifatika.
Igihombo kivugwa gishobora nanone kugira akamaro kubyemezo byo kohereza. Umuvuduko ukunze gusaba kwemera impinduka zishoboka mubisubizo, ariko iyi mpapuro ivuga ko ibisubizo byerekana umururumba wicyitegererezo byabyaye umusaruro wabigenzuye. Niba byemejwe mubizamini byagutse, ibyo byatuma tekinike ijyanye na porogaramu zikeneye imyitwarire yumwimerere ya decoding mugihe ushakisha igihe gito cyo gusubiza cyangwa ikiguzi cyo kugereranya. Inkomoko ntabwo ishyiraho ayo kuzigama yo hasi, ariko, kandi ntabwo itanga raporo yoherejwe, umusaruro uhari-ukoresha, cyangwa ingaruka kumiterere irenze iyororoka nyaryo mugusuzuma ryakozwe.
Uburyo bukoreshwa: Uburyo bukora
Shakisha ikoranabuhanga ryihishe inyuma yiri terambere.
Which component of an AI application is the machine-learning model itself?
Ibyo kureba
Urupapuro ni inyandiko nshya yatanzwe, kubwibyo isaba iracyakeneye kwigana byigenga. Ibisobanuro ntibisobanura ibyuma, intego yicyitegererezo, imibare yamakuru, kubara byihuse, ubukererwe bwuzuye, cyangwa imirimo itanu yasuzumwe. Raporo ntarengwa yihuta irashobora rero gushingira cyane kubikorwa byakazi no guhitamo gushyira mubikorwa; abanditsi ubwabo bavuga ko inyandiko-yubuntu ikomeje gushyigikira inyandiko zikurikirana.
Ikibazo nyamukuru nukubyara. Inkomoko igaragaza impapuro, abanditsi, itariki yoherejweho, hamwe na code iboneka, ariko ibisobanuro byayo ntibitanga URL yo gushyira mubikorwa, iboneza ryibyuma, amazina yicyitegererezo, ingano ya dataset, kubara vuba, cyangwa ibisobanuro birambuye byakazi. Ibyo bisobanuro birakenewe kugirango umenye niba igishushanyo cya 2.93 × kigaragaza iterambere ryagutse cyangwa igisubizo cyiza-cyiza kumurimo runaka. Ijambo "kugeza" ryerekana ko ntarengwa atari ngombwa byanze bikunze.
Kugereranya bisaba kandi gusobanurwa neza. GLANCE igereranwa na decode ya autoregressive hamwe numutwe ushingiye kuri EAGLE munsi ya moteri yavuzwe hamwe ningengo yimari, ariko ibisobanuro ntibisobanura niba sisitemu zose zarakoresheje intanga zimwe, guterana, gushiraho kwibuka, cyangwa politiki yo kugenzura. Kuvuga ko GLANCE yemeye guhagarikwa inshuro 2,7 kurenza umutwe wa EAGLE-3 watojwe kumurambo umwe biratanga amakuru, nyamara uburebure bwemewe bwonyine ntibugaragaza ubukererwe bwanyuma. Igiciro cyo kugenzura, gukoresha kwibuka, gukoresha ibyuma, no kunanirwa cyangwa kwangwa bizagira akamaro.
Ibindi bisuzumabumenyi bigomba kugerageza uburyo kuri moderi nyinshi zigamije, uburyo, indimi, ubwoko bwamashusho, nuburyo bwo gusubiza, harimo nigihe igisubizo gifunguye-cyarangiye aho gukopororwa mubyerekanwe. Umubano wa entropie urashobora kuba ingirakamaro kuko ushobora gufasha guhanura igihe umushinga wo guhagarika uzatanga umusaruro, ariko isoko ntiguha intera idashidikanywaho cyangwa kwemeza kwigenga kuri iryo tegeko ryashyizweho. Kugeza ubwo ibyo bipimo biboneka, GLANCE yunvikana neza nkigisubizo cyubushakashatsi butanga umusaruro uhereye kubitabo aho kuba ibipimo rusange byihuta byihuta.