Chii chaitika
Vatsvagiri vanotsanangura OmniLens, dhizaini yelenzi yakagadzirirwa kuita mamodhi makuru epakati 'makomputa epakati nyore kuongorora pachiyero. Iro bepa rinoshuma yakaderera uye ndangariro zvinodiwa, kufukidzira kune yakasara hova, kutarisisa, uye zvikamu zveMLP, uye zvakawanikwa kubva kutatu kududzira nyaya dzezvidzidzo.
Bepa, rakatumirwa kuarXiv muna Nyamavhuvhu 10, 2026, rinopa OmniLens, nzira yekududzira nyika dzakavanzwa mukati memhando dzemitauro. Lens nzira dzemepu dzepakati activation kune iyo modhi yekubuda kwemazwi, zvichibvumira vaongorori kuti vaongorore kuti inotevera-token fungidziro inokura sei kuburikidza nezvikamu zvinotevedzana zvetiweki. Nzvimbo yakapihwa inosimbisa zita rebepa, kunyorwa, zuva rekutumira uye abstract; haitsigiri zvakazvimirira zviedzo kana mhedziso dzazvo.
Vanyori vanoratidza matambudziko maviri ekuyera mumalenzi akadzidziswa. Vashanduri veAffine vanoda akati wandei maparamendi anokura quadratically nehupamhi hwemodhiyo, ukuwo kudzidziswa chaiko kupokana neakazara mazwi Kullback-Leibler kugovera kunogadzira ndangariro dzakakura. OmniLens inogadzirisa dambudziko rekutanga nevashanduri vakaderera. Iyo abstract inoti izvi zvinoshandura per-lens kukura kune mutsara muhupamhi hwemodhi uye inoderedza zvinodzidziswa paramita kusvika 98.4 muzana.
Kune dambudziko rekuyeuka, OmniLens inoshandisa Subset-KL, iyo inongotora yakasarudzwa mazwi emazwi panguva yekudzidziswa. Yayo Top-k modhi inonzi inoderedza peak kudzidziswa ndangariro neanosvika makumi manomwe muzana. Yakakosha-sampled vhezheni inotsanangurwa sekuchengeta unbiased stochastic gradients yechinangwa chakazara cheKL. Izvi mhedzisiro uye maitiro akataurwa nevanyori vebepa; iwo mameseji akapihwa haapi akakwana manhamba ekurangarira, nguva yekudzidziswa, ruzivo rwehardware kana matafura ekuenzanisa.
Iyo yakachengetwa yakachengetwa yakagonesa iyo vanyori vanodana dense ensemble ye482 lenzi yeLLaMA-3.3-70B. Vanoti izvi zvakapa katanhatu kufukidzwa kwedhizaini yakasara-rukova pakadzika kumwe chete uye zvakavabvumira kuti vaongorore zvakasara-kurukova, kutarisisa uye kuvhurwa kweMLP mune imwe hurongwa. Mukati mezvidzidzo zvenyaya zvinosanganisira kuwanikwa kwejekiseni nekukurumidza, akawanda-hop ndangariro jekiseni uye huturu hwenzvimbo, chirevo chinoti OmniLens yakaburitsa makiyi akaburitswa mhedzisiro pamutengo wakaderera. Iyo hairatidze mhedzisiro yese yakaburitswa kana kupa iwo epasi metrics mune yakapihwa zvinhu.
Kwakabva mashoko: arxiv.org ↗
Nei zvichikosha
Kunzwisisa uko modhi inoumba fungidziro uye uko kupindira kunoshandura maitiro kwakakosha pakugadzirisa, kutsvaga kuchengetedza, uye kudzidza kwesainzi. Mupiro wepakati weOmniLens, kana mhedzisiro yayo yakashumwa ikaramba iripo, ndeyekuita yakawedzera modhi-yakafara ongororo inoshanda kupfuura nzira dzekare dzelens dzinobvumidzwa.
Kukosha kunoshanda kunowedzera mukana wekududzirwa kwemuenzaniso. Kana kuongorora zvimiro zvemukati kuchida mashoma anodzidziswa paramita uye kushoma kwepamusoro ndangariro, akawanda mapoka ekutsvagisa anogona kukwanisa kuongorora mahombe mamodheru pane kudzikisira kuongororwa kune madiki masisitimu kana kirasi nhete yezvikamu. Sosi inotsigira izvi sekuda kwekugonesa kutsvagisa, kwete sehumbowo hwekuti OmniLens yakatochinja yekutarisa kugadzirwa kana kusimudzira modhi.
Bepa rinoratidza musiyano unokosha pabasa rekuchengetedza: chikamu icho maitiro anonyanya kuoneka chingave chisiri icho chikamu icho kushandura modhi kunoshanda zvakanyanya. Nzira inoongorora mhando dzakawanda dzezvikamu inogona kuderedza njodzi yekubata chiratidzo chiri nyore kucherechedzwa seyakanyanya kutonga nzvimbo. Kuwana ikoko kungangove kwakakosha nekuti kunonetsa kududzira kunobva pamisoro yekutarisisa yega kana maonero asara erukova.
Zvidzidzo zvitatu izvi zvinobatanidza nzira kune nzvimbo dzine zvido zvevanhu. Kurumidza-jekiseni yekuona ine chekuita nekuedza kupesvedzera modhi kuburikidza nemirairo mune zvayo. Multi-hop ndangariro jekiseni ine chekuita neruzivo rwunounzwa kana kutakurwa pamatanho akawanda ekufunga, ukuwo huturu hwenzvimbo hune chekuita nekuona painomiririrwa maitiro anokuvadza. Iyo abstract haitaure kuti OmniLens inodzivirira maitiro aya, inonatsiridza dziviriro dzakaiswa kana kupa tsananguro yakazara pamusoro pazvo.
Hukoshi hwetsvagiridzo yakakura ndeye methodological. Modhi-yakafara lens ensemble inogona kubatsira vaongorori kuenzanisa panobuda masaini, machinjiro aanoita mumatanho uye kuti ndeapi mapindiro ane mhedzisiro inoyerwa. Zvakadaro, tsime rakapihwa hariratidze kuti nzira iyi ndiyo ine chikonzero mukuongorora kwese, kuti dudziro dzayo dzakaringana, kana kuti kuderedzwa kwemitengo kwakashumwa kunochengetedza ruzivo rwese runobatsira. Iyo mibvunzo inoramba iri pakati pekutonga maitiro ebasa.
Interactive Mechanism: Iyo Inonyatsoshanda
Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.
What is the best response when AI Models Explained makes a mistake in production?
Zvekutarisa zvinotevera
Iwo akakosha anotevera bvunzo kudzokorora kwakazvimiririra, kuburitswa kweruzivo rwekuita uye modhi zvigadzirwa, kuongororwa kupfuura kwakashumwa LLaMA-3.3-70B ongororo, uye humbowo hwekuti kuoneka kwakakura kunotungamira kukuvandudzwa kwechokwadi mukuchengetedza chaiko kana kuvimbika mabasa.
Kudzokorora kunofanira kuva yekutanga kuongorora. Kwakabva mishumo inobuda kubva mukuedza kwevanyori, asi zvinhu zvakapihwa hazvina yakazvimirira kuburitsa, sarudzo yekuongorora-vezera kana ongororo yekunze. Vaverengi vanofanirwa kutsvaga humbowo hwekuti paramende uye kudzikisira ndangariro kunobata pasi pemaseti ekudzidziswa uye kuti iyo yakashumwa 482-lens yekuvhara inogona kudhindwa pasina zvakavanzika zveinjiniya fungidziro.
ndiyo imwe nyaya isina kugadziriswa. Iyo abstract inopa yakadzama yekuyera muenzaniso weLLaMA-3.3-70B uye inoti iyo dhizaini inoshanda kune chero modhi-yakafara activation, asi hairatidzi icho chinoda kumhuri dzakasiyana dzemhando, saizi, nzira dzekudzidzisa kana magadzirirwo emazwi. Izvo zvakare hazviratidze kana izvo zvakafanana zvakawanikwa pamusoro pekuonekwa uye kupindira zvakabata kunze kwematatu akadomwa nyaya zvidzidzo.
Tsanangudzo yekuongorora ichaona kuti ivimbo yakadii yekuisa mune zvine chekuita nekuchengetedza. Kwakabva hakupi humbowo hwekuona, kunaka kwenzvimbo, kuwanda kwekubudirira kwekupindira, mwero wenhema, kana tsananguro dzezvakaburitswa zvabuda. Izvo zvakare hazvitsanangure kana nzira yacho inogona kushanda pasi pekugovera mashifiti, kusimudzira kweanopikisa kana modhi inogadziridza. Izvozvo zvinosiiwa zvinodzivirira mutongo pamusoro pekuvimbika kwekushanda.
Kuita uye kuwanikwa kuchakanganisa kana ichi chinoramba chiri mhedzisiro yekutsvagisa kana kuve chishandiso chinoshandiswa zvakanyanya. Iyo yakapihwa rekodhi inobatanidza kune bepa uye kwairi mafaera asi haitaure kuti kodhi, akadzidziswa lenzi, dhatasethi kana evaluation zvinyorwa zviripo. Izvo zvakare hazvipi humbowo nezve mutengo wekutumira, latency, zvakavanzika zvinorehwa kana kuenderana nemamodhi evaridzi. Kusvikira iwo ruzivo uye zvidzidzo zvenguva refu zvaonekwa, OmniLens inobatwa zvakanyanya senzira inovimbisa yekududzira kwete chigadzirwa chekuchengetedza chakasimbiswa.