Lens Lens na Lens Lens
Lens lens hamwe na lens ya tekinoroji ni tekinoroji yo gusobanura ireba kuri transformateur yihishe imiterere kumurongo kugirango urebe icyo icyitegererezo 'gitekereza' mbere yuko gitanga igisubizo cyanyuma.
Incamake
They reveal how a prediction gradually forms as information flows up through the network.
Kwibira cyane
Impinduramatwara yubaka igisubizo cyayo gahoro gahoro: buri cyiciro cyiyongera kumikorere ikora 'ibisigara bisigaye' bihinduka gusa ijambo rishoboka kumpera. Lens lens, yatangijwe na nostalgebraist mumwaka wa 2020, ihita ikoresheje uburyo bwanyuma bwa moderi itarangizwa (na layer layer) muburyo butaziguye, kuburyo ushobora gusoma igitekerezo cyiza cyurusobe kuri ubujyakuzimu. Ibi akenshi byerekana igisubizo korohereza hagati-gutinda. Lens yatunganijwe (Belrose na bagenzi be, 2023) itezimbere kuriyo ihugura umuto muto wa afine kuri buri cyiciro kugirango uhindure ibihugu byihishe muburyo bwa nyuma, bikosora kubogama no kutamenya neza lens ya logit mbisi ibabara, cyane cyane mubyiciro byambere ndetse no mumiryango itandukanye y'icyitegererezo.
Ubushishozi
Ubwo buryo bwombi bwifashisha ibisigisigi byerekanwe: buri cyiciro cyandika ibyongeweho byongeweho kuri vector isangiwe matrike idashyizwe hamwe nyuma umushinga wamagambo. Lens lens yongeye gukoresha ibyo bitarondoreka kuri leta ziciriritse nta mahugurwa y'inyongera. Lens yatunganijwe ahubwo yiga ikarita yumurongo (umurongo wize 'umusemuzi') bityo leta ya buri cyiciro igahinduka muburyo bwa nyuma iteganya, bitanga umusaruro woroheje, wizerwa kandi wohanze cyane.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka Logit Lens na Tens Lens
Tekinike ya Lens iragenda iba igipimo cyo gukurikirana uburyo ibintu, kwangwa, cyangwa kubogama kugaragara mubwimbitse, no kubona igihe icyitegererezo 'kimenya' igisubizo hakiri kare. Witege ko byahujwe na autoencoders zidasanzwe hamwe nimpamvu zitera kugirango zive mu gusobanura ibyahanuwe zisobanura uburyo. Ubushakashatsi nabwo burimo gusuzuma niba abasomyi bo hagati bagaragaza ubumenyi bwihishe cyangwa uburiganya icyitegererezo cyihishe mubisohoka byanyuma, bigatuma lensike yubaka umukandida kugirango igenzurwe ryumutekano no kugenzura hakiri kare.
Gushyira mu bikorwa Isi
Gukoresha lens ya lens kugirango urebe igisubizo gifatika nkumurwa mukuru ugaragara mubyitegererezo byo hagati
Koresha lens yahujwe kugirango ugereranye uburyo imiryango itandukanye yicyitegererezo ihurira kubihanura byimbitse
Kumenya ko icyitegererezo 'cyahisemo' igisubizo mubice byinshi mbere yo gusohoka
Gupima ibice aho ibimenyetso byangiza cyangwa bibogamye byerekana ibimenyetso byambere byiganje mumigezi isigaye
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Logit Lens and Tuned Lens quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Lens Lens na Hagati Hagati ya Decoding
Ibibazo bikunze kubazwa
What is Logit Lens and Tuned Lens?
Lens lens hamwe na lens ya tekinoroji ni tekinoroji yo gusobanura ireba kuri transformateur yihishe imiterere kumurongo kugirango urebe icyo icyitegererezo 'gitekereza' mbere yuko gitanga igisubizo cyanyuma. Bagaragaza uburyo guhanura bigenda buhoro buhoro uko amakuru agenda asohoka murusobe.
Lens ikora iki?
Imishinga ya logit yerekana intera isigaye-imigezi ivuga ibinyujije mubitariho kugirango ibone ibimenyetso byahanuwe kuri buri burebure.
Ni ubuhe buryo bw'ingenzi butezimbere lens yongeweho yongeramo lens mbisi mbisi?
Lens yatunganijwe yiga umusemuzi kumurongo umwe, ikosora kubogama kandi igatanga ibyizerwa, byo hasi-bitesha umutwe kuruta lisiti mbisi.
Ni ubuhe buryo bwo guhindura ibintu butuma izo lens zishoboka?
Buri cyiciro cyandika ibyongeweho byongeweho kumasoko asigaye, bityo umushinga utemba hakiri kare ugereranya guhanura hagati.
Ninde watangije lens yumwimerere, kandi hafi ryari?
Lens ya lensit yatangijwe nostalgebraist mumwanya wa blog ya 2020 isesengura ibyahanuwe hagati ya GPT-2.
Ni hehe lens ya logit yerekana igisubizo cyanyuma 'korohereza'?
Ibisomwa mubisanzwe byerekana ikimenyetso cyukuri cyunguka amahirwe hagati yo gutinda-gutinda nkuko kubara kwegeranya.