Ubuyobozi bwa tekiniki

Lens Lens na Lens Lens

Lens lens hamwe na lens ya tekinoroji ni tekinoroji yo gusobanura ireba kuri transformateur yihishe imiterere kumurongo kugirango urebe icyo icyitegererezo 'gitekereza' mbere yuko gitanga igisubizo cyanyuma.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka Logit Lens na Tens Lens
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

They reveal how a prediction gradually forms as information flows up through the network.

Kwibira cyane

Impinduramatwara yubaka igisubizo cyayo gahoro gahoro: buri cyiciro cyiyongera kumikorere ikora 'ibisigara bisigaye' bihinduka gusa ijambo rishoboka kumpera. Lens lens, yatangijwe na nostalgebraist mumwaka wa 2020, ihita ikoresheje uburyo bwanyuma bwa moderi itarangizwa (na layer layer) muburyo butaziguye, kuburyo ushobora gusoma igitekerezo cyiza cyurusobe kuri ubujyakuzimu. Ibi akenshi byerekana igisubizo korohereza hagati-gutinda. Lens yatunganijwe (Belrose na bagenzi be, 2023) itezimbere kuriyo ihugura umuto muto wa afine kuri buri cyiciro kugirango uhindure ibihugu byihishe muburyo bwa nyuma, bikosora kubogama no kutamenya neza lens ya logit mbisi ibabara, cyane cyane mubyiciro byambere ndetse no mumiryango itandukanye y'icyitegererezo.

Gushyira mu bikorwa Isi

Gukoresha lens ya lens kugirango urebe igisubizo gifatika nkumurwa mukuru ugaragara mubyitegererezo byo hagati

Koresha lens yahujwe kugirango ugereranye uburyo imiryango itandukanye yicyitegererezo ihurira kubihanura byimbitse

Kumenya ko icyitegererezo 'cyahisemo' igisubizo mubice byinshi mbere yo gusohoka

Gupima ibice aho ibimenyetso byangiza cyangwa bibogamye byerekana ibimenyetso byambere byiganje mumigezi isigaye

Kazoza ka Logit Lens na Tens Lens

Tekinike ya Lens iragenda iba igipimo cyo gukurikirana uburyo ibintu, kwangwa, cyangwa kubogama kugaragara mubwimbitse, no kubona igihe icyitegererezo 'kimenya' igisubizo hakiri kare. Witege ko byahujwe na autoencoders zidasanzwe hamwe nimpamvu zitera kugirango zive mu gusobanura ibyahanuwe zisobanura uburyo. Ubushakashatsi nabwo burimo gusuzuma niba abasomyi bo hagati bagaragaza ubumenyi bwihishe cyangwa uburiganya icyitegererezo cyihishe mubisohoka byanyuma, bigatuma lensike yubaka umukandida kugirango igenzurwe ryumutekano no kugenzura hakiri kare.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Logit Lens and Tuned Lens quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Logit Lens and Tuned Lens?

Lens lens hamwe na lens ya tekinoroji ni tekinoroji yo gusobanura ireba kuri transformateur yihishe imiterere kumurongo kugirango urebe icyo icyitegererezo 'gitekereza' mbere yuko gitanga igisubizo cyanyuma. Bagaragaza uburyo guhanura bigenda buhoro buhoro uko amakuru agenda asohoka murusobe.

Lens ikora iki?

Imishinga ya logit yerekana intera isigaye-imigezi ivuga ibinyujije mubitariho kugirango ibone ibimenyetso byahanuwe kuri buri burebure.

Ni ubuhe buryo bw'ingenzi butezimbere lens yongeweho yongeramo lens mbisi mbisi?

Lens yatunganijwe yiga umusemuzi kumurongo umwe, ikosora kubogama kandi igatanga ibyizerwa, byo hasi-bitesha umutwe kuruta lisiti mbisi.

Ni ubuhe buryo bwo guhindura ibintu butuma izo lens zishoboka?

Buri cyiciro cyandika ibyongeweho byongeweho kumasoko asigaye, bityo umushinga utemba hakiri kare ugereranya guhanura hagati.

Ninde watangije lens yumwimerere, kandi hafi ryari?

Lens ya lensit yatangijwe nostalgebraist mumwanya wa blog ya 2020 isesengura ibyahanuwe hagati ya GPT-2.

Ni hehe lens ya logit yerekana igisubizo cyanyuma 'korohereza'?

Ibisomwa mubisanzwe byerekana ikimenyetso cyukuri cyunguka amahirwe hagati yo gutinda-gutinda nkuko kubara kwegeranya.