Ugororotse-Binyuze mu Kugereranya
Igororotse-Binyuze mu Kugereranya (STE) ni amayeri yoroshye yo guhugura imiyoboro ikubiyemo intambwe zikomeye, zidatandukanye nko kuzenguruka cyangwa kurenga.
Incamake
It uses the discrete value on the forward pass but pretends the operation was the identity when computing gradients.
Kwibira cyane
Ibikorwa bimwe, nko kuzenguruka kuri integer, binini yerekana uburemere kugeza kuri + 1 / -1, cyangwa gutoranya icyiciro cyo hejuru hamwe na argmax, bifite inkomoko ya zeru hafi ya hose kandi idasobanuwe neza. Iyo zero gradient ihagarika kwiga imbeho. Igororotse-Binyuze muri Estimator kuruhande ibi mugukuramo inzira zinyuma ninyuma: imbere, ikoresha ibikorwa byukuri; gusubira inyuma, ikoporora gusa ibyinjira byinjira byanyuze nkaho ibikorwa byabaye indangamuntu (cyangwa proksi yoroshye). Ikigereranyo kibogamye, kubera ko igipimo nyacyo rwose ari zeru, nyamara mubikorwa iyi 'kwigira ko yoroshye' igereranya gari ya moshi igereranya kandi igereranya imiyoboro idasanzwe, niyo mpamvu STE ari urugo rwakazi rwo kwiga byimbitse.
Ubushishozi
Gushyira mubikorwa ni umurongo umwe muburyo bugezweho: kubara y = bigoye (x) ariko gradients yinzira nkaho y = x. Igishushanyo rusange ni y = x + guhagarika_gukurikirana (bigoye (x) - x), bityo agaciro kambere kangana kangana (x) mugihe icyiciro cyinyuma gisa neza na x. Ibihinduka bivanaho kunyura kuri gradient kugeza kuri zeru hanze [-1, 1] kugirango wirinde kongera ibikorwa ibikorwa bigoye byuzura, bitezimbere ituze.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza Keza-Binyuze mu Kugereranya
STE ishimangira kwiyongera mumashanyarazi mato mato na binary bikurikirana kubikoresho na AI bitagabanije ingufu, kandi nibyingenzi muguhugura moderi zingana na vector nkizikoreshwa mumashusho agezweho hamwe na tokenizer. Imirimo ikomeje irashaka kugereranya, kutabogamye kubigereranyo no gusobanukirwa neza nimpamvu igereranya rito rikora. Nkuko bikenewe kubintu bito, byihuse, byuzuye bigenda byiyongera kuri terefone hamwe nibikoresho bigezweho, tegereza amayeri yuburyo bwa STE azakomeza kuba urufatiro nubwo bizwi kubogama.
Gushyira mu bikorwa Isi
Guhugura binary na bike-bitondekanya imiyoboro ya neural kugirango isuzume neza kuri terefone nibikoresho byo ku nkombe.
Gusubira inyuma ukoresheje codebook ya discret reba muri VQ-VAE hamwe na neural amajwi / amashusho yerekana ibimenyetso.
Kwimenyekanisha-Kwimenyereza aho uburemere cyangwa ibikorwa byegeranijwe kugeza kuri point-point mugihe cyimbere.
Kwiga kwitonda cyane cyangwa gutandukanya amarembo aho argmax cyangwa imbago yicaye muburyo bwo kubara.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Straight-Through Estimator quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Itondere Kuzunguruka no Gukata Umutwe
Ibibazo bikunze kubazwa
What is Straight-Through Estimator?
Igororotse-Binyuze mu Kugereranya (STE) ni amayeri yoroshye yo guhugura imiyoboro ikubiyemo intambwe zikomeye, zidatandukanye nko kuzenguruka cyangwa kurenga. Ikoresha agaciro keza kuri pass yimbere ariko yitwaza ko imikorere yari indangamuntu mugihe ibara gradients.
Niki Igororotse-Binyuze muri Estimator ikora kumurongo winyuma (gradient)?
STE ikomeza ibikorwa byukuri kubikorwa byimbere ariko ikabifata nkirangamuntu (cyangwa proxy yoroshye) mugihe cyinyuma, ikareka gradients zikagenda.
Ni ukubera iki imikorere isanzwe idatandukanye nko kuzenguruka ikibazo cyamahugurwa?
Intambwe imeze nkintambwe ifite zeru zeru hagati yisimbuka nubuso budasobanutse kurusimbuka, so backpropagation ntabwo yakira ibimenyetso byingirakamaro.
Ikintu cyingenzi kinyangamugayo kijyanye na Straight-Binyuze muri Estimator nuko itanga ubwoko bwa gradient?
Kuberako igipimo cyukuri cyibikorwa bikomeye ni zeru, kunyuramo kugereranya kubogamye; bidasanzwe, iracyahugura imiyoboro ihanitse kandi ibiri.
Nibihe bikorwa bya kera, bikoreshwa cyane muburyo bugororotse-Binyuze muri Estimator?
STE nigikoresho gisanzwe kuri binary / ingano yimiyoboro, aho uburemere cyangwa ibikorwa byerekanwe muburyo bwimbere ariko bigahugurwa hamwe na pass-gradients.
Ihinduka risanzwe rya STE ikora iki kuri pass-through gradient?
Gucomeka (kwiyuzuza) STE zeru gradients aho imikorere igoye yuzuye, ikumira ibikorwa byo guhunga no kunoza imyitozo ihamye.