HejuruUbuyobozi bukurikira
Kwiyoroshya kwa Softmax ya Multiclass Itondekanya
Tekiniki
Ubuyobozi bwa tekiniki
Gumbel-Softmax ni amayeri areka imiyoboro yimitsi 'sample' kuva mubyiciro bitandukanye mugihe ikiri gutozwa na gradient descente.
Umva iki gitaboAI-byavuzwe · ~2 min
Nibyingenzi kuko gusubira inyuma mubisanzwe ntibishobora gutembera muburyo butemewe, bwihariye.
Imiyoboro ya neural yiga kohereza gradients inyuma muri buri gikorwa. Ariko gutoranya icyiciro cyihariye (nko gutoranya ijambo # 7 kuri 50.000) nugusimbuka gukomeye, kudatandukana, gradients zipfirayo. Amayeri ya reparameterisation yongeye kwandika icyitegererezo kuburyo butunguranye buturuka kumasoko ahamye yo hanze, hasigara inzira yoroshye, itandukanye ya gradients. Gumbel-Softmax ikoresha ibi muburyo butandukanye: yongeraho urusaku rwakwirakwijwe na Gumbel kuri logi, hanyuma igasimbuza argmax ikomeye hamwe na softmax igenzurwa n'ubushyuhe. Ku bushyuhe bwo hejuru ibisohoka ni blob yoroshye hejuru y'ibyiciro; nkuko ubushyuhe bugabanuka kuri zeru bikarishye hafi ya vector imwe ishyushye, igarura icyitegererezo nyacyo mugihe igumye itandukanye muri rusange.
Guhugura autoencoders zitandukanye hamwe na code (catretique) code yihishe aho kuba iyikomeza ya Gaussian gusa.
Itandukaniro ritandukanye ryubwubatsi bwubushakashatsi (urugero, uburyo bwa DARTS-uburyo) guhitamo igikorwa cyo gushyira kuri buri cyiciro.
Kwiga gutandukanya codebook yatoranijwe muburyo bwa VQ na moderi yo kwerekana.
Gutandukanya inzira zitandukanye cyangwa gufata ibyemezo muruvange-rwinzobere nimbuga-yo kubara.
Gumbel-Softmax ikomeza kuba igikoresho cyambere cyo gutandukanya ibintu byihishe, gushakisha imyubakire itandukanye, kwerekana imiterere ya vector, hamwe no kwiga inzira muri mix-ya-sisitemu. Ubushakashatsi burakomeza kuri vari-variance, hasi-kubogama kuruhuka (nka Rao-Blackwellized na control-variate igereranya) no kuri gahunda ya annealing igereranya kubogama kwubushyuhe bukabije hamwe nubushyuhe bukabije bwimbeho. Nkuko abanyamideli bagenda bafata ibyemezo byihariye, tegereza ibyo kuruhuka bikomeza kuguma hagati kugirango uhitemo amahitamo nkaya yiga-iherezo.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Gumbel-Softmax ni amayeri areka imiyoboro yimitsi 'sample' kuva mubyiciro bitandukanye mugihe ikiri gutozwa na gradient descente. Nibyingenzi kuko gusubira inyuma mubisanzwe ntibishobora gutembera muburyo butemewe, bwihariye.
The guide explains gradients do not pass through a hard discrete jump.
The guide describes moving randomness into a noise source and preserving a smooth path.
The guide gives the noisy softmax construction for differentiable categorical sampling.
High temperature yields a smoother distribution over categories.
The guide says low temperature sharpens toward a near one-hot vector.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Kwiyoroshya kwa Softmax ya Multiclass Itondekanya
Tekiniki