Dubawa
Gumbel-Softmax wata dabara ce da ke ba da damar cibiyoyin sadarwar jijiyoyi 'samfuri' daga nau'ikan mabambanta yayin da har yanzu ana iya horar da su ta hanyar zuriya. Yana da mahimmanci saboda yada baya yawanci ba zai iya gudana ta hanyar bazuwar, zaɓi mai hankali ba.
Gumbel-Softmax da Reparameterization tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikelin.
Zurfafa nutsewa
Cibiyoyin jijiyoyi suna koyo ta hanyar aika gradients baya ta kowane aiki. Amma ɗaukar nau'i mai ma'ana (kamar ɗaukar kalmar #7 na 50,000) tsalle ne mai wuya, wanda ba shi da bambanci, don haka gradients suna mutuwa a can. Dabarar sake fasalin yana sake rubuta samfurin bazuwar don haka bazuwar ya fito daga kafaffen amo na waje, yana barin hanya mai santsi, banbanta ga gradients. Gumbel-Softmax yana yin amfani da wannan ga masu canji masu ƙima: yana ƙara amo da aka rarraba Gumbel zuwa logits, sannan ya maye gurbin argmax mai ƙarfi tare da softmax mai sarrafa zafin jiki. A babban zafin jiki abin fitarwa yana da santsi mai laushi akan nau'ikan; yayin da zafin jiki ke faɗuwa zuwa sifili yana ƙaruwa zuwa kusa da vector mai zafi ɗaya, yana dawo da samfur na gaskiya yayin da ake iya bambanta gaba ɗaya.
Fahimtar Fasaha
Dabarar Gumbel-Max ta ce: ƙara ƙarar Gumbel (0,1) mai zaman kanta zuwa kowane logit da ɗaukar argmax yana haifar da ainihin samfurin daga rarraba softmax. Gumbel-Softmax yana musanya wancan mai wuyar argmax don softmax((log p + g)/tau). Matsakaicin zafin jiki yana shiga tsakanin santsi, babban rabe-raben entropy (babban tau) da kuma kusa-zafi ɗaya (karamin tau). Saboda an zana amo g a wajen hanyar sadarwa, hanyar daga logits zuwa fitarwa ta kasance mai bambanta.
Jagorar Gumbel-Softmax da Reparameterization
Gumbel-Softmax wata dabara ce da ke ba da damar cibiyoyin sadarwar jijiyoyi 'samfuri' daga nau'ikan mabambanta yayin da har yanzu ana iya horar da su ta hanyar zuriya. Yana da mahimmanci saboda yada baya yawanci ba zai iya gudana ta hanyar bazuwar, zaɓi mai hankali ba. Gumbel-Softmax da Reparameterization tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikelin. Don gina zurfin fahimta, bi da Gumbel-Softmax da Reparameterization a matsayin samfurin aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, bayyana zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Gumbel-Softmax da Reparameterization suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa akan dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Horar da bambance-bambancen autoencoders tare da latent latent (masu hankali) maimakon na Gaussian masu ci gaba.
Binciken gine-gine daban-daban (misali, hanyoyin salon DARTS) zaɓin aikin da za a sanya a kowane Layer.
Koyan zaɓukan littafin code a cikin salon VQ da ƙirar wakilci mai hankali.
bambance-bambancen ra'ayi ko yanke shawara a cikin cakuda-na-ƙwararru da cibiyoyin sadarwa na ƙididdigewa.
Hanyoyin Aiwatarwa
Gumbel-Softmax da Reparameterization a aikace
Horar da bambance-bambancen autoencoders tare da latent latent (masu hankali) maimakon na Gaussian masu ci gaba.
Horar da bambance-bambancen autoencoders tare da latent latent (masu hankali) maimakon kawai ci gaba na Gaussian ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefen, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
Gumbel-Softmax da Reparameterization a aikace
Binciken gine-gine daban-daban (misali, hanyoyin salon DARTS) zaɓin aikin da za a sanya a kowane Layer.
Binciken gine-gine daban-daban (misali, hanyoyin DARTS-style) zaɓin aikin da za a sanya a kowane Layer Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da kuma bin duk abubuwan da aka samu na samarwa da ƙimar kuskure akan lokaci.
Gumbel-Softmax da Reparameterization a aikace
Koyan zaɓukan littafin code a cikin salon VQ da ƙirar wakilci mai hankali.
Koyan zaɓen littafin rubutu mai hankali a cikin salon VQ da samfuran wakilci masu hankali Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Gumbel-Softmax da Reparameterization a aikace
bambance-bambancen ra'ayi ko yanke shawara a cikin cakuda-na-ƙwararru da cibiyoyin sadarwa na ƙididdigewa.
Bambance-bambancen ra'ayi ko yanke shawara a cikin cakuda-na-ƙwararru da cibiyoyin sadarwa na ƙididdigewa Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.