Dubawa
Madaidaicin-Ta Ƙididdiga (STE) dabara ce mai sauƙi don hanyoyin sadarwar horarwa waɗanda ke ƙunshe da matakai masu wuya, marasa bambance-bambance kamar zagaye ko kofa. Yana amfani da ƙima mai ƙima akan fasfo na gaba amma yana riya cewa aikin shine ainihin lokacin da ake lissafin gradients.
Madaidaicin-Ta hanyar Estimator tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli.
Zurfafa nutsewa
Wasu ayyuka, kamar zagaye zuwa lamba, binarizing ma'aunin nauyi zuwa +1/-1, ko ɗaukar babban nau'i tare da argmax, suna da abin da ba shi da sifili kusan ko'ina kuma ba a bayyana shi ba a tsalle. Wannan sifirin gradient yana daina koyon sanyi. Mai ƙididdigewa Mai Madaidaici-Ta hanyar Ƙididdiga yana ɓata wannan ta hanyar ɓata gaba da baya: gaba, yana aiwatar da aiki mai wuyar gaske; baya, kawai yana kwafin gradient mai shigowa kai tsaye ta hanyar kamar aikin shine ainihin (ko wakili mai santsi). Ƙididdiga na nuna son kai, saboda gaskiyar gradient da gaske sifili ne, duk da haka a aikace wannan 'kamar yana da santsi' yana ba da ƙima da ƙididdige cibiyoyin sadarwa da kyau, wanda shine dalilin da ya sa STE babban doki ne na ingantaccen ilmantarwa mai zurfi.
Fahimtar Fasaha
Aiwatar da layi ɗaya ne a cikin tsarin zamani: ƙididdige y = hard(x) amma hanyar gradients kamar y = x. Tsarin gama gari shine y = x + stop_gradient (hard (x) - x), don haka ƙimar gaba tayi daidai da wuya(x) yayin da gradient na baya shine daidai na x. Bambance-bambancen suna zazzage hanyar wucewa ta gradient zuwa sifili a waje [-1, 1] don guje wa haɓaka haɓakawa wanda aiki mai wuyar gaske zai cika, inganta kwanciyar hankali.
Jagoran Madaidaicin-Ta hanyar Ƙididdiga
Madaidaicin-Ta Ƙididdiga (STE) dabara ce mai sauƙi don hanyoyin sadarwar horarwa waɗanda ke ƙunshe da matakai masu wuya, marasa bambance-bambance kamar zagaye ko kofa. Yana amfani da ƙima mai ƙima akan fasfo na gaba amma yana riya cewa aikin shine ainihin lokacin da ake lissafin gradients. Madaidaicin-Ta hanyar Estimator tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli. Don haɓaka fahimta mai zurfi, bi da Madaidaicin-Ta hanyar Ƙididdiga azaman ƙirar aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi masu amfani da Madaidaicin-Ta Ƙididdiga suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa tare da dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Horar da hanyoyin sadarwa na jijiyoyi masu ƙarancin ƙididdige ƙididdige binary da ƙananan-bit don ingantacciyar ƙididdigewa akan wayoyi da na'urorin gefe.
Bayar da baya ta hanyar duban littafin lambar a cikin VQ-VAE da na'urorin sauti/hoto na jijiya.
Horowar ƙididdigewa-sane inda aka haɗa ma'auni ko kunnawa zuwa ƙayyadadden wuri yayin wucewar gaba.
Koyan hankali mai ƙarfi ko gating mai hankali inda argmax ko kofa ke zaune a cikin hanyar lissafi.
Hanyoyin Aiwatarwa
Madaidaicin-Ta Ƙimar Ƙimar a aikace
Horar da hanyoyin sadarwa na jijiyoyi masu ƙarancin ƙididdige ƙididdige binary da ƙananan-bit don ingantacciyar ƙididdigewa akan wayoyi da na'urorin gefe.
Horar da hanyoyin sadarwa na binary da ƙananan ƙananan ƙididdigewa don ingantaccen ƙididdigewa akan wayoyi da na'urori na gefe Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Madaidaicin-Ta Ƙimar Ƙimar a aikace
Bayar da baya ta hanyar duban littafin lambar a cikin VQ-VAE da na'urorin sauti/hoto na jijiya.
Bayar da baya ta hanyar duba littafin codebook a cikin VQ-VAE da jijiya audio/hoto tokenizers Ƙungiyoyi yawanci suna samun ingantacciyar sakamako lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Madaidaicin-Ta Ƙimar Ƙimar a aikace
Horowar ƙididdigewa-sane inda aka haɗa ma'auni ko kunnawa zuwa ƙayyadadden wuri yayin wucewar gaba.
Horowar ƙididdigewa-sane inda aka haɗa ma'auni ko kunnawa zuwa ƙayyadaddun ma'auni yayin wucewar gaba Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da ƙimar kuskure a kan lokaci.
Madaidaicin-Ta Ƙimar Ƙimar a aikace
Koyan hankali mai ƙarfi ko gating mai hankali inda argmax ko kofa ke zaune a cikin hanyar lissafi.
Koyon hankali mai ƙarfi ko gating mai hankali inda argmax ko kofa ke zaune a cikin hanyar ƙididdigewa Ƙungiyoyi yawanci suna samun ingantacciyar sakamako lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.