Dubawa
Matsakaicin Nauyin Stochastic (SWA) yana ɗaukar matsakaicin matsakaicin ma'aunin ƙirar daga maki da yawa a ƙarshen horo maimakon kawai adana hoton ƙarshe. Wannan dabarar mai arha sau da yawa tana saukar da ƙirar a cikin shimfidar wuri mai faɗi, yanki mafi fa'ida na yanayin asara, wanda ke ba da fifiko ga mafi kyawu akan bayanan gaibu.
Matsakaicin Nauyin Stochastic wani shingen gini ne na fasaha wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli.
Zurfafa nutsewa
Izmailov, Wilson da abokan aiki suka gabatar da su a cikin 2018, SWA ta yi amfani da lura cewa SGD tare da ƙimar koyo na akai-akai ko cyclical ba ya haɗuwa zuwa aya ɗaya - yana bounces a kusa da gefen wani fili mai faɗin kwari. Maimakon ɗaukar ɗayan waɗannan wuraren tsayawa masu hayaniya, SWA tana gudanar da matsakaicin matsakaicin matsakaici (sau da yawa akai-akai ko cyclic) ƙimar koyo don lokutan ƙarshe kuma yana daidaita ma'aunin nauyi da yake ziyarta, yawanci kowane zamani. Matsakaicin ma'aunin nauyi yana zama kusa da tsakiyar yankin faɗuwa. Saboda ana ƙididdige ƙididdiga na daidaitawa ga takamaiman ma'auni, SWA na buƙatar ƙarin wucewa ɗaya na gaba akan bayanai don sake ƙididdige hanyoyin tafiyar da BN da bambance-bambancen ƙima. Farashin ainihin kyauta ne, kuma daidaitattun ribar da aka samu sun yi daidai a cikin rarrabuwar hotuna da bayan haka.
Fahimtar Fasaha
SWA tana kiyaye matsakaicin gudu w_SWA = (n·w_SWA + w_i)/(n+1) ana sabunta kowane zagayowar, yayin da ƙirar SGD mai rai ke ci gaba da bincike tare da ƙimar koyo mai girma. Matsakaicin matsakaicin nauyi a sararin samaniya yana kusanta tari a sararin aiki amma yana biyan ƙira ɗaya bisa ƙididdigewa, ba da yawa ba. Makullin hanyar ita ce ƙaramin ƙaramin lebur yana da ƙarfi ga rikicewar nauyi, don haka filayen asarar horo/gwaji suna kasancewa a daidaita, rage tazarar gaba ɗaya.
Jagoran Matsakaicin Nauyin Stochastic
Matsakaicin Nauyin Stochastic (SWA) yana ɗaukar matsakaicin matsakaicin ma'aunin ƙirar daga maki da yawa a ƙarshen horo maimakon kawai adana hoton ƙarshe. Wannan dabarar mai arha sau da yawa tana saukar da ƙirar a cikin shimfidar wuri mai faɗi, yanki mafi fa'ida na yanayin asara, wanda ke ba da fifiko ga mafi kyawu akan bayanan gaibu. Matsakaicin Nauyin Stochastic wani shingen gini ne na fasaha wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli. Don gina zurfin fahimta, kula da Ma'aunin nauyi na Stochastic azaman samfurin aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Matsakaicin Nauyin Stochastic suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa tare da dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Haɓaka daidaiton gwajin ResNet da DeseNet masu rarraba hoto akan CIFAR da ImageNet ba tare da ƙarin farashi ba.
SWAG (SWA-Gaussian) yana samar da ƙididdige ƙididdiga na rashin tabbas don tsinkaya-aminci daga aikin horo guda ɗaya.
EMA-na-nauyi yana daidaita hanyar sadarwar samfur a cikin masu samar da hoto kamar Stable Diffusion.
Gina 'miyan ƙira' ta hanyar maƙasudin madaidaitan wuraren bincike da yawa don inganta ƙarfi ba tare da sake horarwa ba.
Hanyoyin Aiwatarwa
Matsakaicin nauyin Stochastic a aikace
Haɓaka daidaiton gwajin ResNet da DeseNet masu rarraba hoto akan CIFAR da ImageNet ba tare da ƙarin farashi ba.
Haɓaka daidaiton gwajin ResNet da masu rarraba hoto na DenseNet akan CIFAR da ImageNet ba tare da ƙarin farashi ba Ƙungiyoyin yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin abubuwan samarwa da ƙimar kuskure akan lokaci.
Matsakaicin nauyin Stochastic a aikace
SWAG (SWA-Gaussian) yana samar da ƙididdige ƙididdiga na rashin tabbas don tsinkaya-aminci daga aikin horo guda ɗaya.
SWAG (SWA-Gaussian) yana samar da ƙididdige ƙididdiga na rashin tabbas don tsinkaya-aminci na aminci daga guduwar horo guda ɗaya Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefen, da bin duk nasarorin samarwa da ƙimar kuskure a kan lokaci.
Matsakaicin nauyin Stochastic a aikace
EMA-na-nauyi yana daidaita hanyar sadarwar samfur a cikin masu samar da hoto kamar Stable Diffusion.
EMA-na-nauyi masu daidaita hanyar sadarwar samfuri a cikin masu samar da hotuna masu rarraba kamar Stable Diffusion Teams yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
Matsakaicin nauyin Stochastic a aikace
Gina 'miyan ƙira' ta hanyar maƙasudin madaidaitan wuraren bincike da yawa don inganta ƙarfi ba tare da sake horarwa ba.
Gina 'miyan ƙira' ta hanyar matsakaita wuraren bincike masu kyau da yawa don haɓaka ƙarfi ba tare da sake horarwa Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da bin diddigin nasarorin samarwa da farashi na kuskure akan lokaci.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.