Dropout da Stochastic Regularization
Dropout dabara ce ta daidaitawa wacce ke kashe juzu'i na neuron ba tare da izini ba yayin kowane matakin horo, tilasta wa hanyar sadarwar gina sabbin abubuwa masu ƙarfi.
Dubawa
Dropout dabara ce ta daidaitawa wacce ke kashe juzu'i na neuron ba tare da izini ba yayin kowane matakin horo, tilasta wa hanyar sadarwar gina sabbin abubuwa masu ƙarfi. Ya zama ɗaya daga cikin mafi tasiri dabarun yaƙi da wuce gona da iri a cikin zurfin koyo.
Dropout da Stochastic Regularization suna zaune a cikin ainihin kayan aikin AI. Lokacin da kuka fahimce shi, sauran batutuwan AI sun zama masu sauƙi don kimantawa da kwatantawa.
Zurfafa nutsewa
Ƙungiya ta Hinton ta gabatar a kusa da 2012, dropout yana magance babban rauni na manyan cibiyoyin sadarwa: neurons na iya daidaitawa, koyan gyara kuskuren juna ta hanyoyin da kawai ke aiki akan bayanan horo. A kan kowane fasinja na gaba yayin horo, ficewa ba da gangan yana saita fitowar kowane neuron zuwa sifili tare da wasu yuwuwar p (sau da yawa 0.5 a cikin yadudduka masu yawa). Saboda duk wani neuron na iya ɓacewa, hanyar sadarwar ba za ta iya dogaro da ƙawance masu rauni ba kuma dole ne ta yada bayanai masu amfani a cikin raka'a da yawa. Wannan yana aiki kamar horar da ɗimbin ɗimbin cibiyoyin cibiyoyin sadarwa waɗanda ke raba nauyi. A lokacin gwaji ana kashe ficewar kuma ana amfani da cikakkiyar hanyar sadarwa, tare da daidaita matakan kunnawa don haka abin da ake sa ran ya dace da horo. Sakamakon yawanci shine mafi kyawun haɓakawa akan farashi na ɗan ɗan lokaci horo.
Fahimtar Fasaha
Yayin horarwa ana kiyaye kowane rukunin tare da yuwuwar (1 debe p) ta hanyar abin rufe fuska na binary, don haka ana yin samfuri daban-daban ƙananan cibiyoyin sadarwa kowane tsari. Tsarin zamani yana amfani da jujjuyawar jujjuyawar: ana rarraba abubuwan kunnawa masu rai ta hanyar (1 debe p) a lokacin jirgin ƙasa, don haka ba a buƙatar sikeli idan aka kwatanta. Wannan bazuwar yana shigar da amo wanda ke hana daidaitawa tare da kusan maƙasudi sama da adadi mai ƙima na ƙananan hanyoyin sadarwa masu nauyi, nau'in haɗaɗɗiyar arha.
Jagorar Dropout da Tsara Tsare-tsare
Don gina zurfin fahimta, kula da Dropout da Stochastic Regularization azaman ƙirar aiki, ba fasali ɗaya ba. Ƙayyade sakamakon da ake so, fayyace zato, kuma raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu ke buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi masu amfani da Dropout da Stochastic Regularization suna gina ƙira mai ƙarfi da farko, sannan taswirar waɗannan ƙirar zuwa ƙaƙƙarfan samarwa. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla. A lokaci guda, Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyawarsa da wuri. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Ƙara Layer Dropout tare da p a kusa da 0.5 tsakanin manyan yadudduka na hoto ko rubutun rubutu a cikin PyTorch ko Keras
Samfuran masu canza canji da ke amfani da faduwa zuwa ma'aunin hankali da kunnawa ciyarwa gaba yayin horo
Ficewar Monte Carlo, inda barin barin ya tsaya akan ƙima don samar da ƙididdiga marasa tabbas don tsinkayar lafiya ko aminci.
Zurfin Stochastic (DropPath) ba da gangan ba yana tsallake ragowar tubalan don daidaita hanyoyin sadarwa masu zurfi kamar ResNets da masu canza hangen nesa.
Hanyoyin Aiwatarwa
Dropout da Stochastic Regularization a aikace
Ƙara Layer Dropout tare da p a kusa da 0.5 tsakanin manyan yadudduka na hoto ko rubutun rubutu a cikin PyTorch ko Keras.
Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Dropout da Stochastic Regularization a aikace
Samfuran masu canza canji da ke amfani da faduwa zuwa ma'aunin hankali da kunnawa ciyarwa gaba yayin horo.
Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Dropout da Stochastic Regularization a aikace
Ficewar ta Monte Carlo, inda ficewar ta tsaya a kan ra'ayi don samar da ƙididdiga marasa tabbas don tsinkayar lafiya ko aminci.
Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Dropout da Stochastic Regularization a aikace
Zurfin Stochastic (DropPath) ba da gangan ba yana tsallake ragowar tubalan don daidaita hanyoyin sadarwa masu zurfi kamar ResNets da masu canza hangen nesa.
Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Yi la'akari da wannan a matsayin ƙofar shaida: idan ba a cika ka'idodin ba, dakatar da fitowar, rufe tazarar, sannan kawai faɗaɗa amfani.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Yi la'akari da wannan a matsayin ƙofar shaida: idan ba a cika ka'idodin ba, dakatar da fitowar, rufe tazarar, sannan kawai faɗaɗa amfani.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Yi la'akari da wannan a matsayin ƙofar shaida: idan ba a cika ka'idodin ba, dakatar da fitowar, rufe tazarar, sannan kawai faɗaɗa amfani.
Daftarin aiki inda Dropout da Stochastic Regularization ke taimakawa kuma inda mafi sauƙi hanyoyin sun fi kyau.
Yi la'akari da wannan a matsayin ƙofar shaida: idan ba a cika ka'idodin ba, dakatar da fitowar, rufe tazarar, sannan kawai faɗaɗa amfani.
Ci gaba da Bincike
Check your understanding
Test yourself: take the Dropout and Stochastic Regularization quiz