Dubawa
Yadda kuke saita ma'aunin farawa na cibiyar sadarwa na jijiyoyi kafin a fara horo, wanda ke da ƙarfi sosai ko sigina da gradients suna da lafiya ta cikin yadudduka masu zurfi. Kyakkyawan farawa shine bambanci tsakanin haɗuwa da sauri da samfurin da bai taɓa koyo ba.
Ƙaddamar da nauyi tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli.
Zurfafa nutsewa
Kafin horo, kowane nauyi yana buƙatar ƙimar farawa. Sanya su duka zuwa sifili yana da mutuwa: ma'aunin nauyi iri ɗaya yana haifar da gradients iri ɗaya, don haka neurons ba su taɓa bambanta ba - wannan ita ce matsalar warwarewar ƙima. Farawa bazuwar yana karya daidaito, amma ma'aunin yana da mahimmanci. Yayi girma da yawa da kunnawa da gradients suna fashewa; ƙanƙanta kuma sun ɓace. Tsare-tsare masu ƙa'ida sun zaɓi bambance-bambancen dangane da girman Layer don kiyaye bambancin sigina daidai gwargwado a tsakanin yadudduka. Xavier (Glorot) farkon farawa yana daidaita bambance-bambance ta adadin shigarwar da raka'o'in fitarwa kuma ya dace da cibiyoyin sadarwa na tanh da sigmoid. Ya (Kaiming) ƙaddamar da ma'auni ta adadin abubuwan da aka shigar da asusun don ReLU ya watsar da rabin abubuwan da aka shigar, yana mai da shi ma'auni na tushen ReLU mai zurfi da CNNs. Kyakkyawan farawa yana kiyaye horon da wuri har sai an daidaita da inganta haɓakawa.
Fahimtar Fasaha
Manufar ita ce kiyaye bambance-bambancen kunnawa da gradients akai-akai daga Layer zuwa Layer. Xavier yana saita bambance-bambancen nauyi zuwa 2 / (fan_in + fan_out), yana daidaita wucewar gaba da baya don kunna madaidaici. Yana farawa yana amfani da 2 / fan_in saboda ReLU yana fitar da kusan rabin abubuwan shigarsa, don haka ninka bambancin yana rama wannan siginar da ta ɓace. Ana fara nuna son zuciya zuwa sifili tun da an riga an karye sifili ta ma'aunin bazuwar.
Jagoran Farko Nauyi
Yadda kuke saita ma'aunin farawa na cibiyar sadarwa na jijiyoyi kafin a fara horo, wanda ke da ƙarfi sosai ko sigina da gradients suna da lafiya ta cikin yadudduka masu zurfi. Kyakkyawan farawa shine bambanci tsakanin haɗuwa da sauri da samfurin da bai taɓa koyo ba. Ƙaddamar da nauyi tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli. Don gina zurfin fahimta, bi da Ƙaddamar da Nauyi azaman samfurin aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, bayyana zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi masu amfani da Ƙaddamar da Nauyi suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa tare da dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
CNN da ke amfani da ayyukan ReLU an fara farawa tare da Ƙaddamarwa don haka zurfin juzu'i na jujjuyawar jirgin ƙasa ba tare da ɓata sigina ba.
Cibiyar sadarwa tare da kunnawa tanh tana amfani da ƙaddamarwar Xavier don kiyaye bambancin kunnawa a tsakanin yadudduka.
Injiniya wanda ya fara ƙaddamar da duk ma'aunin nauyi zuwa sifili ba da gangan ba yana ganin hanyar sadarwa ta kasa koyo saboda kowane neuron yana zama iri ɗaya.
Matsalolin Tsari (PyTorch's Kaiming, Keras's Glorot uniform) suna amfani da ƙa'idar farawa ta atomatik lokacin da aka ƙirƙiri Layer.
Hanyoyin Aiwatarwa
Fara nauyi a aikace
CNN da ke amfani da ayyukan ReLU an fara farawa tare da Ƙaddamarwa don haka zurfin juzu'i na jujjuyawar jirgin ƙasa ba tare da ɓata sigina ba.
CNN da ke amfani da ayyukan ReLU an fara farawa tare da Ya fara don haka zurfin juzu'i tara jirgin ƙasa ba tare da siginar ɓacewa Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Fara nauyi a aikace
Cibiyar sadarwa tare da kunnawa tanh tana amfani da ƙaddamarwar Xavier don kiyaye bambancin kunnawa a tsakanin yadudduka.
Cibiyar sadarwa tare da kunnawa tanh tana amfani da farawar Xavier don kiyaye bambancin kunnawa a tsakanin yadudduka Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararrakin ƙira, da kuma bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
Fara nauyi a aikace
Injiniya wanda ya fara ƙaddamar da duk ma'aunin nauyi zuwa sifili ba da gangan ba yana ganin hanyar sadarwa ta kasa koyo saboda kowane neuron yana zama iri ɗaya.
Injiniyan wanda ba da gangan ya ƙaddamar da duk ma'aunin nauyi zuwa sifili yana ganin hanyar sadarwa ta kasa koyo saboda kowane neuron yana tsayawa iri ɗaya Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da kuma bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
Fara nauyi a aikace
Matsalolin Tsari (PyTorch's Kaiming, Keras's Glorot uniform) suna amfani da ƙa'idar farawa ta atomatik lokacin da aka ƙirƙiri Layer.
Matsalolin Tsari (PyTorch's Kaiming, Keras's Glorot uniform) suna amfani da ƙa'idar farawa ta atomatik lokacin da aka ƙirƙiri ƙira Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin diddigin nasarorin samarwa da farashi na kuskure akan lokaci.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.