Hasashen tikitin caca
Hasashen tikitin Lottery ya ce a cikin babbar hanyar sadarwar jijiyoyi da aka fara bazuwar yana ɓoye ƙaramin hanyar sadarwa - 'tikitin nasara' - wanda, wanda aka horar da shi kaɗai daga ma'aunin farko iri ɗaya, zai iya dacewa da cikakkiyar hanyar sadarwar.
Dubawa
It matters because it suggests we are training far more parameters than we actually need.
Zurfafa nutsewa
Jonathan Frankle da Michael Carbin suka ba da shawara a MIT a cikin 2018, hasashen ya girma ne daga binciken dasa. A al'ada zaka iya datse hanyar sadarwar da aka horar zuwa kashi 10-20% na nauyinta ba tare da rasa daidaito ba, amma horar da waccan karamar cibiyar sadarwa daga karce ta kasa. Frankle da Carbin sun sami dabara: ci gaba da ma'aunin nauyi na farko na haɗin kai. Wannan ƙananan hanyar sadarwa - tikitin cin nasara - sannan yana horarwa zuwa cikakkiyar daidaito a keɓe, wani lokacin sauri fiye da ainihin asali. Sun gano tikiti ta hanyar 'girman girman kai': jirgin kasa, datse mafi girman ma'auni, mayar da sauran zuwa ƙimarsu ta farko, da maimaitawa. Sakamakon yana nuna girman juzu'i na musamman yana taimakawa haɓakawa nemo tsari mara kyau, ba wai duk waɗannan ma'auni ba daidai ba ne.
Fahimtar Fasaha
Babban hanyar ita ce girman dasawa tare da jujjuya nauyi: bayan horo, cire ma'aunin mafi ƙasƙanci, sake saita sauran ma'aunin nauyi zuwa farkon farkon su (ko wurin binciken horo na farko, gyaran da ake kira 'rewinding'), sannan sake horarwa. Haɗin takamaiman abin rufe fuska DA wanda ya dace da farawa shine abin da ke sa tikitin 'nasara' - maido da abin rufe fuska ba da gangan ba yana lalata tasirin.
Dabarun Tasiri
Shawarwari masu haske
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Kudin da kasafin kuɗi
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Ƙungiya da aikin aiki
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Makomar Hasashen Tikitin Lottery
Tikitin caca yana ingiza bincike kan hanyoyin sadarwar horarwa tun daga farko don adana ƙididdiga da kuzari, da kuma cikin ko canja wurin tikiti zuwa manyan bayanai da ayyuka. Ƙirƙirar pruning na jujjuyawa zuwa nau'ikan ma'auni biliyan ya kasance masu tsada, don haka ana ci gaba da aiki kan nemo tikiti cikin arha ko tabbatar da wanzuwarsu (hasashen tikitin 'karfi' ya ce tikitin suna wanzuwa a farkon farawa ba tare da wani horo ba). Yi tsammanin haɗin kai tare da ingantattun samfuran kan-na'ura da kore AI.
Aiwatar da Gaskiyar Duniya
Matsa babban mai rarraba hoto zuwa ƙasa da 20% na ma'aunin nauyi don turawa akan waya yayin kiyaye daidaito
Ƙaddamar da horarwa ta hanyar ganowa da horar da babbar hanyar sadarwa mai nasara kawai
Nazarin canja wurin nauyi ta hanyar sake amfani da tikitin da aka samo akan saitin bayanai ɗaya don tsalle-fara horo akan wani abu mai alaƙa.
Rage ƙima da ƙwaƙwalwar ajiya a cikin na'urori masu gefe ta hanyar jigilar tikitin cin nasara da aka yanke maimakon ƙira mai yawa
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Takaddun inda Hasashen Tikitin Lottery ke taimakawa kuma inda mafi sauki hanyoyin suka fi kyau.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Lottery Ticket Hypothesis quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Chinchilla Compute-Mafi kyawun horo
Tambayoyin da ake yawan yi
What is Lottery Ticket Hypothesis?
Hasashen tikitin Lottery ya ce a cikin babbar hanyar sadarwar jijiyoyi da aka fara bazuwar yana ɓoye ƙaramin hanyar sadarwa - 'tikitin nasara' - wanda, wanda aka horar da shi kaɗai daga ma'aunin farko iri ɗaya, zai iya dacewa da cikakkiyar hanyar sadarwar. Yana da mahimmanci saboda yana nuna muna horar da sigogi fiye da yadda muke buƙata.
Menene 'tikitin nasara' a cikin wannan hasashe?
Tikitin cin nasara ƙaramin cibiyar sadarwa ne wanda, lokacin da aka horar da shi keɓe daga ma'aunin farko iri ɗaya, ya kai daidaito kwatankwacin babbar hanyar sadarwa.
Me yasa horar da hanyar sadarwar da aka datse ke kasawa sai dai idan kun yi wani abu na musamman?
Maɓalli mai mahimmanci shine cewa abin rufe fuska yana aiki ne kawai idan an haɗa shi tare da madaidaicin farawa na asali; bazuwar reinitialization karya shi.
Wanene ya ba da shawarar Hasashen Tikitin Lottery?
Jonathan Frankle da Michael Carbin sun gabatar da hasashen a cikin takardar MIT ta 2018.
Wace dabara ake amfani da ita don nemo tikitin cin nasara?
Girman dasawa akai-akai yana horarwa, yana cire mafi ƙarancin ma'aunin nauyi, kuma yana mayar da sauran zuwa ƙimarsu ta farko.
Menene hasashe ke nunawa game da manyan hanyoyin sadarwa da aka wuce gona da iri?
Sakamakon binciken yana nuna wuce gona da iri yana taimakawa nemo hanyar sadarwa mara nauyi maimakon kowane nauyi ya zama dole.