Ibitonyanga hamwe na Stochastic Regularisation
Dropout ni amayeri asanzwe azimya byanze bikunze igice cya neuron muri buri ntambwe yo guhugura, guhatira umuyoboro kubaka ibishushanyo mbonera, bikomeye.
Incamake
It became one of the most influential techniques for fighting overfitting in deep learning.
Kwibira cyane
Byatangijwe nitsinda rya Hinton ahagana mu mwaka wa 2012, abata ishuri bakemura intege nke zingenzi zurusobe runini: neuron irashobora gufatanya, kwiga gukosora amakosa ya buri wese muburyo bukora gusa kumyitozo. Kuri buri cyiciro cyimbere mugihe cyamahugurwa, abata ishuri bashiraho buri neuron ibisohoka kuri zeru hamwe nibishoboka p (akenshi 0.5 mubice byuzuye). Kuberako neuron iyariyo yose ishobora gucika, umuyoboro ntushobora gushingira kubufatanye bworoshye kandi ugomba gukwirakwiza amakuru yingirakamaro mubice byinshi. Ibi bikora nko guhugura itsinda rinini ryimiyoboro isangiye uburemere. Mugihe cyibizamini guta ishuri bizimya kandi umuyoboro wuzuye urakoreshwa, hamwe nibikorwa byapimwe kuburyo ibyateganijwe gusohoka bihuye namahugurwa. Ibisubizo mubisanzwe nibyiza muri rusange kubiciro byamahugurwa maremare.
Ubushishozi
Mugihe cy'amahugurwa buri gice kibikwa hamwe nibishoboka (1 ukuyemo p) ukoresheje mask ya binary idasanzwe, bityo imiyoboro itandukanye itangwa buri cyiciro. Ibikorwa bigezweho bifashisha guta ishuri: ibikorwa byo kurokoka bigabanijwe na (1 ukuyemo p) mugihe cya gari ya moshi, kubwibyo ntagipimo gikenewe muguhitamo. Uku guhitamo gutera urusaku rubuza guhuza n'imihindagurikire y'ikirere kandi ugereranya impuzandengo ugereranije n'umubare utagereranywa w'isanganya-uburemere-buke, uburyo buhendutse bwo guterana.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Ejo hazaza h'ibitonyanga no Kuringaniza Stochastic
Mu miyoboro y'icyerekezo cyemeza, icyiciro gisanzwe cyimuye ahanini abata ishuri, ariko impinduka zitera imbere ahandi: abahindura bahindura ibitonyanga kubitekerezo no kugaburira imbere, kandi DropPath (ubujyakuzimu bwa stochastique) ita ibisigisigi byose bisigaye. Monte Carlo yataye ishuri, ikomeza guta ishuri ikora, ikoreshwa mukugereranya icyitegererezo kidashidikanywaho. Witegereze ko ibintu bisanzwe bizakomeza kuba ibikoresho byoroshye, byahujwe na buri nyubako aho kuba resept imwe ihamye.
Gushyira mu bikorwa Isi
Ongeraho Dropout layer hamwe na p hafi 0.5 hagati yuburyo bwuzuye bwishusho cyangwa inyandiko itondekanya muri PyTorch cyangwa Keras
Moderi ya moderi ikoresha guta ibitekerezo kuburemere no kugaburira-ibikorwa mbere yo kwitegura
Monte Carlo yataye ishuri, aho abata ishuri bagumaho kugirango batange igereranyo kidashidikanywaho kubuvuzi cyangwa umutekano uhungabana
Ubujyakuzimu butajegajega (DropPath) bidasubirwaho gusimbuka ibisigisigi kugirango uhuze imiyoboro yimbitse cyane nka ResNets hamwe na transformateur iyerekwa
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Dropout na Stochastic Regularisation ifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Dropout and Stochastic Regularization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Stochastic Gradient Kumanuka hamwe na Momentum
Ibibazo bikunze kubazwa
What is Dropout and Stochastic Regularization?
Dropout ni amayeri asanzwe azimya byanze bikunze igice cya neuron muri buri ntambwe yo guhugura, guhatira umuyoboro kubaka ibishushanyo mbonera, bikomeye. Yabaye bumwe mu buryo bukomeye bwo kurwanya birenze urugero mu myigire yimbitse.
Abata ishuri bakora iki mugihe cy'amahugurwa?
Kureka bidasubirwaho zeru buri neuron hamwe nibishoboka p mugihe cy'amahugurwa, bityo rero sub-neti itandukanye yoroheje ikoreshwa buri ntambwe.
Kuki guta ishuri bitezimbere rusange?
Mugukuraho kubushake ibice, guta ishuri bihagarika neuron gukora ubufatanye bworoshye bukora gusa kumyitozo yamahugurwa, kunoza imbaraga.
Bigenda bite guta ishuri mugihe cyibizamini (umwanzuro)?
Mugusuzumisha urusobe rwuzuye rukora hamwe nabataye ishuri, kandi ibikorwa byapimwe kuburyo ibyateganijwe ibisubizo bihuye nogukwirakwiza amahugurwa.
Igipimo cyo guta p = 0.5 murwego bisobanura hafi iki mugihe cyamahugurwa?
Hamwe na p = 0.5 buri neuron ifite amahirwe 50% yo kuba zeru, ugereranije rero hafi kimwe cya kabiri cyamanutse kuri pass imbere.
Ni iki guta ishuri bikunze gusobanurwa nko kugereranya?
Gutoranya ibice bitandukanye-buri ntambwe igereranya impuzandengo yumubare ugereranije numubare uhuriweho-uburemere, uburyo bwo guhuza bihendutse.