HejuruUbuyobozi bukurikira
Stochastic Gradient Kumanuka hamwe na Momentum
Ibyingenzi
AMABWIRIZA Yibanze
Dropout ni amayeri asanzwe azimya byanze bikunze igice cya neuron muri buri ntambwe yo guhugura, guhatira umuyoboro kubaka ibishushanyo mbonera, bikomeye.
Umva iki gitaboAI-byavuzwe · ~2 min
It became one of the most influential techniques for fighting overfitting in deep learning.
Byatangijwe nitsinda rya Hinton ahagana mu mwaka wa 2012, abata ishuri bakemura intege nke zingenzi zurusobe runini: neuron irashobora gufatanya, kwiga gukosora amakosa ya buri wese muburyo bukora gusa kumyitozo. Kuri buri cyiciro cyimbere mugihe cyamahugurwa, abata ishuri bashiraho buri neuron ibisohoka kuri zeru hamwe nibishoboka p (akenshi 0.5 mubice byuzuye). Kuberako neuron iyariyo yose ishobora gucika, umuyoboro ntushobora gushingira kubufatanye bworoshye kandi ugomba gukwirakwiza amakuru yingirakamaro mubice byinshi. Ibi bikora nko guhugura itsinda rinini ryimiyoboro isangiye uburemere. Mugihe cyibizamini guta ishuri bizimya kandi umuyoboro wuzuye urakoreshwa, hamwe nibikorwa byapimwe kuburyo ibyateganijwe gusohoka bihuye namahugurwa. Ibisubizo mubisanzwe nibyiza muri rusange kubiciro byamahugurwa maremare.
Ongeraho Dropout layer hamwe na p hafi 0.5 hagati yuburyo bwuzuye bwishusho cyangwa inyandiko itondekanya muri PyTorch cyangwa Keras
Moderi ya moderi ikoresha guta ibitekerezo kuburemere no kugaburira-ibikorwa mbere yo kwitegura
Monte Carlo yataye ishuri, aho abata ishuri bagumaho kugirango batange igereranyo kidashidikanywaho kubuvuzi cyangwa umutekano uhungabana
Ubujyakuzimu butajegajega (DropPath) bidasubirwaho gusimbuka ibisigisigi kugirango uhuze imiyoboro yimbitse cyane nka ResNets hamwe na transformateur iyerekwa
Mu miyoboro y'icyerekezo cyemeza, icyiciro gisanzwe cyimuye ahanini abata ishuri, ariko impinduka zitera imbere ahandi: abahindura bahindura ibitonyanga kubitekerezo no kugaburira imbere, kandi DropPath (ubujyakuzimu bwa stochastique) ita ibisigisigi byose bisigaye. Monte Carlo yataye ishuri, ikomeza guta ishuri ikora, ikoreshwa mukugereranya icyitegererezo kidashidikanywaho. Witegereze ko ibintu bisanzwe bizakomeza kuba ibikoresho byoroshye, byahujwe na buri nyubako aho kuba resept imwe ihamye.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Dropout ni amayeri asanzwe azimya byanze bikunze igice cya neuron muri buri ntambwe yo guhugura, guhatira umuyoboro kubaka ibishushanyo mbonera, bikomeye. Yabaye bumwe mu buryo bukomeye bwo kurwanya birenze urugero mu myigire yimbitse.
Kureka bidasubirwaho zeru buri neuron hamwe nibishoboka p mugihe cy'amahugurwa, bityo rero sub-neti itandukanye yoroheje ikoreshwa buri ntambwe.
Mugukuraho kubushake ibice, guta ishuri bihagarika neuron gukora ubufatanye bworoshye bukora gusa kumyitozo yamahugurwa, kunoza imbaraga.
Mugusuzumisha urusobe rwuzuye rukora hamwe nabataye ishuri, kandi ibikorwa byapimwe kuburyo ibyateganijwe ibisubizo bihuye nogukwirakwiza amahugurwa.
Hamwe na p = 0.5 buri neuron ifite amahirwe 50% yo kuba zeru, ugereranije rero hafi kimwe cya kabiri cyamanutse kuri pass imbere.
Gutoranya ibice bitandukanye-buri ntambwe igereranya impuzandengo yumubare ugereranije numubare uhuriweho-uburemere, uburyo bwo guhuza bihendutse.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Stochastic Gradient Kumanuka hamwe na Momentum
Ibyingenzi