Ibitonyanga hamwe na Stochastic Regularisation
Dropout ni amayeri asanzwe azimya byanze bikunze igice cya neuron muri buri ntambwe yo guhugura, guhatira umuyoboro kubaka ibishushanyo mbonera, bikomeye.
Incamake
Dropout ni amayeri asanzwe azimya byanze bikunze igice cya neuron muri buri ntambwe yo guhugura, guhatira umuyoboro kubaka ibishushanyo mbonera, bikomeye. Yabaye bumwe mu buryo bukomeye bwo kurwanya birenze urugero mu myigire yimbitse.
Ibitonyanga hamwe na Stochastic Regularisation bicaye mubikoresho bya AI. Iyo ubisobanukiwe, izindi ngingo za AI zoroha gusuzuma no kugereranya.
Kwibira cyane
Byatangijwe nitsinda rya Hinton ahagana mu mwaka wa 2012, abata ishuri bakemura intege nke zingenzi zurusobe runini: neuron irashobora gufatanya, kwiga gukosora amakosa ya buri wese muburyo bukora gusa kumyitozo. Kuri buri cyiciro cyimbere mugihe cyamahugurwa, abata ishuri bashiraho buri neuron ibisohoka kuri zeru hamwe nibishoboka p (akenshi 0.5 mubice byuzuye). Kuberako neuron iyariyo yose ishobora gucika, umuyoboro ntushobora gushingira kubufatanye bworoshye kandi ugomba gukwirakwiza amakuru yingirakamaro mubice byinshi. Ibi bikora nko guhugura itsinda rinini ryimiyoboro isangiye uburemere. Mugihe cyibizamini guta ishuri bizimya kandi umuyoboro wuzuye urakoreshwa, hamwe nibikorwa byapimwe kuburyo ibyateganijwe gusohoka bihuye namahugurwa. Ibisubizo mubisanzwe nibyiza muri rusange kubiciro byamahugurwa maremare.
Ubushishozi
Mugihe cy'amahugurwa buri gice kibikwa hamwe nibishoboka (1 ukuyemo p) ukoresheje mask ya binary idasanzwe, bityo imiyoboro itandukanye itangwa buri cyiciro. Ibikorwa bigezweho bifashisha guta ishuri: ibikorwa byo kurokoka bigabanijwe na (1 ukuyemo p) mugihe cya gari ya moshi, kubwibyo ntagipimo gikenewe muguhitamo. Uku guhitamo gutera urusaku rubuza guhuza n'imihindagurikire y'ikirere kandi ugereranya impuzandengo ugereranije n'umubare utagereranywa w'isanganya-uburemere-buke, uburyo buhendutse bwo guterana.
Kumenyereza Ibitonyanga no Guhindura Stochastic
Kugirango wubake byimbitse, fata Dropout na Stochastic Regularisation nkicyitegererezo gikora, ntabwo ari ikintu kimwe. Sobanura ibyifuzwa, usobanure neza ibitekerezo, kandi utandukanye ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mubimenyerezo, amakipe akomeye akoresha Dropout na Stochastic Regularisation yubaka icyitegererezo gikomeye cyibitekerezo, hanyuma agashushanya izo moderi kubibuza umusaruro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza. Igihe kimwe, Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Ongeraho Dropout layer hamwe na p hafi 0.5 hagati yuburyo bwuzuye bwishusho cyangwa inyandiko itondekanya muri PyTorch cyangwa Keras
Moderi ya moderi ikoresha guta ibitekerezo kuburemere no kugaburira-ibikorwa mbere yo kwitegura
Monte Carlo yataye ishuri, aho abata ishuri bagumaho kugirango batange igereranyo kidashidikanywaho kubuvuzi cyangwa umutekano uhungabana
Ubujyakuzimu butajegajega (DropPath) bidasubirwaho gusimbuka ibisigisigi kugirango uhuze imiyoboro yimbitse cyane nka ResNets hamwe na transformateur iyerekwa
Uburyo bwo Gushyira mu bikorwa
Kureka Ibitonyanga no Guhora mubikorwa
Ongeraho Dropout layer hamwe na p hafi 0.5 hagati yubucucike bwishusho cyangwa inyandiko itondekanya muri PyTorch cyangwa Keras.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Kureka Ibitonyanga no Guhora mubikorwa
Moderi ya moderi ikoresha guta ibitekerezo kuburemere no kugaburira-ibikorwa mbere yo kwitegura.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Kureka Ibitonyanga no Guhora mubikorwa
Monte Carlo yataye ishuri, aho abata ishuri bagumaho kugirango batange igereranyo kidashidikanywaho kubuvuzi cyangwa umutekano uhungabana.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Kureka Ibitonyanga no Guhora mubikorwa
Ubujyakuzimu butajegajega (DropPath) bidasubirwaho gusimbuka ibisigisigi kugirango uhuze imiyoboro yimbitse cyane nka ResNets hamwe na transformateur iyerekwa.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Inyandiko aho Dropout na Stochastic Regularisation ifasha kandi nuburyo bworoshye bworoshye.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza Ubushakashatsi
Check your understanding
Test yourself: take the Dropout and Stochastic Regularization quiz