Akarango Korohereza
Kworoshya ibirango nuburyo bworoshye bwo guhora bworoshya intego imwe yo guhugura, kubwira icyitegererezo igisubizo nyacyo birashoboka cyane ariko ntabwo ari ijana ku ijana.
Incamake
Kworoshya ibirango nuburyo bworoshye bwo guhora bworoshya intego imwe yo guhugura, kubwira icyitegererezo igisubizo nyacyo birashoboka cyane ariko ntabwo ari ijana ku ijana. Itezimbere kalibrasi na rusange mubishusho hamwe nururimi rwindimi hafi nta kiguzi cyinyongera.
Akarango Korohereza bicaye mubikoresho bya AI. Iyo ubisobanukiwe, izindi ngingo za AI zoroha gusuzuma no kugereranya.
Kwibira cyane
Mubisanzwe urutonde rwatojwe kumurongo umwe ushyushye: urwego rwukuri rubona intego 1.0 nibindi byose 0.0. Ufatanije na cross-entropy na softmax, ibi bisunika icyitegererezo kugirango logit iboneye ibe nini cyane kurenza iyindi, itera kwizerana birenze urugero. Ikirango cyoroheje gisimbuza intego na (1 - epsilon) kumurongo wukuri na epsilon / (K-1) ikwirakwira mubindi byiciro K, aho epsilon ari nto (muri rusange 0.1). Icyitegererezo noneho kigamije kwigirira icyizere-ariko-ntabwo-cyuzuye. Yinjijwe mubikorwa bya Inception-v3 2016 hanyuma isesengurwa nitsinda rya Hinton, byateje imbere ImageNet neza kandi birasanzwe muri Transformers, aho Icyitonderwa cyambere aricyo cyose ukeneye impapuro zikoreshwa epsilon ya 0.1.
Ubushishozi
Hamwe na labels zikomeye, kugabanya cross-entropy itwara logitike yukuri itagira iherezo ugereranije nabandi, ibyo ntibishoboka kandi bigatera uburemere bukabije. Korohereza gushiraho icyuho cyiza hagati yikigereranyo gikwiye nibindi bisigaye, bityo rero logit igumaho imipaka kandi moderi ihagarika kwigirira icyizere cyinshi. Ubushakashatsi bwerekana ibi bishimangira amatsinda amwe kandi bitanga umusaruro mwiza-uhindagurika, ibyiringiro byahanuwe bihuye nukuri. Urudandazwa: rushobora gusiba neza-hagati yamakuru-asa namakuru, rimwe na rimwe bikomeretsa ubumenyi bwo gutandukanya ubumenyi aho iyo mibanire yoroshye ifite akamaro.
Kumenyekanisha Ikirango Korohereza
Kugirango wubake byimbitse, fata Label Koroha nkicyitegererezo gikora, ntabwo ari ikintu kimwe. Sobanura ibyifuzwa, usobanure neza ibitekerezo, kandi utandukanye ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mubimenyerezo, amakipe akomeye akoresha Label Yoroheje yubaka icyitegererezo gikomeye cyambere, hanyuma ushushanye izo moderi kubibuza umusaruro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza. Igihe kimwe, Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
IshushoNet itondekanya: Inception-v3 yakoresheje label yoroshye (epsilon 0.1) kugirango izamure top-1 neza kandi igabanye kwigirira icyizere.
Ubusobanuro bwimashini: umwimerere wa Transformer washyizeho label yoroshye ya 0.1, ucuruza gato urujijo kumanota menshi ya BLEU.
Kumenyekanisha imvugo: intego zoroheje zigabanya kutizerana birenze urugero no kunoza kalibrasi kumajwi asakuza.
Uburyo bwo gufata amashusho yubuvuzi: koroshya gutanga umusaruro mwiza-wahinduwe neza, ingenzi mugihe amanota yicyizere amenyesha ibyemezo byubuvuzi.
Uburyo bwo Gushyira mu bikorwa
Akarango Korohereza imyitozo
IshushoNet itondekanya: Inception-v3 yakoresheje label yoroshye (epsilon 0.1) kugirango izamure top-1 neza kandi igabanye kwigirira icyizere.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Akarango Korohereza imyitozo
Ubusobanuro bwimashini: umwimerere wa Transformer washyizeho label yoroshye ya 0.1, ucuruza gato urujijo kumanota menshi ya BLEU.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Akarango Korohereza imyitozo
Kumenyekanisha imvugo: intego zoroheje zigabanya kutizerana birenze urugero no kunoza kalibrasi kumajwi asakuza.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Akarango Korohereza imyitozo
Uburyo bwo gufata amashusho yubuvuzi: koroshya gutanga umusaruro mwiza-wahinduwe neza, ingenzi mugihe amanota yicyizere amenyesha ibyemezo byubuvuzi.
Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Inyandiko aho Ikirango Korohereza bifasha nuburyo bworoshye bworoshye.
Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza Ubushakashatsi
Check your understanding
Test yourself: take the Label Smoothing quiz