Akarango Korohereza
Kworoshya ibirango nuburyo bworoshye bwo guhora bworoshya intego imwe yo guhugura, kubwira icyitegererezo igisubizo nyacyo birashoboka cyane ariko ntabwo ari ijana ku ijana.
Incamake
It improves calibration and generalization across image and language models with almost no extra cost.
Kwibira cyane
Mubisanzwe urutonde rwatojwe kumurongo umwe ushyushye: urwego rwukuri rubona intego 1.0 nibindi byose 0.0. Ufatanije na cross-entropy na softmax, ibi bisunika icyitegererezo kugirango logit iboneye ibe nini cyane kurenza iyindi, itera kwizerana birenze urugero. Ikirango cyoroheje gisimbuza intego na (1 - epsilon) kumurongo wukuri na epsilon / (K-1) ikwirakwira mubindi byiciro K, aho epsilon ari nto (muri rusange 0.1). Icyitegererezo noneho kigamije kwigirira icyizere-ariko-ntabwo-cyuzuye. Yinjijwe mubikorwa bya Inception-v3 2016 hanyuma isesengurwa nitsinda rya Hinton, byateje imbere ImageNet neza kandi birasanzwe muri Transformers, aho Icyitonderwa cyambere aricyo cyose ukeneye impapuro zikoreshwa epsilon ya 0.1.
Ubushishozi
Hamwe na labels zikomeye, kugabanya cross-entropy itwara logitike yukuri itagira iherezo ugereranije nabandi, ibyo ntibishoboka kandi bigatera uburemere bukabije. Korohereza gushiraho icyuho cyiza hagati yikigereranyo gikwiye nibindi bisigaye, bityo rero logit igumaho imipaka kandi moderi ihagarika kwigirira icyizere cyinshi. Ubushakashatsi bwerekana ibi bishimangira amatsinda amwe kandi bitanga umusaruro mwiza-uhindagurika, ibyiringiro byahanuwe bihuye nukuri. Urudandazwa: rushobora gusiba neza-hagati yamakuru-asa namakuru, rimwe na rimwe bikomeretsa ubumenyi bwo gutandukanya ubumenyi aho iyo mibanire yoroshye ifite akamaro.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Kazoza ka Label Koroha
Ikirango cyoroheje gikomeza kuba indashyikirwa mumahugurwa manini, ariko ubushakashatsi bugenda bwerekeza kumihindagurikire kandi yize yoroshye ihindura epsilon kurugero cyangwa ishuri aho gukoresha agaciro kamwe. Uburyo bwibanze bwa Calibration nko gutakaza kwibanda hamwe no gupima ubushyuhe akenshi bipimwa cyangwa bigahuzwa nabyo. Mugihe icyitegererezo gikura kandi ikigereranyo kidashidikanywaho kigereranywa n’umutekano, tegereza koroshya kuba igikoresho kimwe muri benshi kugirango batange amanota yizewe, witondere neza amakimbirane azwi no kubeshya.
Gushyira mu bikorwa Isi
IshushoNet itondekanya: Inception-v3 yakoresheje label yoroshye (epsilon 0.1) kugirango izamure top-1 neza kandi igabanye kwigirira icyizere.
Ubusobanuro bwimashini: umwimerere wa Transformer washyizeho label yoroshye ya 0.1, ucuruza gato urujijo kumanota menshi ya BLEU.
Kumenyekanisha imvugo: intego zoroheje zigabanya kutizerana birenze urugero no kunoza kalibrasi kumajwi asakuza.
Uburyo bwo gufata amashusho yubuvuzi: koroshya gutanga umusaruro mwiza-wahinduwe neza, ingenzi mugihe amanota yicyizere amenyesha ibyemezo byubuvuzi.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Ikirango Korohereza bifasha nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Label Smoothing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
K-Bisobanura
Ibibazo bikunze kubazwa
What is Label Smoothing?
Kworoshya ibirango nuburyo bworoshye bwo guhora bworoshya intego imwe yo guhugura, kubwira icyitegererezo igisubizo nyacyo birashoboka cyane ariko ntabwo ari ijana ku ijana. Itezimbere kalibrasi na rusange mubishusho hamwe nururimi rwindimi hafi nta kiguzi cyinyongera.
Niki ikirango cyoroshya gihindura intego zamahugurwa?
Aho kugirango intego igoye 1.0 / 0.0, ikirango cyorohereza umukoro (1 - epsilon) kumurongo wukuri kandi ikwirakwiza epsilon mubindi.
Ni ikihe kibazo kijyanye na label imwe ishyushye ikora neza?
Kugabanya cross-entropy ku ntego imwe ishyushye itera logitike yukuri itagira iherezo ugereranije nabandi, itera kwizerana birenze urugero.
Nibihe bimenyetso byububiko byafashaga kumenyekanisha label yoroshye?
Kuringaniza ibirango byatangijwe mu mpapuro za Inception-v3 2016 kandi byemejwe na Transformer (Icyitonderwa nicyo ukeneye) hamwe na epsilon 0.1.
Usibye kuba inyangamugayo, ni izihe nyungu label yoroshye izwi?
Korohereza kunoza kalibrasi, ibyiringiro byahanuwe bihuza neza cyane nukuri ko bishoboka.
Niki cyanditse nabi cyerekana label yoroshye?
Mugukomeza cluster no gusibanganya umubano woroshye hagati yamasomo, koroshya birashobora gukuraho amakuru gusibanganya ubumenyi bishingiye.