Aha na-atọ ụtọ
Label smoothing bụ aghụghọ usoro nhazi dị mfe nke na-eme ka ebumnuche ọzụzụ na-ekpo ọkụ dị nro, na-agwa ihe nlereanya azịza ziri ezi nwere ike ịbụ mana ọ bụghị 100% ụfọdụ.
Nchịkọta
It improves calibration and generalization across image and language models with almost no extra cost.
Ime miri emi
Dịka ọ na-adịkarị, a na-azụ onye nhazi ọkwa n'otu akara ọkụ: ezi klaasị na-enweta ebumnuche 1.0 na ihe ọ bụla ọzọ 0.0. Ejikọtara ya na cross-entropy na softmax, nke a na-akpali ihe nlereanya ahụ iji mee ka logit ziri ezi buru ibu karịa ndị ọzọ, na-agba ume na-enweghị atụ na oke. Ntugharị akara aha na-eji (1 - epsilon) dochie ihe mgbaru ọsọ ahụ maka ezigbo klaasị na epsilon/(K-1) gbasaa gafee klaasị K ndị ọzọ, ebe epsilon dị ntakịrị (ọkachasị 0.1). Ihe nlereanya a na-achọ ugbu a maka nkesa obi ike-mana-abụghị nke zuru oke. Ewebata na 2016 Inception-v3 ọrụ ma mesịa nyochaa site na Hinton otu, ọ kwalite ImageNet ziri ezi na bụ ọkọlọtọ na Transformers, ebe mbụ Ntị bụ ihe niile ị chọrọ akwụkwọ eji epsilon nke 0.1.
Nghọta nka nka
N'iji akara ndị siri ike, ibelata cross-entropy na-eme ka logit ziri ezi gaa na njedebe dị mma gbasara ndị ọzọ, nke na-enweghị ike imezu ma na-ebuli ibu ruo oke. Ịdị nro na-esetịpụ oghere kachasị mma n'etiti logit ziri ezi na ndị ọzọ, ya mere logits na-adịgide adịgide na ihe nlereanya ahụ kwụsịrị inwe obi ike. Nnyocha na-egosi na nke a na-eme ka ụyọkọ otu klaasị sie ike ma na-emepụta ihe nwere ike ime nke ọma, ntụkwasị obi buru amụma na dabara adaba n'ezie. The tradeoff: ọ nwere ike ihichapụ ezi-grained n'etiti-klas ozi myirịta, nke mgbe ụfọdụ na-emerụ ihe ọmụma distillation ebe ndị ahụ dị nro mmekọrịta dị mkpa.
Mmetụta atụmatụ
Mkpebi doro anya
Ọ na-enyere gị aka ikewapụta nkwupụta ọrụ aka doro anya na asụsụ ahịa.
Ọnụ ego na mmefu ego
Ị nwere ike ịjụ ajụjụ mmejuputa iwu ka mma tupu itinye ego ma ọ bụ oge.
Team na usoro ọrụ
Ndị otu nwere nghọta na-eme ka ngwaahịa, amụma na mkpebi mmụta ka mma.
Ọdịnihu nke Label Smoothing
Ịdị nro labelụ ka bụ ihe ndabara na ọzụzụ buru ibu, mana nyocha na-aga n'ihu n'ịgbanwe ma mụta ire ụtọ nke na-edozi epsilon kwa ihe atụ ma ọ bụ klaasị kama iji otu uru dị larịị. Ụzọ lekwasịrị anya nlebara anya dị ka mfufocal na mbelata okpomọkụ na-ejikarị ma ọ bụ jikọta ya na ya. Ka ụdị na-eto eto na atụmatụ ejighị n'aka nke a pụrụ ịdabere na ya na-aghọ ihe nchekwa dị oke mkpa, na-atụ anya ka smoothing bụrụ otu ngwá ọrụ n'etiti ọtụtụ ndị na-emepụta akara ntụkwasị obi a pụrụ ịtụkwasị obi, na-eleba anya nke ọma na esemokwu ya na distillation mara mma.
Mmejuputa n'ezie n'ụwa
Nkewa ImageNet: Inception-v3 ejiri akara smoothing mee ihe (epsilon 0.1) iji kwalite izizi-1 ma belata oke obi ike.
Ntụgharị asụsụ igwe: Transformer izizi etinyere akara nrịbama nke 0.1, na-azụta ntakịrị mgbagwoju anya maka akara BLEU dị elu.
Nchọpụta okwu: ebumnobi emezigharị na-ebelata nnabata enweghị ntụkwasị obi gabigara ya ma kwalite nhazi ụda olu mkpọtụ.
Ụdị onyogho ahụike: ire ụtọ na-arụpụta ihe puru omume nke ọma, dị mkpa mgbe akara ntụkwasị obi na-agwa mkpebi ụlọ ọgwụ.
Ihe ize ndụ & okporo ụzọ nche
Otu dị iche iche nwere ike iji otu okwu ahụ mee ihe n'ụzọ dị iche, yabụ kọwapụta oge n'oge.
Ihe nrịbama nwere ike ịdị ike ebe arụmọrụ ụwa na-adaghị adaba.
Ileghara ogo data na atụmatụ nyocha anya na-emepụtakarị nsonaazụ na-adịghị mma.
Map mmejuputa
Malite na nkọwa asụsụ dị larịị nke nsonaazụ ịchọrọ.
Họrọ otu metrik ịga nke ọma na otu ọnọdụ ọdịda tupu nnwale.
Gbaa obere onye na-anya ụgbọ elu nwere data nnọchite anya, ọ bụghị ihe ngosi ngosi na-egbu maramara.
Detuo ebe Label Smoothing na-enyere aka yana ebe ụzọ ndị dị mfe dị mma.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Label Smoothing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
K- pụtara ụyọkọ
Ajụjụ a na-ajụkarị
What is Label Smoothing?
Label smoothing bụ aghụghọ usoro nhazi dị mfe nke na-eme ka ebumnuche ọzụzụ na-ekpo ọkụ dị nro, na-agwa ihe nlereanya azịza ziri ezi nwere ike ịbụ mana ọ bụghị 100% ụfọdụ. Ọ na-eme ka nhazi na nchikota n'ofe onyonyo na ụdị asụsụ na-enweghị ego ọ bụla.
Kedu ihe na-agbanwe labelụ smoothing gbasara ebumnuche ọzụzụ?
Kama ebumnuche 1.0/0.0 siri ike, denye aha smoothing (1 - epsilon) na klaasị nke ọma wee gbasaa epsilon n'ofe ndị ọzọ.
Kedu nsogbu na akara otu ọkụ siri ike na-eme adreesị ire ụtọ?
Ibelata cross-entropy na ebumnuche na-ekpo ọkụ na-ebute ụzọ ziri ezi na enweghị njedebe n'ebe ndị ọzọ nọ, na-agba ume oke obi ike na imebiga ihe ókè.
Kedu ihe owuwu ala ama ama nyere aka na-ewulite akara ngosi?
Ewebatara akara ire ụtọ na akwụkwọ 2016 Inception-v3 wee nakweere Transformer (Ntị bụ ihe niile ị chọrọ) na epsilon 0.1.
E wezụga izi ezi, kedu uru a na-eji ire ụtọ labelụ mara?
Ịdị nro na-eme ka nhazigharị dịkwuo mma, ntụkwasị obi e buru n'amụma dabara nke ọma na ohere nke ịbụ eziokwu.
Kedu ihe edekọla n'akụkụ ala nke labelụ smoothing?
Site na imechi ụyọkọ na ime ka mmekọrịta dị nro dị n'etiti klaasị, ịhịa aka n'ahụ nwere ike wepu ozi nke nhụsianya ihe ọmụma dabere na ya.