Calaamadee jilicsanaan
Summaynta summadadu waa khiyaamo joogto ah oo fudud oo jilcisa yoolalka tababbarka adag ee hal-kulul, u sheegidda tusaalaha jawaabta saxda ah waxay u badan tahay laakiin boqolkiiba 100 lama hubo.
Dulmar
It improves calibration and generalization across image and language models with almost no extra cost.
quusid qoto dheer
Caadiyan kala saaruhu waxa lagu tababaraa summada hal-kulul: fasalka runta ahi waxa uu helaa bartilmaameed 1.0 iyo wax kasta oo kale 0.0. Marka lagu daro cross-entropy iyo softmax, tani waxay riixeysaa moodalka si uu u sameeyo logit sax ah mid aan xad lahayn oo ka weyn inta kale, dhiirigelinta kalsoonida xad dhaafka ah iyo xad dhaafka ah. Summaynta summadaha waxay ku beddeshaa bartilmaameedka (1 - epsilon) ee fasalka runta ah iyo epsilon/(K-1) oo ku faafay fasallada kale ee K, halkaasoo epsilon uu yar yahay (caadi ahaan 0.1). Qaabka hadda wuxuu higsanayaa qaybin kalsooni-laakin-aan- dhammaystirnayn. Waxaa lagu soo bandhigay shaqada Inception-v3 ee 2016 oo markii dambe ay falanqeeyeen kooxda Hinton, waxay wanaajisay saxnaanta ImageNet waxayna tahay halbeegga Transformers, halkaasoo dareenka asalka ah uu yahay Dhammaan waxaad u baahan tahay warqad loo isticmaalo epsilon of 0.1.
Aragtida Farsamada
Iyada oo leh calaamado adag, yaraynta iskutallaabta-entropy waxay u kaxaysaa logit saxda ah ee ku wajahan xad la'aanta togan marka loo eego kuwa kale, taas oo aan la gaari karin oo culeyska ku riixeysa meel fog. Silsixintu waxay dejisaa farqi aad u wanaagsan oo u dhexeeya sagxadda saxda ah iyo inta soo hartay, sidaas darteed saqafka ayaa xaddidan oo moodeelku wuxuu joojiyaa kalsoonida ugu badan. Daraasaduhu waxay muujinayaan in tani ay adkaynayso kooxo isku fasal ah oo ay soo saartaa ixtimaalka si ka wanaagsan loo saxay, kalsoonida la saadaaliyayna waxay la mid tahay saxnaanta dhabta ah. Kala-soocidda: waxay tirtiri kartaa macluumaadka isku midka ah ee u dhexeeya-fasalka, taas oo mararka qaarkood dhaawacdo aqoon-is-weydaarsiga halka cilaaqaadka jilicsani muhiim u yahay.
Saamaynta Istiraatijiyadeed
Go'aamo cad
Waxay kaa caawinaysaa inaad kala saartid sheegashooyinka farsamada cad iyo luqadda suuq-geynta.
Qiimaha iyo miisaaniyada
Waxaad waydiin kartaa su'aalo fulineed oo wanaagsan ka hor inta aadan lacag ama waqti bixin.
Kooxda iyo socodka shaqada
Kooxaha fahamka la wadaago waxay sameeyaan wax soo saar, siyaasad, iyo go'aano waxbarasho oo wanaagsan.
Mustaqbalka Summada Dabiiciga ah
Summaynta summadaha ayaa weli ah mid aan ku habboonayn tababbarka ballaaran, laakiin cilmi-baaristu waxay u socotaa la qabsiga oo la bartay simayn taasoo hagaajinaysa epsilon tusaale ahaan ama fasalka halkii la isticmaali lahaa hal qiime siman. Hababka diiradda saaraya wax-soo-saarka sida luminta focal iyo heerkulka heerkulka ayaa inta badan lagu miisaamaa ama lagu daraa. Marka moodalku koraan oo qiyaasaha hubin la'aanta la isku halayn karo ay noqdaan kuwo badbaado-muhiim ah, filo in fududayntu ay noqoto mid ka mid ah aaladaha qaar badan oo ka mid ah soo saarista buundooyinka kalsoonida lagu kalsoonaan karo, iyada oo fiiro gaar ah loo leeyahay iskahorimaadka la og yahay ee distillation.
Dhaqangelinta Adduunka-dhabta ah
Kala soocidda ImageNet: Inception-v3 waxay adeegsatay summaynta fududaynta (epsilon 0.1) si kor loogu qaado saxnaanta-1 sare loona yareeyo kalsoonida xad dhaafka ah.
Turjumaada mashiinka: Transformer-kii asalka ahaa ayaa lagu dabaqay sumadda fududaynta ee 0.1, ka ganacsiga jaahwareerka yar ee buundooyinka BLEU sare.
Aqoonsiga hadalka: bartilmaameedyada la simay waxay yareeyaan kalsooni-darrada xad-dhaafka ah waxayna wanaajiyaan habaynta maqalka buuqa badan.
Moodooyinka sawir-qaadista caafimaadka: fududayntu waxay soo saartaa ixtimaalka si ka wanaagsan loo cabbiray, oo muhiim ah marka buundada kalsoonida ay ku wargeliso go'aamada caafimaad.
Khatarta & Dariiqyada Ilaalada
Kooxo kala duwan ayaa laga yaabaa inay isla erey u isticmaalaan si kala duwan, marka hore u qeex baaxadda.
Tilmaamaha ayaa u ekaan kara kuwo xooggan halka waxqabadka dhabta ah ee dunidu aanu sinnayn.
In la iska indho tiro tayada xogta iyo qorshayaasha qiimayntu waxay inta badan abuurtaa natiijooyin jilicsan.
Qorshe Hawleedka Dhaqangelinta
Ka bilow qeexidda luqadda cad ee natiijada aad u baahan tahay.
Dooro hal cabbir guusha iyo hal xaalad guuldarro ka hor tijaabada.
Ku orod duuliye yar oo wata xogta matale, ee ma aha bandhig muuqaal ah.
Dukumeenti meesha ay ka caawiso summada jilicsanaanta iyo meelaha hababka fudud ay ka fiican yihiin.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Label Smoothing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
K-Waxaa loola jeedaa Kutlada
Su'aalaha soo noqnoqda
What is Label Smoothing?
Summaynta summadadu waa khiyaamo joogto ah oo fudud oo jilcisa yoolalka tababbarka adag ee hal-kulul, u sheegidda tusaalaha jawaabta saxda ah waxay u badan tahay laakiin boqolkiiba 100 lama hubo. Waxay wanaajisaa isku-habaynta iyo guud-ahaaneed guud ahaan sawirada iyo moodooyinka luqadda iyada oo aan wax kharash dheeraad ah lahayn.
Waa maxay calaamadaynta fududaynta isbeddelka ku saabsan yoolalka tababarka?
Halkii aad ka lahaan lahayd bartilmaameed adag 1.0/0.0, ku calaamadee silbashada (1-epsilon) fasalka runta ah oo ku faafi epsilon kuwa kale.
Waa maxay dhibka leh summada hal-kulul ee adag ayaa ciwaanka fududayntu ka qabtaa?
Yaraynta iskutallaabta-entropy ee bartilmaameedyada hal-kulul waxay u kaxaysaa logtiga saxda ah xagga xad-dhaafka marka loo eego kuwa kale, dhiirigelinta kalsoonida xad-dhaafka ah iyo ku-habboonaanta.
Waa kuwee qaab-dhismeedyada caanka ah ee ka caawiyay in ay caan ku noqdaan summaynta?
Summeynta summadaha waxaa lagu soo bandhigay warqadda Inception-v3 ee 2016 waxaana qaatay Transformer (fiiri waa dhammaan waxaad u baahan tahay) oo leh epsilon 0.1.
Saxnimada ka sokoow, waa maxay faa'iidada sumadaynta sifaynta loo yaqaan?
Silsixintu waxay wanaajisaa jaangooyooyinka, kalsoonida la saadaaliyay waxay si aad ah ugu dhowdahay suurtagalnimada dhabta ah ee saxnaanta.
Waa maxay dhinaca hoose ee la diiwaan galiyay ee summada fududaynta?
Adigoo adkaynaya rucubyada oo la simay cilaaqaadka jilicsan ee u dhexeeya fasallada, fududayntu waxay meesha ka saari kartaa macluumaadka ay aqoontu ku tiirsan tahay.