Lakabin Smooting
Label smoothing dabaru ne mai sauƙi na daidaitawa wanda ke tausasa maƙasudin horarwa mai zafi guda ɗaya, gaya wa ƙirar amsar daidai tana da yuwuwar amma ba tabbas 100%.
Dubawa
It improves calibration and generalization across image and language models with almost no extra cost.
Zurfafa nutsewa
Yawanci ana horar da mai rarrabawa akan lakabi masu zafi guda ɗaya: aji na gaskiya yana samun manufa 1.0 da komai kuma 0.0. Haɗe tare da giciye-entropy da softmax, wannan yana tura ƙirar don yin daidaitaccen logit ɗin da ba shi da iyaka fiye da sauran, yana ƙarfafa amincewa da wuce gona da iri. Lakabin santsi yana maye gurbin manufa tare da (1 - epsilon) don ajin gaskiya da epsilon/(K-1) ya bazu ko'ina cikin sauran azuzuwan K, inda epsilon yayi ƙarami (yawanci 0.1). Samfurin yanzu yana nufin ingantaccen rarrabawa amma ba cikakke ba. An gabatar da shi a cikin aikin 2016 Inception-v3 kuma daga baya ƙungiyar Hinton ta bincikar ta, ta inganta daidaiton ImageNet kuma daidai ne a cikin Transformers, inda ainihin Hankali shine Duk abin da kuke buƙata takarda da aka yi amfani da epsilon na 0.1.
Fahimtar Fasaha
Tare da takalmi masu wuya, rage girman giciye-entropy yana tafiyar da madaidaicin logit zuwa ingantacciyar ƙarancin dangi ga wasu, wanda ba zai yuwu ba kuma yana tura ma'auni zuwa iyaka. Smoothing yana saita mafi ƙarancin tazara tsakanin madaidaicin logit da sauran, don haka logits suna da iyaka kuma ƙirar ta daina kasancewa da ƙarfin gwiwa. Nazarin ya nuna wannan yana ƙarfafa tari-aji ɗaya kuma yana samar da ingantattun yuwuwar daidaitawa, amincewa da annabta yayi daidai da ainihin daidaito. Cinikin ciniki: yana iya goge bayanan kamanni masu kyau tsakanin aji, wanda wani lokaci yana cutar da ilimin sanin inda waɗannan alakoki masu laushi ke da mahimmanci.
Dabarun Tasiri
Shawarwari masu haske
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Kudin da kasafin kuɗi
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Ƙungiya da aikin aiki
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Makomar Label Smoothing
Sliming label ɗin ya kasance tsoho a cikin babban horo, amma bincike yana motsawa zuwa daidaitawa da koyan santsi wanda ke daidaita epsilon kowane misali ko aji maimakon amfani da ƙima guda ɗaya. Hanyoyin da aka mayar da hankali kan daidaitawa kamar asara mai da hankali da ma'aunin zafin jiki galibi ana auna su ko a haɗe su. Yayin da samfura ke girma da kuma amintattun ƙididdiga marasa tabbas sun zama mahimmin aminci, tsammanin smoothing ya zama kayan aiki ɗaya a tsakanin mutane da yawa don samar da amintattun ƙididdiga, tare da kulawa da hankali ga sanannen rikici tare da distillation.
Aiwatar da Gaskiyar Duniya
Rarraba ImageNet: Ƙaddamarwa-v3 yayi amfani da alamar santsi (epsilon 0.1) don haɓaka daidaito na sama-1 da rage ƙarfin zuciya.
Fassarar na'ura: asalin Transformer ɗin da aka yi amfani da alamar santsi na 0.1, yana cinikin ɗan ruɗani don mafi girman maki BLEU.
Gane magana: maƙasudai masu santsi suna rage ƙima da ƙima da haɓaka ƙima akan sauti mai hayaniya.
Samfuran Hoto na likitanci: smoothing yana haifar da ingantattun yuwuwar ƙima, mahimmanci lokacin da ƙimar amincewa ta sanar da yanke shawara na asibiti.
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Takaddun inda Label Smoothing ke taimakawa kuma inda mafi sauƙi hanyoyin suka fi kyau.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Label Smoothing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
K-Ma'anar Tari
Tambayoyin da ake yawan yi
What is Label Smoothing?
Label smoothing dabaru ne mai sauƙi na daidaitawa wanda ke tausasa maƙasudin horarwa mai zafi guda ɗaya, gaya wa ƙirar amsar daidai tana da yuwuwar amma ba tabbas 100%. Yana haɓaka haɓakawa da haɓakawa a cikin ƙirar hoto da harshe ba tare da kusan ƙarin farashi ba.
Menene canji mai laushi game da maƙasudin horo?
Maimakon maƙasudin 1.0/0.0 mai wuya, lakabin smoothing yana sanya (1 - epsilon) zuwa aji na gaskiya kuma yana yada epsilon a kan sauran.
Wace matsala tare da lakabi masu zafi guda ɗaya ke da adireshin smoothing?
Rage giciye-entropy akan maƙasudai masu zafi guda ɗaya yana fitar da madaidaicin logit zuwa ga rashin iyaka dangane da wasu, yana ƙarfafa wuce gona da iri da wuce gona da iri.
Waɗanne gine-ginen gine-ginen ƙasa ne suka taimaka wajen haɓaka alamar santsi?
An gabatar da alamar santsi a cikin takardar Inception-v3 na 2016 kuma Mai Canjawa (Hankali Shine Duk Abinda kuke Bukata) ya karɓa tare da epsilon 0.1.
Bayan daidaito, wane fa'ida aka sani da santsin alamar?
Santsi yana inganta daidaitawa, amincewar da aka annabta ta yi daidai da yuwuwar zama daidai.
Menene bayanan da aka rubuta na alamar santsi?
Ta hanyar ƙulla tari da ɓata lallausan alaƙa tsakanin azuzuwan, sassauƙa na iya cire bayanan da ƙwaƙƙwaran ilimi ya dogara da su.