Ƙididdigar ƙima
Ƙididdigar ƙididdigewa tana haifar da rubutu mai inganci ta hanyar rage ɗabi'un ƙaramin ƙirar harshe mai rauni daga na babba, mai ƙarfi.
Dubawa
It amplifies what the expert knows and the amateur misses, reducing repetition and bland output.
Zurfafa nutsewa
Lokacin da samfurin harshe ya ɗauki kalma ta gaba, yana samar da yuwuwar akan ƙamus ɗinsa. Ƙididdigar ƙididdigewa (wanda Li et al. ya gabatar a cikin 2022) yana gudanar da samfura biyu akan mahallin guda: babban 'gwani' da ƙaramin 'mai son'. Maimakon aminta da ɗanyen yuwuwar ƙwararrun, yana ƙididdige alamar kowane ɗan takara da bambanci tsakanin yuwuwar ƙwararren da mai son. Alamar ƙwararren ya fi so amma mai son ba ya samun haɓaka; Kalmomi na gama-gari duka nau'ikan suna son (kamar 'da'' ko maimaita jimlolin) suna danne, tunda mai son yana son su ma. Tace mai kyawu ta farko tana watsar da alamun da ƙwararrun ke ganin ba za su yi yuwuwa ba, don haka bambanci baya haɓaka maganar banza. Sakamakon ya fi dacewa, daidaitacce, kuma mafi ƙarancin rubutu mai tsayi fiye da ƙima ko samfurin tsakiya, ba tare da ƙarin horo da ake buƙata ba.
Fahimtar Fasaha
Babban makin shine log p_expert(alama) ban da adadin lokuta log p_amateur(alama). Saboda mai son yana raba kurakuran tsararrun ƙwararrun (wanda ke da alaƙa da manyan mitoci, madauki, maimaituwa mai lalacewa), cire yuwuwar log ɗin sa yana soke waɗannan hanyoyin gazawar da aka raba tare da kiyaye ingantaccen ilimin ƙwararru. Ƙuntataccen daidaitawa na daidaitawa yana kiyaye alamun kawai sama da juzu'i (alpha) na babban yuwuwar ƙwararru, yana hana bambanci daga ƙarawa da wuya, kalmomi marasa daidaituwa.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Ƙaddamar da Ƙaddamarwa
Ƙididdigar bambance-bambancen ya yi wahayi zuwa ga dangi na 'bambanta bisa ga hanyoyin', ciki har da DoLa (wanda ya bambanta da farkon abin ƙira da ƙarshen yadudduka don yanke hallucination) da bambance-bambancen fahimtar mahallin da ya bambanta da kuma ba tare da dawo da takaddun ba. Yi tsammanin haɗin kai tare da maidowa, ƙimar gaskiya, da ƙarami mai son distillation, da haɗin kai tare da ƙididdige ƙima don haka mai son duka yana sarrafa inganci kuma yana haɓaka tsarawa lokaci guda.
Aiwatar da Gaskiyar Duniya
Ƙirƙirar dogon labari, ba maimaituwa ba ko ci gaba na labarin inda samfurin tsakiya ya shiga cikin madaukai.
Haɗa ƙwararren 65B tare da mai son 1.5B don haɓaka tsararrun buɗe ido ba tare da daidaitawa ba.
Rage maimaita lalacewa a cikin taƙaitawa da abubuwan tattaunawa
Yin hidima azaman tushen bambance-bambancen salon DoLa don rage hasashe na gaskiya
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Contrastive Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Ƙididdigar Haɗarin Bayes mafi ƙarancin
Tambayoyin da ake yawan yi
What is Contrastive Decoding?
Ƙididdigar ƙididdigewa tana haifar da rubutu mai inganci ta hanyar rage ɗabi'un ƙaramin ƙirar harshe mai rauni daga na babba, mai ƙarfi. Yana haɓaka abin da ƙwararren ya sani kuma mai son ya ɓace, yana rage maimaitawa da fitowar mara kyau.
A cikin rarrabuwar kawuna, wace rawa ƙaramin samfurin 'mai son' ke takawa?
An cire yuwuwar log ɗin mai son daga na ƙwararru, yana soke kurakurai na tsari (kamar fifita alamu akai-akai) waɗanda samfuran biyu ke rabawa.
Me yasa rage yuwuwar mai son yana rage maimaitawa da fitowar mara kyau?
Dukansu nau'ikan biyu sun fi son fifita yawan mitoci da maimaitawa; Rage mai son yana cire wannan son zuciya, rage zaɓe mara kyau.
Menene ƙuntatawa mai daidaitawa ke yi?
Tace mai kyau yana watsar da ƙananan yuwuwar alamun ƙarƙashin gwani, don haka bambanci ba zai iya haɓaka kalmomin da ba su dace ba ko marasa ma'ana.
Kusan mene ne dabarar maƙiya a cikin yanke hukunci?
Kowane ɗan takara ana ƙididdige shi azaman yuwuwar log ɗin ƙwararren ban da yuwuwar log-mateur mai nauyi, alamun lada da ƙwararrun ya fi so.
Wace hanya ce daga baya ta shimfiɗa ra'ayi mai ban sha'awa zuwa nau'in ƙirar guda ɗaya?
DoLa ya bambanta da farkon samfurin (farkon-Layer) da balagagge (marigayi-Layer) tsinkaya don rage hasashe, amfani da ra'ayi na bambanci tsakanin samfuri ɗaya.