Naqshad is burinaya
Go'aaminta is burinaya waxay dhalisaa qoraal tayo sare leh iyadoo laga jarayo moodooyinka luuqad yar, oo daciif ah oo ka mid ah mid weyn, xoog leh.
Dulmar
It amplifies what the expert knows and the amateur misses, reducing repetition and bland output.
quusid qoto dheer
Marka qaabka luqaddu uu doorto kelmadda soo socota, waxay soo saartaa itimaalka erey-bixintiisa. Decoding is burinaya (oo ay soo bandhigtay Li et al. 2022) waxa ay wadaa laba nooc oo isku mid ah: 'khabiir' weyn iyo 'amateur' yar. Halkii lagu aamini lahaa itimaalka cayriin ee khabiirka, waxay ku calaamadaynaysaa musharrax kasta farqiga u dhexeeya itimaalka khabiirka iyo hiwaayadda. Calaamadaha khabiirku wuu jecel yahay laakiin hiwaayadda ma kobcinayso; ereyada guud ee labada noocba way jecel yihiin (sida 'ka' ama weedhaha soo noqnoqda) waa la xakameeyaa, maadaama hiwaayadda sidoo kale uu jecel yahay. Shaandheeyaha macquulka ah ayaa marka hore meesha ka saaraya calaamadihii khabiirku u arko in aanay suurtogal ahayn, markaa ka duwanaanshuhu waligiis ma dhiirrigeliyo wax aan jirin. Natiijadu waa mid aad u faseexan, isku xidhan, oo ka yar soo noqnoqoshada qoraalka qaab dheer marka loo eego hunguriga ama muunada nukleus, iyada oo aan loo baahnayn tababar dheeraad ah.
Aragtida Farsamada
Dhibcaha udub-dhexaadka ah waa log p_expert(calaamad) laga jaray waqti isku-xirnaan ah log p_amateur(calaamad). Sababtoo ah hiwaayadda ayaa la wadaaga khaladaadka habaysan ee khabiirka (doorbidaaya calaamadaha soo noqnoqda ee sarreeya, duubista, soo noqnoqoshada xumaatay), ka-jaridda itimaalka-Log-ga waxay baabi'inaysaa hababka guul-darrooyinka la wadaago iyadoo la ilaalinayo aqoonta khabiirka ee dhabta ah. Caqabadda la qabsiga la qabsiga ayaa calaamado kaliya ka sarreeya jajab (alfa) ee itimaalka khabiirka sare, isaga oo ka hortagaya isbarbardhigga in uu kor u qaado erayada dhifka ah, ee aan is-waafaqsanayn.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Goynta is burinaya
Naqshadeynta is burinaya ayaa dhiirigelisay qoyska hababka 'isbarbardhigga aragtida', oo ay ku jiraan DoLa (isbarbar dhigaya moodeelka hore ee u gaarka ah iyo lakabyada dambe si loo gooyo mala-awaalka) iyo kala duwanaanshiyaha macnaha guud ee ka duwan iyo iyada oo aan dukumeenti la soo saarin. Filo is dhexgalka adag ee soo celinta, dhibcaha xaqiiqada, iyo hiwaayadda yar yar, oo lagu daray isku darka qaabaynta malo-awaalka ah si uu hiwaayaduhu u maamulo tayada isla markaana u dardargeliyo jiilka isku mar.
Dhaqangelinta Adduunka-dhabta ah
Soo saarista sheeko dheer, aan soo noqnoqonaynin ama maqaallo sii socota halkaas oo muunadeynta xudunta u leexanayso wareegyada
Isku-dubbaridka khabiir 65B leh hiwaayadda 1.5B si loo horumariyo jiilka furfuran iyada oo aan la hagaajin
Yaraynta ku celcelinta xumaaday ee soo koobida iyo wada hadalka
U adeegida aasaaska is-barbardhiga qaabka DoLa si hoos loogu dhigo mala-awaalka dhabta ah
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Contrastive Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Go'aaminta Khatarta Bayes ugu yar
Su'aalaha soo noqnoqda
What is Contrastive Decoding?
Go'aaminta is burinaya waxay dhalisaa qoraal tayo sare leh iyadoo laga jarayo moodooyinka luuqad yar, oo daciif ah oo ka mid ah mid weyn, xoog leh. Waxa ay kordhisaa waxa khabiirku yaqaanno iyo hiwaayadda ku seegato, iyada oo yaraynaysa soo-celinta iyo wax-soo-saarka xun.
Decoding ka duwan, doorkee ayuu ka ciyaaraa moodelka 'amateur'?
Itimaalka hiwaayadda waxaa laga jaray khabiirka, baabi'inta khaladaadka joogtada ah (sida doorbidida calaamadaha soo noqnoqda) ee labada nooc wadaagaan.
Maxay tahay sababta kala-goynta hiwaayadda ixtimaalka u yaraynaysaa soo-noqoshada iyo wax-soo-saarka xun?
Labada noocba waxay u muuqdaan inay si xad dhaaf ah u door bidaan calaamadaha soo noqnoqda ee soo noqnoqda; kala goynta hiwaayadda waxay meesha ka saartaa eexdaas la wadaago, hoos u dhigista doorashooyin aan fiicneyn.
Maxay qabtaa xannibaadda macquulka ah ee la qabsiga?
Shaandheeyaha macquulka ah wuxuu tuurayaa calaamadaha itimaalka hoose ee khabiirka, markaa ka duwanaanshuhu ma horumarin karo ereyo aan is-waafajin ama aan macno lahayn.
Qiyaastii waa maxay qaacidada dhibcaha ee dejinta kala duwan?
Musharax kastaa waxa loo buunbuuniyay sidii ixtimaalka khabiirka oo laga jaray itimaalka hiwaayadda miisaanka leh, calaamado abaal-marin leh oo khabiirku si gaar ah u doorbido.
Qaabkee dambe u fidiya fikradda isbarbardhigga ilaa lakabyada hal nooc?
DoLa waxay ka soo horjeedaa saadaasha dhicis ee moodeelka (lakabka hore) iyo qaan-gaadhka (lakabka dambe) si loo yareeyo dhalanteedka, iyadoo la adeegsanaayo fikradda isbarbardhigga ee hal moodal.