Xiga xigaHagaha xiga
Diidmada Muunad-qaadista Fine-Tuning
Luuqadda AI
Luqadda AI HAGAHA
Xaqiijinta Muunada Male-awaalka ah
Speculative sampling uses a draft model to propose tokens and a target model to verify them.
Dhageyso hagahanAI-waa laga sheekeeyay · ~2 min
Boggaan2 daqiiqo akhri
Dulmar
With the exact rejection-sampling correction, it preserves the target distribution; speedup depends on draft cost, acceptance, target verification and workload.
quusid qoto dheer
Autoregressive generation is slow because each token needs a full forward pass of a huge model. Speculative sampling fixes this by pairing a cheap draft model with the expensive target model. The draft proposes a short run of tokens (say 4-8); the target then scores all of them in one parallel forward pass. A modified rejection-sampling rule accepts the longest prefix that is consistent with the target's own distribution and resamples at the first rejected position. Because acceptance is probabilistic and corrected, the final token stream is provably distributed exactly as if the target had generated alone, no quality loss. Speedups vary with draft cost, acceptance rate, target verification, batching and hardware. A parallel verification pass can confirm multiple tokens, but is not free.
Dhaqangelinta Adduunka-dhabta ah
U adeegida qaabka wada sheekaysiga 70B oo leh qaab qabyo ah 7B si loo yareeyo daahitaanka jawaabta qiyaas ahaan kala badh leh tayada wax soo saarka ee isku midka ah.
Qaabka Medusa wuxuu madax ka yahay hal nooc oo saadaalinaya dhowr calaamado mustaqbalka, ka dibna hubinaya iyaga oo aan lahayn shabakad qabyo ah.
Go'aaminta malo-awaalka ee geed-ku-salaysan oo soo jeediya sii wadida laamo badan oo ku xaqiijiya dhamaantood hal baas oo bartilmaameed ah.
Dedejinta kaaliyeyaasha dhamaystirka koodka halkaasoo qaabka qabyada ahi uu gacanta ku hayo weel-biyoodka la saadaalin karo oo qaabka weyni si dhakhso ah u xaqiijiyo.
Mustaqbalka Xaqiijinta Muunada Male-awaalka ah
Go'aaminta male-awaalka ah ayaa noqonaysa halbeeg isku xidhan. Kala duwanaanshiyaha cusubi wuxuu tuurayaa qaabka qabyada ah ee gaarka ah: is-mala-awaal waxay isticmaashaa hore-u-baxa ama madax saadaasha dheeraadka ah (Medusa, EAGLE), diyaarinta geed-ku-salaysan waxay xaqiijinaysaa sii wadida musharraxiinta badan hal mar, iyo go'aan-dejinta madaxa waxay barbar-dhigtaa qiyaasaha n-gram. Filo is dhex galka adag ee maaraynta kaydka-KV-ga, cabbiraadda qabyada-qalabka-ka warqabka ah, iyo isticmaalka ballaadhan ee alaabada xasaasiga ah sida kaaliyeyaasha sheekaysiga iyo aaladaha koodka halka millise-ilbiriqsi kasta lagu tiriyo.
Ku dhaqangelinta
Maxay muhiim u tahay
- Xawaaraha iyo miisaanka. Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
- Helitaanka iyo gaarsiinta. Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
- Go'aamo cad. Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Iska ilaali
- Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
- Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
- Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Tallaabooyinka xiga
- Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
- Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
- Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
- Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Warqad bilaash ah
Hel warbixinta maalinlaha ah ee AI
Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.
Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.
Is tijaabi
Take the Speculative Sampling Verification quiz
Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.
Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq
Su'aalaha soo noqnoqda
Waa maxay Xaqiijinta Muunada Male-awaalka ah?
Speculative sampling uses a draft model to propose tokens and a target model to verify them. With the exact rejection-sampling correction, it preserves the target distribution; speedup depends on draft cost, acceptance, target verification and workload.
Waa maxay fikradda udub-dhexaadka ah ee ka dambeysa muunad mala awaal ah?
Qaab qabyo ah oo raqiis ah ayaa qiyaasi doona dhowr calaamad oo hor leh, iyo qaabka bartilmaameedka qaaliga ah ayaa dhamaantood ku hubinaya hal baas oo isbarbar socda.
Waa maxay sababta shaybaarka mala-awaalka ahi aanu hoos u dhigin tayada wax-soo-saarka?
Sixitaan muunad diidmo ah oo wax laga beddelay ayaa dammaanad qaadaya calaamadaha la aqbalay in loo qaybiyo si sax ah sida qaabka la beegsanayo uu keligiis u soo saari lahaa.
In exact speculative sampling, what happens when a drafted token is rejected?
Exact speculative sampling uses a rejection-sampling correction and discards the later draft suffix.
Under exact speculative sampling, what is guaranteed about the output distribution?
The rejection-sampling rule preserves the target distribution; this does not guarantee the same sampled string for each random seed.
What information does the target verification pass provide in exact speculative sampling?
The target pass scores the draft proposals and supplies target probabilities used by the acceptance rule and residual correction; it has a computation cost.
Sii wad waxbarashada
Tilmaamaha la xidhiidha
Tilmaamayaal badan ayaa loo doortay mawduucan