Nnwale nlele anya
Nlere anya nlebara anya na-eme ka ọgbọ ụdị asụsụ dị ngwa site n'ikwe ka obere 'draft' chepụta ọtụtụ akara n'ihu, wee nwee nnukwu ihe nlereanya nyochaa ha n'otu ngafe.
Nchịkọta
The clever verification step guarantees the output matches what the big model would have produced on its own.
Ime miri emi
Ọgbọ na-agba ọsọ na-adị ngwa n'ihi na akara ngosi ọ bụla chọrọ ngafe zuru oke nke nnukwu ihe nlereanya. Nlere anya nlebara anya na-edozi nke a site na ijikọta ihe atụ dị ọnụ ala yana ụdị ebumnuche dị oke ọnụ. Ihe odide ahụ na-atụ aro obere ihe nrịbama (kwuo 4-8); ihe mgbaru ọsọ wee tụọ ha niile n'otu ngafe na-aga n'ihu. Usoro nleba anya njụjụ gbanwetụrụ na-anabata prefix kachasị ogologo nke dabara na nkesa nke ebumnuche ya na nlegharị anya n'ọnọdụ mbụ jụrụ. N'ihi na nnabata bụ nke puru omume ma mezie ya, a na-ekesa iyi ikpeazụ nke ikpeazụ dịka a ga-asị na e mere naanị ya, enweghị mfu dị mma. Ọsọ ọsọ a na-ahụkarị bụ 2-3x mgbe eserese ahụ dị ngwa ngwa yana dabara nke ọma, ebe ọ bụ na akwadoro ọtụtụ tokens kwa oku dị oke ọnụ.
Nghọta nka nka
Maka akara ngosi ọ bụla edepụtara, ị na-atụnyere ihe gbasara puru omume q na ihe gbasara nke puru omume p. Nabata na nkeji puru omume (1, q/p); ọ bụrụ na ajụrụ ya, nlele sitere na nkesa ihe fọdụrụ nke ọma (0, q-p). Iwu njụta a na-eme ka nkesa dị n'akụkụ ya yitere na nlele ebumnuche dị ọcha. Nfefe myirịta nke ebumnuche ahụ na-ewepụtakwa nkesa akara na-esote 'n'efu' ka akara ikpeazụ anabatara, yabụ ọganihu agaghị akwụsị.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke nkwenye nlele nlele anya
Ndozi nhụsianya na-aghọ ọkọlọtọ na nchịkọta ntụle. Ọdịiche dị iche iche na-ahapụ ụdịdị dị iche iche: ntule onwe onye na-eji isi ụzọ ọpụpụ ma ọ bụ amụma amụma ọzọ (Medusa, EAGLE), nhazi nke sitere na osisi na-enyocha ọtụtụ ndị ga-aga n'ihu n'otu oge, na ngbanwe nleba anya dabara n'echiche n-gram. Na-atụ anya njikọ siri ike na njikwa batching na KV-cache, nhazi ngwaike maara nke ọma, yana ojiji ka ukwuu na ngwaahịa nwere mmetụta dị ka ndị na-enyere aka nkata na koodu nzuzo ebe millisecond ọ bụla dị.
Mmejuputa n'ezie n'ụwa
Ije ozi ụdị nkata 70B nwere ihe ngosi 7B iji belata nzaghachi nzaghachi na ọkara yana ogo mmepụta yiri ya.
Ụdị ụdị Medusa na-aga n'otu ụdị na-ebu amụma ọtụtụ akara n'ọdịnihu, wee nyochaa ha na-enweghị netwọkụ dị iche iche.
Ndozi nkọwa gbasara osisi nke na-atụpụta ọtụtụ alaka alaka wee chọpụta ha niile n'otu ngafe ebumnuche.
Na-eme ka ndị enyemaka mmecha koodu ọsọ ọsọ ebe ihe nlere anya na-ejikwa efere esi mmiri a na-ahụ anya nke nnukwu ihe nlereanya ahụ na-akwado ngwa ngwa.
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Speculative Sampling Verification quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Nlele Nlele Ọjụjụ Dị Mma-Tuning
Ajụjụ a na-ajụkarị
What is Speculative Sampling Verification?
Nlere anya nlebara anya na-eme ka ọgbọ ụdị asụsụ dị ngwa site n'ikwe ka obere 'draft' chepụta ọtụtụ akara n'ihu, wee nwee nnukwu ihe nlereanya nyochaa ha n'otu ngafe. Nzọụkwụ nkwenye nke amamihe na-ekwe nkwa na mmepụta dabara na ihe nnukwu ihe nlereanya gaara emepụta n'onwe ya.
Gịnị bụ isi echiche dị n'azụ ntule nlele anya?
Ihe nlere anya dị ọnụ ala na-eche ọtụtụ akara n'ihu, na ụdị ebumnuche dị oke ọnụ na-enyocha ha niile n'otu ngafe na-aga n'ihu.
Kedu ihe kpatara nleba anya na-adịghị eweda ogo mmepụta ihe?
Ndozi nleba anya njụta a gbanwere na-ekwe nkwa na a na-ekesa akara ngosi anabatara kpọmkwem dịka ụdị ebumnuche ga-emepụta naanị ya.
Kedu ihe kpatara nlere anya nwere ike isi nwee ọganihu ọbụlagodi mgbe a jụrụ akara n'etiti usoro?
Otu ngafe aga n'ihu na-arụpụta nkesa akara na-esote mgbe akara ikpeazụ anabatara, yabụ ọbụlagodi otu token na-aga n'ihu mgbe niile.
Kedu usoro 'ịkọ nkọ' nke na-ezere usoro nhazi dị iche?
Medusa na EAGLE na-agbakwunye isi ndị ọzọ ma ọ bụ jiri ụzọ ọpụpụ n'oge ka otu ihe atụ ahụ na-atụpụta akara ngosi n'ọdịnihu, na-ewepụ mkpa maka ụdị ihe dị iche.