Ndị isi ngbanwe nke Medusa
Medusa bụ usoro ngbanwe nke na-egbochi ọtụtụ amụma 'isi' n'ụdị asụsụ ka o wee nwee ike ịkọ ọtụtụ akara n'ọdịnihu n'otu oge.
Nchịkọta
By verifying these guesses in a single forward pass, it speeds up text generation roughly 2-3x without changing the model's output distribution.
Ime miri emi
Ụdị asụsụ nkịtị na-emepụta otu token maka ngafe na-aga n'ihu, nke na-adị nwayọọ n'ihi na nzọụkwụ ọ bụla ga-echere nke gara aga. Medusa na-agbakwụnye isi na-aga n'ihu na-eri nri dị fechaa n'elu ụdị ntọala kpọnwụrụ akpọnwụ; isi nke ọ bụla na-ebu amụma akara ngosi ole na ole n'ihu (isi 1 na-ebu amụma akara na-esote, isi 2 akara mgbe, na ihe ndị ọzọ). Amụma ndị a na-etolite osisi nke nwa akwukwo n'ihu. Ihe nlereanya zuru oke wee nyochaa osisi ahụ dum n'otu ngafe site na iji nkpuchi 'osisi', na-anabata prefix kachasị ogologo nke dabara na ihe nlereanya ahụ gaara arụpụta. N'ihi na nkwenye na-eji ụdị mbụ, Medusa enweghị efu: ederede anabatara bụ kpọmkwem ihe anyaukwu ma ọ bụ ihe ngbanwe ga-emepụta, nke a na-emepụta na obere usoro.
Nghọta nka nka
Onye isi Medusa ọ bụla bụ obere MLP fọdụrụnụ nke na-esetịpụ ọnọdụ nzuzo ikpeazụ nke ihe nlereanya na nkesa n'elu tokens na defet k. A na-ahazi ndị Candidates sitere na ndị isi ka ha bụrụ osisi, na nkpuchi nlebara anya arụpụtara pụrụ iche na-ahapụ ihe nlereanya ntọala akara alaka ọ bụla n'otu oge n'otu ngafe na-aga n'ihu. Atụmatụ nnabata a na-ahụkarị na-ekpebi akara ntule ọ ga-edobe, na-ekwe nkwa na nsonaazụ ya dabara na nlele nke ihe nlereanya nke ya, yabụ a na-echekwa ịdịmma ka usoro usoro ga-ada.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke ndị isi ngbanwe nke Medusa
Ndozi nhụsianya na-aghọ ọkọlọtọ na nchịkọta ntinye aka mmepụta, yana ụzọ nwere onwe ya dị ka Medusa, nke na-ezere ịchọ ụdị akwụkwọ dị iche, mara mma n'ihi na ọ dị mfe ibugharị. Ọrụ ga-eme n'ọdịnihu na-agwakọta isi ụdị Medusa na amụma njirimara ụdị EAGLE, ịrụ osisi ka mma, yana nkwenye mara ngwaike. Na-atụ anya mwekota siri ike n'ime usoro ọrụ, nhazi akpaka nke ụdị osisi ọ bụla na-arụ ọrụ, yana njikọta na mkpakọ KV-cache ka latency wee daa na-enweghị GPU ma ọ bụ mfu dị mma.
Mmejuputa n'ezie n'ụwa
Ịbelata nzaghachi nzaghachi chatbot site na ịnakwere ọtụtụ akara ngosi egosipụtara n'otu ngafe gafere
Na-eme ka ndị enyemaka mmecha koodu ọsọ ọsọ ebe usoro akara ngosi ga-adị mfe ịkọ nkọ
Mbelata ọnụ ahịa ntinye aka maka ndị LLM API dị elu na-ebuga ụdịdị dị iche iche
Na-eme ngwa ngwa ọgbọ ederede ogologo dị ka nchịkọta ma na-edobe mmepụta ya na ngbanwe ọkọlọtọ
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Medusa Decoding Heads quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ntaramahụhụ ugboro ugboro na njikwa ngbanwe
Ajụjụ a na-ajụkarị
What is Medusa Decoding Heads?
Medusa bụ usoro ngbanwe nke na-egbochi ọtụtụ amụma 'isi' n'ụdị asụsụ ka o wee nwee ike ịkọ ọtụtụ akara n'ọdịnihu n'otu oge. Site n'ịkwado atụmatụ ndị a n'otu ngafe na-aga n'ihu, ọ na-eme ka ọgbọ ederede dị ngwa karịa 2-3x na-agbanweghị nkesa mmepụta ihe nlereanya.
Kedu ihe ndị isi Medusa agbakwunyere na-ebu amụma?
Onye isi Medusa ọ bụla na-ebu amụma akara ọtụtụ ọnọdụ n'ọdịnihu, yabụ enwere ike ịtụpụta ọtụtụ akara n'otu oge.
Kedu ihe kpatara eji were Medusa dị ka 'enweghị mfu' atụnyere ngbanwe ọkọlọtọ?
Ụdị ntọala ahụ na-enyocha akara ngosi ndị ga-eme ntuli aka, na-anabata naanị ndị ọ gaara emepụta, na-echekwa nkesa mmepụta.
Kedu usoro a haziri n'ihu n'ihu onye ndoro-ndoro ochichi Medusa maka nkwenye?
Ndị ndoro-ndoro ochichi na-etolite osisi, na ihe nkpuchi nlebara anya osisi na-eme ka ihe nlereanya ntọala nyochaa alaka niile n'otu ụzọ gafere.
Kedu uru bụ isi nke Medusa karịa ngbanwe ngbanwe nke ụdịdị?
Medusa na-ejikọta isi ndị dị fechaa na ụdị dị adị, yabụ na ọ dịghị mkpa ịzụ ma jee ozi netwọk dị iche iche.
Kedu ụdị ọsọ Medusa na-akọkarị?
Medusa na-enwetakarị mbelata 2-3x n'ọgbọ ọgbọ dabere na ibu ọrụ.