Tabbacin Samfuran Hasashen
Samfuran Hasashen yana hanzarta haɓaka ƙirar ƙirar harshe ta hanyar barin ƙaramin samfurin 'daftarin' ya hango alamu da yawa a gaba, sannan samun babban samfurin ya tabbatar da su a cikin wucewa ɗaya.
Dubawa
The clever verification step guarantees the output matches what the big model would have produced on its own.
Zurfafa nutsewa
Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwaƙwalwa na Ƙadda ) ya yi yana buƙatar cikakken izinin gaba na babban samfurin. Samfuran ƙira yana gyara wannan ta hanyar haɗa ƙirar ƙira mai arha tare da ƙirar manufa mai tsada. Daftarin yana ba da shawarar gajeriyar alamomi (ce 4-8); wanda aka yi niyya sai ya zura dukkan su a cikin layi daya na gaba. Ƙimar ƙima-samfurin da aka gyara yana karɓar mafi tsayin prefix wanda ya yi daidai da rabon abin da aka yi niyya da kuma samfurori a matsayi na farko da aka ƙi. Saboda yarda yana da yuwuwa kuma an gyara shi, tabbas ana rarraba rafin alamar ƙarshe daidai kamar dai an samar da manufa ita kaɗai, ba asara mai inganci. Matsakaicin saurin gudu shine 2-3x lokacin da daftarin yana da sauri kuma yana daidaitawa, tunda ana tabbatar da alamun da yawa akan kowane kira mai tsada.
Fahimtar Fasaha
Ga kowane daftarin alamar, kuna kwatanta yiwuwar yiwuwar q da daftarin yuwuwar p. Karɓa tare da yiwuwar min (1, q/p); idan an ƙi, samfurin daga daidaitaccen rabon rabon max (0, q-p). Wannan ƙa'idar ƙin yarda ta sanya rarraba ta gefe ta zama daidai da tsayayyen samfurin manufa. Matsakaicin madaidaicin maƙasudin kuma yana samar da rabon alama na gaba ' kyauta' bayan alamar da aka karɓa ta ƙarshe, don haka ci gaba baya tsayawa.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Tabbatar da Samfuran Hasashen
Ƙididdigar ƙididdiga ta zama daidaitattun ƙididdiga masu ƙima. Sabbin bambance-bambancen sun zubar da keɓantaccen ƙirar ƙirar: hasashe kai yana amfani da farkon-fitowa ko ƙarin shugabannin tsinkaya (Medusa, EAGLE), zayyana tushen bishiya yana tabbatar da ci gaban ɗan takara da yawa a lokaci ɗaya, kuma duba kai tsaye yana daidaita hasashen n-gram. Yi tsammanin haɗin kai tare da batching da KV-cache management, hardware-sane daftarin daftarin aiki, da kuma faffadar amfani a cikin samfuran latency kamar mataimakan taɗi da kayan aikin coding inda kowane miliyon daƙiƙa ya ƙidaya.
Aiwatar da Gaskiyar Duniya
Yin hidimar ƙirar taɗi ta 70B tare da ƙirar ƙirar 7B don yanke jinkirin amsa kusan cikin rabi tare da ingancin fitarwa iri ɗaya.
Salon Medusa ya jagoranci kan ƙira ɗaya yana tsinkayar alamu da yawa na gaba, sannan tabbatar da su ba tare da wata hanyar sadarwa ta daban ba.
Ƙididdigar ƙididdiga ta tushen itace wanda ke ba da shawarar ci gaba da reshe da yawa kuma yana tabbatar da su duka a cikin manufa ɗaya.
Ƙaddamar da mataimakan kammala lambar inda daftarin ƙirar ke sarrafa tukunyar tukunyar jirgi wanda babban samfurin ya tabbatar da sauri.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Speculative Sampling Verification quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Ƙimar Samfura Mai Kyau-Tuning
Tambayoyin da ake yawan yi
What is Speculative Sampling Verification?
Samfuran Hasashen yana hanzarta haɓaka ƙirar ƙirar harshe ta hanyar barin ƙaramin samfurin 'daftarin' ya hango alamu da yawa a gaba, sannan samun babban samfurin ya tabbatar da su a cikin wucewa ɗaya. Matakin tabbatarwa da wayo yana ba da tabbacin fitarwa ya dace da abin da babban samfurin zai samar da kansa.
Menene ainihin ra'ayin da ke tattare da ƙima?
Samfurin daftarin arha yana hasashen alamu da yawa a gaba, kuma ƙirar manufa mai tsada tana duba su duka a cikin layi ɗaya na gaba.
Me yasa samfurin hasashe baya lalata ingancin fitarwa?
Gyaran ƙin yarda-samfurin gyaran gyare-gyare yana ba da tabbacin rarraba alamun da aka karɓa daidai kamar yadda ƙirar da aka yi niyya za ta samar ita kaɗai.
Me yasa samfurin hasashe zai iya samun ci gaba ko da an ƙi alamar a tsakiyar jerin?
Maƙasudin gaba ɗaya na gaba yana samar da rarraba alama ta gaba bayan alamar da aka karɓa ta ƙarshe, don haka aƙalla alama ɗaya yana ci gaba.
Wanne hanya ce ta 'kishin kai' wacce ke guje wa wani tsari daban?
Medusa da EAGLE suna ƙara ƙarin kawunansu ko amfani da fitattun fitattun wurare don haka ƙirar ɗaya ta ba da shawarar alamu na gaba, cire buƙatar takamaiman ƙirar ƙirar.