Kugenzura Icyitegererezo
Gutoranya byihuta byihuta byururimi rwicyitegererezo kureka icyitegererezo gito 'umushinga' ukeka ibimenyetso byinshi imbere, hanyuma ukagira icyitegererezo kinini ubigenzura mumurongo umwe.
Incamake
The clever verification step guarantees the output matches what the big model would have produced on its own.
Kwibira cyane
Autoregressive generation iratinda kuko buri kimenyetso gikeneye inzira yimbere yimbere yikitegererezo kinini. Icyitegererezo cyicyitegererezo gikosora ibi muguhuza umushinga uhendutse hamwe nicyitegererezo gihenze. Umushinga utanga icyerekezo gito cyibimenyetso (vuga 4-8); intego noneho itanga amanota yose muri parallel imwe imbere. Guhindura kwangwa-gutoranya amategeko yemera prefix ndende ijyanye nintego yo kugabura kwayo hamwe nicyitegererezo kumwanya wambere wanze. Kuberako kwemerwa birashoboka kandi bigakosorwa, umurongo wanyuma wikimenyetso ugabanijwe neza nkaho intego yabyaye wenyine, nta gihombo cyiza. Ibisanzwe byihuta ni 2-3x mugihe umushinga wihuta kandi uhujwe neza, kubera ko ibimenyetso byinshi byemezwa kumuhamagaro uhenze.
Ubushishozi
Kuri buri cyapa cyateguwe, ugereranya intego ishobora kuba q hamwe ninteguza p. Emera hamwe nibishoboka min (1, q / p); niba byanze, icyitegererezo kivuye mubisanzwe bisigaye bigabanywa max (0, q-p). Iri tegeko ryo kwangwa rituma marginal isaranganya ihwanye nicyitegererezo cyiza. Intego ibangikanye nayo itanga ubutaha-ikimenyetso cyo kugabura 'kubuntu' nyuma yikimenyetso cya nyuma cyemewe, bityo iterambere ntirihagarara.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza h'icyitegererezo cyo kugenzura
Gukoresha decoding yibintu birahinduka mubisanzwe. Impinduka nshya zireka umushinga wintangarugero: kwiyitirira gukoresha hakiri kare-gusohoka cyangwa imitwe yinyongera yo guhanura (Medusa, EAGLE), igishushanyo mbonera cyibiti kigenzura abakandida benshi icyarimwe, kandi decodehead decoding igereranya n-garama. Tegereza kwishyira hamwe hamwe nogucunga hamwe na KV-cache, gucunga ibyuma bingana, hamwe no gukoresha mugukoresha ibicuruzwa bitinda cyane nkabafasha kuganira hamwe nibikoresho bya code aho buri milisegonda ibara.
Gushyira mu bikorwa Isi
Gukora moderi ya 70B yo kuganira hamwe na 7B yerekana icyitegererezo kugirango ugabanye gutinda gusubiza hafi kabiri hamwe nubwiza busohoka.
Imiterere ya Medusa kumutwe umwe uhanura ibimenyetso byinshi bizaza, hanyuma ukabigenzura udafite umushinga wihariye.
Igiti gishingiye ku gutondeka ibiti bitanga amashami menshi kandi bikagenzurwa byose muburyo bumwe.
Kwihutisha abafasha-kurangiza abafasha aho umushinga wikitegererezo ukemura ibyateganijwe byavuzwe ko moderi nini yemeza vuba.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Speculative Sampling Verification quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kwangwa Gutoranya Cyiza-Guhuza
Ibibazo bikunze kubazwa
What is Speculative Sampling Verification?
Gutoranya byihuta byihuta byururimi rwicyitegererezo kureka icyitegererezo gito 'umushinga' ukeka ibimenyetso byinshi imbere, hanyuma ukagira icyitegererezo kinini ubigenzura mumurongo umwe. Intambwe yo kugenzura neza yemeza ibyasohotse bihuye nibyo moderi nini yaba yarabyaye wenyine.
Ni ikihe gitekerezo cyibanze inyuma yicyitegererezo?
Inyandiko ihendutse yerekana urugero rwerekana ibimenyetso byinshi imbere, kandi intego ihenze yerekana igenzura byose muburyo bumwe bubangikanye imbere.
Ni ukubera iki icyitegererezo cyo gutesha agaciro kidatesha agaciro ubuziranenge?
Guhindura kwangwa-gutoranya gukosora byemeza ibimenyetso byemewe bitangwa neza nkuko intego yabigenewe yabyaye wenyine.
Ni ukubera iki guhitamo icyitegererezo bishobora gutera imbere nubwo ikimenyetso cyanze hagati yikurikiranya?
Intego imwe yimbere imbere itanga ubutaha-token ikwirakwizwa nyuma yikimenyetso cya nyuma cyemewe, bityo byibuze ikimenyetso kimwe gihora gitera imbere.
Nubuhe buryo 'bwo kwikinisha' bwirinda umushinga wihariye?
Medusa na EAGLE bongeramo imitwe yinyongera cyangwa ukoreshe gusohoka hakiri kare kuburyo moderi imwe itanga ibimenyetso bizaza, ikuraho ibikenewe byimishinga itandukanye.