Naqshadeynta madaxa madaxa
Go'aaminta Lookahead waxay dedejisaa jiilka LLM iyada oo aan la helin qaab qabyo ah oo dheeri ah iyadoo la qiyaasayo lana xaqiijinayo calaamado badan oo mustaqbalka ah oo barbar socda iyadoo la adeegsanayo n-gram-yada moodeelku soo saaro duulista.
Dulmar
It breaks the strict one-token-at-a-time bottleneck.
quusid qoto dheer
Waxaa soo bandhigay cilmi-baarayaasha UC Berkeley sanadka 2023, go'aan ka gaarista eegitaanka waxay dedejisaa fikradda iyadoo la adeegsanayo moodalka la beegsanayo laftiisa - ma jiro nooc labaad iyo ma jiro tababar caawiye ah. Waxay dib u qaabaynaysaa jiilka sidii ay u xallin lahayd nidaamka isla'egyada aan tooska ahayn iyadoo la adeegsanayo hab isbarbar socda oo loo yaqaan ' Jacobi iteration'. Tallaabo kasta qaabku wuxuu mar wada wadaa laba laamood: laan 'lookahead' ah oo sifaysa qiyaasaha boosas calaamado mustaqbalka ah oo isbarbar socda, iyo laan 'xaqiijin' oo hubisa n-garaamyada calaamado badan leh ee lagu ururiyay barkad. N-gram-yada la xaqiijiyay ee moodeelku ku raacsan yahay waxaa la go'aamiyay dhammaan hal mar, markaa calaamado badan ayaa la aqbali karaa tallaabo kasta. Sababtoo ah waxay ku tiirsan tahay oo kaliya baasaska hore ee moodeelka, wax soo saarku wuxuu ahaanayaa sida saxda ah waxa hunguriga ama muunad-dejintu soo saari doono, iyadoo yaraynaysa tirada tillaabooyinka isku xigxiga ee loo baahan yahay.
Aragtida Farsamada
Fikradda udub-dhexaadka ah waxay amaahday Jacobi/Gauss-Seidel-ku-soo-celinta-go'an-goobeedka:-dejin-dejineedka autoregressive waxaa loola dhaqmayaa sidii loo heli lahaa meel go'an oo ka mid ah khariidaynta moodeelka daaqadda calaamadaha mustaqbalka. Qiyaasta isbarbar-dhigga ah ayaa si isdaba joog ah loo safeeyey, barkadda n-gram-na waxay kaydisaa taxanayaal calaamo macquul ah oo la arkay inta lagu gudajiro ku celcelintan. Xaqiijinta waxay xaqiijinaysaa in wax n-gram ah oo la kaydiyay uu la mid yahay tusaalaha soo-saarka xiga ee runta ah, taasoo u oggolaanaysa dhowr calaamadood inay ku hormaraan hal baas oo aan lahayn shabakad qabyo ah.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Future of Lookhead Decoding
Go'aaminta Lookahead waa mid soo jiidasho leh sababtoo ah uma baahna moodal dheeri ah si loo tababaro, la geeyo, ama lagu hayo xusuusta - fududaynta korsashada iskood isu martigeliyay. Filo is dhex galka qaabab adeeg oo badan iyo isku darka leh kood samaynta mala-awaalka ah iyo hagaajinta-KV-cache. Cilmi-baadhistu waxay hagaajinaysaa cabbirrada daaqadaha iyo maaraynta barkadda n-gram ee culaysyo shaqo oo kala duwan, iyo sahaminta sida farsamadu u cabbirto mawduucyo dhaadheer iyo adeegyo la dubay halka GPU-gu si kale aan loo isticmaalin.
Dhaqangelinta Adduunka-dhabta ah
Is-martigelinta moodeel furan sida Llama ama Vicuna oo leh daahitaan degdeg ah iyada oo aan la tababarin ama la rarin nooc kasta oo qabyo ah.
Yaraynta tirada tillaabooyinka goynta isku xigta ee jiilka dheer sida qoraallada ama koodka, halkaas oo flopku ku badan yihiin laakiin tillaabooyinku yihiin xannibaadda.
Ku biirista maktabadaha fikradda (siideynta asalka ah waxay rartay fulinta FlashAttention-ku habboon) si kor loogu qaado wax soo saarka GPU-yada jira.
Kor u qaadida adeega habaysan ee qalabka aan laga faa'iidaysanin iyadoo laga ganacsanayo xisaabaadka isbarbar-dhigga ee kaarka moodeelka ee ka yar.
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Lookahead Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Qalfoofka-Fikirka Isbarbar-dhigga Codaynta
Su'aalaha soo noqnoqda
What is Lookahead Decoding?
Go'aaminta Lookahead waxay dedejisaa jiilka LLM iyada oo aan la helin qaab qabyo ah oo dheeri ah iyadoo la qiyaasayo lana xaqiijinayo calaamado badan oo mustaqbalka ah oo barbar socda iyadoo la adeegsanayo n-gram-yada moodeelku soo saaro duulista. Waxay jebisaa hal-calaamad-waqti-mar-mar-ka-calaamad adag.
Maxaa ka sooca madax-dejinta iyo dejinta koodka caadiga ah?
Go'aaminta Lookahead waxay dedejisaa jiilka iyada oo la adeegsanayo kaliya qaabka bartilmaameedka ee baasaskiisa hore, oo aan lahayn shabakad qabyo ah oo caawisa.
Qaabkee tirsiyeedkee ayaa hoosta ka xarriiqaya go'aan-dejinta?
Waxa ay dib u habayn ku samaysaa goynta autoregressive sidii nidaam aan toos ahayn oo lagu xaliyay qaabka Jacobi isbarbardhiga bar-go'an ee calamadaha mustaqbalka.
Waa maxay labada laamood ee is barbar socda ee ku socda tallaabo kasta?
Laanta ka-fiirsashadu waxay nadiifisaa male-awaalka jagooyinka mustaqbalka halka laanta xaqiijinta ay hubinayso musharraxiinta n-grams barkada.
Maxaa lagu kaydiyaa ' barkadda n-gram'?
Barkadu waxay kaydisaa n-gram-yada musharraxiinta ee la soo saaray inta lagu gudajiro soo noqnoqoshada si loo xaqiijiyo oo ay suurtogal u noqoto inay ka go'an tahay tallaabada mustaqbalka.
Sidee bay u-dejintu u saamaysaa tayada wax-soo-saarka marka la barbar dhigo kood-dejinta caadiga ah?
Sababtoo ah kaliya baasasyada nooca bartilmaameedka ah ayaa la isticmaalay oo la xaqiijiyay, natiijadu waxay la mid tahay waxa soo saarista caadiga ah ay soo saari doonto.