Duba kai Decoding
Ƙididdigar Lookhead yana haɓaka tsarar LLM ba tare da wani ƙarin daftarin ƙira ba ta hanyar ƙididdigewa da kuma tabbatar da alamu masu yawa na gaba a layi daya ta amfani da n-grams da ƙirar ke haifarwa akan tashi.
Dubawa
It breaks the strict one-token-at-a-time bottleneck.
Zurfafa nutsewa
Masu bincike ne suka gabatar da su a UC Berkeley a cikin 2023, duban kai yana ƙara haɓaka ƙima ta amfani da ƙirar da aka yi niyya kawai - babu samfuri na biyu kuma babu horo na taimako. Yana sake tsara tsarawa azaman warware tsarin daidaitawa mara tushe ta amfani da hanyar layi ɗaya da ake kira Jacobi iteration. A kowane mataki samfurin yana gudanar da rassa guda biyu lokaci guda: reshen 'lookahead' wanda ke daidaita ƙididdiga don muƙamai masu yawa na gaba a layi daya, da kuma reshen 'tabbaci' wanda ke bincika manyan n-grams masu alamar alama da aka tattara a cikin tafkin. Tabbatar da n-grams waɗanda samfurin ya yarda da su ana yin su gaba ɗaya, don haka ana iya karɓar alamu da yawa kowane mataki. Saboda ya dogara ne kawai da tsarin wucewar nasa na gaba, fitarwa ya kasance daidai abin da ƙima ko ƙididdigewa samfurin zai haifar, tare da rage adadin matakan da ake buƙata.
Fahimtar Fasaha
Babban ra'ayin yana aro Jacobi/Gauss-Seidel ƙayyadaddun ma'auni mai kayyadaddun bayanai: autoregressive decoding ana kula da shi azaman gano ƙayyadadden batu na taswirar ƙirar akan taga alamun gaba. Hasashe daidai-da-wane ana sabunta su akai-akai, kuma wurin tafki na n-gram yana adana jerin lamurra masu ma'ana da aka gani yayin waɗannan gyare-gyare. Tabbatarwa yana tabbatar da ko kowane n-gram da aka adana ya dace da ainihin abubuwan da aka fitar na samfurin na gaba, yana barin alamu da yawa su ci gaba a wucewa ɗaya ba tare da keɓantaccen hanyar sadarwa ba.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Gyaran Lookhead
Ƙididdigar Lookhead yana da ban sha'awa saboda baya buƙatar ƙarin samfuri don horarwa, turawa, ko kiyayewa a cikin ƙwaƙwalwar ajiya - sauƙaƙe ɗauka ga masu karɓar kai. Yi tsammanin haɗin kai cikin ƙarin tsarin tsarin hidima da haɗin kai tare da ƙididdige ƙididdiga da haɓakawa-KV-cache. Bincike yana daidaita girman taga da sarrafa n-gram pool don nau'ikan ayyuka daban-daban, da kuma bincika yadda dabarar ma'aunin ma'auni tare da tsayin daka da hidimar da aka yi amfani da su a inda ba a yi amfani da lissafin GPU ba.
Aiwatar da Gaskiyar Duniya
Gudanar da kai da buɗaɗɗen ƙira kamar Llama ko Vicuna tare da jinkiri cikin sauri ba tare da horo ko loda kowane samfurin daftarin aiki ba.
Rage adadin matakan ɓata lokaci-lokaci don tsarawa na dogon lokaci kamar rubutu ko lamba, inda flops ke da yawa amma matakai sune cikas.
Haɗin kai cikin ɗakunan karatu (sakin na asali ya aika da aiwatarwa mai dacewa da FlashAttention) don haɓaka kayan aiki akan GPUs masu wanzuwa.
Ƙaddamar da kayan aikin da ba a yi amfani da su ba da sauri ta hanyar siyar da ƙarin lissafin layi ɗaya don ƙarancin ƙirar ƙira.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Lookahead Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Ƙwararren Ƙwararren-Tunani
Tambayoyin da ake yawan yi
What is Lookahead Decoding?
Ƙididdigar Lookhead yana haɓaka tsarar LLM ba tare da wani ƙarin daftarin ƙira ba ta hanyar ƙididdigewa da kuma tabbatar da alamu masu yawa na gaba a layi daya ta amfani da n-grams da ƙirar ke haifarwa akan tashi. Yana karya ƙaƙƙarfan ƙaƙƙarfan alama ɗaya-a-lokaci.
Menene ya bambanta gyare-gyaren lookhead daga daidaitattun ƙididdigewa?
Ƙididdigar Lookhead yana haɓaka tsarawa ta amfani da ƙirar gaba ɗaya kawai, ba tare da daftarin hanyar sadarwa ba.
Wace hanya ta lamba ce ke goyan bayan yanke kai tsaye?
Yana sake fasalin ƙaddamarwa ta atomatik azaman tsarin da ba na kan layi wanda aka warware tare da salon Jacobi daidai da ƙayyadaddun ƙayyadaddun maki akan alamu na gaba.
Menene rassa guda biyu masu kama da juna da ke gudana a kowane mataki?
Reshen lookhead yana sake daidaita zato don matsayi na gaba yayin da reshen tabbatarwa ke bincika n-grams ɗan takara daga tafkin.
Menene aka adana a cikin 'n-gram pool'?
Tafkin yana adana n-gram ɗin ɗan takara da aka samar yayin maimaitawa ta yadda za a iya tantance su da yuwuwar aikata su a mataki na gaba.
Ta yaya gyare-gyaren lookhead ke shafar ingancin fitarwa idan aka kwatanta da ƙaddamarwa na yau da kullun?
Domin kawai fasfon ɗin da aka yi niyya ana amfani da shi kuma an tabbatar da shi, sakamakon ya yi daidai da abin da ƙayyadaddun ƙididdigewa zai samar.