Incamake
Kode ya Lookahead yihutisha ibisekuruza bya LLM nta yandi mashusho yinyongera mugukeka no kugenzura ibimenyetso byinshi bizaza mugihe kimwe ukoresheje n-garama icyitegererezo gitanga muguruka. Ivunagura cyane icyerekezo kimwe-icyarimwe.
Lookahead Decoding ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo.
Kwibira cyane
Byatangijwe nabashakashatsi bo muri UC Berkeley mu 2023, decodehead yihuta yihutisha gufata umwanzuro ukoresheje icyitegererezo cyonyine - nta moderi ya kabiri kandi nta mahugurwa y'abafasha. Ivugurura ibisekuruza nkugukemura sisitemu yo kugereranya idafite umurongo ukoresheje uburyo bubangikanye bwitwa Jacobi itera. Kuri buri ntambwe icyitegererezo gikoresha amashami abiri icyarimwe: ishami 'rireba' rinonosora ibitekerezwa kumyanya myinshi yikimenyetso kizaza, hamwe nishami rya 'verisiyo' igenzura ibyiringiro byinshi-n-garama byakusanyirijwe muri pisine. Kugenzura n-garama icyitegererezo cyemeranijweho icyarimwe icyarimwe, bityo ibimenyetso byinshi birashobora kwemerwa kuri buri ntambwe. Kuberako yishingikiriza gusa kuri moderi yimbere yimbere, ibisohoka bikomeza kuba ibyo umururumba cyangwa icyitegererezo cya decoding byatanga umusaruro, mugihe ugabanya umubare wintambwe zikenewe zikenewe.
Ubushishozi
Igitekerezo cyibanze kiguza Jacobi / Gauss-Seidel itondekanya-ingingo itera: decode ya autoregressive ifatwa nkugushakisha ingingo ihamye yerekana ikarita yerekana idirishya ryibimenyetso bizaza. Ibigereranyo bisa neza biratunganijwe neza, kandi n-garama pisine cashe yerekana ibimenyetso byerekana ibimenyetso mugihe cyo gusubiramo. Igenzura ryemeza niba buri cashe n-garama ihuye nicyitegererezo cyukuri gikurikiraho, kureka ibimenyetso byinshi bigatera imbere muri pass imwe idafite umushinga wihariye.
Kumenya Kurangiza
Kode ya Lookahead yihutisha ibisekuruza bya LLM nta yandi mashusho yinyongera mugukeka no kugenzura ibimenyetso byinshi bizaza mugihe kimwe ukoresheje n-garama icyitegererezo gitanga muguruka. Ivunagura cyane icyerekezo kimwe-icyarimwe. Lookahead Decoding ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo. Kugirango wubake byimbitse, fata Lookahead Decoding nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Lookahead Decoding igishushanyo mbonera, kugarura, no gusuzuma imirongo nka sisitemu imwe y'itumanaho ihuriweho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mugihe kimwe, ibintu bya Hallucinated birashobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Yagura uburyo bwindimi nuburyo bwo gutumanaho. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Kwiyakira-moderi ifunguye nka Llama cyangwa Vicuna hamwe nubukererwe bwihuse nta mahugurwa cyangwa gupakira icyitegererezo cyabafasha.
Kugabanya umubare wikurikiranya ryikurikiranya ryigihe kirekire-nkibisekuru cyangwa code, aho flops ari nyinshi ariko intambwe ninzitizi.
Kwinjiza mumasomero yerekana (gusohora kwambere byohereje FlashAttention-ihuza ishyirwa mubikorwa) kugirango uzamure ibicuruzwa kuri GPUs zisanzwe.
Kwihutisha ibyiciro byakorewe kubikoresho bidakoreshwa mugucuruza ibigereranyo bisa na compte nkeya ya moderi ikurikiranye.
Uburyo bwo Gushyira mu bikorwa
Lookahead Decoding mubikorwa
Kwiyakira-moderi ifunguye nka Llama cyangwa Vicuna hamwe nubukererwe bwihuse nta mahugurwa cyangwa gupakira icyitegererezo cyabafasha.
Kwiyakira-moderi ifunguye nka Llama cyangwa Vicuna hamwe nubukererwe bwihuse nta mahugurwa cyangwa gupakira umushinga wintangarugero wintangarugero Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
Lookahead Decoding mubikorwa
Kugabanya umubare wikurikiranya ryikurikiranya ryigihe kirekire-nkibisekuru cyangwa code, aho flops ari nyinshi ariko intambwe ninzitizi.
Kugabanya umubare wintambwe zikurikirana zikurikirana kubisekuru birebire nkibisomwa cyangwa kode, aho flops ari nyinshi ariko intambwe nintambamyi Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Lookahead Decoding mubikorwa
Kwinjiza mumasomero yerekana (gusohora kwambere byohereje FlashAttention-ihuza ishyirwa mubikorwa) kugirango uzamure ibicuruzwa kuri GPUs zisanzwe.
Kwinjiza mumasomero yerekana (gusohora kwambere byoherejwe na FlashAttention-ihuza ishyirwa mubikorwa) kugirango uzamure ibicuruzwa mumakipe ariho ya GPU asanzwe abona ibisubizo byiza mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Lookahead Decoding mubikorwa
Kwihutisha ibyiciro byakorewe kubikoresho bidakoreshwa mugucuruza ibigereranyo bisa na compte nkeya ya moderi ikurikiranye.
Kwihutisha ibyiciro bikoreshwa mubikoresho bidakoreshwa mugucuruza compte yinyongera igereranya kubintu bike byikurikiranya Amakipe asanzwe abona ibisubizo byiza mugihe asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Komeza kugenzura abantu kugenzura ibisubizo byinshi. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.