Incamake
Kunyerera idirishya ryitondewe rigabanya buri kimenyetso cyo kwitabira gusa mubunini-bunini buturanye bwibimenyetso byegeranye aho kugirango bikurikirane. Ibi bigabanya ibiciro bya kwadratike yibitekerezo bisanzwe kumurongo, bigatuma imiterere-ndende-ndende ihendutse gukora.
Kunyerera Idirishya Icyitonderwa ni igice cyururimi-AI igikoresho gikoreshwa mugusoma, kubyara, gutondekanya, no guhindura inyandiko nimvugo murwego.
Kwibira cyane
Kwiyitaho bisanzwe kugereranya buri kimenyetso nikindi kimenyetso, bityo rero uburebure bwa N busaba kugereranya N-kwaduka. Kunyerera idirishya ryitondewe bikosora ibi muguha buri kimenyetso idirishya ryubunini W (vuga ibimenyetso 4.096) kandi witabire abaturanyi gusa muriryo dirishya. Igiciro gikura nka N inshuro W aho kuba N-kare. Byibanze, gutondekanya ibice byinshi byamadirishya byagura umurima wakira neza: nyuma ya L, amakuru arashobora gukwirakwira hafi yikimenyetso cya L inshuro W, nkumurima wa CNN ukura. Mistral 7B yamenyekanye cyane hamwe nidirishya rya 4.096-ryerekana hejuru ya 32, igera kuri theoretical 131K-token span. Abanyamideli bakunze kuvanga idirishya ryibice hamwe na rimwe-byuzuye byuzuye kugirango babungabunge intera ndende.
Ubushishozi
Muri mask yo kwitondera, ikibazo kumwanya i nemerewe gusa kubona urufunguzo ruva kumwanya i gukuramo W wongeyeho 1 kugeza i (urubanza rwimpamvu). Iyi maskike isobanura KV cache ikenera gusa ibimenyetso bya W byanyuma kuri layer, kugabanya kwibuka mugihe cyibisekuru. Kuberako idirishya rihinduranya hamwe na buri kimenyetso gishya, gihuza muburyo busanzwe hamwe na cache izunguruka yandika ibyanditswe kera kuruta gukura ubuziraherezo.
Kumenya kunyerera Idirishya Icyitonderwa
Kunyerera idirishya ryitondewe rigabanya buri kimenyetso cyo kwitabira gusa mubunini-bunini buturanye bwibimenyetso byegeranye aho kugirango bikurikirane. Ibi bigabanya ibiciro bya kwadratike yibitekerezo bisanzwe kumurongo, bigatuma imiterere-ndende-ndende ihendutse gukora. Kunyerera Idirishya Icyitonderwa ni igice cyururimi-AI igikoresho gikoreshwa mugusoma, kubyara, gutondekanya, no guhindura inyandiko nimvugo murwego. Kugirango wubake byimbitse, fata Sliding Window Attention nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Slide Window Attention igishushanyo mbonera, kugarura, no gusubiramo imirongo nka sisitemu imwe y'itumanaho ihuriweho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mugihe kimwe, ibintu bya Hallucinated birashobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Yagura uburyo bwindimi nuburyo bwo gutumanaho. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Mistral 7B ikoresha idirishya rya 4.096-ryerekana kunyerera hejuru yurwego rwayo kugirango ikore ibisobanuro birebire bihendutse kubakoresha GPUs.
Longformer ikoresha idirishya ryitondewe hiyongereyeho ibimenyetso bike kwisi kugirango ushyire hamwe kandi uvuge muri make impapuro nyinshi.
Gemma 2 ihinduranya kunyerera-idirishya ryibanze hamwe nisi-yita kumurongo kugirango iringanize umuvuduko hamwe nigihe kirekire cyo kwibuka.
Rolling-buffer KV cache mubufasha bunganira ibika gusa idirishya rya vuba ryibimenyetso, gufata ububiko mugihe cyibiganiro birebire.
Uburyo bwo Gushyira mu bikorwa
Kunyerera Idirishya Kwitondera imyitozo
Mistral 7B ikoresha idirishya rya 4.096-ryerekana kunyerera hejuru yurwego rwayo kugirango ikore ibisobanuro birebire bihendutse kubakoresha GPUs.
Mistral 7B ikoresha idirishya rya 4,096 ryerekana kunyerera hejuru yurwego rwayo kugirango ikemure ibicuruzwa birebire bihendutse ku baguzi ba GPUs Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Kunyerera Idirishya Kwitondera imyitozo
Longformer ikoresha idirishya ryitondewe hiyongereyeho ibimenyetso bike kwisi kugirango ushyire hamwe kandi uvuge muri make impapuro nyinshi.
Longformer ikoresha ibitekerezo byongeweho hiyongereyeho ibimenyetso bike kwisi kugirango ishyire hamwe kandi uvuge muri make inyandiko zimpapuro nyinshi Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimanza, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Kunyerera Idirishya Kwitondera imyitozo
Gemma 2 ihinduranya kunyerera-idirishya ryibanze hamwe nisi-yita kumurongo kugirango iringanize umuvuduko hamwe nigihe kirekire cyo kwibuka.
Gemma 2 isimbuza ibice byanyerera-idirishya ryibanze hamwe nisi-yitabwaho kugirango iringanize umuvuduko hamwe nigihe kirekire cyo kwibuka Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
Kunyerera Idirishya Kwitondera imyitozo
Rolling-buffer KV cache mubufasha bunganira ibika gusa idirishya rya vuba ryibimenyetso, gufata ububiko mugihe cyibiganiro birebire.
Rolling-buffer KV cache mubafasha kuganira bagumana gusa idirishya rya vuba ryibimenyetso, gufata memoire mugihe cyibiganiro birebire Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Komeza kugenzura abantu kugenzura ibisubizo byinshi. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.