Incamake
Jamba nicyitegererezo kinini cyururimi kuva muri Laboratwari ya AI21 ihuza ibice byitaweho na Transformer hamwe na leta ya Mamba ya leta (hiyongereyeho imvange-yinzobere) kugirango ibone imikorere miremire idatanze ubuziranenge bwa Transformer. Nibyingenzi kuko byerekana ubwubatsi bwububiko bushobora gutsinda Transformers nziza kububiko no kwinjiza muburebure bukurikiranye.
Jamba Hybrid Transformer-Mamba Models ni igice cyururimi-AI igikoresho cyo gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo murwego.
Kwibira cyane
Abahinduye neza bishyura ikiguzi cya quadratic mubitekerezo mugihe imiterere ikura, hamwe nurufunguzo-agaciro cache ballon hamwe nuburebure bwikurikiranya. Icyitegererezo cya leta-umwanya wikigereranyo nka Mamba igipimo cyumurongo kandi ugumane ubunini buhoraho burigihe, ariko mumateka yatinze kwitondera imirimo imwe n'imwe. Jamba ihuza byombi: itondekanya aho usanga ibyiciro byinshi ari Mamba (bihendutse, umurongo, binini kubirebire birebire) kandi umubare muto ni kwitabwaho bisanzwe (bikomeye mubyibutse neza no mubitekerezo). Yongeraho kandi imvange-yinzobere (MoE) ibice kugirango ikure ubushobozi mugihe ikomeza ibipimo byoroheje. Jamba ya mbere yasohoye ifite idirishya rya 256K-token kandi irashobora guhuza imiterere myinshi kuri GPU imwe ugereranije na Transformers igereranywa, bitewe na cache ntoya ya KV.
Ubushishozi
Mamba nicyitegererezo cya leta-umwanya wicyitegererezo: aho kwitabira buri kimenyetso cyashize, ikomeza leta isubirwamo isubirwamo ivugururwa kumurongo ikurikiranye, hamwe ninjiza-ishingiye kumuryango uhitamo icyo ugomba kubika cyangwa kwibagirwa. Jamba ihuza ibice bike byuzuye-byuzuye mubice byinshi bya Mamba kuburyo moderi igumana ibitekerezo byukuri birebire birebire mugihe ibyinshi mubibara hamwe nibuka biguma kumurongo, kandi inzira ya MoE ikora igice cyinzobere kuri buri kimenyetso.
Kumenya Jamba Hybrid Transformer-Mamba Models
Jamba nicyitegererezo kinini cyururimi kuva muri Laboratwari ya AI21 ihuza ibice byitaweho na Transformer hamwe na leta ya Mamba ya leta (hiyongereyeho imvange-yinzobere) kugirango ibone imikorere miremire idatanze ubuziranenge bwa Transformer. Nibyingenzi kuko byerekana ubwubatsi bwububiko bushobora gutsinda Transformers nziza kububiko no kwinjiza muburebure bukurikiranye. Jamba Hybrid Transformer-Mamba Models ni igice cyururimi-AI igikoresho cyo gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo murwego. Kugirango wubake byimbitse, fata Moderi ya Jamba Hybrid Transformer-Mamba nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Jamba Hybrid Transformer-Mamba Models igishushanyo mbonera, kugarura, no gusubiramo imirongo nka sisitemu imwe y'itumanaho ihuriweho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mugihe kimwe, ibintu bya Hallucinated birashobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Yagura uburyo bwindimi nuburyo bwo gutumanaho. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa-Isi
Gutunganya 256K-token inyongeramusaruro nka dosiye ndende yemewe cyangwa ububiko bunini bwa kode kuri GPU imwe idashobora guhuza na cache ya Transformer igereranywa
Gukora ibintu byinshi-byinjira-biganira igihe kirekire aho Mamba ihagaze neza igumya kwibuka neza uko ibiganiro bikura
Isesengura ryinyandiko hamwe no kugarura-byongerewe ibisekuru hejuru yubumenyi bunini cyane bwuzuye muburyo bwuzuye
Gukoresha uburemere-burebure-burebure bwa LLM (Jamba yarekuwe afite uburemere bufunguye) kugirango akore ubushakashatsi mubwubatsi bwa Hybrid
Uburyo bwo Gushyira mu bikorwa
Jamba Hybrid Transformer-Mamba Models mubikorwa
Gutunganya 256K-token yinjiza nkibisobanuro birebire byemewe n'amategeko cyangwa ububiko bunini bwa kode kuri GPU imwe idashobora guhuza na cache ya Transformer igereranywa.
Gutunganya 256K-token yinjiza nkibisobanuro birebire byemewe n'amategeko cyangwa ububiko bunini bwa kode kuri GPU imwe idashobora guhuza na Kache cache ya Transformer igereranya Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimanza, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
Jamba Hybrid Transformer-Mamba Models mubikorwa
Gukora ibintu byinshi-byinjira-biganira igihe kirekire aho Mamba ihagaze neza igumya kwibuka neza uko ibiganiro bikura.
Gukora ibintu byinshi-byinjira-biganira aho imiterere ihamye ya Mamba ituma kwibuka bigenda neza nkuko ibiganiro bikura Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.
Jamba Hybrid Transformer-Mamba Models mubikorwa
Isesengura ryinyandiko hamwe no kugarura-byongerewe ibisekuru hejuru yubumenyi bunini cyane bwuzuye muburyo bwuzuye.
Isesengura ry'inyandiko hamwe no kugarura-ibisekuruza byongerewe ubumenyi bushingiye ku bumenyi bunini bwujujwe mu buryo butaziguye Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho biri imbere, agakomeza inzira yo kuzamura abantu ku manza, kandi agakurikirana inyungu zibyara umusaruro hamwe n'ikosa ryigihe.
Jamba Hybrid Transformer-Mamba Models mubikorwa
Gukoresha uburemere-burebure-burebure bwa LLM (Jamba yarekuwe afite uburemere bufunguye) kugirango akore ubushakashatsi mubwubatsi bwa Hybrid.
Gukoresha uburemere-burebure-burebure bwa LLM (Jamba yarekuwe afite uburemere bufunguye) kugirango hakorwe ubushakashatsi mubyubatswe bivangavanze Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Komeza kugenzura abantu kugenzura ibisubizo byinshi. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.