Ubuyobozi bwa tekiniki

Icyitegererezo kivanze kandi gike

Mixtral ni Mistral AI ifunguye ivanze-ryinzobere itanga ubuziranenge bwikitegererezo ku muvuduko muto.

Incamake

Mixtral ni Mistral AI ifunguye ivanze-ryinzobere itanga ubuziranenge bwikitegererezo ku muvuduko muto. Moderi idasanzwe nkiyi ikora gusa igice cyibipimo byabo kuri buri kimenyetso, guca compte utitanze kubushobozi.

Moderi ya Mixtral na Sparse nicyuma cyubaka tekinike kigira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.

Kwibira cyane

Mixtral 8x7B, yasohowe na Mistral AI mu mpera za 2023, yamamaye uburyo budasanzwe bwo kuvanga-impuguke (MoE) muburyo bweruye. Irimo imiyoboro umunani itandukanye 'impuguke' igaburira-imbere kuri buri cyiciro, hamwe na miliyari 47 zose hamwe, ariko router yoroheje ihitamo impuguke ebyiri kuri buri kimenyetso. Nkigisubizo, ibipimo bigera kuri miliyari 13 gusa nibyo bikora kuri buri kimenyetso, bityo umwanzuro ugenda wihuta nkicyitegererezo cya 13B mugihe ugeze mubwiza ugereranije nini nini cyane. Mixtral yahuye cyangwa itsinze GPT-3.5 na Llama 2 70B kubipimo byinshi mugihe byihuta kandi bihendutse gutanga. Mistral yaje gusohora Mixtral 8x22B. Icyitegererezo cyemerewe kumugaragaro munsi ya Apache 2.0, kongerera imbaraga kwihuta no guhuza neza mumiryango ifunguye.

Ubushishozi

Mubice bike bya MoE, igaburo ryuzuye-ryimbere risimburwa numuyoboro winzobere wongeyeho umuyoboro muto winjira (router). Kuri buri kimenyetso, router ibara amanota kandi igatora abahanga bo hejuru-k (top-2 muri Mixtral), ikayobora ikimenyetso gusa muriyo. Ibisubizo byabo biremereye kandi byegeranijwe. Kuberako abahanga benshi baguma badafite icyo bakora kuri buri kimenyetso, icyitegererezo gifite ibipimo byinshi murwibutso nyamara ntigikora cyane kubara. Gucuruza: abahanga bose bagomba kwinjizwa muri VRAM nubwo bamwe bakora.

Kumenya Kuvangavanga na Ntangarugero

Mixtral ni Mistral AI ifunguye ivanze-ryinzobere itanga ubuziranenge-bwiza ku muvuduko muto. Moderi idasanzwe nkiyi ikora igice gusa cyibipimo byabo kuri token, guca compte utitanze kubushobozi. Moderi ya Mixtral na Sparse nicyuma cyubaka tekinike kigira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugirango wubake byimbitse, fata Moderi ya Mixtral na Sparse nk'icyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha Mixtral na Sparse Models atezimbere ubwubatsi, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza ka Mixtral na Ntangarugero

Sparse MoE ubu ni rwagati kumupaka AI. Tegereza byinshi byafunguye MoE irekuwe, inzira nziza-nziza hamwe ninzobere ntoya, hamwe nibisangano cyangwa impuguke zinzobere zishushanya kunoza imikorere kurushaho. Nka moderi igipimo kigera kuri triliyoni yibipimo byose, ubuke nigikoresho nyamukuru cyo gukomeza gufata umwanzuro uhendutse. Ubushakashatsi burimo guhangana n’intege nke za MoE, kuringaniza imizigo hejuru yinzobere, kwibuka hejuru, hamwe namahugurwa ahoraho, mugihe ibyuma nibikoresho bitanga bigenda byoroha cyane cyane kubijyanye ninzobere.

Gushyira mu bikorwa Isi

Gukora chatbot yo murwego rwohejuru kubiciro n'umuvuduko wa moderi ntoya cyane

Kwiyakira-moderi yemewe ya Apache-2.0 kubicuruzwa byubucuruzi nta mafaranga yo gukoresha

Guhuza neza imyitwarire ya buri muntu kuri Mixtral ya code, incamake, cyangwa imirimo yindimi nyinshi

Gukoresha byihuse umwanzuro kuri seriveri imwe-GPU imwe aho moderi ya 70B yuzuye yatinda cyane

Uburyo bwo Gushyira mu bikorwa

Moderi ivanze kandi idasanzwe mubikorwa

Gukora chatbot yo murwego rwohejuru kubiciro n'umuvuduko wa moderi ntoya cyane.

Gukorera chatbot yujuje ubuziranenge ku giciro n'umuvuduko wa moderi ntoya cyane Ikipi isanzwe ibona ibisubizo byiza iyo isobanuye ibipimo ngenderwaho imbere, ikomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi ikurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Moderi ivanze kandi idasanzwe mubikorwa

Kwiyakira-moderi yemewe ya Apache-2.0 kubicuruzwa byubucuruzi nta mafaranga yo gukoresha.

Kwiyakira-moderi yemewe ya Apache-2.0 kubicuruzwa byubucuruzi nta mafaranga yo gukoresha Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

Moderi ivanze kandi idasanzwe mubikorwa

Guhuza neza imyitwarire ya buri muntu kuri Mixtral ya code, incamake, cyangwa imirimo yindimi nyinshi.

Guhuza neza imyitwarire yumuntu ku giti cye kuri Mixtral kugirango yandike, incamake, cyangwa imirimo yindimi nyinshi Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi agakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Moderi ivanze kandi idasanzwe mubikorwa

Gukoresha byihuse umwanzuro kuri seriveri imwe-GPU imwe aho moderi ya 70B yuzuye yatinda cyane.

Gukoresha umwanzuro wihuse kuri seriveri imwe ya GPU imwe aho moderi ya 70B yuzuye yatinda cyane Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

!

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

!

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi