Icyitegererezo kivanze kandi gike
Mixtral ni Mistral AI ifunguye ivanze-ryinzobere itanga ubuziranenge bwikitegererezo ku muvuduko muto.
Incamake
Sparse models like it activate only a fraction of their parameters per token, cutting compute without sacrificing capability.
Kwibira cyane
Mixtral 8x7B, yasohowe na Mistral AI mu mpera za 2023, yamamaye uburyo budasanzwe bwo kuvanga-impuguke (MoE) muburyo bweruye. Irimo imiyoboro umunani itandukanye 'impuguke' igaburira-imbere kuri buri cyiciro, hamwe na miliyari 47 zose hamwe, ariko router yoroheje ihitamo impuguke ebyiri kuri buri kimenyetso. Nkigisubizo, ibipimo bigera kuri miliyari 13 gusa nibyo bikora kuri buri kimenyetso, bityo umwanzuro ugenda wihuta nkicyitegererezo cya 13B mugihe ugeze mubwiza ugereranije nini nini cyane. Mixtral yahuye cyangwa itsinze GPT-3.5 na Llama 2 70B kubipimo byinshi mugihe byihuta kandi bihendutse gutanga. Mistral yaje gusohora Mixtral 8x22B. Icyitegererezo cyemerewe kumugaragaro kuri Apache 2.0, kongerera imbaraga kwihuta no guhuza neza mumiryango ifunguye.
Ubushishozi
Mubice bike bya MoE, igaburo ryuzuye-ryimbere risimburwa numuyoboro winzobere wongeyeho umuyoboro muto winjira (router). Kuri buri kimenyetso, router ibara amanota kandi igatora abahanga bo hejuru-k (top-2 muri Mixtral), ikayobora ikimenyetso gusa muriyo. Ibisubizo byabo biremereye kandi byegeranijwe. Kuberako abahanga benshi baguma badafite icyo bakora kuri buri kimenyetso, icyitegererezo gifite ibipimo byinshi murwibutso nyamara ntigikora cyane kubara. Gucuruza: abahanga bose bagomba kwinjizwa muri VRAM nubwo bamwe bakora.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka Mixtral na Ntangarugero
Sparse MoE ubu ni rwagati kumupaka AI. Witegereze gufungura MoE gusohora, guhuza neza-hamwe ninzobere ntoya, hamwe ninzobere zisangiwe cyangwa zivanze zitezimbere kurushaho. Nka moderi igipimo kigera kuri triliyoni yibipimo byose, ubuke nigikoresho nyamukuru cyo gukomeza gufata umwanzuro uhendutse. Ubushakashatsi burimo guhangana n’intege nke za MoE, kuringaniza imizigo hejuru yinzobere, kwibuka hejuru, no guhugura imyitozo, mugihe ibyuma na serivise bigenda byoroha cyane cyane kubijyanye ninzira zinzobere.
Gushyira mu bikorwa Isi
Gukora chatbot yo murwego rwohejuru kubiciro n'umuvuduko wa moderi ntoya cyane
Kwikorera wenyine Apache-2.0 yemewe kubicuruzwa byubucuruzi nta mafaranga yo gukoresha
Guhuza neza imyitwarire ya buri muntu kuri Mixtral ya code, incamake, cyangwa imirimo yindimi nyinshi
Gukoresha umwanzuro wihuse kuri seriveri imwe-GPU imwe aho moderi ya 70B yuzuye yatinda cyane
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Mixtral and Sparse Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Icyitegererezo hamwe n'umuyoboro
Ibibazo bikunze kubazwa
What is Mixtral and Sparse Models?
Mixtral ni Mistral AI ifunguye ivanze-ryinzobere itanga ubuziranenge bwikitegererezo ku muvuduko muto. Moderi idasanzwe nkiyi ikora gusa igice cyibipimo byabo kuri buri kimenyetso, guca compte utitanze kubushobozi.
Muri Mixtral 8x7B, abahanga bangahe batunganya buri kimenyetso?
Mixtral ikoresha top-2 inzira: router ihitamo impuguke ebyiri muri umunani zo gutunganya buri kimenyetso.
Niki kintu kigena impuguke ikimenyetso cyoherejwe?
Umuyoboro muto winjira, witwa router, utanga amanota abahanga kandi ugahitamo izitwara buri kimenyetso.
Nubwo Mixtral 8x7B ifite ibipimo bigera kuri 47B byose, hafi ni bangahe bakora kuri token?
Kuberako impuguke ebyiri zonyine zikoresha kuri buri kimenyetso, hafi miliyari 13 ibipimo birakora, biha umuvuduko wa moderi ntoya cyane.
Ni ubuhe buryo bw'ingenzi bwo gucuruza moderi zidasanzwe za MoE nka Mixtral?
MoE ibika compte kuri buri kimenyetso ariko iracyasaba abahanga bose kuba muri VRAM, kongera ububiko bukenewe.
Ni uruhe ruhushya Mistral AI yarekuye Mixtral, bikongerera uburenganzira bwo kwakirwa?
Mixtral yarekuwe munsi yimpushya zemewe za Apache 2.0, yemerera gukoresha ubucuruzi kubuntu no gutunganya neza.