Isbarbardhigga Khabiirka ee Adeegga MOE
Isbarbardhigga khabiirku wuxuu kala qaybiyaa moodalka Isku-dhafka-Khubarada ee 'khubaro' horudhac u ah 'khubaro' badan oo GPU-yada kala duwan ah sidaa darteed aalad kastaa waxay haysaa jeex ka mid ah cabbirrada.
Dulmar
It is the key to serving trillion-parameter MoE models cheaply, since only a few experts run per token.
quusid qoto dheer
Lakabka Isku-dhafka-Khubarada (MoE) wuxuu beddelaa hal shabakad-horumarineed oo weyn oo leh kuwo badan oo yaryar (khubaro) oo lagu daray router ka soo qaada top-k (badanaa 1 ama 2) khubaro calaamad kasta. Isbarbar yaaca khabiirka (EP) ayaa khubaro kala duwan dhiga GPU-yada kala duwan. Marka la eego, router-ku wuxuu go'aamiyaa khabiirada calaamad kastaa u baahan yahay, ka dib tallaabo isgaarsiin oo dhan-dhan ah ayaa isku shaandheynaysa calaamadaha GPU-yada haysta khubarada ay doorteen, waxay maamulaan FFN, oo natiijooyinka dib u habeyn ku sameeyaan. Tani waxay u oggolaanaysaa moodalku inuu yeesho cabbirro wadarta guud (yar yar) iyadoo la hawlgelinayo qayb yar oo keliya calaamadiiba (FLOPs hoose). Moodooyinka sida Mixtral 8x7B, DeepSeek-V3, iyo GPT-OSS ayaa isticmaala tan. Qaybaha adagi waa isku-dheellitirka culeyska khubarada iyo labada boodbood ee qaaliga ah ee-dhammaan-dhammaan lakabkiiba.
Aragtida Farsamada
Farsamoyaqaanka xudunta u ah waa laba wadar oo dhan-dhan lakabkii MoE: diri (u dir calaamado khubaradooda) oo isku dar ah (soo-ururinta dib-u-soo-celinta). Sababtoo ah marinku waa xog-ku-tiirsane, tirada calaamadaha garaaca khabiir kasta way kala duwan tahay, taasoo keenaysa dheelitir la'aanta culeyska iyo 'stragglers'. Nidaamyada adeegyadu waxay ku daraan arrimo karti, kayd-qabaro khabiir ah, iyo hoos u dhigista ama suufka si loo ilaaliyo GEMM-yada (matrix-ku-dhufashada) labbiska, oo inta badan isku-kordhaya wada-xiriirka-dhan-dhammaan xisaabinta khabiirada si loo qariyo daahitaanka.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka Isbarbar-dhigga Khabiirka ee Adeegga MOE
Filo naqshado adag oo isku-dubbarididda iyo qalabka: diritaanka-kumbuyuutarada-isku-darka kernels, GEMM-yo kooxaysan oo ka kooban khubaro badan, iyo NVLink/InfiniBand-ka warqaba dhammaan-dhan-dhan. Farsamooyinka sida DeepSeek's dheellitirnaanta-kaaliyaha-khasaare-la'aanta iyo marin-goynta-xaddidan waxay yareeyaan taraafikada-nodes-ka. Adeegga la kala saaray ayaa u hibayn doona 'khabiir' GPU-yada ka soocan GPU-yada dareenka, iyo khubarada waaweyn ayaa tirinaya (boqolaal) kuwa ugu sarreeya waxay MoE ku riixi doonaan xag-jirnimo xad-dhaaf ah iyadoo la ilaalinayo qiimaha calammada.
Dhaqangelinta Adduunka-dhabta ah
U adeegida Mixtral 8x7B guud ahaan 2-4 GPUs iyadoo la gelinayo 2-4 ka mid ah 8deeda khabiiro qalab kasta
DeepSeek-V3 iyada oo la adeegsanayo marin-u-socod xaddidan si loo daboolo inta nood ee khubarada calaamaduhu ay ku taallo, gooynta noodhka-dhammaan-dhan
Isticmaalka vLLM ama SGLang khabiir-qaab isbarbar socda si aad u martigeliso moodal yar oo 200B+ ah hal 8-GPU
Isku darka isbarbardhigga khabiirada iyo isbarbardhigga tensor ee lakabyada dareenka ee geynta EP+
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Expert Parallelism for MoE Serving quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Buuxinta la kala saaray oo Decode u adeegida
Su'aalaha soo noqnoqda
What is Expert Parallelism for MoE Serving?
Isbarbardhigga khabiirku wuxuu kala qaybiyaa moodalka Isku-dhafka-Khubarada ee 'khubaro' horudhac u ah 'khubaro' badan oo GPU-yada kala duwan ah sidaa darteed aalad kastaa waxay haysaa jeex ka mid ah cabbirrada. Waa furaha loogu adeegayo moodooyinka MoE-ga ee trillion-ka ah si raqiis ah, maadaama khubaro yar oo kaliya ay ku shaqeeyaan calaamad kasta.
Waa maxay isbarbardhigga khabiiradu u qaybiyaan GPU-yada oo dhan?
Isbarbardhigga khabiirku wuxuu dhigayaa khubaro kala duwan (shabakad-hoosaadka FFN ee lakabka MoE) GPU-yada kala duwan, markaa qalab kastaa wuxuu hayaa kaliya qayb hoosaadyo khubaro ah.
Qaabkee isgaarsiineed ayaa udub dhexaad u ah isbarbardhigga khabiirada MoE?
Lakab kasta oo MoE ah wuxuu caadi ahaan u baahan yahay dhammaan-dhan-dhan si loogu diro calaamado khubaradooda iyo mid kale oo dhan-dhan-dhan si dib loogu daro wax-soo-saarka.
Waa maxay sababta MoE ay u xisaabiso hoos-u-dhac kasta iyadoo ay jirto wadarta guud?
Router-ku waxa uu dhaqaajiyaa kaliya khubarada sare-k (badanaa 1-2) calaamadiiba, marka FLOPs way yar yihiin inkasta oo moodelku leeyahay khubaro badan guud ahaan.
Dhibaato noocee ah ayaa soo baxda sababtoo ah marin-ku-gudbinta waxay ku tiirsan tahay xog?
Maadaama doorashooyinka router-ku ay ku xiran yihiin gelinta, khubarada qaar ayaa hela calaamado badan oo ka badan kuwa kale, abuurista isku dheelitirnaan la'aanta culeyska iyo qalafsanayaasha.
Waa maxay farsamada caadiga ah si loo ilaaliyo matrix khabiir ku dhufto lebbiska cabbir ahaan?
U adeegida xirmooyinka ayaa dejinaya awoodda khabiirkiiba (tirinta ugu badan ee calaamadda) iyo suuf ama hoos u dhigista calaamado ka baxsan si GEMM khabiir kasta uu yeesho qaab la saadaalin karo.