InfiniBand iyo isku xidhka RDMA
InfiniBand waa xawaare sare, xidhiidh hoose oo daahsoon kaas oo isku xidha server-yada iyo GPU-yada ku jira kooxaha AI, RDMA waxay u ogolaataa hal mashiin inuu akhriyo ama qoro xusuusta kale iyada oo aan ku lug lahayn CPU.
Dulmar
Together they are the plumbing that keeps thousands of GPUs fed with data during large-model training.
quusid qoto dheer
Marka aad tababarto moodal kumanaan GPU-yo ah, shabakadu inta badan waxay noqotaa cidhifyada, maaha jajabyada. InfiniBand waa maro la beddelay oo tan loo dhisay: waxay bixisaa halbeegga isku xidhka ee boqollaal gigabits ilbiriqsikii (NDR waxay ku socotaa 400 Gb/s) iyo daahitaanka cabbirka-microsecond. Xeeladdeeda furaha ah waa Helitaanka Xusuusta Tooska ah ee Fog (RDMA), kaas oo si toos ah xogta ugu dhex wareejinaya xusuusta labada nood, isaga oo ka gudbaya kernel-ka nidaamka hawlgalka iyo koobiyada CPU ee hoos u dhigaya TCP/IP caadiga ah. Tani 'kernel bypass' waxay xoraysaa wareegyada CPU waxayna yaraysaa daahitaanka. InfiniBand sidoo kale waxay siisaa kontoroolka qulqulka qalabka ee maro aan lumin, iyo NVIDIA's Quantum switches iyo adapters ConnectX ayaa xukuma AI supercomputer. RoCE (RDMA ka sarreeya Ethernet Converged) waxay u keentaa faa'iidooyin RDMA isku mid ah shabakadaha Ethernet.
Aragtida Farsamada
RDMA waxay ku shaqeysaa shaqal iyo lammaane saf. Codsigu wuxuu soo dhejiyaa codsiyada shaqada si loo diro oo loo helo safafka; adabtarada shabkada (HCA) ayaa akhriya oo si toos ah xogta ugu gudbisa kuwa hore u diiwaan gashanaa, meelaha xusuusta ku xidhan ee martigeliyaha fog. Sababtoo ah NIC waxay gacanta ku haysaa wareejinta qalabka iyo kernel-ka OS waa la hareer maray, waxaa jira eber xog nuqul ah mana jiro baakidh kasta oo CPU carqaladeeya wareejinta badan. InfiniBand's isku xirka-lakabka credit-ku-saleysan kontoroolka socodka socodka wuxuu ka hortagayaa qulqulka qulqulka, taasoo ka dhigaysa dharka mid aan lumin iyada oo aan la helin duufaanno dib u gudbin ah.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka InfiniBand iyo Isku xidhka RDMA
Bandwidth ayaa sii kordheysa: XDR InfiniBand wuxuu bartilmaameedsadaa 800 Gb/s isku xirka, oo leh khariidado waddooyin ah oo ku wajahan 1.6 Tb/s. Tartanku wuu sii xoogaysanayaa iyadoo Ultra Ethernet Consortium ay naqshadayso Ethernet kaas oo u dhigma InfiniBand ee culeyska shaqada ee AI, iyo sida in-network computing (SHARP) ay ka saareyso xisaabta wadajirka ah furayaasha laftooda. Filo isku xidhka GPU-ilaa-shabakad adag, isku xidhka indhaha si loo gooyo awooda, iyo maro la miisaamay ilaa rucubyada boqollaal kun ee dardar-geliyayaasha marka moodooyinka xuduuduhu koraan.
Dhaqangelinta Adduunka-dhabta ah
Isku xirka kumanaan GPU-yada supercomputer-ka AI si xogta tartiib-tartiibku ay u guurto inta u dhaxaysa noodhka ilbiriqsiyo gudahood inta lagu jiro tababarka la qaybiyay
U oggolow hal server inuu si toos ah u akhriyo xusuusta kale (RDMA) si loo dardargeliyo nidaamyada faylalka la qaybiyay iyo xog-ururinta iyada oo aan la dhaafin CPU.
Ku socodsiinta hawlaha NCCL-dhammaan-yaraynta ee InfiniBand si loo waafajiyo miisaanka moodeelka guud ahaan kooxda GPU
Isticmaalka RoCE si loo keeno wareejinta daahsoon ee qaabka RDMA ee shabakadaha xarunta xogta Ethernet jira
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the InfiniBand and RDMA Networking quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Tubbooyinka Injineerinka ah ee Feature iyo Nooca Xogta
Su'aalaha soo noqnoqda
What is InfiniBand and RDMA Networking?
InfiniBand waa xawaare sare, xidhiidh hoose oo daahsoon kaas oo isku xidha server-yada iyo GPU-yada ku jira kooxaha AI, RDMA waxay u ogolaataa hal mashiin inuu akhriyo ama qoro xusuusta kale iyada oo aan ku lug lahayn CPU. Si wada jir ah waa tuubbooyinka ilaaliya kumanaan GPU-yada lagu quudiyo xogta inta lagu jiro tababarka moodeelka weyn.
Maxay RDMA asal ahaan u ogolaataa hal kumbuyuutar inuu sameeyo?
Helitaanka Xusuusta Tooska ah ee Fog waxa ay si toos ah xogta u dhex martaa inta u dhaxaysa xusuusta labada nood, iyada oo ka gudbaysa kernel-ka OS iyo koobiyada CPU, kaas oo jaraya daahitaanka kana xoreeya wareegyada CPU.
Waa maxay sababta InfiniBand u gaadho daahisnimo aad uga hooseeya kan caadiga ah ee TCP/IP?
Adabiyeyaasha InfiniBand waxay si toos ah xogta ugu wareejiyaan/ka rogaan xusuusta dhejiska ah ee hardware-ka waxayna dhaafaan kernel-ka OS-ka, iyagoo meesha ka saaraya baakidh walba ee CPU iyo koobiyada xogta.
Qiyaastii waa maxay bandwiishkii isku xirka ee NDR InfiniBand ay bixiso?
NDR (Qiimaha Xogta Xiga) InfiniBand wuxuu ku shaqeeyaa 400 Gb/s isku xidhkiiba, iyadoo XDR la beegsanayo 800 Gb/s jiilka soo socda.
Gudaha RDMA, maxaa 'lammaanaha safka' loo isticmaalaa?
Codsiyada waxay dhajiyaan codsiyo shaqo si ay u diraan oo helaan safafka (lammaanaha safka); Adapter-ka kanaalka martida loo yahay wuu akhriyaa oo wuxuu sameeyaa wareejinta xusuusta tooska ah.
Waa maxay RoCE?
RoCE waxay u taagan tahay RDMA oo ka sarreysa Ethernet Converged, taasoo u oggolaanaysa daahitaanka hooseeya, wareejinta kernel-bypass ee dharka caadiga ah ee Ethernet beddelka InfiniBand ee asalka ah.