Reseau InfiniBand ak RDMA
InfiniBand ab lëkkaloo bu gaaw la, te amul latency bu bari, muy lëkkale serwër yi ak GPU yi ci cluster IA yi, RDMA dafay may benn masin mu jàng wala bind memory beneen masin te du jëfandikoo CPU bi.
Résumé
Together they are the plumbing that keeps thousands of GPUs fed with data during large-model training.
Plongeur bu xóot
Soo tàggatee benn model ci ay junni GPU, reso bi mooy faral di nekk bottleneck bi, du chips yi. InfiniBand tissu commuté la buñu defar ngir loolu: dafay joxe yaatuwaayu band ci lëkkalekaay bu nekk ci téemeeri gigabit ci seconde (NDR dafay daw ci 400 Gb/s) ak latency ci escale microseconde. Li gëna am solo mooy Remote Direct Memory Access (RDMA), muy toxal done yi ci diggante ñaari node, te du romb kernel sistem biy doxal ak kopi CPU yiy yeexal TCP/IP. Bii 'bypass kernel' dafay dindi cycle CPU yi ba noppi wàññi latency bi. InfiniBand itam dafay joxe seytu debit ci aparey bi ngir tissu bu amul benn perte, ba noppi commutateur Quantum yu NVIDIA ak adaptëru ConnectX ñoo ëpp doole ci ordinatër yu mag yi ci IA. RoCE (RDMA ci kaw Ethernet buñ boole) dafay indi njariñ yu noonu mel ci reso Ethernet yi.
Gis-gis xarala
RDMA dafay liggéey ci verb ak ñaari raŋ. Aplikaasioŋ dafay dugal ay laaj liggéey ngir yónnee ak jot ay raŋ; adaptatëru reso bi (HCA) daf leen di jàng ba noppi yónnee done yi ci gox yiñ njëkka bind, yuñ fikse ci mémoire bi ci host bi sori. Ndax NIC mooy yonnee toxal bi ci hardware bi te kernel OS bi dafay bypass, amul benn kopi done te amul benn CPU buy dakkal toxal bi ci paket bu nekk. Kontrolu debit bi lalu ci leble bu InfiniBand dafay tere tampon bi di wal, suko defee tissu bi du ñàkk dara te du am retransmission.
njeextalu pexe
Njëgg ak budget
Dogal yi architecture di jël dañuy indi njariñ ak njëgu liggéey bi ay at ci ginaaw.
dogal yu gëna leer
Njàngalem xarala yi dafay jàppale ekip yi ñu tànn li gën, te baña yam ci li gëna bees daal.
Xool kalite
Tanneef yu gëna baax ci wàllu ingeñër dina wàññi jafe-jafe yi ci wàllu wóor ci liggéey bi.
Ëlëgu Reseau InfiniBand ak RDMA
Yaatuwaayu bande bi dafay wéy di yokk: XDR InfiniBand mingi bëgga yegg ba 800 Gb/s ci lëkkalekaay bu nekk, ak kàrtu yoon yuy dem ba 1.6 Tb/s. Taxawaay bi mungi wey di gina am doole ginnaaw bi Ultra Ethernet Consortium defar Ethernet bu méngoo ak InfiniBand ngir ay ligeeyu IA, ak ginnàaw bi ordinatër yi ci biir reso bi (SHARP) di yobbu math bu mbooloo ci kommutatër yi ci seen bopp. Xaarandil boole GPU ak reso bu gëna dëgër, lëkkaloo optik ngir dagg doole, ak tissu yuñ yokk ba tollu ci téemeeri junni accelerator yu model frontier yi di màgg.
Doxal ci àdduna dëgg
Jokko ay junni GPU ci benn super ordinatër IA suko defee done yu gradient yi di toxu ci diggante node yi ci ay mikrosegond ci diiru tàggat buñ séddale
Bayyi benn serwër mu jàng beneen serwër ci saasi (RDMA) ngir gaawlu sistemu fichier yiñ séddale ak base de done te du am benn CPU
Doxal NCCL lépp luy wàññi liggéey ci kaw InfiniBand ngir méngale diisaayu model ci biir benn cluster GPU
Jëfandikoo RoCE ngir indi toxal yu woyof yu melni RDMA ci reso santu done Ethernet yi fi nekk
Risk yi ak balustrade yi
Optimize benn benchmark mën na nëbb ñakk kattan yu gëna yaatu ci sistem bi.
Njëg li ñuy fay ci infrastructure yi ak ci toppatoo dañuy faral di suufeel.
Bu sistem yi di gëna xawa jafee xam, jafe-jafe yi am ci wàllu kaaraange ak seetlu mën nañu gëna bari.
Roadmap ngir samp gi
Mandargal latency, kalite, ak njëg yi laata ngay jëfandikoo.
Benchmark ci biir sargal ak done yu dëggu.
Jumtukaay bi di saytu njuumte yi, derive bi ak njeextalu jëfandikukat bi.
Waajal rollback ak yooni tontu ci jafe-jafe yi laata ngay eskale.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the InfiniBand and RDMA Networking quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Pipelines Ingénieur yu am solo ak Versioŋu Done
Laaj yi ñuy faral di laaj
What is InfiniBand and RDMA Networking?
InfiniBand ab lëkkaloo bu gaaw la, te amul latency bu bari, muy lëkkale serwër yi ak GPU yi ci cluster IA yi, RDMA dafay may benn masin mu jàng wala bind memory beneen masin te du jëfandikoo CPU bi. Ñoom ñépp bokk ñooy plomberie biy tëye ay junni GPU yu am done ci diiru tàggat model yu mag.
Lan la RDMA may benn ordinatër mu def?
Remote Direct Memory Access dafay toxal done yi ci digganté mémoire ñaari node, te du romb kernel OS bi ak kopi CPU yi, loolu mooy dagg latency bi ba noppi dindi cycle CPU yi.
Lan moo waral InfiniBand di def ay latency yu gëna ndaw yeneen reso TCP/IP yi?
Adaptatëri InfiniBand dañuy toxal done yi ci/ci memory biñ tëye ci hardware bi ba noppi romb kernel OS bi, di dindi dagg CPU bu nekk ci paket bi ak kopie done yi.
Lu tollu ci ban yaatuwaayu band la NDR InfiniBand di joxe ci lëkkalekaay bu nekk?
NDR (Tolluwaayu done yi ci topp) InfiniBand dafay daw ci 400 Gb/s ci lëkkalekaay bu nekk, ak XDR buy wut 800 Gb/s ci jamono ji ci topp.
Ci RDMA, lan lañuy jëfandikoo 'ñaari raŋ'?
Aplikaasioŋ yi dañuy yónnee ak jot ay raŋ (ñaari raŋ); adaptatëru chaine host bi daf leen di jàng ba noppi def toxal mémoire bi ci saasi.
Luy RoCE?
RoCE mooy RDMA ci kaw Ethernet buñ boole, loolu mooy tax ñu mëna toxal kernel ci kaw tissu Ethernet buñ miin, du InfiniBand buñ miin.