Nhungamiro yehunyanzvi
NVLink uye GPU Interconnects
NVLink uye zvine hukama zvinongedzo ndizvo zvinongedzo zvekumhanya izvo zvinoita kuti maGPU mazhinji ataure kune mumwe nemumwe zvakananga uye nekukurumidza.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Pa peji ino2 min verenga
Pfupiso
Izvo zvakakosha nekuti kudzidziswa uye kushandira makuru makuru eAI modhi zvinoda mazana kana zviuru zveGPU kuita senge hofori yekumhanyisa.
Kudzika Kwakadzika
GPU imwe chete haigone kubata mamodheru makuru, saka anopatsanurwa pamachipi mazhinji anofanirwa kugara achichinjana data, senge uremu, gradients, uye activation. Iyo yakajairwa PCIe bhazi inononoka pane izvi, saka NVIDIA yakagadzira NVLink, yakananga GPU-kune-GPU link inopa kure yakakwira bandwidth uye yakaderera latency. NVSwitch machipisi anowedzera izvi kuita jira kuitira kuti maGPU ese ari musevha asvike kune imwe neimwe nekumhanya kuzere, achishandura maGPU masere kuita imwe hombe ndangariro uye compute dziva. Pa rack scale, masisitimu akaita seNVIDIA's NVL72 anobatanidza akawanda eGPUs pamusoro peiyo yakabatana NVLink domain. Kupfuura rack imwechete, matekinoroji etiweki seInfiniBand uye Ethernet (kazhinji neRDMA) inosunga zviuru zvemanodhi musumbu. Hunhu hweaya anobatana anoganhura zvakananga kuti yakakura sei uye nekukurumidza mamodheru anogona kudzidzisa.
Kuitwa muNyika yeChokwadi
Kubatanidza sere maGPU mukati mesevha imwechete (seNVIDIA DGX masisitimu) kuburikidza neNVSwitch saka vanogovana ndangariro uye kudzidzisa imwe hombe modhi pamwechete.
Kuita zvese-kudzikisa gradient kuwiriranisa mukati meGPUs panguva yakagoverwa kudzidziswa, inokwidziridzwa neNVLink bandwidth.
Kubatanidza akawanda eGPUs mune rack-scale NVL72 system mune imwe yakabatana NVLink domain yematrion-parameter modhi.
Kusunga zviuru zveGPU maseva kuita sumbu uchishandisa InfiniBand kana RDMA-pamusoro-Ethernet yehukuru-hukuru hwaro modhi yekudzidziswa.
Ramangwana reNVLink uye GPU Interconnects
Sezvo mamodheru achikura maseva ega, iyo yekubatanidza iri kuita sisitimu. NVLink inoramba ichiwana bandwidth chizvarwa chega chega, uye rack-scale NVLink domains (seNVL72) iri kuwedzera huwandu hweGPU dzinoita seimwe. Tarisira makuru akabatana madomasi, kusimba kwakabatana kwekombuta uye network, optical zvinongedzo kudzikisa simba pamusoro pechinhambwe, uye indasitiri kuedza kuvhura yakavhurika yekubatanidza zviyero (seUALink) kukwikwidza machira evaridzi. Kuyera AI kunowedzera kunoenderana nekufambisa data pakati pemachipi zvakanyanya sepamachipisi pachawo.
Kuzvishandisa
Nei zvichikosha
- Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
- Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
- Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.
Chenjera
- Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
- Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
- Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.
Matanho anotevera
- Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
- Benchmark pasi pechokwadi mutoro uye data mamiriro.
- Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
- Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.
Ramba Uchiongorora
Tsamba yemahara
Tora iyo yemazuva ese AI pfupiso
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Take the NVLink and GPU Interconnects quiz
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Mibvunzo inowanzo bvunzwa
Chii chinonzi NVLink uye GPU Interconnects?
NVLink uye zvine hukama zvinongedzo ndizvo zvinongedzo zvekumhanya izvo zvinoita kuti maGPU mazhinji ataure kune mumwe nemumwe zvakananga uye nekukurumidza. Izvo zvakakosha nekuti kudzidziswa uye kushandira yakakura kwazvo AI modhi inoda mazana kana zviuru zveGPU kuita senge hofori yekumhanyisa.
Nei yakakwira-kumhanya yekubatanidza seNVLink ichidikanwa kune hombe AI modhi?
Mahombe modhi anodarika kugona kweGPU imwe chete, saka akapararira kune akawanda machipi anoramba achigovana uremu, gradients, uye activation, inoda kukurumidza malink.
Ndeipi mukana unopihwa neNVLink pamusoro peyakajairwa PCIe bhazi reGPU-kune-GPU kutaurirana?
NVLink ndeye yakananga GPU-kune-GPU yekubatanidza ine yakakura kwazvo bandwidth uye yakaderera latency kupfuura PCIe, ichigonesa kukurumidza kuchinjana data pakati pemachipi.
Ndeipi basa reNVSwitch mune yakawanda-GPU server?
NVSwitch inotambanudzira NVLink mumucheka usingavhare, ichirega maGPU ese munode achitaurirana nekumhanya kuzere.
Ndeipi mashandiro emubatanidzwa, akajairika mukudzidziswa kwakagoverwa, anobatsirika zvakanyanya kubva kune inokurumidza kubatanidza?
Yese-inoderedza masamu uye inogovera gradients muGPU dzese nhanho imwe neimwe yekudzidziswa, saka kumhanya kwayo kunoenderana zvakanyanya nekubatanidza bandwidth.
Kupfuura sevha imwe chete, ndeapi matekinoroji anowanzo kubatanidza zviuru zveGPU node musumbu rimwe?
Pachikwata chechikwata, networking yakadai seInfiniBand kana Ethernet neRDMA inosunga node dzakawanda pamwe chete, ichizadzisa NVLink mukati mesevha yega yega.
Ramba uchidzidza
Mazano anoenderana
Mamwe madhairekitori akasarudzirwa nyaya iyi