Ubuyobozi bwa tekiniki
NVLink na GPU Ihuza
NVLink hamwe nibihuza bifitanye isano nihuta ryihuta ryemerera GPU nyinshi kuvugana muburyo butaziguye kandi vuba.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
They are essential because training and serving the largest AI models requires hundreds or thousands of GPUs to act like one giant accelerator.
Kwibira cyane
GPU imwe ntishobora gufata moderi nini, bityo igabanijwemo chip nyinshi zigomba guhora zihana amakuru, nkibiro, gradients, hamwe nibikorwa. Bisi isanzwe ya PCIe iratinda cyane kubwibi, NVIDIA rero yashizeho NVLink, ihuza GPU-na-GPU itaziguye itanga umurongo mwinshi cyane kandi utinda cyane. Chip ya NVSwitch yagura ibi mubitambaro kugirango buri GPU muri seriveri ibashe kugera kubindi byose kumuvuduko wuzuye, ihindura GPU umunani mububiko bunini hamwe na pisine. Ku gipimo cya rack, sisitemu nka NVL72 ya NVIDIA ihuza GPU nyinshi kumurongo umwe wa NVLink. Kurenga kumurongo umwe, tekinoroji yo guhuza imiyoboro nka InfiniBand na Ethernet (akenshi hamwe na RDMA) ihuza ibihumbi nibihumbi muri cluster. Ubwiza bwibi buhuza bugabanya ingano nini nuburyo bwihuta bwerekana imyitozo.
Gushyira mu bikorwa Isi
Guhuza GPU umunani imbere muri seriveri imwe (nka sisitemu ya NVIDIA DGX) ukoresheje NVSwitch kugirango basangire kwibuka kandi bahugure icyitegererezo kinini hamwe.
Gukora byose-bigabanya buhoro buhoro syncronisation muri GPUs mugihe cyamahugurwa yatanzwe, byihuta na NVLink umurongo.
Guhuza GPUs nyinshi muri sisitemu ya NVL72 muri sisitemu imwe ihuriweho na NVLink kuri moderi ya trillion-parameter.
Guhambira ibihumbi bya seriveri ya GPU muri cluster ukoresheje InfiniBand cyangwa RDMA-hejuru-Ethernet mumahugurwa manini manini y'amahugurwa.
Kazoza ka NVLink na GPU Guhuza
Nka moderi iruta seriveri imwe, ihuriro rihinduka sisitemu. NVLink ikomeza kwiyongera kuri buri gisekuru, kandi rack-nini ya NVLink (nka NVL72) yagura umubare wa GPU yitwara nkimwe. Tegereza imiyoboro minini ihuriweho, guhuza mudasobwa no guhuza imiyoboro, guhuza optique kugirango ugabanye ingufu hejuru yintera, nimbaraga zinganda zigana amahame afunguye (nka UALink) kumyenda yihariye. Gupima AI bigenda biterwa no kwimura amakuru hagati ya chip kimwe no kuri chip ubwayo.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
- Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
- Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Witondere
- Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
- Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
- Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Intambwe ikurikira
- Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
- Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
- Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
- Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Take the NVLink and GPU Interconnects quiz
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
What is NVLink and GPU Interconnects?
NVLink hamwe nibihuza bifitanye isano nihuta ryihuta ryemerera GPU nyinshi kuvugana muburyo butaziguye kandi vuba. Nibyingenzi kuko imyitozo no gukorera moderi nini ya AI bisaba amagana cyangwa ibihumbi bya GPU gukora nka moteri yihuta.
Ni ukubera iki imiyoboro yihuta ihuza nka NVLink ikenewe kubintu binini bya AI?
Moderi nini irenze ubushobozi bwa GPU imwe, bityo ikwirakwizwa kuri chip nyinshi zihora zisangira uburemere, gradients, hamwe nibikorwa, bisaba guhuza byihuse.
Ni izihe nyungu NVLink itanga hejuru ya bisi isanzwe ya PCIe yo gutumanaho kwa GPU-kuri GPU?
NVLink ni umuyoboro utaziguye wa GPU-kuri-GPU ufite umurongo munini cyane kandi wihuta cyane ugereranije na PCIe, bigatuma habaho guhanahana amakuru byihuse hagati ya chip.
Ni uruhe ruhare rwa NVSwitch muri seriveri nyinshi-GPU?
NVSwitch yagura NVLink mumyenda idahagarika, ireka GPUs zose muri node zishyikirana muburyo bwihuse.
Nibihe bikorwa rusange, bisanzwe mumahugurwa yatanzwe, byunguka cyane guhuza byihuse?
Kugabanya amafaranga yose hamwe no kugabana gradients muri GPU zose buri ntambwe yo guhugura, bityo umuvuduko wacyo uterwa cyane numuyoboro mugari.
Kurenga seriveri imwe, ni ubuhe buryo bw'ikoranabuhanga busanzwe buhuza ibihumbi bya GPU muri cluster imwe?
Ku gipimo cya cluster, guhuza nka InfiniBand cyangwa Ethernet hamwe na RDMA ihuza imitwe myinshi hamwe, ikuzuza NVLink muri buri seriveri.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo