NVLink na GPU Ihuza
NVLink hamwe nibihuza bifitanye isano nihuta ryihuta ryemerera GPU nyinshi kuvugana muburyo butaziguye kandi vuba.
Incamake
They are essential because training and serving the largest AI models requires hundreds or thousands of GPUs to act like one giant accelerator.
Kwibira cyane
GPU imwe ntishobora gufata moderi nini, bityo igabanijwemo chip nyinshi zigomba guhora zihana amakuru, nkibiro, gradients, hamwe nibikorwa. Bisi isanzwe ya PCIe iratinda cyane kubwibi, NVIDIA rero yashizeho NVLink, ihuza GPU-na-GPU itaziguye itanga umurongo mwinshi cyane kandi utinda cyane. Chip ya NVSwitch yagura ibi mubitambaro kugirango buri GPU muri seriveri ibashe kugera kubindi byose kumuvuduko wuzuye, ihindura GPU umunani mububiko bunini hamwe na pisine. Ku gipimo cya rack, sisitemu nka NVL72 ya NVIDIA ihuza GPU nyinshi kumurongo umwe wa NVLink. Kurenga kumurongo umwe, tekinoroji yo guhuza imiyoboro nka InfiniBand na Ethernet (akenshi hamwe na RDMA) ihuza ibihumbi nibihumbi muri cluster. Ubwiza bwibi buhuza bugabanya ingano nini nuburyo bwihuta bwerekana imyitozo.
Ubushishozi
NVLink itanga umurongo wihariye-ku-ngingo hagati ya GPUs hamwe numuyoboro mugari inshuro nyinshi za PCIe nubukererwe buke, kureka GPUs igasomana murwibutso nkaho ari hafi. NVSwitch ikora nkumuvuduko wihuse wihuta kuburyo GPUs zose muri node zitumanaho zidahagarika kumurongo wuzuye. Ibikorwa rusange nka all-kugabanya, igiteranyo cya gradients muri GPUs mugihe cyamahugurwa, ikora vuba cyane hejuru yiyi myenda, niyo mpamvu umurongo mugari uhuza imbaraga bigira uruhare runini muburyo bwo gupima umunzani kuri chip nyinshi.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka NVLink na GPU Guhuza
Nka moderi iruta seriveri imwe, ihuriro rihinduka sisitemu. NVLink ikomeza kwiyongera kuri buri gisekuru, kandi rack-nini ya NVLink (nka NVL72) yagura umubare wa GPU yitwara nkimwe. Tegereza imiyoboro minini ihuriweho, guhuza mudasobwa no guhuza imiyoboro, guhuza optique kugirango ugabanye ingufu hejuru yintera, nimbaraga zinganda zigana amahame afunguye (nka UALink) kumyenda yihariye. Gupima AI bigenda biterwa no kwimura amakuru hagati ya chip kimwe no kuri chip ubwayo.
Gushyira mu bikorwa Isi
Guhuza GPU umunani imbere muri seriveri imwe (nka sisitemu ya NVIDIA DGX) ukoresheje NVSwitch kugirango basangire kwibuka kandi bahugure icyitegererezo kinini hamwe.
Gukora byose-bigabanya buhoro buhoro syncronisation muri GPUs mugihe cyamahugurwa yatanzwe, byihuta na NVLink umurongo.
Guhuza GPUs nyinshi muri sisitemu ya NVL72 muri sisitemu imwe ihuriweho na NVLink kuri moderi ya trillion-parameter.
Guhambira ibihumbi bya seriveri ya GPU muri cluster ukoresheje InfiniBand cyangwa RDMA-hejuru-Ethernet mumahugurwa manini manini y'amahugurwa.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the NVLink and GPU Interconnects quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
GPU vs TPU kuri AI
Ibibazo bikunze kubazwa
What is NVLink and GPU Interconnects?
NVLink hamwe nibihuza bifitanye isano nihuta ryihuta ryemerera GPU nyinshi kuvugana muburyo butaziguye kandi vuba. Nibyingenzi kuko imyitozo no gukorera moderi nini ya AI bisaba amagana cyangwa ibihumbi bya GPU gukora nka moteri yihuta.
Ni ukubera iki imiyoboro yihuta ihuza nka NVLink ikenewe kubintu binini bya AI?
Moderi nini irenze ubushobozi bwa GPU imwe, bityo ikwirakwizwa kuri chip nyinshi zihora zisangira uburemere, gradients, hamwe nibikorwa, bisaba guhuza byihuse.
Ni izihe nyungu NVLink itanga hejuru ya bisi isanzwe ya PCIe yo gutumanaho kwa GPU-kuri GPU?
NVLink ni umuyoboro utaziguye wa GPU-kuri-GPU ufite umurongo munini cyane kandi wihuta cyane ugereranije na PCIe, bigatuma habaho guhanahana amakuru byihuse hagati ya chip.
Ni uruhe ruhare rwa NVSwitch muri seriveri nyinshi-GPU?
NVSwitch yagura NVLink mumyenda idahagarika, ireka GPUs zose muri node zishyikirana muburyo bwihuse.
Nibihe bikorwa rusange, bisanzwe mumahugurwa yatanzwe, byunguka cyane guhuza byihuse?
Kugabanya amafaranga yose hamwe no kugabana gradients muri GPU zose buri ntambwe yo guhugura, bityo umuvuduko wacyo uterwa cyane numuyoboro mugari.
Kurenga seriveri imwe, ni ubuhe buryo bw'ikoranabuhanga busanzwe buhuza ibihumbi bya GPU muri cluster imwe?
Ku gipimo cya cluster, guhuza nka InfiniBand cyangwa Ethernet hamwe na RDMA ihuza imitwe myinshi hamwe, ikuzuza NVLink muri buri seriveri.