Ibice byinshi GPU Gutandukana
Multi-Instance GPU (MIG) ni tekinoroji ya NVIDIA ikata GPU imwe yumubiri mubice byinshi byitaruye.
Incamake
It matters because it lets one expensive accelerator serve many small workloads at once without them interfering with each other.
Kwibira cyane
Yamenyekanye na NVIDIA A100 (Ampere) ikomeza kuri H100 hamwe namakuru mashya-ya GPUs, MIG ikora GPU mubihe bigera kuri birindwi byigenga. Bitandukanye na software igabanya igihe, MIG itanga ibyuma byukuri byo kwigunga: buri rugero rubona uburyo bwihariye bwo gutondeka ibintu byinshi (SMs), L2 cache ikata, kugenzura ububiko, hamwe nigice gihamye cyo kwibuka cyane. A100 ifite 40GB irashobora kugabanywamo inshuro zirindwi 5GB, cyangwa nini nini. Buri gice cyitwara nka GPU ntoya, bityo akazi gasakuza cyangwa guhanuka murugero rumwe ntishobora kwicwa ninzara cyangwa konona urundi. Iyi garanti yizewe-ya-serivisi ituma MIG iba nziza muburyo bwo gutanga serivisi, amahuriro menshi-akodeshwa, hamwe niterambere ryiterambere aho abakoresha benshi basangira ikarita imwe.
Ubushishozi
MIG ikora muburyo bwo kwinjiza GPU imbere yimbere kugirango buri rugero rugire inzira ihamye yibice byayo yibuka na SMs. NVIDIA isobanura imyirondoro nkibice nka 1g.5gb (igice kimwe cya compte, 5GB) kugeza kuri 7g.40gb. GPU Instance ibika kwibuka na SMs; muri yo Compute Instance igabanya SMs kurushaho. Kuberako ibice ari ibyuma-byashyizwe mu bikorwa, amakosa, amakosa ya ECC, hamwe nububiko bwagutse bugumaho kurugero rumwe.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka Multi-Instance GPU Gutandukana
Mugihe GPU ikura ikagera kuri 80GB, 141GB, na nyuma yayo, gutandukana bigenda birushaho kuba byiza kuko moderi kugiti cye idakenera ikarita yose kugirango ifate umwanzuro. Tegereza gukomera Kubernetes no guhuza ibicu, gusubiranamo imbaraga utarinze gukuramo node, hamwe na profili nziza. Abacuruzi bahatanira gukurikirana ibintu bisa na SR-IOV-yuburyo bwa GPU, hamwe na seriveri idafite seriveri igenda yishingikiriza kubice kugirango bapakire moderi nyinshi cyane kandi bagabanye imyanda idafite akamaro.
Gushyira mu bikorwa Isi
Igicu gitanga igabana A100 mubice birindwi kuburyo abakiriya barindwi buri wese abona igice cya GPU cyizewe, cyitaruye.
Ihuriro ry’ubushakashatsi muri kaminuza riha buri munyeshuri wa PhD urugero rwa 10GB MIG yo gukora prototyping aho kwiharira amakarita yose.
Serivise yerekana ifata imvugo ntoya nicyerekezo kuri H100 imwe, buri gice cyacyo hamwe nubukererwe buteganijwe.
Ihuriro rya Kubernetes ryamamaza MIG ingero nkibikoresho byateganijwe bityo pods isaba 'nvidia.com/mig-1g.5gb' nkibindi bikoresho byose.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Multi-Instance GPU Partitioning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kwiga Ibikorwa byinshi
Ibibazo bikunze kubazwa
What is Multi-Instance GPU Partitioning?
Multi-Instance GPU (MIG) ni tekinoroji ya NVIDIA ikata GPU imwe yumubiri mubice byinshi byitaruye. Nibyiza kuko ireka umuvuduko umwe uhenze ukorera imirimo myinshi icyarimwe icyarimwe utabangamiye undi.
Ni ubuhe bwigunge MIG itanga hagati yingero?
MIG ishyira mu bwigunge mu byuma, kwiyegurira SMs, L2 cache ikata, hamwe na memoire kuri buri rugero kugirango imizigo y'akazi idashobora kubangamira.
Ni ubuhe bwubatsi bwa NVIDIA MIG yatangijwe bwa mbere?
MIG yatangiriye kuri A100 ishingiye kuri A100 ikomeza kuri H100 hanyuma nyuma ya data-center GPUs.
Nuwuhe mubare ntarengwa w'ingero MIG ishoboye GPU ishobora kugabanywamo?
MIG ishoboye GPU nka A100 irashobora kugabanwa inshuro zirindwi zigenga.
Mu mwirondoro MIG nka '1g.5gb', '5gb' igereranya iki?
Umwirondoro urimo ibice bya compte (1g) hamwe nububiko bwabugenewe (5GB) bwahawe urugero.
Nuwuhe murimo MIG ubereye cyane?
MIG irabagirana iyo imirimo myinshi ntoya, yitaruye (nkumwanzuro) igabana ikarita imwe ifite ireme rya serivisi.