Ubuyobozi bwa tekiniki

Gahunda ya CUDA na GPU

CUDA ni urubuga rwa NVIDIA rwo kwandika gahunda zikoreshwa kuri GPU, zifungura ibihumbi by'ibice byo kubara.

2 min somaIbiherutse kuvugururwa

Incamake

It is the software foundation that turned GPUs into the engine of modern AI.

Kwibira cyane

CUDA (Compute Unified Device Architecture) ireka abitezimbere bandika code ikora neza kuri NVIDIA GPUs aho kuba CPU gusa. Porogaramu yerekana icyitegererezo yibanze kuri 'kernel' - umurimo ukorerwa icyarimwe nibihumbi byoroheje byoroheje, byateguwe mubice na gride. Kuberako GPU ari SIMT (Amabwiriza amwe, Imitwe myinshi), insanganyamatsiko zose mumatsinda zikoresha amabwiriza amwe kumakuru atandukanye, nibyiza kuri matrix na vector math. Benshi mubakora AI ntibigera bandika CUDA mbisi; Ahubwo, ibyingenzi nka PyTorch na TensorFlow guhamagara amasomero meza ya CUDA - cuDNN kubikorwa bya neural-net na cuBLAS kumurongo wa algebra - munsi ya hood. Iyi software ikungahaye, ikuze ni NVIDIA ikomeye cyane yo guhatanira: niyo mugihe imipira ihanganye yihuta, guhuza urusobe rwibinyabuzima bya CUDA biragoye cyane.

Ubushishozi

Muri CUDA utangiza intangiriro hejuru ya gride yumutwe; buri nyuzi ibara igice kimwe cyibisohoka, bigaragazwa nibice byayo hamwe nurutonde rwurudodo. Imikorere ihagaze kumurongo wibuke: byihuse kuri-chip 'gusangira kwibuka' hamwe no gutinda kwisi kwisi, hamwe na 'coesced' kwinjira aho insanganyamatsiko zegeranye zisoma aderesi zegeranye. Kwirinda gutandukana kwintambara - aho insanganyamatsiko ziri mumutwe-32-wintambara 'ifata amashami atandukanye kandi igomba gukurikiranwa - nayo ni urufunguzo rwo gukomeza ingirabuzimafatizo za GPU.

Ingaruka z'Ingamba

Igiciro na bije

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo bisobanutse

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Kugenzura ubuziranenge

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Kazoza ka CUDA na GPU Gahunda

CUDA izakomeza kwiganza muri AI imyaka myinshi bitewe na ecosystem yayo ifunze, ariko igitutu kiriyongera. Fungura ubundi buryo nka __AIU_PROTECTED_10 __ 'Triton reka abitezimbere bandike intoki za GPU muri Python, kandi imbaraga zambukiranya ibicuruzwa (OpenCL, ROCm ya AMD, SYCL) zigamije guca intege NVIDIA. Kwiyongera, murwego rwohejuru rwabakusanyirizo bahita batanga kodegisi ya GPU nziza, bityo injeniyeri nke mukwandika intoki. Inzira igana kurwego rwohejuru rwo gukuramo mugihe CUDA igumaho imikorere yibanze buriwese agereranya.

Gushyira mu bikorwa Isi

PyTorch ihita ikora tensor ibikorwa kuri GPU ukoresheje CUDA mugihe uhamagaye .ku ('cuda')

cuDNN itanga intoki za CUDA gushyira mubikorwa ibyemezo byihutisha imyitozo yishusho

Injeniyeri wandika intangiriro ya CUDA kugirango yihutishe kwigana siyanse yihariye

__AIU_PROTECTED_10 __ 'Triton ireka abashakashatsi kwandika intete za GPU neza muri Python aho kwandika CUDA yo murwego rwo hasi

Ingaruka & Kurinda

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the CUDA and GPU Programming quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Ubuyobozi bwa GPU bwo kwibuka no gucamo ibice

Ibibazo bikunze kubazwa

What is CUDA and GPU Programming?

CUDA ni urubuga rwa NVIDIA rwo kwandika gahunda zikoreshwa kuri GPU, zifungura ibihumbi by'ibice byo kubara. Nibikorwa bya software byahinduye GPU moteri ya AI igezweho.

Mu magambo ya CUDA, 'intangiriro' ni iki?

Muri CUDA intungamubiri nigikorwa cyatangijwe kugirango icyarimwe icyarimwe icyarimwe ibihumbi bya GPU, buri kimwe gikora kumakuru atandukanye.

Icyitegererezo cyo gukora SIMT gisobanura iki?

SIMT (Amabwiriza amwe, insanganyamatsiko nyinshi) bisobanura amatsinda yinsanganyamatsiko ikora amabwiriza amwe kubice bitandukanye byamakuru, byiza kubiharuro bya matrix.

Kuki PyTorch na TensorFlow bidakunze gusaba abakoresha kwandika CUDA mbisi?

Ibi bikoresho bipfunyika cyane amasomero ya CUDA (cuDNN, cuBLAS), bityo abakoresha babona kwihuta kwa GPU batanditse intoki zo murwego rwo hasi.

'Warp divergence' ni iki kandi ni ukubera iki bibabaza imikorere?

Intambara ni itsinda ryinsanganyamatsiko (mubisanzwe 32); niba bafashe amashami atandukanye, ibyuma bikurikirana inzira, guta ibyangiritse byinjira.

Ni ukubera iki 'guhuriza hamwe' kwibuka kwibuka ari ngombwa muri CUDA?

Iyo insanganyamatsiko zituranye zigera kuri aderesi yibuka, ibyuma birashobora guhuza ibyo bisomwa, bigateza imbere cyane kwibuka.