Tensor
Tensor Cores ni ibikoresho byabikoresho byabugenewe imbere muri NVIDIA GPU igezweho ikora matrix kugwiza-no gukusanya ibikorwa byihuse.
Incamake
They are the main reason a single GPU can train and run large neural networks orders of magnitude faster than general-purpose compute would allow.
Kwibira cyane
Yinjijwe hamwe nubwubatsi bwa Volta muri 2017, Tensor Cores ni imirongo yabugenewe ibara matrike yo kugwiza mato hiyongereyeho (D = A x B + C) mugikorwa kimwe, aho gukora buri kugwiza icyarimwe kumurongo wa CUDA isanzwe. Kuberako hafi buri cyiciro cyurusobe rw'imitsi rugabanuka kugwiza matrix, ibi bihuye n'imibare AI ikeneye. Buri gisekuru cya GPU cyaguye ibyo bakora: Volta yakoze amatafari ya 4x4 FP16, mugihe nyuma yububiko bwa Ampere, Hopper, na Blackwell bwongeyeho imiterere yo hasi cyane nka TF32, BF16, INT8, FP8, na FP4. Ubusobanuro bwo hasi busobanura imibare myinshi yatunganijwe kumasaha, izamura cyane ibicuruzwa byamahugurwa hamwe numusozo mugihe bikomeza kwemerwa.
Ubushishozi
A Tensor Core igwiza matrices ebyiri nto kandi ikusanya ibisubizo muntambwe imwe yahujwe, ikoresha ukuri ko agaciro kamwe kinjira kongeye gukoreshwa mubintu byinshi bisohoka. Mubisanzwe isoma inyongeramusaruro zagabanijwe neza (FP16, BF16, cyangwa FP8) ariko ikusanya amafaranga yo kwiruka muburyo bunoze (akenshi FP32) kugirango igabanye amakosa yo kuzenguruka. Isomero rya software nka cuBLAS na cuDNN, hamwe nuburyo nka PyTorch, tile matrices nini muri utwo duce duto mu buryo bwikora kuburyo moderi zibona umuvuduko udafite code yintoki.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka Tensor
Tensor Cores ikomeza kugenda yerekeza kumurongo wo hasi: Hopper yongeyeho FP8 hanyuma Blackwell yinjiza 4-bit FP4 hamwe nogupima ibyuma byifashishwa, byikuba kabiri byinjira buri ntambwe kubikorwa byakazi biremereye. Tegereza ubufasha bukomeye kubusa (gusimbuka zeru zeru), imiterere ya microscaling ihuza ibipimo byibipimo bito bito byimibare, hamwe no guhuza byimbitse hamwe na sisitemu yo kwibuka kugirango ibice bikomeze kugaburirwa. Mugihe icyitegererezo gikura, moteri ya matrix, ntabwo yihuta yisaha, ikomeza kuba ikibuga cyibanze hagati yimikorere yibikoresho bya AI.
Gushyira mu bikorwa Isi
Guhugura imiterere nini yindimi nka GPT yuburyo bwa transformateur, aho miliyari zo kugwiza matrix kuri buri ntambwe ikora kuri Tensor Cores muri BF16 cyangwa FP8.
Gukoresha igihe nyacyo cyo kuganira kubiganiro na generator zamashusho, ukoresheje ingano ya INT8 cyangwa FP8 kugirango ukoreshe abakoresha benshi kuri GPU.
Kwihutisha NVIDIA DLSS mumikino ya videwo, aho urusobe rw'imitsi rushyira hejuru imiterere-yo hasi ikoresheje Tensor Cores buri kadamu.
Kwihutisha kubara siyanse nka protein-igwiza (AlphaFold) hamwe nikitegererezo cyikirere cyavuguruwe nka matrix-iremereye imitsi yimirimo.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Tensor Cores quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Tensor Iringaniza Kuri Moderi Nini
Ibibazo bikunze kubazwa
What is Tensor Cores?
Tensor Cores ni ibikoresho byabikoresho byabugenewe imbere muri NVIDIA GPU igezweho ikora matrix kugwiza-no gukusanya ibikorwa byihuse. Ninimpamvu nyamukuru GPU imwe ishobora guhugura no gukoresha imiyoboro minini yimitsi itondekanya ubunini bwihuse kuruta rusange-intego ya compte yakwemerera.
Ni ubuhe buryo bwibanze bw'imibare Tensor Cores yagenewe kwihuta?
Tensor Cores ikora matrix yagabanijwe hiyongereyeho kwirundanya muntambwe imwe, nigikorwa rwose cyiganjemo imiyoboro y'urusobe.
Ni ubuhe bwubatsi bwa NVIDIA GPU bwatangije bwa mbere Tensor Cores?
Tensor Cores yatangijwe nubwubatsi bwa Volta muri 2017, duhereye kubikorwa bya matrix ya FP16 4x4.
Kuki Tensor Cores ikunze gukoresha neza kugabanya nka FP16 cyangwa FP8?
Gukoresha bits nkeya kuri numero bisobanura indangagaciro nyinshi zinyura mubyuma buri cyiciro, byongera cyane umuvuduko hamwe na bike gusa, mubisanzwe byihanganirwa, gutakaza neza.
Kugirango ubungabunge ukuri, ni ubuhe busobanuro Tensor Cores ikoresha muburyo bwo gukoresha amafaranga (kwirundanya)?
Iyinjiza irashobora kuba idasobanutse neza, ariko ikusanyirizo mubisanzwe ikora muburyo bunoze nka FP32 kugirango igabanye iyubakwa ryamakosa.
Nigute imikorere ya AI ya buri munsi nka PyTorch ikoresha Tensor Cores?
Amasomero yibanze asibanganya ibikorwa bya matrix muri Tensor-Core-nini ya tile mu buryo bwikora, bityo ibikorerwa bikabona umuvuduko udafite code yintoki.