Ubuyobozi bwa tekiniki

Tensor

Tensor Cores ni ibikoresho byabikoresho byabugenewe imbere muri NVIDIA GPU igezweho ikora matrix kugwiza-no gukusanya ibikorwa byihuse.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka Tensor
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Ninimpamvu nyamukuru GPU imwe ishobora guhugura no gukoresha imiyoboro minini yimitsi itondekanya ubunini bwihuse kuruta rusange-intego ya compte yakwemerera.

Kwibira cyane

Yinjijwe hamwe nubwubatsi bwa Volta muri 2017, Tensor Cores ni imirongo yabugenewe ibara matrike yo kugwiza mato hiyongereyeho (D = A x B + C) mugikorwa kimwe, aho gukora buri kugwiza icyarimwe kumurongo wa CUDA isanzwe. Kuberako hafi buri cyiciro cyurusobe rw'imitsi rugabanuka kugwiza matrix, ibi bihuye n'imibare AI ikeneye. Buri gisekuru cya GPU cyaguye ibyo bakora: Volta yakoze amatafari ya 4x4 FP16, mugihe nyuma yububiko bwa Ampere, Hopper, na Blackwell bwongeyeho imiterere yo hasi cyane nka TF32, BF16, INT8, FP8, na FP4. Ubusobanuro bwo hasi busobanura imibare myinshi yatunganijwe kumasaha, izamura cyane ibicuruzwa byamahugurwa hamwe numusozo mugihe bikomeza kwemerwa.

Gushyira mu bikorwa Isi

Guhugura imiterere nini yindimi nka GPT yuburyo bwa transformateur, aho miliyari zo kugwiza matrix kuri buri ntambwe ikora kuri Tensor Cores muri BF16 cyangwa FP8.

Gukoresha igihe nyacyo cyo kuganira kubiganiro na generator zamashusho, ukoresheje ingano ya INT8 cyangwa FP8 kugirango ukoreshe abakoresha benshi kuri GPU.

Kwihutisha NVIDIA DLSS mumikino ya videwo, aho urusobe rw'imitsi rushyira hejuru imiterere-yo hasi ikoresheje Tensor Cores buri kadamu.

Kwihutisha kubara siyanse nka protein-igwiza (AlphaFold) hamwe nikitegererezo cyikirere cyavuguruwe nka matrix-iremereye imitsi yimirimo.

Kazoza ka Tensor

Tensor Cores ikomeza kugenda yerekeza kumurongo wo hasi: Hopper yongeyeho FP8 hanyuma Blackwell yinjiza 4-bit FP4 hamwe nogupima ibyuma byifashishwa, byikuba kabiri byinjira buri ntambwe kubikorwa byakazi biremereye. Tegereza ubufasha bukomeye kubusa (gusimbuka zeru zeru), imiterere ya microscaling ihuza ibipimo byibipimo bito bito byimibare, hamwe no guhuza byimbitse hamwe na sisitemu yo kwibuka kugirango ibice bikomeze kugaburirwa. Mugihe icyitegererezo gikura, moteri ya matrix, ntabwo yihuta yisaha, ikomeza kuba ikibuga cyibanze hagati yimikorere yibikoresho bya AI.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Tensor Cores quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Tensor Cores ni iki?

Tensor Cores ni ibikoresho byabikoresho byabugenewe imbere muri NVIDIA GPU igezweho ikora matrix kugwiza-no gukusanya ibikorwa byihuse. Ninimpamvu nyamukuru GPU imwe ishobora guhugura no gukoresha imiyoboro minini yimitsi itondekanya ubunini bwihuse kuruta rusange-intego ya compte yakwemerera.

Ni ubuhe buryo bwibanze bw'imibare Tensor Cores yagenewe kwihuta?

Tensor Cores ikora matrix yagabanijwe hiyongereyeho kwirundanya muntambwe imwe, nigikorwa rwose cyiganjemo imiyoboro y'urusobe.

Ni ubuhe bwubatsi bwa NVIDIA GPU bwatangije bwa mbere Tensor Cores?

Tensor Cores yatangijwe nubwubatsi bwa Volta muri 2017, duhereye kubikorwa bya matrix ya FP16 4x4.

Kuki Tensor Cores ikunze gukoresha neza kugabanya nka FP16 cyangwa FP8?

Gukoresha bits nkeya kuri numero bisobanura indangagaciro nyinshi zinyura mubyuma buri cyiciro, byongera cyane umuvuduko hamwe na bike gusa, mubisanzwe byihanganirwa, gutakaza neza.

Kugirango ubungabunge ukuri, ni ubuhe busobanuro Tensor Cores ikoresha muburyo bwo gukoresha amafaranga (kwirundanya)?

Iyinjiza irashobora kuba idasobanutse neza, ariko ikusanyirizo mubisanzwe ikora muburyo bunoze nka FP32 kugirango igabanye iyubakwa ryamakosa.

Nigute imikorere ya AI ya buri munsi nka PyTorch ikoresha Tensor Cores?

Amasomero yibanze asibanganya ibikorwa bya matrix muri Tensor-Core-nini ya tile mu buryo bwikora, bityo ibikorerwa bikabona umuvuduko udafite code yintoki.