Incamake
Tensor Cores ni ibikoresho byabikoresho byabugenewe imbere muri NVIDIA GPU igezweho ikora matrix kugwiza-no gukusanya ibikorwa byihuse. Ninimpamvu nyamukuru GPU imwe ishobora guhugura no gukoresha imiyoboro minini yimitsi itondekanya ubunini bwihuse kuruta rusange-intego ya compte yakwemerera.
Tensor Cores ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.
Kwibira cyane
Yinjijwe hamwe nubwubatsi bwa Volta muri 2017, Tensor Cores ni imirongo yabugenewe ibara matrike yo kugwiza mato hiyongereyeho (D = A x B + C) mugikorwa kimwe, aho gukora buri kugwiza icyarimwe kumurongo wa CUDA isanzwe. Kuberako hafi buri cyiciro cyurusobe rw'imitsi rugabanuka kugwiza matrix, ibi bihuye n'imibare AI ikeneye. Buri gisekuru cya GPU cyaguye ibyo bakora: Volta yakoze amatafari ya 4x4 FP16, mugihe nyuma yububiko bwa Ampere, Hopper, na Blackwell bwongeyeho imiterere yo hasi cyane nka TF32, BF16, INT8, FP8, na FP4. Ubusobanuro bwo hasi busobanura imibare myinshi yatunganijwe kumasaha, izamura cyane ibicuruzwa byamahugurwa hamwe numusozo mugihe bikomeza kwemerwa.
Ubushishozi
A Tensor Core igwiza matrices ebyiri nto kandi ikusanya ibisubizo muntambwe imwe yahujwe, ikoresha ukuri ko agaciro kamwe kinjira kongeye gukoreshwa mubintu byinshi bisohoka. Mubisanzwe isoma inyongeramusaruro zagabanijwe neza (FP16, BF16, cyangwa FP8) ariko ikusanya amafaranga yo kwiruka muburyo bunoze (akenshi FP32) kugirango igabanye amakosa yo kuzenguruka. Isomero rya software nka cuBLAS na cuDNN, hamwe nuburyo nka PyTorch, tile matrices nini muri utwo duce duto mu buryo bwikora kuburyo moderi zibona umuvuduko udafite code yintoki.
Kumenya ibyingenzi
Tensor Cores ni ibikoresho byabikoresho byabugenewe imbere muri NVIDIA GPU igezweho ikora matrix kugwiza-no gukusanya ibikorwa byihuse. Ninimpamvu nyamukuru GPU imwe ishobora guhugura no gukoresha imiyoboro minini yimitsi itondekanya ubunini bwihuse kuruta rusange-intego ya compte yakwemerera. Tensor Cores ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugirango wubake byimbitse, fata Tensor Cores nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Tensor Cores atezimbere imyubakire, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Guhugura imiterere nini yindimi nka GPT yuburyo bwa transformateur, aho miliyari zo kugwiza matrix kuri buri ntambwe ikora kuri Tensor Cores muri BF16 cyangwa FP8.
Gukoresha igihe nyacyo cyo kuganira kubiganiro na generator zamashusho, ukoresheje ingano ya INT8 cyangwa FP8 kugirango ukoreshe abakoresha benshi kuri GPU.
Kwihutisha NVIDIA DLSS mumikino ya videwo, aho urusobe rw'imitsi rushyira hejuru imiterere-yo hasi ikoresheje Tensor Cores buri kadamu.
Kwihutisha kubara siyanse nka protein-igwiza (AlphaFold) hamwe nikitegererezo cyikirere cyavuguruwe nka matrix-iremereye imitsi yimirimo.
Uburyo bwo Gushyira mu bikorwa
Tensor Cores mubikorwa
Guhugura imiterere nini yindimi nka GPT yuburyo bwa transformateur, aho miliyari zo kugwiza matrix kuri buri ntambwe ikora kuri Tensor Cores muri BF16 cyangwa FP8.
Guhugura imiterere nini yindimi nka GPT yuburyo bwa transformateur, aho miliyari zo kugwiza matrix kuri buri ntambwe ikorera kuri Tensor Cores muri BF16 cyangwa FP8 Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zumusaruro hamwe nibiciro byamakosa mugihe runaka.
Tensor Cores mubikorwa
Gukoresha igihe nyacyo cyo kuganira kubiganiro na generator zamashusho, ukoresheje ingano ya INT8 cyangwa FP8 kugirango ukoreshe abakoresha benshi kuri GPU.
Gukoresha igihe nyacyo cyo kuganiriraho no gutanga amashusho, ukoresheje umubare wa INT8 cyangwa FP8 kugirango ukoreshe abakoresha benshi mumakipe ya GPU mubisanzwe babona ibisubizo byiza mugihe basobanuye ibipimo byujuje ubuziranenge imbere, bagakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi bagakurikirana inyungu zibyara umusaruro nibiciro byigihe.
Tensor Cores mubikorwa
Kwihutisha NVIDIA DLSS mumikino ya videwo, aho urusobe rw'imitsi rushyira hejuru imiterere-yo hasi ikoresheje Tensor Cores buri kadamu.
Kwihutisha NVIDIA DLSS mumikino ya videwo, aho urusobe rw'imitsi rushyira hejuru ikadiri yo hasi ikemura ikoresheje Tensor Cores buri cyiciro Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
Tensor Cores mubikorwa
Kwihutisha kubara siyanse nka protein-igwiza (AlphaFold) hamwe nikitegererezo cyikirere cyavuguruwe nka matrix-iremereye imitsi yimirimo.
Kwihutisha kubara siyanse nka poroteyine-igabanuka (AlphaFold) hamwe nuburyo bwikirere byavuguruwe nkibikorwa bya matrix-biremereye byakazi bikora Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamuka kwabantu kubibazo bikabije, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.