Tensor Cores
Tensor Cores sune na'urori na musamman na kayan masarufi a cikin NVIDIA GPUs na zamani waɗanda ke yin matrix ninka-da-tara ayyuka cikin sauri.
Dubawa
They are the main reason a single GPU can train and run large neural networks orders of magnitude faster than general-purpose compute would allow.
Zurfafa nutsewa
An gabatar da shi tare da gine-ginen Volta a cikin 2017, Tensor Cores sune keɓaɓɓun da'irori waɗanda ke ƙididdige ƙaramin adadin matrix da ƙari (D = A x B + C) a cikin aiki guda ɗaya, maimakon yin kowane ninki ɗaya a lokaci ɗaya akan daidaitattun CUDA. Domin kusan kowane Layer na cibiyar sadarwa na jijiyoyi yana raguwa zuwa matrix multiplications, wannan yayi daidai da math AI a zahiri ke buƙata. Kowane ƙarni na GPU ya faɗaɗa abin da suke ɗauka: Volta ya yi fale-falen fale-falen 4 × 4 FP16, yayin da daga baya Ampere, Hopper, da kuma gine-ginen Blackwell sun ƙara ƙananan madaidaicin tsari kamar TF32, BF16, INT8, FP8, da FP4. Ƙarƙashin daidaito yana nufin ƙarin lambobi waɗanda aka sarrafa kowace agogo, haɓaka kayan aiki da yawa don horo da ƙima yayin kiyaye daidaito karɓuwa.
Fahimtar Fasaha
Tensor Core yana ninka ƙananan matrices guda biyu kuma yana tara sakamakon a cikin matakai guda ɗaya, yana amfani da gaskiyar cewa ana sake amfani da ƙimar shigarwa iri ɗaya a cikin abubuwan fitarwa da yawa. Yawanci yana karanta abubuwan shigarwa cikin madaidaicin madaidaici (FP16, BF16, ko FP8) amma yana tara jimlar gudu cikin madaidaici mafi girma (sau da yawa FP32) don iyakance kuskuren zagaye. Dakunan karatu na software kamar cuBLAS da cuDNN, da ginshiƙai kamar PyTorch, tile manyan matrices a cikin waɗannan ƙananan tubalan ta atomatik don haka samfura suna samun saurin gudu ba tare da coding na hannu ba.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar Tensor Cores
Tensor Cores suna ci gaba da matsawa zuwa daidaici-ƙasa: Hopper ya ƙara FP8 da Blackwell sun gabatar da 4-bit FP4 tare da sikelin sarrafa kayan masarufi, kusan ninki biyu kayan aiki kowane mataki don ƙima-nauyin ayyuka. Yi tsammanin tallafi mai ƙarfi don ɓarna (tsalle ma'aunin sifili), ƙirar microscaling waɗanda ke haɗa abubuwan sikelin zuwa ƙananan tubalan lambobi, da zurfafa haɗin kai tare da tsarin ƙwaƙwalwar ajiya don su ci gaba da ciyar da su. Kamar yadda samfura ke girma, injin matrix, ba ɗan saurin agogo ba, ya kasance babban filin yaƙi don aikin kayan aikin AI.
Aiwatar da Gaskiyar Duniya
Horar da manyan nau'ikan harshe kamar na'urorin canji na GPT, inda biliyoyin matrix multiplications na kowane mataki ke gudana akan Tensor Cores a cikin BF16 ko FP8.
Gudun ƙayyadaddun ƙayyadaddun ƙayyadaddun bayanai don chatbots da masu samar da hoto, ta amfani da ƙididdigewa na INT8 ko FP8 don ba da ƙarin masu amfani ga kowane GPU.
Haɓaka NVIDIA DLSS a cikin wasannin bidiyo, inda hanyar sadarwar jijiyoyi ke haɓaka ƙananan firam ɗin ƙira ta amfani da Tensor Cores kowane firam.
Ƙaddamar da ƙididdiga na kimiyya kamar furotin-folding (AlphaFold) da kuma yanayin yanayi waɗanda aka sake fasalin su azaman matrix-nauyin aikin jijiya.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Tensor Cores quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Daidaiton Tensor don Manyan Samfura
Tambayoyin da ake yawan yi
What is Tensor Cores?
Tensor Cores sune na'urori na musamman na kayan masarufi a cikin NVIDIA GPUs na zamani waɗanda ke yin matrix ninka-da-tara ayyuka cikin sauri. Su ne babban dalilin GPU guda ɗaya zai iya horarwa da gudanar da oda manyan hanyoyin sadarwa na jijiyoyi da sauri fiye da ƙididdige manufa ta gaba ɗaya zai ba da izini.
Menene ainihin aikin lissafin Tensor Cores musamman da aka ƙera don haɓakawa?
Tensor Cores suna yin haɗe-haɗen matrix multiplication tare da tarawa a mataki ɗaya, wanda shine ainihin aikin da ke mamaye yadudduka na cibiyar sadarwa.
Wanne gine-gine na NVIDIA GPU ya fara gabatar da Tensor Cores?
Tensor Cores da aka yi muhawara tare da gine-ginen Volta a cikin 2017, farawa da ayyukan matrix na FP16 4 × 4.
Me yasa Tensor Cores sukan yi amfani da ƙarancin daidaito kamar FP16 ko FP8?
Amfani da ƴan ragi a kowane lamba yana nufin ƙarin ƙima suna gudana ta cikin kayan masarufi kowane zagayowar, yana ƙaruwa da sauri tare da ƙarami, yawanci abin jurewa, asarar daidaito.
Don kiyaye daidaito, wane daidaici ne Tensor Cores yawanci ke amfani da shi don jimlar gudu (taro)?
Abubuwan shigarwa na iya zama ƙananan daidaici, amma mai tarawa yawanci yana gudana cikin daidaito mafi girma kamar FP32 don iyakance gina kurakurai.
Ta yaya tsarin AI na yau da kullun kamar PyTorch ke amfani da Tensor Cores?
Laburaren da ke ƙasa suna karya manyan ayyuka na matrix cikin manyan fale-falen fale-falen Tensor-Core ta atomatik, don haka tsarin tsarin yana samun saurin sauri ba tare da coding na hannu ba.