Ci bi mu melGis bi ci topp
Core ML ngir jëfandikoo ci aparey Apple
Xarala
GUIDE teknik
Tensor
Tensor Cores ay jumtukaay lañu yuñ jagleel GPU NVIDIA yu bees yi, ñuy def matrix yu bari ak dajale ci anam wu gaaw lool.
Déglul tegtal biiIA-nettali · ~2 min
Ci xët wii2 simili jàng
Résumé
Mooy sabab bi tax benn GPU mëna tàggat ak doxal reso neuronal yu mag yu magnitude yu gëna gaaw ci ordinatër yu bari yi.
Plongeur bu xóot
Dugaale ak architecture Volta ci 2017, Tensor Cores ay sircuit yuñ jagleel ñuy xayma ab matrix bu ndaw buy yokk (D = A x B + C) ci benn jëfandikoo, moo gën ñuy def bu nekk benn-benn ci cores CUDA standard. Ndax daanaka bépp couche ci reso neuronal dafay wàññeeku ci matrix yu bari, loolu méngoo ak li IA soxla ci math. GPU bu nekk dafay yokk limuy jëfandikoo: Volta defar na 4x4 FP16, ci ganaw ga Ampere, Hopper, ak Blackwell yokk nañu ay formaa yu gëna ndaw yu melni TF32, BF16, INT8, FP8, ak FP4. Lu gëna ndaw ci njub mooy limu gëna bari ci montor bu nekk, loolu dafay yokk bu baax produit bi ci tàggat yaram ak ci inference boole ci tëye njubte gi.
Doxal ci àdduna dëgg
Taggat xeetu làkk yu mag yu melni transformatër yu nuroo ak GPT, fu ay miliyaar ciy bari matrix jéego bu nekk di dox ci kaw Tensor Cores ci BF16 wala FP8.
Doxal ay gis-gis ci jamono dëgg ngir chatbots ak defarkati nataal, jëfandikoo INT8 wala FP8 ngir mëna jàppale jëfandikukat yu bari ci GPU bu nekk.
Gaawaay NVIDIA DLSS ci jeu video, fu reso neuronal di yokk kadre yu am dayo bu néew di jëfandikoo Tensor Cores ci kadre bu nekk.
Gaawaale ordinatër yu gëstukat yi lu ci melni pliage protein (AlphaFold) ak modeli meteo yuñ defaraat ñu nekk ay liggéey yu diis ci matrix.
Ëlëgu Tensor Cores
Tensor Cores wéyam di dem ci gëna néew njub: Hopper yokk FP8 ak Blackwell dugal 4-bit FP4 ak scaling hardware-managed, lu tollu ci ñaari yoon produit bi jéego bu nekk ngir liggéey bu diis. Xaarandi ndimmbal bu gëna dëgër ngir sparsity (teggi poids nul), formaa microscaling yuy takk facteur scale ci bloc yu ndaw yu lim, ak boole bu gëna xóot ak sistemu mémoire ngir core yi mëna des. Lu model yi di gëna màgg, motëru matrix bi, du gaawaayu montor bu ñor bi, mooy des ci xeex bi gëna mag ci performance hardware IA.
Teg ko ci jëf
Lu tax mu am solo
- Njëgg ak budget. Dogal yi architecture di jël dañuy indi njariñ ak njëgu liggéey bi ay at ci ginaaw.
- dogal yu gëna leer. Njàngalem xarala yi dafay jàppale ekip yi ñu tànn li gën, te baña yam ci li gëna bees daal.
- Xool kalite. Tanneef yu gëna baax ci wàllu ingeñër dina wàññi jafe-jafe yi ci wàllu wóor ci liggéey bi.
Moytul
- Optimize benn benchmark mën na nëbb ñakk kattan yu gëna yaatu ci sistem bi.
- Njëg li ñuy fay ci infrastructure yi ak ci toppatoo dañuy faral di suufeel.
- Bu sistem yi di gëna xawa jafee xam, jafe-jafe yi am ci wàllu kaaraange ak seetlu mën nañu gëna bari.
Jéego yi ci topp
- Mandargal latency, kalite, ak njëg yi laata ngay jëfandikoo.
- Benchmark ci biir sargal ak done yu dëggu.
- Jumtukaay bi di saytu njuumte yi, derive bi ak njeextalu jëfandikukat bi.
- Waajal rollback ak yooni tontu ci jafe-jafe yi laata ngay eskale.
Weyal di banneexu
Bulletin bu amul fayda
Jàngal xibaar AI bu bes
Ñatti jaar-jaari IA yuñ firndeel bis bu nekk ci ayu-bis bi, ñu bind leen ci Àngle bu leer. Gratis ba fàww, amul yëgle.
Benn email bis bu nekk ci ayu-bis bi. Benn klik nga dindi abonemaa bi. Dunu musa jaay wala séddoo sa adres.
Nattal sa bopp
Take the Tensor Cores quiz
Feedback ci saasi ci bépp tontu, ak sertifikaa buñ mëna séddoo ak ID buñ mëna saytu soo jàllee ci njàng mi.
Jàppale njàngum IA te doo fay. AI Understanding mbootaay la buy def te Yàlla tax — amul yëgle, amul paywall, musul am. Defal ab sarax
Laaj yi ñuy faral di laaj
Luy tensor cores?
Tensor Cores ay jumtukaay lañu yuñ jagleel GPU NVIDIA yu bees yi, ñuy def matrix yu bari ak dajale ci anam wu gaaw lool. Mooy sabab bi tax benn GPU mëna tàggat ak doxal reso neuronal yu mag yu magnitude yu gëna gaaw ci ordinatër yu bari yi.
Ban core math lañu defar Tensor Cores ngir gaaw?
Tensor Cores yi dañuy def matrix fused buy yokk boole ci accumulation ci benn jéego, muy liggéey bi gëna am solo ci reso neuronal yi.
Ban arsitektir GPU NVIDIA moo njëkka dugal Tensor Cores?
Tensor Cores mingi njëkka feeñ ci arsitektir Volta ci 2017, daal di tàmbalee ci FP16 4x4 jëfandikoo matrix.
Lan moo waral Tensor Cores di faral di jëfandikoo njubte gu néew lu melni FP16 wala FP8?
Jëfandikoo bit yu néew ci nimero bu nekk dafay tekki ni valeur yu bari dañuy jaar ci hardware bi ci cycle bu nekk, di yokk bu baax gaawaay bi ak lu tuuti, luñuy faral di muñ, ñàkka am njub.
Ngir baña gaawa jeex, ban njub la Tensor Cores yi di faral di jëfandikoo ngir am xaalis buy daw (accumulation)?
Duggal yi mën nañu baña am njub, waaye accumulateur bi dafay faral di dox ci njub bu gëna rëy lu melni FP32 ngir wàññi njuumti yi ci rounding.
Ak naka la kaadar IA yu melni PyTorch di jëfandikoo Tensor Cores?
Bibliothèque yi ci suuf dañuy xaaj matrix yu mag yi ci ay carreaux yu tollu ni Tensor-Core ci saasi, suko defee kaadar yi am gaawaay bi te duñu soxla kode manuel.
Weyal di jàng
Gid yu jëm ci loolu
Tann nañu yeneen njiit ngir topic bii