Ubuyobozi bwa tekiniki

Kwibuka kwinshi

Ububiko Bwinshi bwa Memory Memory (HBM) ni ububiko bwibitse bushyizwe kuruhande rwa GPU butanga amakuru byihuse kuruta RAM isanzwe.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Ejo hazaza h'Urwibutso rwo hejuru
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

It is what keeps AI accelerators fed, preventing the powerful compute cores from sitting idle while they wait for model weights and data.

Kwibira cyane

HBM ikemura ikibazo cyibanze: chip ya kijyambere ya AI irashobora gukora trillioni yibikorwa kumasegonda, ariko mugihe amakuru ageze vuba bihagije. Ububiko busanzwe bwa GDDR buhuza hejuru ya bisi isa naho ifunganye, mugihe HBM itondekanya DRAM nyinshi ipfa guhagarikwa kandi ikabahuza ninsinga ibihumbi nini ziciriritse ziciriritse bita binyuze muri silicon vias (TSVs). Iyi stack yicaye kuri milimetero ya silicon interposer kuva kuri GPU, itanga inzira yagutse cyane, tekereza ibihumbi nibihumbi icyarimwe aho kuba amagana. Igisubizo ni umurongo wapimwe muri terabaýt kumasegonda. Ibisekuruza byateye imbere kuva HBM2 kugeza HBM2e, HBM3, na HBM3e, buri kimwe kizamura ubushobozi n'umuvuduko. Kuri moderi nini yindimi, uburemere bugomba guhora butambuka, ubushobozi bwa HBM hamwe numuyoboro mugari akenshi bifite agaciro kuruta kubara.

Gushyira mu bikorwa Isi

Gufata uburemere icumi cyangwa amagana ya gigabayiti yuburemere bwururimi runini rwegereye GPU kugirango zishobore gutambuka muri buri ntambwe zifatika.

Gushoboza NVIDIA H100 na H200 datacenter GPUs kugera kuri terabaýt nyinshi kumasegonda ya memoire ya memoire ya mahugurwa.

Guha ingufu amahugurwa ya AI aho GPUs nyinshi buri wese yishingikiriza kuri HBM kugirango yirinde guhagarara mubikorwa bya matrix.

Gushyigikira-hejuru-yerekana amashusho menshi na moderi ya videwo igomba kwimura tensors nini cyane kandi ikanibuka vuba.

Ejo hazaza h'Urwibutso rwo hejuru

Umuyoboro wibuke ubu ni imbogamizi iyobora kuri AI, bityo HBM iratera imbere byihuse. HBM3e yohereza mubyihuta byihuta, hamwe na HBM4 kuri horizon isezeranya intera nini, imirongo miremire, hamwe nubushobozi bwinshi kuri paki. Tegereza gufatanya gushushanya hagati yibuka na logique, birashoboka ko base base apfa no gutunganya-hafi-yibuka, wongeyeho amarushanwa akaze mubatanga nka SK hynix, Samsung, na Micron. Mugihe icyitegererezo gikura, kubona amakuru menshi hafi yo kubara, byihuse kandi ku mbaraga nkeya, biguma hagati yibikoresho bya AI gutera imbere.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the High Bandwidth Memory quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is High Bandwidth Memory?

Ububiko Bwinshi bwa Memory Memory (HBM) ni ububiko bwibitse bushyizwe kuruhande rwa GPU butanga amakuru byihuse kuruta RAM isanzwe. Nicyo gituma umuvuduko wa AI ugaburirwa, ukabuza imbaraga za compte zikomeye kwicara ubusa mugihe bategereje uburemere bwikitegererezo hamwe namakuru.

Ni ikihe kibazo cyibanze Memory ya Memory yibuka kuri AI yihuta?

AI chip irashobora gukora trillioni yibikorwa kumasegonda gusa iyo amakuru ageze vuba bihagije; HBM itanga umurongo mugari kuburyo cores ziticwa ninzara.

Nigute HBM yubatswe muburyo butandukanye nububiko busanzwe bwa GDDR?

HBM itondekanya DRAM ipfa hejuru yundi kandi ikayihuza ninsinga zibihumbi zihagaritse (TSVs), ikora inzira yagutse cyane.

Niki HBM yishingikirizaho cyane kugirango igere kumurongo mwinshi?

Aho kugira ngo byihute, HBM yerekana intera nini cyane (bits 1024 kuri stack no hejuru) bytes nyinshi zigenda icyarimwe.

Ni ukubera iki ibice bya HBM bishyirwa kuri interpicon ya silicon kuruhande rwa GPU?

Insinga ngufi kuri interposer isanganywe igabanya ingufu zikenewe kuri biti byimuwe kandi bigabanya ubukererwe hagati yo kwibuka na compte.

Kurugero runini rwindimi, kuki HBM ishobora kuba ingana na compte mbisi?

LLM umwanzuro uhoraho utambutsa matrices nini yuburemere, kubwibyo ubushobozi bwo kwibuka hamwe numuyoboro mugari akenshi biba ibintu bigabanya aho kubara ibicuruzwa.