Kwibuka kwinshi
Ububiko Bwinshi bwa Memory Memory (HBM) ni ububiko bwibitse bushyizwe kuruhande rwa GPU butanga amakuru byihuse kuruta RAM isanzwe.
Incamake
It is what keeps AI accelerators fed, preventing the powerful compute cores from sitting idle while they wait for model weights and data.
Kwibira cyane
HBM ikemura ikibazo cyibanze: chip ya kijyambere ya AI irashobora gukora trillioni yibikorwa kumasegonda, ariko mugihe amakuru ageze vuba bihagije. Ububiko busanzwe bwa GDDR buhuza hejuru ya bisi isa naho ifunganye, mugihe HBM itondekanya DRAM nyinshi ipfa guhagarikwa kandi ikabahuza ninsinga ibihumbi nini ziciriritse ziciriritse bita binyuze muri silicon vias (TSVs). Iyi stack yicaye kuri milimetero ya silicon interposer kuva kuri GPU, itanga inzira yagutse cyane, tekereza ibihumbi nibihumbi icyarimwe aho kuba amagana. Igisubizo ni umurongo wapimwe muri terabaýt kumasegonda. Ibisekuruza byateye imbere kuva HBM2 kugeza HBM2e, HBM3, na HBM3e, buri kimwe kizamura ubushobozi n'umuvuduko. Kuri moderi nini yindimi, uburemere bugomba guhora butambuka, ubushobozi bwa HBM hamwe numuyoboro mugari akenshi bifite agaciro kuruta kubara.
Ubushishozi
HBM igera ku muvuduko wayo binyuze mu buryo bukabije aho kuba amasaha yo hejuru. Mugukurikirana DRAM ipfa no kuyihuza nibihumbi bya TSVs, irerekana intera nini cyane (bits 1024 kuri stack no hejuru), kuburyo byite nyinshi zigenda icyarimwe. Gushyira uduce kuri interposer isangiwe kuruhande rwa GPU ituma insinga ngufi, zigabanya ingufu kuri biti nubukererwe. Umuvuduko umwe nka NVIDIA H100 cyangwa H200 uhuza ibice byinshi bya HBM kugirango ugere kuri terabaýt nyinshi kumasegonda yumubyigano wuzuye.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'Urwibutso rwo hejuru
Umuyoboro wibuke ubu ni imbogamizi iyobora kuri AI, bityo HBM iratera imbere byihuse. HBM3e yohereza mubyihuta byihuta, hamwe na HBM4 kuri horizon isezeranya intera nini, imirongo miremire, hamwe nubushobozi bwinshi kuri paki. Tegereza gufatanya gushushanya hagati yibuka na logique, birashoboka ko base base apfa no gutunganya-hafi-yibuka, wongeyeho amarushanwa akaze mubatanga nka SK hynix, Samsung, na Micron. Mugihe icyitegererezo gikura, kubona amakuru menshi hafi yo kubara, byihuse kandi ku mbaraga nkeya, biguma hagati yibikoresho bya AI gutera imbere.
Gushyira mu bikorwa Isi
Gufata uburemere icumi cyangwa amagana ya gigabayiti yuburemere bwururimi runini rwegereye GPU kugirango zishobore gutambuka muri buri ntambwe zifatika.
Gushoboza NVIDIA H100 na H200 datacenter GPUs kugera kuri terabaýt nyinshi kumasegonda ya memoire ya memoire ya mahugurwa.
Guha ingufu amahugurwa ya AI aho GPUs nyinshi buri wese yishingikiriza kuri HBM kugirango yirinde guhagarara mubikorwa bya matrix.
Gushyigikira-hejuru-yerekana amashusho menshi na moderi ya videwo igomba kwimura tensors nini cyane kandi ikanibuka vuba.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the High Bandwidth Memory quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Ubuyobozi bwa GPU bwo kwibuka no gucamo ibice
Ibibazo bikunze kubazwa
What is High Bandwidth Memory?
Ububiko Bwinshi bwa Memory Memory (HBM) ni ububiko bwibitse bushyizwe kuruhande rwa GPU butanga amakuru byihuse kuruta RAM isanzwe. Nicyo gituma umuvuduko wa AI ugaburirwa, ukabuza imbaraga za compte zikomeye kwicara ubusa mugihe bategereje uburemere bwikitegererezo hamwe namakuru.
Ni ikihe kibazo cyibanze Memory ya Memory yibuka kuri AI yihuta?
AI chip irashobora gukora trillioni yibikorwa kumasegonda gusa iyo amakuru ageze vuba bihagije; HBM itanga umurongo mugari kuburyo cores ziticwa ninzara.
Nigute HBM yubatswe muburyo butandukanye nububiko busanzwe bwa GDDR?
HBM itondekanya DRAM ipfa hejuru yundi kandi ikayihuza ninsinga zibihumbi zihagaritse (TSVs), ikora inzira yagutse cyane.
Niki HBM yishingikirizaho cyane kugirango igere kumurongo mwinshi?
Aho kugira ngo byihute, HBM yerekana intera nini cyane (bits 1024 kuri stack no hejuru) bytes nyinshi zigenda icyarimwe.
Ni ukubera iki ibice bya HBM bishyirwa kuri interpicon ya silicon kuruhande rwa GPU?
Insinga ngufi kuri interposer isanganywe igabanya ingufu zikenewe kuri biti byimuwe kandi bigabanya ubukererwe hagati yo kwibuka na compte.
Kurugero runini rwindimi, kuki HBM ishobora kuba ingana na compte mbisi?
LLM umwanzuro uhoraho utambutsa matrices nini yuburemere, kubwibyo ubushobozi bwo kwibuka hamwe numuyoboro mugari akenshi biba ibintu bigabanya aho kubara ibicuruzwa.