Ebe nchekwa bandwit dị elu
Ebe nchekwa bandwidth dị elu (HBM) etinyere n'akụkụ GPU nke na-ebuga data ngwa ngwa karịa RAM nkịtị.
Nchịkọta
It is what keeps AI accelerators fed, preventing the powerful compute cores from sitting idle while they wait for model weights and data.
Ime miri emi
HBM na-edozi obere ọkpọkọ: ibe AI ọgbara ọhụrụ nwere ike ịrụ ọtụtụ puku ijeri ọrụ kwa nkeji, mana ọ bụrụ na data rutere ngwa ngwa. Ebe nchekwa GDDR ọkọlọtọ na-ejikọ n'elu ụgbọ ala dị warara dị warara, ebe HBM na-etinye ọtụtụ DRAM na-anwụ na kwụ ọtọ wee jikọta ha na puku kwuru puku obere waya kwụ ọtọ akpọrọ site-silicon vias (TSVs). Ngwunye ndị a na-anọdụ ala na silicon interposer millimeters site na GPU, na-enye ụzọ data sara mbara, na-eche puku kwuru puku ibe n'otu oge kama ọtụtụ narị. Nsonaazụ bụ bandwidth tụrụ na terabytes kwa nkeji. Ọgbọ esiwo na HBM2 gaa HBM2e, HBM3, na HBM3e, nke ọ bụla na-ebuli ma ikike na ọsọ. Maka ụdị asụsụ buru ibu, nke a ga-ebufe ibu arọ ya mgbe niile, ike HBM na bandwit na-adịkarị mkpa karịa mkpokọta raw.
Nghọta nka nka
HBM na-enweta ọsọ ya site na oke myirịta karịa ọnụego elekere dị elu. Site n'ịkọba DRAM na-anwụ anwụ na ijikọta ha na puku kwuru puku TSV, ọ na-ekpughe interface dị obosara (1024 bits kwa nchịkọta na elu), ọtụtụ bytes na-agagharị n'otu oge. Ịtụkwasị ngwugwu ahụ na onye na-ekerịta interposer n'akụkụ GPU na-eme ka waya dị mkpụmkpụ, na-ebelata ike kwa ntakịrị na latency. Otu ngwa ngwa dị ka NVIDIA H100 ma ọ bụ H200 na-ejikọta ọtụtụ HBM stacks iji ruo ọtụtụ terabytes kwa nkeji nke mkpokọta bandwidth ebe nchekwa.
Mmetụta atụmatụ
Ọnụ ego na mmefu ego
Mkpebi ihe owuwu ụlọ na-akwalite arụmọrụ yana ọnụ ahịa ọrụ ruo ọtụtụ afọ.
Mkpebi doro anya
Nkà mmụta nka na-enyere ndị otu egwuregwu aka ịhọrọ nchịkọta ziri ezi, ọ bụghị naanị nke kachasị ọhụrụ.
Quality akara
Nhọrọ injinia ka mma na-ebelata ihe omume ntụkwasị obi na mmepụta.
Ọdịnihu nke ebe nchekwa bandwit dị elu
Bandband ebe nchekwa ugbu a bụ ihe mgbochi na-eduga na AI, yabụ HBM na-aga n'ihu ngwa ngwa. HBM3e na-ebufe na ngwa ngwa flagship, yana HBM4 na mbara igwe na-ekwe nkwa ohere sara mbara, ngwugwu toro ogologo, yana ikike karịa otu ngwugwu. Na-atụ anya imewe nso nso n'etiti ebe nchekwa na mgbagha, ikekwe ntọala omenala nwụrụ yana nhazi nso-ncheta, gbakwunyere asọmpi kpụ ọkụ n'ọnụ n'etiti ndị na-ebubata dị ka SK hynix, Samsung, na Micron. Ka ụdị na-eto eto, na-enwetakwu data nso iji gbakọọ, ngwa ngwa na ike dị ala, na-anọ n'etiti ọganihu ngwaike AI.
Mmejuputa n'ezie n'ụwa
Jide iri iri ma ọ bụ narị gigabytes nke ịdị arọ maka nnukwu ụdị asụsụ dị nso na GPU ka enwere ike ịgbanye ha n'oge usoro ntinye ọ bụla.
Na-enyere NVIDIA H100 na H200 datacenter GPUs aka iru ọtụtụ terabytes kwa nkeji nke bandwidth ebe nchekwa maka ọzụzụ.
Ịkwanye ụyọkọ ọzụzụ AI ebe ọtụtụ GPU nke ọ bụla na-adabere na HBM iji zere nkwụsị n'etiti arụmọrụ matriks.
Na-akwado ihe onyonyo mmepụta ihe dị elu na ụdị vidiyo nke ga-ebulirịrị tenors mgbake dị ukwuu na ebe nchekwa ngwa ngwa.
Ihe ize ndụ & okporo ụzọ nche
Ịkwalite otu akara ngosi nwere ike zoo adịghị ike sistemụ sara mbara.
A na-eledakarị ihe akụrụngwa na ụgwọ ọrụ anya.
Ọdịiche nchekwa na nleba anya nwere ike itolite ka sistemu na-adịwanye mgbagwoju anya.
Map mmejuputa
Kọwaa latency, ịdịmma na ebumnuche ọnụ ahịa tupu mmejuputa ya.
Benchmark n'okpuru ibu dị adị na ọnọdụ data.
Nleba anya akụrụngwa maka mperi, ịkpafu na mmetụta onye ọrụ.
Kwadebe ụzọ nzaghachi azụghachi azụ na ihe omume tupu ịchachaa.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the High Bandwidth Memory quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Njikwa ebe nchekwa GPU na nkewa
Ajụjụ a na-ajụkarị
What is High Bandwidth Memory?
Ebe nchekwa bandwidth dị elu (HBM) etinyere n'akụkụ GPU nke na-ebuga data ngwa ngwa karịa RAM nkịtị. Ọ bụ ihe na-eme ka AI accelerators na-eri nri, na-egbochi cores compute dị ike ịnọdụ ala mgbe ha na-echere ihe atụ na data.
Kedu nsogbu bụ isi na adreesị ebe nchekwa bandwidth dị elu maka ngwa ngwa AI?
Chips AI nwere ike ịrụ ọtụtụ puku ijeri ọrụ kwa sekọnd naanị ma ọ bụrụ na data rutere ngwa ngwa; HBM na-enye bandwidth nke mere na cores anaghị agụ agụụ.
Kedu ka esi ewuli HBM n'ụzọ anụ ahụ dị iche na ebe nchekwa GDDR nkịtị?
HBM na-ekpokọta DRAM na-anwụ n'elu ibe ya ma jikọta ha na puku kwuru puku waya kwụ ọtọ (TSV), na-eke ụzọ data sara mbara.
Kedu ihe HBM na-adabere na tumadi iji nweta nnukwu bandwit ya?
Kama imechi ngwa ngwa, HBM na-ekpughe interface dị obosara nke ukwuu (1024 bit kwa nchịkọta na elu) ọtụtụ bytes na-aga n'otu oge.
Kedu ihe kpatara eji etinye ngwugwu HBM na onye na-ahụ maka silicon n'akụkụ GPU?
Waya dị mkpirikpi na interposer na-ekekọrịta na-ebelata ike a chọrọ n'otu n'otu ma belata nkwụsị n'etiti ebe nchekwa na mgbakọ.
Maka ụdị asụsụ buru ibu kpọmkwem, kedu ihe kpatara HBM nwere ike isi dị mkpa ka ịgbakọ ngwa ngwa?
Ntụle LLM na-aga n'ihu na-ebufe nnukwu matrices dị arọ, yabụ ikike ebe nchekwa na bandwit na-abụkarị ihe na-amachi kama ịgbakọ mmepụta.