Subira ku makuru
IbicuruzwaAI Understanding ibisobanuro

eTeknix ivuga ko Nvidia yazanye ububiko bwa NVHBM bwububiko bwa AI yihuta

eTeknix itangaza ko Nvidia yazanye NVHBM, igishushanyo mbonera cyo kwibuka cyane kigamije kuzamura umurongo no gukoresha ingufu za sisitemu nini ya AI. Isoko rivuga ko Amazon iteganya kuzayikoresha mu bikorwa remezo bya Trainium4, mu gihe Nvidia iteganya ko GPUs ya Feynman yakira igishushanyo mu 2028.

6 min readRead the linked source
Source-provided image accompanying eTeknix reports Nvidia introduced NVHBM memory architecture for AI accelerators
InkomokoInkomoko yanditse
Umwanditsi
eteknix.com
Ihuza ry'inkomoko
eteknix.comhttps://www.eteknix.com/nvidia-introduces-its-own-nvhbm-memory-for-artificial-intelligence/
Ubwoko bw'inkomoko
Inkomoko ihujwe - ibanze-isoko yimiterere ntabwo yashizweho.
Byatanzwe kandi

Inkuru iheruka gusubirwamo

ImirongoSobanukirwa ibi mumasegonda 60

Tangira hano

Amagambo y'ingenzi

Kwibuka (Memory Memory)
Imiterere yabitswe umukozi wa AI akoresha intambwe cyangwa amasomo kugirango atezimbere.
Ibipimo
Ikizamini gisanzwe cyangwa dataset ikoreshwa mugupima no kugereranya imikorere yicyitegererezo.
Umwanzuro
Icyiciro cyogukora aho icyitegererezo cyahuguwe gitanga ibyahanuwe cyangwa ibisubizo.
IsuzumeModeri ya AI Yasobanuwe Ikibazo

Niki cyahindutse kuva cyatangazwa

  1. Byatangajwe bwa mbere
  2. Ubu buryo bwa tekinike NVIDIA Ivugurura ryabatezimbere ritezimbere ibintu bimwe biteza imbere NVLink Fusion hamwe nibikorwa bya NVHBM byabigenewe bihagarariwe na kanoniki. Yongeraho ibisobanuro birambuye byamasosiyete kubyerekeranye nubwubatsi bwa NVHBM ninyungu zishobora kubaho: kugeza kuri 30% mugukwirakwiza kwinshi kurenza HBM4e, kugeza kuri 67% munsi ya PHY hamwe n’ahantu hashyigikirwa, kugeza kuri 30% silicon-nyamukuru ipfa kubara cyangwa kubindi bikoresho, kugeza kuri 15% yo gukoresha ingufu za HBM munsi ya XPU iyo uhujwe na NVLink F.
  3. Nibintu bimwe bya NVHBM ibicuruzwa byakozwe na Canonical Nvidia NVLink Fusion ivugururwa. eTeknix yongeraho raporo y'ibikorwa byavuzwe hejuru ya 30% yumurongo mwinshi, 15% ikoreshwa ryingufu nkeya, kugeza kuri 25% yo kuzigama-silicon no kuzigama kugera kuri 80% ya pack-silicon, hamwe na gahunda yo kubakira ejo hazaza irimo Amazon Trainium4 na Nvidia 2028 yubatswe na Feynman. Ibisobanuro birambuye kuri eTeknix kandi ntabwo byemejwe byigenga mubikoresho byatanzwe.

Byagenze bite

eTeknix itangaza ko Nvidia yazanye NVHBM, imyubakire yo mu rwego rwo hejuru yububiko bwububiko bwakozwe na Laboratwari ya Annapurna ya Amazon. Ahantu hasohokera havuga ko igishushanyo cyimura ububiko bwa memoire kuva kwihuta kwingenzi mukwibuka pake yibikoresho bipfa kandi bigenewe sisitemu ya AI ifite moderi nini cyane.

eTeknix iratangaza ko Nvidia yazanye NVHBM, ubwinshi bwubwubatsi bwayo bwibuke bwububiko bwibikoresho byubukorikori-bwenge. Ingingo ivuga ko Nvidia yateje imbere igishushanyo hamwe na Annapurna Labs, Amazon igabana chip. Intego yatangajwe ni icyiciro cya sisitemu ya AI ifite moderi zirimo trillioni yibipimo, aho kwimura amakuru byihuse hagati yabatunganya na memoire bishobora kugabanya imikorere no kongera ingufu zamashanyarazi. Inkomoko yerekana NVHBM nk'ikoranabuhanga ry'ibikorwa remezo byihuta bya AI aho kuba nk'ibicuruzwa rusange bigamije kwibuka. Ntabwo itanga igiciro cyibicuruzwa, itariki yoherejwe cyangwa ibisobanuro bya tekiniki byuzuye.

Nk’uko eTeknix ibivuga, gutandukanya igishushanyo mbonera ni ugushyira mugenzuzi yibuka mu buryo butaziguye mu rupfu rw’ibikoresho byinshi byo mu mutwe aho kubika imbere mu bikoresho bikuru, iyo ngingo ikaba yitwa XPU. Raporo yemeza ko gushyira umugenzuzi mu rupfu rudasanzwe gusa kuri Nvidia ikavuga ko Samsung, SK Hynix na Micron barimo gushakisha uburyo nk'ubwo. Nvidia isabwa gushyira mu bikorwa, icyakora, itangwa nkuburyo bwo kugabanya ingano ya logic logic isabwa kuri moteri yihuta no kugabanya interineti yibuka. Inkomoko ivuga ko ibi bishobora koroshya interposer, ibice bigize pake ihuza gutunganya no kwibuka.

Isoko ryerekana imibare myinshi yitiriwe Nvidia: irenga 30% yumurongo mugari hamwe na 15% yo gukoresha ingufu ugereranije na HBM4E. Ivuga kandi ko kwimura umugenzuzi bishobora kwigobotora kugera kuri 25% by'ibanze bya silicon nyamukuru ya chip, mugihe kugabanya ubugari bwimbere bishobora kugarura hafi 80% ya silicon ikoreshwa muri paki. Iyi mibare nibisabwa na sosiyete nkuko byatangajwe na eTeknix; ibikoresho byatanzwe nta bipimo byigenga, uburyo bwikizamini, icyitegererezo cyibicuruzwa cyangwa kwemeza abandi bantu. eTeknix ikomeza ivuga ko Nvidia ishaka guhuza ibisobanuro ku bakora ibintu byinshi bibuka bityo abafatanyabikorwa muri ecosystem yayo ya NVLink Fusion barashobora kugerageza no guhuza umuvuduko wihuse byoroshye.

eTeknix ivuga ko Amazon iri mu masosiyete ya mbere ateganya kwemeza NVHBM. Iyo ngingo ivuga ko Amazon igamije guhuza imyubakire yo kwibuka hamwe na Nvidia ya NVLink ya NVLink mu gihe kizaza cya AWS Trainium4 itunganijwe, igakora inyubako yo mu rwego rwa rack ihuza Amazon hamwe na Nvidia GPUs hamwe. Ku ruhande rwa Nvidia, raporo ivuga ko NVHBM biteganijwe ko izatangira gukoreshwa n’imyubakire ya Feynman GPU, iteganijwe mu 2028. Izi ni gahunda zizaza nk'uko byasobanuwe n’ikigo. Raporo ntabwo ishyiraho iboneka muri iki gihe, ibyuma byuzuye, ibyohereza abakiriya cyangwa gahunda ihamye yo gutangiza ubucuruzi.

Ibisobanuro birambuye: eteknix.com ↗

Impamvu ari ngombwa

Igishushanyo mbonera cyibanze ku bikorwa remezo bikuru muri AI: kwimura amakuru hagati yo kwibuka no gutunganya neza. Niba inyungu zavuzwe zagezweho mubikorwa, NVHBM irashobora guha abashushanya umuvuduko mwinshi, gukoresha ingufu nkeya hamwe na silikoni yinyongera kubikoresho byo kubara.

Kwibuka byahindutse igice kigabanya igishushanyo mbonera cya AI kuko abatunganya ibintu bashobora gukora neza mugihe amakuru bakeneye ageze vuba bihagije. Raporo ya eTeknix ikora NVHBM mu rwego rwo kugerageza gukemura icyo kibazo kurwego rwa paki. Bivugwa ko guhuza umurongo mwinshi hamwe no gukoresha ingufu nkeya byagira akamaro cyane mumahugurwa manini manini na sisitemu zifatika, aho umuvuduko mwinshi ukorera hamwe kandi kwibuka bishobora gutwara ibintu byinshi. Inkomoko ntisobanura uburyo ibyo byavuzwe ko byahinduwe byahindurwa mumahugurwa yihuse yicyitegererezo, ibiciro byo gukora cyangwa serivisi nziza zanyuma-abakoresha.

Raporo yo kuzigama ya silicon irashobora kandi kugira ingaruka muburyo bwihuta bwateguwe. Niba bigera kuri 25% byahantu hatunganijwe bitagikenewe kubagenzuzi ba memoire, abashushanya barashobora guha uwo mwanya ibikoresho byongera kubara, nubwo eTeknix idatanga raporo yihariye ibikora. Ikirego cyayo kivuga ko 80% ya pake ikoreshwa na silicon ishobora kugarurwa nayo isobanura icyumba cyashushanyijemo, ntabwo ari ibisubizo byerekana imikorere. Agaciro gafatika kazaterwa nubunini bwahantu hasubijwe hashobora gukoreshwa mubyukuri, niba paki iguma ihendutse kandi niba ububiko bushobora gukorwa mubipimo bisabwa.

Gahunda yubuziranenge ifite akamaro kuko kwibuka byateye imbere ni ingirakamaro gusa mugihe abatunganya ibintu, bapakira, software hamwe nibikorwa byo gukora bikorana. eTeknix itangaza ko Nvidia yifuza ko abakora ibintu byinshi bibuka bashyigikira ibisobanuro rusange bya NVHBM, bishobora kugabanya imirimo yo guhuza ibigo byubaka ibicuruzwa byihuse binyuze muri NVLink Fusion. Icyifuzo cya Amazon cyagura ubusobanuro burenze GPUs Nvidia niba Trainium4 amaherezo ihuza na Nvidia ihuza ibikorwa remezo cyangwa ibikorwa byihuta. Nubwo bimeze bityo, raporo yatanzwe ntabwo yerekana amasezerano hamwe nabatanga amazina yibikoresho, barangije igeragezwa ryimikorere cyangwa ibyo biyemeje kubakiriya bicu birenze ibizaza bya Amazon bisobanura.

Inkuru rero ireba ibirenze ibirango bishya byo kwibuka. Irasobanura Nvidia igerageza gukora urwego rwingenzi rwibikoresho bya AI mugihe uhuza urwo rwego na ecosysteme ihuza ibidukikije ndetse na Amazon yatunganijwe. Ibyo birashobora guhindura uburyo sisitemu ya AI yubatswe nuburyo bugenzura Nvidia igumana ibice bikikije. Ingaruka rusange ikomeje kuba ibyiringiro: ingingo nta kimenyetso cyerekana ko NVHBM itarahinduye ubushobozi bwibicu biboneka, ibiciro byihuta, gukoresha ingufu cyangwa kubona serivisi za AI.

Interactive Mechanism

Uburyo bukoreshwa: Uburyo bukora

Shakisha ikoranabuhanga ryihishe inyuma yiri terambere.

Document Size:128K tokens
Needle Placement Depth (Location in document):50% into text
Attention Context Buffer Map:
Target Fact (50%)
Equivalent Pages~320Standard book pages
Retrieval Accuracy99.9%Needle recall score
RAM / KV Cache5.1 GBMemory overhead
Prompt CachingActive~80% discount on reuse
Core takeaway: Million-token context windows allow querying whole codebases or legal archives in one prompt. However, KV cache memory scales with context length, making prompt caching crucial for real-time production.
Kugenzura Ibitekerezo Byagenzuwe+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Ibyo kureba

Ikintu kitazwi cyane ni ubucuruzi bwaboneka, abafatanyabikorwa bakora, ibizamini byigenga byigenga nigihe cyoherejwe. eTeknix ivuga ko Amazon iteganya guhuza Trainium4 ejo hazaza kandi Nvidia iteganya ko Feynman izatangira mu 2028, ariko raporo yatanzwe ntisobanura ko ibicuruzwa byoherezwa cyangwa ko inyungu zisabwa zagenzuwe mu bwigenge.

Ikibazo cya mbere cyo kureba ni ukumenya niba Nvidia itangaza ibisobanuro byuzuye bya NVHBM kandi niba abasesengura ibyuma byigenga cyangwa abakiriya bigerageza umurongo wavuzwe n’umubare w’amashanyarazi. Raporo yatanzwe itanga igereranya na HBM4E ariko ntisobanura imizigo y'akazi, ubushobozi bwo kwibuka, imikorere cyangwa uburyo bwo gupima. Hatariho ibisobanuro birambuye, ijanisha ntirishobora gukoreshwa muguhishurira inyungu nyayo kwisi kubintu runaka cyangwa ikigo cyamakuru. Igeragezwa ryigenga naryo risobanura niba iterambere ryagutse cyane cyangwa gusa byatoranijwe neza.

Ikibazo cya kabiri ni ugutanga no gukorana. Gahunda yavuzwe na Nvidia, nkuko byatangajwe na eTeknix, ni uguhuza NVHBM mu bakora ibintu byinshi bibuka, ariko ingingo ntivuga amazina y'abayitabira cyangwa ngo igaragaze igihe cyo gukora. Kwemeza ejo hazaza bizaterwa nuko ayo masosiyete atanga ibice bihuye mubunini ndetse nubushobozi bwo gupakira bushobora kugendana nibisabwa na AI byihuta. Bizaba ngombwa kandi kureba niba abafatanyabikorwa-byihuta bashobora gukoresha igishushanyo batarinze kwishingikiriza kuri Nvidia yihariye cyangwa inzira yo gutanga ibyemezo.

Ikibazo cya gatatu nigihe cyo kwerekana ibicuruzwa byerekana ibicuruzwa. eTeknix ivuga ko Amazon iteganya guhuza NVHBM na NVLink mu gihe kizaza cya Trainium4 kandi ko Nvidia iteganya ko ikoranabuhanga rizagaragara hamwe na Feynman GPUs mu 2028. Raporo ntivuga igihe Trainium4 izatangirira, niba ibicuruzwa by’ibigo byombi bizaboneka hamwe, cyangwa niba ibigo 2028 bizaboneka hamwe, cyangwa niba ibigo 2028 bizaboneka hamwe, cyangwa niba ibigo 2028 bizaboneka hamwe. Ayo matariki rero agomba gufatwa nkumugambi wo kureba imbere aho kuboneka ubu.

Hanyuma, abasomyi bagomba kureba ibimenyetso byingaruka zoherejwe: gukoresha ingufu nkeya kurwego rwa sisitemu, kwinjiza byinshi kumurimo wa AI wasobanuwe, impinduka mubucucike bwihuse cyangwa kugabanya ibintu bigoye. Nta na kimwe muri ibyo bisubizo cyashyizweho niyi ngingo. Ibintu bitazwi bifite akamaro birimo ikiguzi, umusaruro, imyitwarire yubushyuhe, ubushobozi bwo kwibuka, guhuza na sisitemu zihari hamwe nuburyo abandi batanga isoko barushanwe shingiro-bipfa kugera ku isoko. Kugeza ubwo ibyo bibazo bisubijwe, NVHBM nigisubizo cyatanzwe cyerekezo cyicyuma, ariko inyungu zacyo ntikiramenyekana.

Ibijyanye nuyobora & ibibazo

Moderi ya AI YasobanuweAmahugurwa ya AIAbahinduraEjo hazaza ha AIGerageza ibyo uzi - gerageza ikibazo cya AI kubuntuReba ijambo AI mumagambo yacuKurikiza icyerekezo cya AI cyo kurekura

Kuvugurura no gukosora

Iyi nkuru yemewe ivugururwa mugihe iyo iterambere ryiterambere rihindutse mubintu. URL yayo nitariki yo gusohora itariki ntizigera ihinduka.

  • Nibintu bimwe bya NVHBM ibicuruzwa byakozwe na Canonical Nvidia NVLink Fusion ivugururwa. eTeknix yongeraho raporo y'ibikorwa byavuzwe hejuru ya 30% yumurongo mwinshi, 15% ikoreshwa ryingufu nkeya, kugeza kuri 25% yo kuzigama-silicon no kuzigama kugera kuri 80% ya pack-silicon, hamwe na gahunda yo kubakira ejo hazaza irimo Amazon Trainium4 na Nvidia 2028 yubatswe na Feynman. Ibisobanuro birambuye kuri eTeknix kandi ntabwo byemejwe byigenga mubikoresho byatanzwe.
  • Ubu buryo bwa tekinike NVIDIA Ivugurura ryabatezimbere ritezimbere ibintu bimwe biteza imbere NVLink Fusion hamwe nibikorwa bya NVHBM byabigenewe bihagarariwe na kanoniki. Yongeraho ibisobanuro birambuye byamasosiyete kubyerekeranye nubwubatsi bwa NVHBM ninyungu zishobora kubaho: kugeza kuri 30% mugukwirakwiza kwinshi kurenza HBM4e, kugeza kuri 67% munsi ya PHY hamwe n’ahantu hashyigikirwa, kugeza kuri 30% silicon-nyamukuru ipfa kubara cyangwa kubindi bikoresho, kugeza kuri 15% yo gukoresha ingufu za HBM munsi ya XPU iyo uhujwe na NVLink F.
Reba igitabo gikosora rusange
Basanze ari ingirakamaro?