InoteveraGaidhi rinotevera
Cruise Self-Driving Systems
Makambani
Makambani GUIDE
SambaNova inogadzirisa inogadzirika dataflow hardware uye yakabatanidzwa software mapuratifomu eAI basa rekutakura.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Yayo dataflow dhizaini mepu modhi mashandiro uye nzira data pakati pavo; kuendesa, ndangariro kugona, kuita, uye data-kutonga mhedzisiro zvinoenderana nechigadzirwa uye kumisikidzwa.
SambaNova's Reconfigurable Dataflow Unit (RDU) inomepu yemuenzaniso wekombuta girafu pane inogadziriswa komputa uye ndangariro zviwanikwa. Iyo kambani inotsanangura iyo inokonzeresa dataflow semabasa akabatana mupombi, nechinangwa chekudzikisa kudzokororwa kwekufamba kwe data yepakati. Zvishandiso zvakaburitswa zveSN40L rondedzero SRAM, HBM, uye DDR memory tiers, nepo zvigadzirwa zvazvino uye hunyanzvi zvinosiyana nechizvarwa. SambaStack inosanganisa hardware uye software yeAI inference uye inoshambadzira akawanda-modhi uye agent workflows; kuwanikwa kwemuenzaniso uye zvigumisiro zvinoenderana nehuwandu hwebasa uye kushandiswa. SambaNova inopawo pane-zvivakwa mazwi, ichibvumira masangano kuti aongorore kushanda munzvimbo yavo. Kuiswa panzvimbo pachayo hakugadzirise kuvanzika, chengetedzo, kana kutevedza zviri pamutemo; ongorora masisitimu ekugadzirisa, kudzora kwekuwana, kuyerera kwedata, uye mazwi echibvumirano. SambaNova's official timu peji inozivisa Kunle Olukotun semubatsiri-muvambi uye mukuru wetekinoroji. Kune iyo yakanyorwa SN50 kumisikidzwa, HBM inobata inoshanda modhi uremu uye inopisa KV cache, nepo DDR inogona kutsigira hombe modhi madziva uye inotonhora KV cache. Ndeupi muenzaniso data inogara inogara zvinoenderana nehukuru hwechigadzirwa uye kugadzirisa; tiering haibvisi kufamba kwedata kana kuvimbisa kukurumidza kwebasa rega rega.
Kune SN50 basa rekuita, tarisa kuti anoshanda sei uremu uye inopisa KV cache inoshandisa HBM uye mashandisirwo akasarudzwa anoshandisa DDR kune akakura modhi madziva kana inotonhora KV cache.
YeSN40L sisitimu, enzanisa iyo yakanyorwa SRAM, HBM, uye DDR tiers nesaizi yemuenzaniso uye yekushandira basa rekuita usati wasarudza gadziriso.
Paunenge uchiongorora iyo yakawanda-modhi inference yekufambisa, tarisa kuti ndeapi SambaStack uye modhi-bundling masimba anowanikwa mune chaiyo kutumirwa.
Usati wasarudza mashandiro epanzvimbo, ongorora iyo inoshanda SambaStack mazwi, kuyerera kwedata, kutonga kwekuwana, uye mabasa ekushanda.
Zvishandiso zveSambaNova zvazvino zvinotsanangura chizvarwa-chaiyo RDU ndangariro masisitimu, SambaStack yekuendesa sarudzo, uye modhi-bundling workflows. Simbisa huwandu uye maficha anotsigirwa mune zvinyorwa zveiyo chaiyo chigadzirwa chizvarwa. Enzanisa accelerators nemuenzaniso wakafanana, kunyatsojeka, kureba kwekutevedzana, concurrency, uye kushumira stack, uye kuyera latency uye kubuda munzvimbo yakarongwa.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
SambaNova inogadzirisa inogadzirika dataflow hardware uye yakabatanidzwa software mapuratifomu eAI basa rekutakura. Yayo dataflow dhizaini mepu modhi mashandiro uye nzira data pakati pavo; kuendesa, ndangariro kugona, kuita, uye data-kutonga mhedzisiro zvinoenderana nechigadzirwa uye kumisikidzwa.
SambaNova's Reconfigurable Dataflow Units mepu yeAI modhi's computation graph pane Hardware uye kuyerera data kuburikidza nayo.
SambaNova inotsanangura kuyerera kwe data semepu yemuenzaniso mashandiro uye routing data pakati pavo sepombi; izvi zvinodzivirira kuita chirevo chepasirese nezveCPUs kana kumhanya kwebasa.
SambaNova inopa SambaStack seyakasanganiswa hardware-uye-software AI chikuva; chaiyo modhi uye kuwanikwa kwekutumira kunoenderana nekupa.
SambaNova inonyora HBM yehuremu inoshanda uye inopisa KV cache, ine DDR inowanikwa kune akakura modhi madziva kana inotonhora KV cache. Chii chinoramba chiripo chinoenderana nechigadzirwa uye kugadzirisa; iyo hierarchy haibvisi kufamba kwedata kana kuvimbisa kukurumidza kwebasa rega rega.
SambaNova inoburitsa pane-zvivakwa mazwi, saka masangano anogona kuongorora kuendeswa kunoitwa munharaunda; nzvimbo chete haivimbisi kuvanzika, chengetedzo, kana kuteererwa kwemutemo.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Cruise Self-Driving Systems
Makambani