Makambani GUIDE

SambaNova Systems

SambaNova inogadzirisa inogadzirika dataflow hardware uye yakabatanidzwa software mapuratifomu eAI basa rekutakura.

Teerera kugwaro iriAI-yakarondedzerwa · ~2 min

Pa peji ino2 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reSambaNova Systems
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Yayo dataflow dhizaini mepu modhi mashandiro uye nzira data pakati pavo; kuendesa, ndangariro kugona, kuita, uye data-kutonga mhedzisiro zvinoenderana nechigadzirwa uye kumisikidzwa.

Kudzika Kwakadzika

SambaNova's Reconfigurable Dataflow Unit (RDU) inomepu yemuenzaniso wekombuta girafu pane inogadziriswa komputa uye ndangariro zviwanikwa. Iyo kambani inotsanangura iyo inokonzeresa dataflow semabasa akabatana mupombi, nechinangwa chekudzikisa kudzokororwa kwekufamba kwe data yepakati. Zvishandiso zvakaburitswa zveSN40L rondedzero SRAM, HBM, uye DDR memory tiers, nepo zvigadzirwa zvazvino uye hunyanzvi zvinosiyana nechizvarwa. SambaStack inosanganisa hardware uye software yeAI inference uye inoshambadzira akawanda-modhi uye agent workflows; kuwanikwa kwemuenzaniso uye zvigumisiro zvinoenderana nehuwandu hwebasa uye kushandiswa. SambaNova inopawo pane-zvivakwa mazwi, ichibvumira masangano kuti aongorore kushanda munzvimbo yavo. Kuiswa panzvimbo pachayo hakugadzirise kuvanzika, chengetedzo, kana kutevedza zviri pamutemo; ongorora masisitimu ekugadzirisa, kudzora kwekuwana, kuyerera kwedata, uye mazwi echibvumirano. SambaNova's official timu peji inozivisa Kunle Olukotun semubatsiri-muvambi uye mukuru wetekinoroji. Kune iyo yakanyorwa SN50 kumisikidzwa, HBM inobata inoshanda modhi uremu uye inopisa KV cache, nepo DDR inogona kutsigira hombe modhi madziva uye inotonhora KV cache. Ndeupi muenzaniso data inogara inogara zvinoenderana nehukuru hwechigadzirwa uye kugadzirisa; tiering haibvisi kufamba kwedata kana kuvimbisa kukurumidza kwebasa rega rega.

Kuitwa muNyika yeChokwadi

Kune SN50 basa rekuita, tarisa kuti anoshanda sei uremu uye inopisa KV cache inoshandisa HBM uye mashandisirwo akasarudzwa anoshandisa DDR kune akakura modhi madziva kana inotonhora KV cache.

YeSN40L sisitimu, enzanisa iyo yakanyorwa SRAM, HBM, uye DDR tiers nesaizi yemuenzaniso uye yekushandira basa rekuita usati wasarudza gadziriso.

Paunenge uchiongorora iyo yakawanda-modhi inference yekufambisa, tarisa kuti ndeapi SambaStack uye modhi-bundling masimba anowanikwa mune chaiyo kutumirwa.

Usati wasarudza mashandiro epanzvimbo, ongorora iyo inoshanda SambaStack mazwi, kuyerera kwedata, kutonga kwekuwana, uye mabasa ekushanda.

Ramangwana reSambaNova Systems

Zvishandiso zveSambaNova zvazvino zvinotsanangura chizvarwa-chaiyo RDU ndangariro masisitimu, SambaStack yekuendesa sarudzo, uye modhi-bundling workflows. Simbisa huwandu uye maficha anotsigirwa mune zvinyorwa zveiyo chaiyo chigadzirwa chizvarwa. Enzanisa accelerators nemuenzaniso wakafanana, kunyatsojeka, kureba kwekutevedzana, concurrency, uye kushumira stack, uye kuyera latency uye kubuda munzvimbo yakarongwa.

Kuzvishandisa

Nei zvichikosha

  • Nzira yemutengesi. Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera.
  • Mutengo uye bhajeti. Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi.
  • Ngozi uye kuchengeteka. Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika.

Chenjera

  • Zviziviso zvekutanga zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows.
  • Mitengo yeAPI kana shanduko yepolicy inogona kukanganisa fungidziro husiku.
  • Kutsamira kune mumwe-mutengesi kunowedzera kukiya-mukati uye mari yekufambisa.

Matanho anotevera

  1. Ongorora vanopa uchishandisa ako ega mabasa uye dataset.
  2. Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa.
  3. Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi.
  4. Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the SambaNova Systems quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi SambaNova Systems?

SambaNova inogadzirisa inogadzirika dataflow hardware uye yakabatanidzwa software mapuratifomu eAI basa rekutakura. Yayo dataflow dhizaini mepu modhi mashandiro uye nzira data pakati pavo; kuendesa, ndangariro kugona, kuita, uye data-kutonga mhedzisiro zvinoenderana nechigadzirwa uye kumisikidzwa.

Ndeipi yakakosha kuvaka iyo SambaNova inoshandisa machipisi ayo?

SambaNova's Reconfigurable Dataflow Units mepu yeAI modhi's computation graph pane Hardware uye kuyerera data kuburikidza nayo.

SambaNova inotsanangura sei kufamba kwedata mune yayo RDU dataflow architecture?

SambaNova inotsanangura kuyerera kwe data semepu yemuenzaniso mashandiro uye routing data pakati pavo sepombi; izvi zvinodzivirira kuita chirevo chepasirese nezveCPUs kana kumhanya kwebasa.

Chii chinosanganisa SambaNova's SambaStack chigadzirwa?

SambaNova inopa SambaStack seyakasanganiswa hardware-uye-software AI chikuva; chaiyo modhi uye kuwanikwa kwekutumira kunoenderana nekupa.

Ko iyo yakanyorwa SN50 memory hierarchy inoisa modhi data?

SambaNova inonyora HBM yehuremu inoshanda uye inopisa KV cache, ine DDR inowanikwa kune akakura modhi madziva kana inotonhora KV cache. Chii chinoramba chiripo chinoenderana nechigadzirwa uye kugadzirisa; iyo hierarchy haibvisi kufamba kwedata kana kuvimbisa kukurumidza kwebasa rega rega.

Chii chingave pane-nzvimbo SambaStack deployment inopa sangano?

SambaNova inoburitsa pane-zvivakwa mazwi, saka masangano anogona kuongorora kuendeswa kunoitwa munharaunda; nzvimbo chete haivimbisi kuvanzika, chengetedzo, kana kuteererwa kwemutemo.