BigScience uye iyo BLOOM Model
BigScience yaive yegore-yakareba yakavhurika yekutsvagisa kubatana kwevanopfuura chiuru vevaongorori vakagadzira BLOOM, imwe yekutanga yemitauro yakawanda, yakaburitswa pachena mikuru yemitauro mikuru.
Pfupiso
It matters as a landmark in transparent, community-driven AI built outside Big Tech.
Kudzika Kwakadzika
BigScience yaive musangano wegore rimwe chete wekutsvagisa waitangira muna 2021 kusvika 2022, wakarongwa neHugging Face uye uchiunza pamwechete vanopfuura chiuru chevazvipiri kubva kunyika dzinopfuura makumi matanhatu nemasangano mazana maviri nemakumi mashanu. Musoro wayo wakabuda, wakaburitswa muna Chikunguru 2022, waive BLOOM, 176-bhiriyoni-parameter autoregressive mutauro modhi. BLOOM yaive nemaune mitauro yakawanda, yakadzidziswa paROOTS corpus inofukidza 46 mitauro yechisikigo uye 13 mitauro yekuronga, ine kumiririra kwakasimba kwemitauro isingamiririrwe semitauro yakawanda yemuAfrica neSouth Asia. Kudzidziswa kwakatora mwedzi yakati wandei pane yakapihwa mari pachena Jean Zay supercomputer muFrance ichishandisa yakatenderedza 384 GPUs. BLOOM yakaburitswa pasi peResponsible AI License ine magwaro akazara e data rayo, kudzidziswa, uye chinangwa chekushandiswa, zvichipesana zvakanyanya neyakavharwa kuvandudzwa kwemhando dzakafanana.
Technical Insight
BLOOM idhikodha-chete shandurudzo yechiyero chakafanana neGPT-3, ichishandisa ALiBi yekumisikidza inomisikidza pachinzvimbo cheakadzidza chinzvimbo mavheta, ayo anoibatsira kuti iwedzere kune akareba akateedzana pane anoonekwa mukudzidziswa. Inoshandisawo embedding layer normalization iyo yakavandudza kudzidziswa kugadzikana pachiyero. Iyo yemitauro yakawanda ROOTS corpus yakanyatso kuunganidzwa uye kunyorwa kuitira kuti musanganiswa wemutauro uye zvinyorwa zvedata zvive pachena uye zvinogoneka, kungobva nemaune kubva kuopaque yakaraswa dataset.
Strategic Impact
Vendor strategy
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera.
Mutengo uye bhajeti
Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi.
Ngozi uye kuchengeteka
Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika.
Ramangwana reBigScience uye iyo BLOOM Model
BigScience yakaratidza kuti yakakura, inotongwa pachena AI inogoneka, uye modhi yayo yakapesvedzera gare gare kuburitswa kwakavhurika uye yakafara yekusundira pachena. Basa remangwana remitauro yakawanda ringangovaka pamusoro pezvidzidzo zvaro muzvinyorwa zvedata uye inosanganisirwa yemitauro, nepo mhando nyowani, dzakanyanya kushanda dzakapfuura BLOOM pakugona kubikwa. Nhaka yaro yenguva refu ndiyo yakajairwa yekutsikisa makadhi emhando, zvinyorwa zvedata, uye marezinesi ane mutoro, pamwe nehumbowo hwekuti komputa yeruzhinji inogona kudzidzisa mhando dzepamuganhu.
Real-World Implementation
Kugadzira uye kupedza zvinyorwa mumitauro yakawanda, kusanganisira isingashandiswe nemhando dzekutengeserana
Kushanda seyakavhurika yekutsvagisa yekutanga yekufunda kurerekera, kutamisa mitauro yakawanda, uye kuyera maitiro
Kunyatsogadzirisa kuita basa-rakananga kana kuraira-kutevera akasiyana akadai seBLOOMZ kunharaunda dzisiri dzechiRungu.
Kupa modhi yakanyorwa yakazara yevadzidzi vanodzidza kudzidziswa dhata uye ane mutoro AI rezinesi
Njodzi & Guardrails
Zviziviso zvekutanga zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows.
Mitengo yeAPI kana shanduko yepolicy inogona kukanganisa fungidziro husiku.
Kutsamira kune mumwe-mutengesi kunowedzera kukiya-mukati uye mari yekufambisa.
Implementation Roadmap
Ongorora vanopa uchishandisa ako ega mabasa uye dataset.
Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa.
Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi.
Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the BigScience and the BLOOM Model quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
Mashiripiti AI Yakareba-Context Code Models
Mibvunzo inowanzo bvunzwa
What is BigScience and the BLOOM Model?
BigScience yaive yegore-yakareba yakavhurika yekutsvagisa kubatana kwevanopfuura chiuru vevaongorori vakagadzira BLOOM, imwe yekutanga yemitauro yakawanda, yakaburitswa pachena mikuru yemitauro mikuru. Izvo zvine basa sechiratidzo mune pachena, inotungamirwa nenharaunda AI yakavakwa kunze kweBig Tech.
Chii chaive chinangwa chekutanga chekusiyanisa cheBLOOM modhi kana ichienzaniswa nemhando dzakafanana dzenguva yayo?
BLOOM yakagadzirwa kuti inyatsoita mitauro yakawanda uye yakaburitswa pachena iine zvinyorwa zvizere, kusiyana nemamodhi akavharwa echiyero chakafanana.
Anenge mangani ma parameter ane BLOOM?
BLOOM i176-bhiriyoni-parameter modhi, ichiiisa pachiyero chakafanana neGPT-3.
BLOOM akadzidziswa kubata mitauro mingani?
BLOOM's ROOTS yekudzidzisa korasi yakafukidza 46 mitauro yechisikigo pamwe nemitauro gumi nemitatu yekuronga.
Nderipi sangano rakaronga kubatana kweBigScience?
Hugging Face yakarongedza BigScience, musangano wevanopfuura chiuru chevaongorori vanozvipira.
BLOOM akadzidziswa kupi?
BLOOM akadzidziswa paJean Zay supercomputer muFrance, zvichiratidza kuti komputa yevoruzhinji inogona kudzidzisa modhi yechikero chemuganhu.