Overview
BigScience yaive yegore-yakareba yakavhurika yekutsvagisa kubatana kwevanopfuura chiuru vevaongorori vakagadzira BLOOM, imwe yekutanga yemitauro yakawanda, yakaburitswa pachena mikuru yemitauro mikuru. Izvo zvine basa sechiratidzo mune pachena, inotungamirwa nenharaunda AI yakavakwa kunze kweBig Tech.
BigScience uye BLOOM Model inonzwisiswa zvakanyanya mumamiriro ehurongwa, kuwana modhi, sarudzo dzepuratifomu, uye ecosystem kudyidzana.
Deep Dive
BigScience yaive musangano wegore rimwe chete wekutsvagisa waitangira muna 2021 kusvika 2022, wakarongwa neHugging Face uye uchiunza pamwechete vanopfuura chiuru chevazvipiri kubva kunyika dzinopfuura makumi matanhatu nemasangano mazana maviri nemakumi mashanu. Musoro wayo wakabuda, wakaburitswa muna Chikunguru 2022, waive BLOOM, 176-bhiriyoni-parameter autoregressive mutauro modhi. BLOOM yaive nemaune mitauro yakawanda, yakadzidziswa paROOTS corpus inofukidza 46 mitauro yechisikigo uye 13 mitauro yekuronga, ine kumiririra kwakasimba kwemitauro isingamiririrwe semitauro yakawanda yemuAfrica neSouth Asia. Kudzidziswa kwakatora mwedzi yakati wandei pane yakapihwa mari pachena Jean Zay supercomputer muFrance ichishandisa yakatenderedza 384 GPUs. BLOOM yakaburitswa pasi peResponsible AI License ine magwaro akazara e data rayo, kudzidziswa, uye chinangwa chekushandiswa, zvichipesana zvakanyanya neyakavharwa kuvandudzwa kwemhando dzakafanana.
Technical Insight
BLOOM idhikodha-chete shandurudzo yechiyero chakafanana neGPT-3, ichishandisa ALiBi yekumisikidza inomisikidza pachinzvimbo cheakadzidza chinzvimbo mavheta, ayo anoibatsira kuti iwedzere kune akareba akateedzana pane anoonekwa mukudzidziswa. Inoshandisawo embedding layer normalization iyo yakavandudza kudzidziswa kugadzikana pachiyero. Iyo yemitauro yakawanda ROOTS corpus yakanyatso kuunganidzwa uye kunyorwa kuitira kuti musanganiswa wemutauro uye zvinyorwa zvedata zvive pachena uye zvinogoneka, kungobva nemaune kubva kuopaque yakaraswa dataset.
Mastering BigScience uye iyo BLOOM Model
BigScience yaive yegore-yakareba yakavhurika yekutsvagisa kubatana kwevanopfuura chiuru vevaongorori vakagadzira BLOOM, imwe yekutanga yemitauro yakawanda, yakaburitswa pachena mikuru yemitauro mikuru. Izvo zvine basa sechiratidzo mune pachena, inotungamirwa nenharaunda AI yakavakwa kunze kweBig Tech. BigScience uye BLOOM Model inonzwisiswa zvakanyanya mumamiriro ehurongwa, kuwana modhi, sarudzo dzepuratifomu, uye ecosystem kudyidzana. Kuvaka kunzwisisa kwakadzama, bata BigScience uye BLOOM Model semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodikanwa, kujekesa fungidziro, uye patsanura izvo zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa BigScience uye BLOOM Model inoongorora zano revatengesi, kuvimbika kwemepu yemugwagwa, uye njodzi yekuvhara isati yaita. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera. Panguva imwecheteyo, zviziviso zveLaunch zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera.
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi.
Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika.
Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Kugadzira uye kupedza zvinyorwa mumitauro yakawanda, kusanganisira isingashandiswe nemhando dzekutengeserana
Kushanda seyakavhurika yekutsvagisa yekutanga yekufunda kurerekera, kutamisa mitauro yakawanda, uye kuyera maitiro
Kunyatsogadzirisa kuita basa-rakananga kana kuraira-kutevera akasiyana akadai seBLOOMZ kunharaunda dzisiri dzechiRungu.
Kupa modhi yakanyorwa yakazara yevadzidzi vanodzidza kudzidziswa dhata uye ane mutoro AI rezinesi
Maitiro Ekuita
BigScience uye iyo BLOOM Model mukuita
Kugadzira uye kupedza zvinyorwa mumitauro yakawanda, kusanganisira isingashandiswe nemhando dzekutengeserana.
Kugadzira uye kupedzisa mameseji mumitauro yakawanda, kusanganisira iyo isingachengetedzwe nemhando dzekutengesa Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
BigScience uye iyo BLOOM Model mukuita
Kushanda seyakavhurika yekutsvagisa yekutanga yekufunda kurerekera, kutamisa mitauro yakawanda, uye kuyera maitiro.
Kushanda seyakavhurika yekutsvagisa yekutanga yekudzidza kurerekera, kutamisa mitauro yakawanda, uye kuyera maitiro Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura mhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
BigScience uye iyo BLOOM Model mukuita
Kunyatsogadzirisa mumisiyano yakanangana nebasa kana kuraira-kutevera senge BLOOMZ kunharaunda dzisiri dzechiRungu.
Kunyatsogadzirisa mumisiyano yakanangana nebasa kana mirairo-inotevera senge BLOOMZ yenharaunda dzisiri dzechiRungu Matimu anowanzo kuwana mibairo iri nani kana achinge atsanangura zvikumbaridzo zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
BigScience uye iyo BLOOM Model mukuita
Kupa modhi yakanyorwa yakazara yevadzidzi vanodzidza kudzidziswa dhata uye ane mutoro AI rezinesi.
Kupa modhi yakanyorwa yakazara yevadzidzi vanodzidza kudzidziswa dhata uye vane mutoro AI marezinesi Matimu anowanzo kuwana mhedzisiro iri nani pavanotsanangura hunhu hwepamberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Zviziviso zvekutanga zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows.
Mitengo yeAPI kana shanduko yepolicy inogona kukanganisa fungidziro husiku.
Kutsamira kune mumwe-mutengesi kunowedzera kukiya-mukati uye mari yekufambisa.
Implementation Roadmap
Ongorora vanopa uchishandisa ako ega mabasa uye dataset.
Ongorora vanopa uchishandisa ako ega mabasa uye dataset. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa.
Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi.
Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata.
Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.