Awọn ile-iṣẹ Itọsọna

BigScience ati Awoṣe BLOOM

BLOOM is a 176-billion-parameter multilingual language model produced by the BigScience collaboration and released with its research documentation.

Gbọ si itọsọna yiiAI-ṣe afihan · ~2 min

Lori iwe yi2 min ka
  1. Akopọ
  2. Jin Dive
  3. Real-World imuse
  4. Ọjọ iwaju ti BigScience ati Awoṣe BLOOM
  5. Fifi o sinu iwa
  6. Tesiwaju Ṣiṣawari
  7. Awọn ibeere ti a beere nigbagbogbo

Akopọ

Its ROOTS training corpus included natural and programming languages, making it a prominent open-access research model.

Jin Dive

The BigScience paper describes BLOOM as a decoder-only Transformer with 176 billion parameters. It was trained on ROOTS, a corpus assembled from hundreds of sources in 46 natural languages and 13 programming languages. The collaboration released the model and code under the Responsible AI License and documented data and training choices. Its open-access release supports research, but does not remove the need to consider the license, model limitations, or the represented language distribution.

Real-World imuse

Ṣiṣẹda ati ipari ọrọ kọja awọn dosinni ti awọn ede, pẹlu eyiti a ko tọju nipasẹ awọn awoṣe iṣowo

Ṣiṣẹ bi ipilẹ iwadii ṣiṣi fun kikọ ojuṣaaju, gbigbe ede pupọ, ati ihuwasi igbelosoke

Ṣiṣatunṣe daradara sinu iṣẹ-ṣiṣe kan pato tabi awọn iyatọ ti o tẹle itọnisọna gẹgẹbi BLOOMZ fun awọn agbegbe ti kii ṣe Gẹẹsi

Pese awoṣe ti o ni akọsilẹ ni kikun fun awọn ọmọ ile-iwe ti n kẹkọ ijẹrisi data ikẹkọ ati iwe-aṣẹ AI lodidi

Ọjọ iwaju ti BigScience ati Awoṣe BLOOM

BigScience ṣe afihan pe iwọn-nla, AI iṣakoso ni gbangba ṣee ṣe, ati pe awoṣe rẹ ni ipa awọn idasilẹ ṣiṣi nigbamii ati titari gbooro fun akoyawo. Ise multilingualism ti ọjọ iwaju yoo ṣe agbero awọn ẹkọ rẹ ni iwe data ati agbegbe agbegbe, lakoko ti tuntun, awọn awoṣe ti o munadoko diẹ sii ti kọja BLOOM lori agbara aise. Ogún pípẹ́ rẹ̀ ni iwuwasi ti awọn kaadi awoṣe titẹjade, awọn alaye data, ati awọn iwe-aṣẹ oniduro, pẹlu ẹri pe iṣiro gbogbogbo le ṣe ikẹkọ awọn awoṣe iwọn-aala.

Fifi o sinu iwa

Kini idi ti o ṣe pataki

  • Ilana olutaja. Awọn maapu opopona olutaja ni ipa kini awọn ẹya ti ẹgbẹ rẹ le kọ ni atẹle.
  • Iye owo ati isuna. Awọn ofin iṣowo ati awọn aṣayan imuṣiṣẹ ni ipa lori idiyele igba pipẹ ati eewu.
  • Ewu ati ailewu. Awọn imoriya ile-iṣẹ ṣe apẹrẹ awọn abawọn ọja, iduro ailewu, ati ṣiṣi.

Ṣọra fun

  • Awọn ikede ifilọlẹ le ju iduroṣinṣin lọ ni awọn iṣan-iṣẹ iṣelọpọ gidi.
  • Ifowoleri API tabi awọn iyipada eto imulo le fọ awọn arosinu ni alẹ.
  • Igbẹkẹle olutaja ẹyọkan ṣe alekun titiipa-inu ati awọn idiyele ijira.

Next awọn igbesẹ

  1. Ṣe ayẹwo awọn olupese nipa lilo awọn iṣẹ ṣiṣe tirẹ ati awọn ipilẹ data.
  2. Ṣe atunyẹwo asiri, aabo, ati awọn ofin ofin ṣaaju iṣọpọ.
  3. Ṣetọju eto ipadabọ kọja awọn awoṣe tabi awọn olutaja.
  4. Bojuto awọn akọsilẹ itusilẹ nitoribẹẹ awọn iyipada maapu oju-ọna ma ṣe iyalẹnu awọn ẹgbẹ.

Tesiwaju Ṣiṣawari

Ìwé ìròyìn ọfẹ

Gba ìkànìyàn AI ojoojúmọ́

Ìtàn AI mẹta tó jẹ́rìí ní gbogbo owurọ́ ọjọ́ iṣẹ́, kọ́wé ní Gẹ̀ẹ́sì tó rọrùn. Ọfẹ́ fún gbogbo àkókò, kò sí ìpolówó.

Ìmeèlì kan ní gbogbo ọjọ́ iṣẹ́. Yọkúrò ní ìkànìyàn ní ìkànìyàn kan. A kò ta tàbí pín àdírẹ́sì rẹ.

Ṣe idanwo fun ara rẹ

Take the BigScience and the BLOOM Model quiz

Ìdáhùn lẹ́sẹ̀kẹsẹ̀ lórí gbogbo ìdáhùn, àti iwe-ẹ̀rí tó lè pin pẹ̀lú ID tó lè jẹ́rìí lẹ́yìn tí o bá kọ́ ẹ̀kọ́.

Bẹrẹ adanwo

Ṣe àtìlẹ́yìn ẹ̀kọ́ AI ọfẹ́. AI Understanding jẹ́ àjọ àìní èrè 501(c)(3) — kò sí ìpolówó, kò sí àkúnya owó, ní gbogbo àkókò. Ṣe ẹbun kan

Awọn ibeere ti a beere nigbagbogbo

Kini BigScience ati Awoṣe BLOOM?

BLOOM is a 176-billion-parameter multilingual language model produced by the BigScience collaboration and released with its research documentation. Its ROOTS training corpus included natural and programming languages, making it a prominent open-access research model.

Kini ibi-afẹde iyasọtọ akọkọ ti awoṣe BLOOM ni akawe si awọn awoṣe ti o jọra ti akoko rẹ?

A ṣe apẹrẹ BLOOM lati jẹ ọpọlọpọ ede nitootọ ati pe o ti tu silẹ ni gbangba pẹlu iwe kikun, laisi awọn awoṣe pipade ti iwọn afiwera.

O fẹrẹ to awọn aye-aye melo ni BLOOM ni?

BLOOM jẹ awoṣe paramita 176-bilionu-biliọnu kan, gbigbe si lori iwọn kanna si GPT-3.

Awọn ede adayeba melo ni a kọ BLOOM lati mu?

BLOOM's ROOTS corpus ikẹkọ bo awọn ede adayeba 46 pẹlu awọn ede siseto 13.

Ẹgbẹ wo ni o ṣajọpọ ifowosowopo BigScience?

Face Face ṣajọpọ BigScience, idanileko ti diẹ sii ju awọn oniwadi oluyọọda 1,000.

Nibo ni ikẹkọ BLOOM?

A ti gba BLOOM ikẹkọ lori kọnputa Super Jean Zay ni Ilu Faranse, ti n ṣafihan pe iṣiro gbogbogbo le ṣe ikẹkọ awoṣe iwọn-aala kan.