AMABWIRIZA

BigScience na Moderi YUBURYO

BigScience yari umwaka wose wubufatanye bwubushakashatsi bwakozwe nabashakashatsi barenga 1.000 bakoze BLOOM, imwe mururimi rwambere rwindimi nyinshi, rwasohoye kumugaragaro imvugo nini yindimi.

2 min somaIbiherutse kuvugururwa

Incamake

It matters as a landmark in transparent, community-driven AI built outside Big Tech.

Kwibira cyane

BigScience yari amahugurwa yumwaka umwe yubushakashatsi yatangiye kuva 2021 kugeza 2022, ihujwe na Hugging Face no guhuza abashakashatsi b’abakorerabushake barenga 1.000 baturutse mu bihugu birenga 60 n’ibigo 250. Umutwe wacyo wasohotse, muri Nyakanga 2022, yari BLOOM, miliyari 176-yerekana imiterere yindimi. BLOOM yari ifite indimi nyinshi nkana, yatojwe kuri ROOTS corpus ikubiyemo indimi karemano 46 nindimi 13 zo gutangiza gahunda, hamwe n’indimi nyinshi zidahagarariwe nkindimi nyinshi nyafurika na Aziya yepfo. Amahugurwa yamaze amezi menshi kuri super super mudasobwa Jean Zay yatewe inkunga na leta mubufaransa akoresheje GPU zigera kuri 384. BLOOM yasohotse munsi yuburenganzira bwa AI bufite ibyangombwa byuzuye byamakuru, amahugurwa, hamwe nibigenewe gukoreshwa, bitandukanye cyane niterambere ryafunzwe ryikigereranyo.

Ubushishozi

BLOOM ni decoder-ihindura gusa igipimo gisa na GPT-3, ikoresheje gushyiramo imyanya ya ALiBi aho kuba imyanya yize yizewe, ikayifasha gutandukana mugihe kirekire kuruta uko bigaragara mumahugurwa. Irakoresha kandi gushyiramo urwego rusanzwe rwatezimbere imyitozo ihamye. Indimi nyinshi za ROOTS corpus ziteranijwe neza kandi zandikwa kugirango imvugo ivanze ninkomoko yamakuru byari mucyo kandi byumvikane, kuva nkana kuva datasets zasibwe.

Ingaruka z'Ingamba

Vendor strategy

Ibishushanyo mbonera byabacuruzi bigira ingaruka kubiranga ikipe yawe ishobora kubaka ubutaha.

Igiciro na bije

Amagambo yubucuruzi nuburyo bwo kohereza bigira ingaruka kubiciro byigihe kirekire ningaruka.

Risk and safety

Isosiyete ishimangira gushiraho ibicuruzwa bitemewe, igihagararo cyumutekano, no gufungura.

Ejo hazaza ha BigScience na Moderi ya BLOOM

BigScience yerekanye ko nini-nini, iyobowe na AI ku mugaragaro birashoboka, kandi icyitegererezo cyayo cyagize uruhare nyuma yo gusohora no kwaguka gukorera mu mucyo. Ibikorwa bizaza mu ndimi nyinshi birashoboka ko bizashingira kumasomo yayo mubyangombwa byamakuru no gukwirakwiza ururimi, mugihe icyitegererezo gishya, cyiza cyarenze BLOOM kubushobozi buke. Umurage wacyo urambye ni ihame ryo gutangaza amakarita yicyitegererezo, ibisobanuro byamakuru, hamwe nimpushya zibishinzwe, hiyongereyeho gihamya ko compte rusange ishobora guhugura imipaka yerekana imipaka.

Gushyira mu bikorwa Isi

Kubyara no kuzuza inyandiko mururimi rwinshi, harimo nizindi zidakwiye nubucuruzi bwubucuruzi

Gukora nkubushakashatsi bwibanze bwo kwiga kubogama, kwimura indimi nyinshi, hamwe nimyitwarire yo gupima

Kuringaniza neza mubikorwa byihariye cyangwa amabwiriza-akurikira nka BLOOMZ kumiryango itari icyongereza

Gutanga icyitegererezo cyuzuye kubanyeshuri biga amakuru yerekana amahugurwa hamwe nimpushya za AI

Ingaruka & Kurinda

Gutangiza amatangazo arashobora gusumbya ituze mubikorwa nyabyo byakazi.

Ibiciro bya API cyangwa guhindura politiki birashobora guhagarika ibitekerezo ijoro ryose.

Abashoramari bonyine bishingira byongera gufunga no kwimuka.

Igishushanyo mbonera

1

Suzuma abatanga serivisi ukoresheje imirimo yawe bwite na datasets.

2

Ongera usuzume ubuzima bwite, umutekano, namategeko mbere yo kwishyira hamwe.

3

Komeza gahunda yo gusubira inyuma kurugero cyangwa abacuruzi.

4

Kurikirana inyandiko zisohora kugirango impinduka zumuhanda ntizitangaje amakipe.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the BigScience and the BLOOM Model quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Magic AI Long-Context Code Models

Ibibazo bikunze kubazwa

What is BigScience and the BLOOM Model?

BigScience yari umwaka wose wubufatanye bwubushakashatsi bwakozwe nabashakashatsi barenga 1.000 bakoze BLOOM, imwe mururimi rwambere rwindimi nyinshi, rwasohoye kumugaragaro imvugo nini yindimi. Nibyingenzi nkibimenyetso mu mucyo, utwarwa nabaturage AI yubatswe hanze ya Big Tech.

Niyihe ntego yibanze yo gutandukanya icyitegererezo cya BLOOM ugereranije nubunini buringaniye bwigihe cyayo?

BLOOM yagenewe kuba indimi nyinshi kandi yarekuwe kumugaragaro hamwe ninyandiko zuzuye, bitandukanye na moderi zifunze zingana.

Hafi ya bangahe ibipimo BLOOM ifite?

BLOOM nicyitegererezo cya miliyari 176-yimiterere, uyishyira kurwego rusa na GPT-3.

Indimi zingahe BLOOM yatojwe gukora?

BLOOM's ROOTS Training corpus ikubiyemo indimi karemano 46 wongeyeho indimi 13 zo gutangiza.

Nuwuhe muryango wahuje ubufatanye bwa BigScience?

Guhobera Isura yahuje BigScience, amahugurwa y'abashakashatsi barenga 1.000.

BLOOM yatojwe he?

BLOOM yatojwe kuri super super mudasobwa ya Jean Zay mu Bufaransa, yerekana ko compte rusange ishobora guhugura urugero rwimbibi.