BigScience na ụdị BLOOM
BigScience bụ mmekorita oghe nke afọ nke ihe karịrị ndị nyocha 1,000 rụpụtara BLOOM, otu n'ime asụsụ izizi n'ezie ọtụtụ asụsụ, weputara ụdị asụsụ buru ibu.
Nchịkọta
It matters as a landmark in transparent, community-driven AI built outside Big Tech.
Ime miri emi
BigScience bụ ogbako nyocha otu afọ na-aga site na 2021 ruo 2022, nke a na-ahazi site na Hugging Face ma na-achịkọta ihe karịrị ndị ọrụ afọ ofufo 1,000 sitere na mba 60 na ụlọ ọrụ 250. Mwepụta isi akụkọ ya, nke ewepụtara na Julaị 2022, bụ BLOOM, ihe nlere asụsụ autoregressive dị ijeri ijeri 176. BLOOM kpachaara anya na-asụ ọtụtụ asụsụ, zụọ ya na ROOTS corpus na-ekpuchi asụsụ 46 na asụsụ mmemme iri na atọ, yana nhụta siri ike nke asụsụ ndị a na-egosighi ya dịka ọtụtụ asụsụ Africa na South Asia. Ọzụzụ gbara ọtụtụ ọnwa na Jean Zay supercomputer nke ọha na-akwado na France na-eji gburugburu 384 GPU. A tọhapụrụ BLOOM n'okpuru ikikere AI nwere ọrụ yana akwụkwọ zuru oke nke data ya, ọzụzụ ya na ojiji e bu n'obi mee, na-emegide nke ọma na mmepe mechiri emechi nke ụdị atụnyere.
Nghọta nka nka
BLOOM bụ ihe ngbanwe nke naanị GPT-3, na-eji ntinye ọnọdụ ALiBi kama ịbụ vectors ọnọdụ mmụta, nke na-enyere ya aka iwepụta usoro ogologo karịa ka a na-ahụ na ọzụzụ. Ọ na-etinyekwa n'ụdị oyi akwa normalization nke kwalitere nkwụsi ike ọzụzụ n'ogo. Ejiri nlezianya chịkọta ọnụ ma dekọba ọnụ ọgụgụ nke ROOTS corpus ọtụtụ asụsụ ka agwakọta asụsụ na isi mmalite data bụrụ nke doro anya ma bụrụ nke a na-enyocha ya, nke a kpachapụrụ anya na-apụ site na datasets ekpochapụghị anya.
Mmetụta atụmatụ
Atụmatụ ndị na-ere ahịa
Ụzọ ndị na-ere ahịa na-emetụta atụmatụ ndị otu gị nwere ike ịrụ na-esote.
Ọnụ ego na mmefu ego
Usoro azụmahịa na nhọrọ mbugharị na-emetụta ọnụ ahịa ogologo oge yana ihe egwu.
Ihe ize ndụ na nchekwa
Ihe mkpali ụlọ ọrụ na-akpụzi ndabara ngwaahịa, ọnọdụ nchekwa, na oghere.
Ọdịnihu nke BigScience na ụdị BLOOM
BigScience gosipụtara na nnukwu, AI na-achị achị n'ihu ọha ga-ekwe omume, ihe nlereanya ya na-emetụta mwepụta mepere emepe emesịa yana nkwusa ka ukwuu maka nghọta. Ọrụ asụsụ ọtụtụ asụsụ n'ọdịnihu ga-ewulite na nkuzi ya na akwụkwọ data yana mkpuchi asụsụ gụnyere, ebe ndị ọhụrụ, ụdị dị mma karịa BLOOM n'ike. Ihe nketa ya na-adịgide adịgide bụ ụkpụrụ nke ibipụta kaadị nlereanya, nkwupụta data, na ikike ikike, gbakwunyere ihe akaebe na mgbakọ ọha na eze nwere ike ịzụ ụdị n'oke oke.
Mmejuputa n'ezie n'ụwa
Ịmepụta na imecha ederede n'ọtụtụ asụsụ, gụnyere nke ụdị azụmahịa anaghị echekwa ya
Na-eje ozi dị ka usoro nyocha mepere emepe maka ịmụ ihe na-adịghị mma, ịnyefe ọtụtụ asụsụ, na omume mkpali
Idozi nke ọma n'ime ụdị ọrụ akọwapụtara ma ọ bụ nkuzi na-eso dịka BLOOMZ maka obodo ndị na-abụghị Bekee
Inye usoro edekọ nke ọma maka ndị gụrụ akwụkwọ na-amụ nyocha data ọzụzụ yana inye ikike AI nwere ọrụ
Ihe ize ndụ & okporo ụzọ nche
Mwepụta ọkwa nwere ike karịa nkwụsi ike na usoro nrụpụta n'ezie.
Ọnụ ahịa API ma ọ bụ mgbanwe amụma nwere ike imebi echiche n'otu abalị.
Ndabere otu onye na-ere ahịa na-abawanye mkpọchi na ọnụ ahịa mbugharị.
Map mmejuputa
Nyochaa ndị na-eweta ọrụ site na iji ọrụ nke gị na nhazi data.
Nyochaa nzuzo, nchekwa na usoro iwu tupu njikọta.
Jikwaa atụmatụ ọdịda n'ofe ụdị ma ọ bụ ndị na-ere ahịa.
Nyochaa ndetu mwepụta ka mgbanwe map ụzọ ghara iju ndị otu anya.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the BigScience and the BLOOM Model quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ụdị Ime Anwansi AI Long-Context Code Model
Ajụjụ a na-ajụkarị
What is BigScience and the BLOOM Model?
BigScience bụ mmekorita oghe nke afọ nke ihe karịrị ndị nyocha 1,000 rụpụtara BLOOM, otu n'ime asụsụ izizi n'ezie ọtụtụ asụsụ, weputara ụdị asụsụ buru ibu. Ọ dị mkpa dị ka akara ngosi n'ụzọ doro anya, AI nke obodo chụpụrụ na mpụga Big Tech.
Kedu ihe bụ isi ebumnuche e ji amata ụdị BLOOM ma e jiri ya tụnyere ụdị nke oge ya?
Emebere BLOOM ka ọ bụrụ ezigbo asụsụ ọtụtụ ma wepụta ya n'ihu ọha yana akwụkwọ zuru oke, n'adịghị ka ụdị mechiri emechi nke nha nha.
Odika parampat ole ka BLOOM nwere?
BLOOM bụ ihe nlere nha ijeri ijeri 176, na-edobe ya n'ogo yiri nke GPT-3.
Asụsụ okike ole ka a zụrụ BLOOM ka ọ na-asụ?
Ụlọ ọrụ ọzụzụ BLOOM's ROOTS kpuchiri asụsụ 46 sitere n'okike gbakwunyere asụsụ mmemme iri na atọ.
Kedu nzukọ chịkọtara mmekorita BigScience?
BigScience chịkọtara ịmakụ ihu, nkuzi nke ihe karịrị 1,000 ndị nyocha afọ ofufo.
Ebee ka a zụrụ BOOM?
A zụrụ BLOOM na Jean Zay supercomputer dị na France, na-egosi na mgbakọ ọha na eze nwere ike ịzụ ihe nlere anya n'ókè.