EleutherAI
EleutherAI nitsinda ryibanze ridaharanira inyungu ryatangije isoko ryindimi nini mugihe imipaka AI yari ifunze inyuma yinkuta zamasosiyete.
Incamake
It proved that a volunteer community could build and freely release models rivaling closed systems, reshaping who gets to participate in AI research.
Kwibira cyane
EleutherAI yatangiye muri Nyakanga 2020 nk'umuryango wa Discord wateguwe na Connor Leahy, Sid Black, na Leo Gao, mu ntangiriro ugamije kwigana __AIU_PROTECTED_10 __ 'GPT-3. Kugira ngo bahugure izo ngero, babanje kubaka no gusohora Ikirundo, 825GB yanditswemo inyandiko yamakuru yahinduwe ihinduka imyitozo isanzwe ifunguye. Bahise barekura GPT-Neo, GPT-J-6B, hamwe na miliyari 20-ibipimo bya GPT-NeoX-20B, mubyitegererezo binini byururimi biboneka kumugaragaro. Ibikoresho byabo, harimo isomero ryamahugurwa rya GPT-NeoX hamwe na LM Evaluation Harness yakoresheje inganda zose mugupima ibipimo, byabaye ibikorwa remezo abandi bubakiyeho. Muri 2023 EleutherAI yemeye nkikigo cyubushakashatsi kidaharanira inyungu, cyaguka mubisobanuro, guhuza, na siyanse yukuntu abanyamideli biga.
Ubushishozi
Moderi ya EleutherAI ikoresha imiterere ya decoder ya transformateur, ariko GPT-J na GPT-NeoX batangije amahitamo yubuhanga nka Rotary Positional Embeddings (RoPE) kugirango bashireho imyanya yikimenyetso kandi bagereranya ibitekerezo-byongeye-kugaburira ibyiciro byamahugurwa yihuta. Icy'ingenzi, bahuguye kuri TPU na GPUs batanzwe binyuze mubufatanye nka __AIU_PROTECTED_11 __ 'TPU yubushakashatsi bwa Cloud na CoreWeave, berekana ko compte yatanzwe, yatewe inkunga nabaterankunga ishobora gusimbuza datacenter yibigo iyo ihujwe na code ifunguye.
Ingaruka z'Ingamba
Vendor strategy
Ibishushanyo mbonera byabacuruzi bigira ingaruka kubiranga ikipe yawe ishobora kubaka ubutaha.
Igiciro na bije
Amagambo yubucuruzi nuburyo bwo kohereza bigira ingaruka kubiciro byigihe kirekire ningaruka.
Risk and safety
Isosiyete ishimangira gushiraho ibicuruzwa bitemewe, igihagararo cyumutekano, no gufungura.
Kazoza ka EleutherAI
EleutherAI iri kuva mu isiganwa ryiza ryerekana urugero rwo gusobanura, guhugura-amakuru mu mucyo, no gusuzuma neza, ahantu hakenewe siyanse ifunguye. Tegereza imirimo ikomeza yo gusobanukirwa nicyitegererezo imbere, gusohora imibare yanditswe neza, no gushyigikira ubushakashatsi bwumutekano bwigenga. Mugihe laboratoire yimbibi igenda ikura rwihishwa, uruhare rwa EleutherAI nkurwego rushimishije rwinyungu rusange, guhugura ab'igihe kizaza cyabashakashatsi, birashoboka ko ari ngombwa kuruta kubara ibipimo byose byerekana.
Gushyira mu bikorwa Isi
Pile dataset ikoreshwa nabashakashatsi kwisi yose kugirango bahugure kandi bige imiterere yururimi rufunguye.
GPT-J-6B na GPT-NeoX-20B boherejwe nabatangiye ndetse nabashakashatsi nkuburyo bwubusa kubucuruzi bwa API bwubucuruzi.
LM Evaluation Harness nigikoresho gisanzwe laboratoire ikoresha mugupima imikorere yicyitegererezo mubikorwa byinshi.
Abashakashatsi bigenga umutekano no gusobanurwa bakoresha uburemere bwa EleutherAI kugirango bige imbere yimbere yimbere yafunze API zihishe.
Ingaruka & Kurinda
Gutangiza amatangazo arashobora gusumbya ituze mubikorwa nyabyo byakazi.
Ibiciro bya API cyangwa guhindura politiki birashobora guhagarika ibitekerezo ijoro ryose.
Abashoramari bonyine bishingira byongera gufunga no kwimuka.
Igishushanyo mbonera
Suzuma abatanga serivisi ukoresheje imirimo yawe bwite na datasets.
Ongera usuzume ubuzima bwite, umutekano, namategeko mbere yo kwishyira hamwe.
Komeza gahunda yo gusubira inyuma kurugero cyangwa abacuruzi.
Kurikirana inyandiko zisohora kugirango impinduka zumuhanda ntizitangaje amakipe.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the EleutherAI quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Ibiro & Kubogama
Ibibazo bikunze kubazwa
What is EleutherAI?
EleutherAI nitsinda ryibanze ridaharanira inyungu ryatangije isoko ryindimi nini mugihe imipaka AI yari ifunze inyuma yinkuta zamasosiyete. Byagaragaje ko umuryango w’abakorerabushake ushobora kubaka no kurekura ku buntu moderi zihanganye na sisitemu zifunze, zigahindura abitabira ubushakashatsi bwa AI.
Nigute EleutherAI yatangiye muri 2020?
EleutherAI yatangiye nkitsinda rya Discord ridasanzwe ryabakorerabushake ryateguwe kwigana GPT-3 icyo gihe yari ifunze.
'Ikirundo' ni iki?
Ikirundo ni kinini, gitandukanye, cyasohotse kumugaragaro inyandiko corpus EleutherAI yubatswe mugutoza no kwiga imiterere yindimi.
Ninde muribi murugero rwururimi rwa EleutherAI?
GPT-NeoX-20B ni imwe mu modoka ya EleutherAI yerekana imiterere; abandi baturuka kuri Google cyangwa Meta.
Niki LM Isuzuma Harness ikoreshwa?
Ibikoresho nigikoresho cyemewe gifunguye mugusuzuma bisanzwe byerekana imiterere yindimi ku bipimo byinshi.
Nigute EleutherAI yabonye compte yo gutoza moderi nini hakiri kare?
Kubura datacenter yibigo, EleutherAI yishingikirije kumuterankunga yatanzwe na TPU na GPU kugirango atoze icyitegererezo cyayo.