EleutherAI
EleutherAI bụ mkpokọta nyocha na-anaghị akwụ ụgwọ nke sụrụ ụzọ mepere emepe ụdị asụsụ buru ibu mgbe ekpochiru oke AI n'azụ mgbidi ụlọ ọrụ.
Nchịkọta
It proved that a volunteer community could build and freely release models rivaling closed systems, reshaping who gets to participate in AI research.
Ime miri emi
EleutherAI malitere na Julaị 2020 dị ka obodo Discord nke Connor Leahy, Sid Black, na Leo Gao haziri, na-achọbu ịmegharị OpenAI's GPT-3. Iji zụọ ụdịdị dị otú ahụ, ha buru ụzọ wuo ma wepụta The Pile, ihe ndekọ ederede 825GB chepụtara nke ghọrọ ọkọlọtọ ọzụzụ ọzụzụ mepere emepe. Ha weputara GPT-Neo, GPT-J-6B, na 20-billion-parameter GPT-NeoX-20B, n'etiti ụdị asụsụ a na-emepe emepe n'oge ha. Ngwá ọrụ ha, gụnyere ọbá akwụkwọ ọzụzụ GPT-NeoX na LM Evaluation Harness jiri ụlọ ọrụ n'obosara maka benchmarking, ghọrọ akụrụngwa ndị ọzọ arụnyere na ya. Na 2023 EleutherAI ahaziri dị ka ụlọ ọrụ nyocha anaghị akwụ ụgwọ, na-agbasawanye n'ime nkọwa, nhazi na sayensị nke otu ụdị si amụta.
Nghọta nka nka
Modelsdị EleutherAI na-eji ihe nrụzi mgbanwe mgbanwe mgbanwe, mana GPT-J na GPT-NeoX webatara nhọrọ injinịa bara uru dị ka Rotary Positional Embeddings (RoPE) maka itinye ọnọdụ akara yana nlebara anya-gbakwunyere-nkwado na-enye ọzụzụ na-agba ọsọ ọsọ. N'ụzọ dị mkpa, ha zụrụ azụ na TPU na GPU ndị enyere site na mmekorita dị ka Google's TPU Research Cloud na CoreWeave, na-egosi na nkesa na-ekesa, nkwado ego nwere ike dochie anya datacenter ụlọ ọrụ mgbe ejikọtara ya na koodu mepere emepe.
Mmetụta atụmatụ
Atụmatụ ndị na-ere ahịa
Ụzọ ndị na-ere ahịa na-emetụta atụmatụ ndị otu gị nwere ike ịrụ na-esote.
Ọnụ ego na mmefu ego
Usoro azụmahịa na nhọrọ mbugharị na-emetụta ọnụ ahịa ogologo oge yana ihe egwu.
Ihe ize ndụ na nchekwa
Ihe mkpali ụlọ ọrụ na-akpụzi ndabara ngwaahịa, ọnọdụ nchekwa, na oghere.
Ọdịnihu nke EleutherAI
EleutherAI na-agbanwe site n'ọsọ ihe nlere anya dị ọcha gaa na nkọwa, nghọta data-ọzụzụ, na nyocha siri ike, mpaghara ebe sayensị mepere emepe kacha mkpa. Na-atụ anya ka aga n'ihu na-arụ ọrụ n'ịghọta ihe ụdị dị n'ime ya na-anọchi anya ya, na-ewepụta ihe ndekọ ederede nke ọma, na ịkwado nchọpụta nchekwa onwe onye. Ka ụlọ nyocha ndị dị n'ihu na-etowanye nzuzo, ọrụ EleutherAI dị ka ọnụ ahịa ọmụrụ nwa nke ọha, na-azụ ọgbọ na-eme nchọpụta na-esote, ma eleghị anya ọ dị mkpa karịa ọnụọgụ nke ụdị ọ bụla ọ na-ebu.
Mmejuputa n'ezie n'ụwa
Ndị na-eme nchọpụta n'ụwa niile na-eji ihe ndekọ data ahụ iji zụọ ma mụọ ụdị asụsụ mepere emepe nke ọma.
GPT-J-6B na GPT-NeoX-20B bụ ndị mmalite na ndị gụrụ akwụkwọ na-ebunye dị ka ihe ọzọ efu na ụdị API azụmahịa.
The LM Evaluation Harness bụ ọkọlọtọ ngwaọrụ ọtụtụ ụlọ nyocha na-eji na-arụ ọrụ nlereanya n'ofe narị ọrụ.
Ndị nyocha nchekwa na ịkọwapụta onwe ha na-eji eleutherAI's ghe oghe iji mụọ ụdị internals mechiri emechi API.
Ihe ize ndụ & okporo ụzọ nche
Mwepụta ọkwa nwere ike karịa nkwụsi ike na usoro nrụpụta n'ezie.
Ọnụ ahịa API ma ọ bụ mgbanwe amụma nwere ike imebi echiche n'otu abalị.
Ndabere otu onye na-ere ahịa na-abawanye mkpọchi na ọnụ ahịa mbugharị.
Map mmejuputa
Nyochaa ndị na-eweta ọrụ site na iji ọrụ nke gị na nhazi data.
Nyochaa nzuzo, nchekwa na usoro iwu tupu njikọta.
Jikwaa atụmatụ ọdịda n'ofe ụdị ma ọ bụ ndị na-ere ahịa.
Nyochaa ndetu mwepụta ka mgbanwe map ụzọ ghara iju ndị otu anya.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the EleutherAI quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Arọ & Ọhụụ
Ajụjụ a na-ajụkarị
What is EleutherAI?
EleutherAI bụ mkpokọta nyocha na-anaghị akwụ ụgwọ nke sụrụ ụzọ mepere emepe ụdị asụsụ buru ibu mgbe ekpochiru oke AI n'azụ mgbidi ụlọ ọrụ. Ọ gosipụtara na obodo ndị ọrụ afọ ofufo nwere ike wulite ma hapụkwa ụdị nke na-emegide sistemụ mechiri emechi, na-emegharị onye ga-esonye na nyocha AI.
Kedu ka EleutherAI siri malite na 2020?
EleutherAI malitere dị ka mkpokọta Discord na-ezighi ezi nke ndị ọrụ afọ ofufo ahaziri iji megharịa GPT-3 mechiri emechi.
Kedu ihe bụ 'Pile'?
Pile bụ nnukwu, dị iche iche, nke ewepụtara n'ihu ọha corpus EleutherAI wuru iji zụọ na ịmụ ụdị asụsụ.
Kedu n'ime ndị a bụ ụdị asụsụ EleutherAI?
GPT-NeoX-20B bụ otu n'ime ihe ngosi mepere emepe EleutherAI; Ndị ọzọ si Google ma ọ bụ Meta.
Kedu ihe eji LM Evaluation Harness maka?
Akụrụngwa bụ ngwa mepere emepe nke anakwere maka nyocha ahaziri ahazi nke ụdị asụsụ na narị akara akara.
Kedu ka EleutherAI siri nweta kọmpụta iji zụọ nnukwu ụdị n'oge?
Na-enweghị ebe nchekwa data ụlọ ọrụ, EleutherAI dabere na akụrụngwa TPU na GPU nyere nkwado iji zụọ ụdị ya.