EleutherAI
I-EleutherAI iqoqo lokucwaninga elingenzi nzuzo elisezingeni eliphansi elisungule amamodeli ezilimi ezinkulu zemithombo evulekile lapho umngcele we-AI ukhiyelwe ngemuva kwezindonga zebhizinisi.
Uhlolojikelele
It proved that a volunteer community could build and freely release models rivaling closed systems, reshaping who gets to participate in AI research.
I-Deep Dive
I-EleutherAI yaqala ngoJulayi 2020 njengomphakathi we-Discord ohlelwe u-Connor Leahy, uSid Black, no-Leo Gao, ekuqaleni owawuhloselwe ukuphinda OpenAI's GPT-3. Ukuze baqeqeshe amamodeli anjalo, baqale bakhe futhi bakhipha i-The Pile, isethi yedatha ekhethiwe engu-825GB eyaba ikhophasi yokuqeqeshwa evulekile evamile. Babe sebekhipha i-GPT-Neo, GPT-J-6B, kanye ne-20-billion-parameter GPT-NeoX-20B, phakathi kwezinhlobo zezilimi ezinkulu ezitholakala ngokuvulekile zesikhathi sabo. Amathuluzi abo, okuhlanganisa umtapo wolwazi we-GPT-NeoX kanye ne-LM Evaluation Harness esetshenziswe imboni yonke ukuze kubekwe uphawu lokulinganisa, aba ingqalasizinda abanye bakhelwe phezu kwayo. Ngo-2023 i-EleutherAI yenziwa ngokusemthethweni njengesikhungo socwaningo esingenzi nzuzo, inweba ekuchazekeni, ukuqondanisa, kanye nesayensi yokuthi amamodeli afunda kanjani.
I-Technical Insight
Amamodeli we-EleutherAI asebenzisa i-architecture ye-decoder ye-transformer, kodwa i-GPT-J ne-GPT-NeoX yethule izinketho zobunjiniyela ezisebenzayo ezifana ne-Rotary Positional Embeddings (RoPE) ukuze kufakwe amathokheni amathokheni kanye nezendlalelo zokunaka ezihambisanayo-plus-feedforward ukuze kusheshiswe ukuqeqeshwa. Okubaluleke kakhulu, baqeqeshwe kuma-TPU nama-GPU anikelwe ngokubambisana okufana ne-Google's TPU Research Cloud kanye ne-CoreWeave, okubonisa ukuthi ikhompuyutha esabalalisiwe, exhaswe ngabaxhasi ingase ithathele indawo yedathacenter yebhizinisi uma ibhangqwe nekhodi evulekile.
I-Strategic Impact
Isu lomthengisi
Imephu yemigwaqo yabathengisi ithonya ukuthi yiziphi izici iqembu lakho elingazakha ngokulandelayo.
Izindleko kanye nesabelomali
Imigomo yezohwebo nezinketho zokuthunyelwa zithinta izindleko zesikhathi eside nobungozi.
Ingozi nokuphepha
Izinxephezelo zenkampani zibumba okuzenzakalelayo komkhiqizo, ukuma kokuphepha, nokuvuleleka.
Ikusasa le-EleutherAI
I-EleutherAI iyasuka emncintiswaneni omsulwa wokukala imodeli iye ekuchazeni, ukuqeqeshwa-idatha esobala, nokuhlola okuqinile, izindawo lapho isayensi evulekile idingeka kakhulu. Lindela ukuqhubeka komsebenzi ekuqondeni ukuthi yimaphi amamodeli amele ngaphakathi, ukukhulula amasethi edatha abhalwe kahle, nokusekela ucwaningo oluzimele lokuphepha. Njengoba amalebhu asemngceleni ekhula eyimfihlo, indima ye-EleutherAI njenge-counterweight yenzuzo yomphakathi, ukuqeqesha isizukulwane esilandelayo sabacwaningi, cishe ibaluleke ngaphezu kwesibalo sepharamitha yanoma iyiphi imodeli eyodwa eyithumelayo.
Ukuqaliswa Komhlaba Wangempela
Iqoqo ledatha lenqwaba lisetshenziswa abacwaningi emhlabeni wonke ukuze baqeqeshe futhi bafunde amamodeli olimi oluvulekile ngendlela ephindaphindekayo.
I-GPT-J-6B kanye ne-GPT-NeoX-20B zisetshenziswa yiziqalo nezifundiswa njengezinye izindlela zamahhala zamamodeli we-API wokuhweba.
I-LM Evaluation Harness iyithuluzi elijwayelekile amalebhu amaningi alisebenzisela ukulinganisa ukusebenza kwemodeli kumakhulu emisebenzi.
Abacwaningi abazimele bezokuphepha nokutolika basebenzisa izisindo ezivuliwe ze-EleutherAI ukuze bafunde amamodeli angaphakathi avale ama-API acashile.
Izingozi & Guardrails
Izimemezelo zokwethula zingase zeqe ukuzinza ekugelezeni komsebenzi wangempela wokukhiqiza.
Izintengo ze-API noma izinguquko zenqubomgomo zingaphula ukucabanga ngobusuku obubodwa.
Ukuncika komthengisi oyedwa kukhulisa izindleko zokukhiya nokufuduka.
Ukuqalisa Umhlahlandlela
Linganisa abahlinzeki usebenzisa eyakho imisebenzi namasethi edatha.
Buyekeza ubumfihlo, ukuphepha, nemibandela yomthetho ngaphambi kokuhlanganiswa.
Gcina uhlelo lokubuyela emuva kuwo wonke amamodeli noma abathengisi.
Gada amanothi okukhululwa ukuze izinguquko zemephu yomgwaqo zingamangazi amaqembu.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the EleutherAI quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Izisindo & Ukuchema
Imibuzo evame ukubuzwa
What is EleutherAI?
I-EleutherAI iqoqo lokucwaninga elingenzi nzuzo elisezingeni eliphansi elisungule amamodeli ezilimi ezinkulu zemithombo evulekile lapho umngcele we-AI ukhiyelwe ngemuva kwezindonga zebhizinisi. Kufakazele ukuthi umphakathi wamavolontiya ungakha futhi ukhulule ngokukhululekile amamodeli aphikisanayo amasistimu avaliwe, abumbe kabusha ukuthi ubani obamba iqhaza ocwaningweni lwe-AI.
I-EleutherAI yaqala kanjani ngo-2020?
I-EleutherAI yaqala njengeqoqo le-Discord elingakahleleki lamavolontiya ahlelelwe ukuphindaphinda i-GPT-3 eyayivalwe ngaleso sikhathi.
Iyini 'Inqwaba'?
Inqwaba iyikhorasi yombhalo enkulu, ehlukahlukene, ekhishwe ngokuvulekile i-EleutherAI eyakhelwe ukuqeqesha nokufunda amamodeli olimi.
Iyiphi kulezi eyimodeli yolimi ye-EleutherAI?
I-GPT-NeoX-20B ingenye yamamodeli avulekile e-EleutherAI; abanye baphuma ku-Google noma Meta.
I-LM Evaluation Harness isetshenziselwa ini?
Ihhanisi iyithuluzi elivulelekile elamukelwa kabanzi lokuhlola okujwayelekile kwamamodeli olimi kumakhulukhulu wamabhentshimakhi.
Ngabe i-EleutherAI ilithole kanjani ikhompuyutha yokuqeqesha amamodeli amakhulu kusenesikhathi?
Intula isikhungo sedatha sebhizinisi, i-EleutherAI ithembele kuzinsiza ze-TPU ne-GPU enikelwe ngabaxhasi ukuze iqeqeshe amamodeli ayo.