EleutherAI
EleutherAI waa cilmi-baaris wadareed aan faa'iido doon ahayn oo aasaasi ah oo hormuud ka ahaa moodooyinka luqadaha waaweyn ee il-furan markii xudduudda AI lagu xiray gidaarada shirkadaha gadaasheeda.
Dulmar
It proved that a volunteer community could build and freely release models rivaling closed systems, reshaping who gets to participate in AI research.
quusid qoto dheer
EleutherAI waxay bilaabatay Juulaay 2020 sida bulshada Discord oo ay soo abaabuleen Connor Leahy, Sid Black, iyo Leo Gao, asal ahaan ujeedadoodu tahay in lagu celiyo OpenAI's GPT-3. Si loo tababaro moodooyinka noocaas ah, waxay markii hore dhiseen oo sii daayeen The Pile, 825GB xog-qoraaleed la curiyey oo noqday urur tababar furan oo caadi ah. Kadibna waxay sii daayeen GPT-Neo, GPT-J-6B, iyo 20-bilyan-parameter GPT-NeoX-20B, oo ka mid ah moodooyinka luqadaha furan ee ugu weyn waqtigooda. Qalabkooda, oo ay ku jiraan maktabadda tababarka GPT-NeoX iyo LM Evaluation Harness waxay u adeegsadeen warshadaha oo dhan si ay u cabbiraan, waxay noqdeen kaabayaasha kuwa kale oo lagu dhisay. 2023 EleutherAI waxaa loo qaabeeyey sidii machad cilmi baaris oo aan faa'iido doon ahayn, iyadoo lagu ballaarinayo fasiraada, toosinta, iyo sayniska sida moodooyinka wax u bartaan.
Aragtida Farsamada
Moodooyinka EleutherAI waxay adeegsadaan qaab-dhismeedka qalabka wax-ka-beddelka, laakiin GPT-J iyo GPT-NeoX waxay soo bandhigeen doorashooyin injineernimo oo wax ku ool ah sida Rotary Positional Embeddings (Rotary Positional Embeddings (RoPE) si loo codeeyo boosaska calaamada iyo isbarbar-dhigga lakabyada feejignaanta-iyo-soo-jeedinta si loo dedejiyo tababarka. Muhiimad gaar ah, waxay ku tababareen TPU-yada iyo GPU-yada lagu deeqay iyada oo loo marayo shuraako ay ka mid yihiin Google's TPU Research Cloud iyo CoreWeave, oo muujinaya in la qaybiyey, xisaabinta kafaala-qaadka ah ay u beddeli karto xarun xog-ururineed marka lagu lammaaniyo kood furan.
Saamaynta Istiraatijiyadeed
Istaraatiijiyadda iibiyaha
Wadooyinka iibiyuhu waxay saameeyaan sifooyinka ay kooxdaadu dhisi karto marka xigta.
Qiimaha iyo miisaaniyada
Shuruudaha ganacsiga iyo ikhtiyaarka geynta ayaa saameeya kharashka iyo khatarta muddada-dheer.
Khatarta iyo badbaadada
Dhiirrigelinta shirkadu waxay qaabaysaa wax-soo-saarka alaabada, booska badbaadada, iyo furfurnaanta.
Mustaqbalka EleutherAI
EleutherAI waxa ay ka bedeshaa tartan miisaan-qaab saafi ah oo ay u socoto tarjumaada, daah-furnaanta xogta-tababarka, iyo qiimaynta adag, meelaha sayniska furan aadka loogu baahan yahay. Filo shaqada sii socota ee fahamka moodooyinka gudaha ka jira, sii daynta xog-ururinta si wanaagsan loo diiwaangeliyay, iyo taageeridda cilmi-baarista badbaadada ee madax-bannaan. Sida shaybaarada xudduudaha u koraan si qarsoodi ah, doorka EleutherAI oo ah miisaan ka-hortagga danaha dadweynaha, tababarka jiilka soo socda ee cilmi-baarayaasha, waxay u badan tahay arrimo ka badan tirinta halbeegga nooc kasta oo ay dhoofiso.
Dhaqangelinta Adduunka-dhabta ah
Xogta Pile waxaa isticmaala cilmi-baarayaasha adduunka oo dhan si ay u tababaraan oo ay u daraaseeyaan moodooyinka luqadda furan si dib loo soo saaro.
GPT-J-6B iyo GPT-NeoX-20B waxaa geeyey bilawga iyo aqoonyahanada si ay u noqdaan kuwo bilaash ah moodooyinka API-ganacsiyeedka.
Xarunta Qiimaynta LM waa aaladda caadiga ah ee shaybaadhada badani ay isticmaalaan si ay u cabbiraan waxqabadka moodalka ee boqollaal hawlood.
Cilmi baadhayaasha badbaadada iyo tarjumaadda madaxa-bannaan waxay isticmaalaan miisaanka furan ee EleutherAI si ay u daraaseeyaan moodal gudaha ah oo xidhmay API-yada.
Khatarta & Dariiqyada Ilaalada
Ogeysiisyada bilawga ah ayaa laga yaabaa inay ka dheereeyaan xasilloonida socodka shaqo ee wax soo saarka dhabta ah.
Qiimaynta API ama isbedelada siyaasada waxay jebin karaan malo awaalka habeen dhaxa
Ku-tiirsanaanta iibiyuhu wuxuu kordhiyaa qufulka iyo kharashaadka socdaalka.
Qorshe Hawleedka Dhaqangelinta
Qiimee bixiyeyaasha adiga oo isticmaalaya hawlahaaga iyo kaydinta xogtaada.
Dib u eeg sirta, amniga, iyo shuruudaha sharciga ka hor is dhexgalka.
Ilaali qorshaha dib u dhaca ee moodooyinka ama iibiyeyaasha.
La soco qoraalada sii daynta si isbeddellada khariidadda waddo aysan ula yaabin kooxaha.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the EleutherAI quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Miisaanka & Eexda
Su'aalaha soo noqnoqda
What is EleutherAI?
EleutherAI waa cilmi-baaris wadareed aan faa'iido doon ahayn oo aasaasi ah oo hormuud ka ahayd moodooyinka luqadaha waaweyn ee il-furan markii xudduudda AI lagu xiray gidaarada shirkadaha gadaasheeda. Waxay caddaysay in bulshada iskaa wax u qabso ahi ay dhisi karto oo si xor ah u sii dayn karto moodooyinka la tartamaya nidaamyada xidhan, dib u qaabaynta cidda ka qaybqaadanaysa cilmi-baarista AI.
Sidee bay EleutherAI asal ahaan ku bilaabatay 2020?
EleutherAI waxay ku bilaabatay sidii urur Discord aan rasmi ahayn oo iskaa wax u qabso ah oo loo habeeyey si ay ugu celceliyaan GPT-3-da markaas-xiran.
Waa maxay 'Pile'?
Pile waa qoraal weyn, kala duwan, si furan loo sii daayay corpus EleutherAI oo loo dhisay in lagu tababaro oo lagu barto moodooyinka luqadda.
Waa kuwee kuwan nooca luqadda EleutherAI?
GPT-NeoX-20B waa mid ka mid ah moodooyinka furan ee EleutherAI; kuwa kale waxay ka yimaadeen Google ama Meta.
Waa maxay suunka Qiimaynta LM ee loo isticmaalo?
Suunka waa qalab furan oo si weyn loo qaatay oo loogu talagalay qiimaynta jaangooyooyinka luuqadaha ee boqollaal bartilmaameed.
Sidee bay EleutherAI u heshay xisaabinta si ay u tababarto moodooyinka waaweyn goor hore?
La'aanta xarun xog-ururineed, EleutherAI waxay ku tiirsanayd TPU iyo agabka GPU ee ay kafaala-qaadatay si ay u tababarto moodalkeeda.