EleutherAI
EleutherAI ƙungiyar bincike ce mai zaman kanta wacce ta fara buɗe tushen manyan nau'ikan harshe lokacin da aka kulle iyakokin AI a bayan bangon kamfanoni.
Dubawa
It proved that a volunteer community could build and freely release models rivaling closed systems, reshaping who gets to participate in AI research.
Zurfafa nutsewa
EleutherAI ya fara ne a cikin Yuli 2020 a matsayin ƙungiyar Discord wanda Connor Leahy, Sid Black, da Leo Gao suka shirya, tun da farko suna da nufin yin kwafin GPT-3 na OpenAI. Don horar da irin waɗannan samfuran, sun fara ginawa kuma sun fito da The Pile, saitin bayanan rubutu na 825GB wanda aka tsara wanda ya zama daidaitaccen ƙungiyar horon buɗe ido. Daga nan sai suka fito da GPT-Neo, GPT-J-6B, da sigar biliyan 20 GPT-NeoX-20B, daga cikin mafi girma a bayyane samfurin yare na zamaninsu. Kayan aikin su, gami da ɗakin karatu na horo na GPT-NeoX da LM Evaluation Harness sun yi amfani da fa'idar masana'antu don tantancewa, sun zama abubuwan more rayuwa waɗanda aka gina su. A cikin 2023 EleutherAI an ƙirƙira shi azaman cibiyar bincike mai zaman kanta, faɗaɗa cikin fassarar, daidaitawa, da kimiyyar yadda samfura ke koya.
Fahimtar Fasaha
Samfuran EleutherAI suna amfani da gine-ginen na'ura mai canzawa, amma GPT-J da GPT-NeoX sun gabatar da zaɓin aikin injiniya mai amfani kamar Rotary Positional Embeddings (RoPE) don shigar da matsayi na alama da daidaita matakan kulawa-da-ci gaba don horar da sauri. Mahimmanci, sun horar da TPUs da GPUs waɗanda aka ba da gudummawa ta hanyar haɗin gwiwa kamar Google's TPU Research Cloud da CoreWeave, yana nuna cewa rarraba, lissafin tallafi na tallafi na iya maye gurbin cibiyar tattara bayanai na kamfani idan an haɗa su tare da buɗe lambar.
Dabarun Tasiri
Dabarun mai siyarwa
Taswirorin hanyoyin tallace-tallace suna yin tasiri ga abubuwan da ƙungiyar ku za ta iya ginawa na gaba.
Kudin da kasafin kuɗi
Sharuɗɗan kasuwanci da zaɓuɓɓukan turawa suna shafar farashi da haɗari na dogon lokaci.
Haɗari da aminci
Ƙwararrun kamfani suna siffanta ɓangarorin samfur, yanayin aminci, da buɗewa.
Makomar EleutherAI
EleutherAI yana jujjuya daga tseren ƙima mai tsafta zuwa ga fassara, fayyace bayanan horo, da ƙaƙƙarfan kimantawa, wuraren da aka fi buƙatar ilimin kimiyya. Yi tsammanin ci gaba da aiki akan fahimtar abin da samfura ke wakilta a ciki, fitar da ingantaccen bayanan bayanai, da tallafawa binciken aminci mai zaman kansa. Yayin da labs na kan iyaka ke ƙara asirce, rawar EleutherAI a matsayin mai ƙima mai ƙima ta jama'a, horar da masu bincike na gaba na gaba, mai yuwuwa al'amura fiye da ƙididdige ma'auni na kowane samfurin guda ɗaya da yake jigilar su.
Aiwatar da Gaskiyar Duniya
Masu bincike a duk duniya suna amfani da saitin bayanai na Pile don horarwa da nazarin nau'ikan yare na buɗaɗɗe ta hanyar maimaitawa.
GPT-J-6B da GPT-NeoX-20B ana tura su ta hanyar farawa da masana ilimi azaman madadin kyauta ga samfuran API na kasuwanci.
LM Evaluation Harness shine daidaitaccen kayan aiki da dakunan gwaje-gwaje da yawa ke amfani da su don yin aikin ƙira a cikin ɗaruruwan ayyuka.
Masu bincike na aminci da fassarori masu zaman kansu suna amfani da ma'aunin buɗaɗɗen EleutherAI don nazarin ƙirar cikin gida waɗanda ke ɓoye APIs.
Hatsari & Tsare-tsare
Sanarwar ƙaddamarwa na iya ƙetare kwanciyar hankali a cikin ayyukan samarwa na gaske.
Farashin API ko sauye-sauyen manufofi na iya karya zato cikin dare.
Dogaro mai siyarwa guda ɗaya yana ƙara kulle-kulle da farashin ƙaura.
Taswirar Hanya
Kimanta masu samarwa ta amfani da ayyukan ku da saitin bayanai.
Yi bitar sirri, tsaro, da sharuɗɗan doka kafin haɗin kai.
Kula da tsarin koma baya a cikin samfura ko masu siyarwa.
Saka idanu bayanin kula don haka canje-canjen taswirar hanya kada suyi mamakin ƙungiyoyi.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the EleutherAI quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Nauyi & Ra'ayi
Tambayoyin da ake yawan yi
What is EleutherAI?
EleutherAI ƙungiyar bincike ce mai zaman kanta wacce ta fara buɗe tushen manyan nau'ikan harshe lokacin da aka kulle iyakokin AI a bayan bangon kamfanoni. Ya tabbatar da cewa al'ummar sa kai na iya ginawa da sakin samfuran da ke adawa da tsarin rufaffiyar, sake fasalin wanda zai shiga cikin binciken AI.
Ta yaya EleutherAI ta fara farawa a cikin 2020?
EleutherAI ya fara ne azaman ƙungiyar masu sa kai na Discord na yau da kullun da aka tsara don maimaita GPT-3 da aka rufe a lokacin.
Menene 'The Pile'?
Pile babba ne, daban-daban, buɗaɗɗen fitar da rubutu corpus EleutherAI wanda aka gina don horarwa da nazarin ƙirar harshe.
Wanne ne a cikin waɗannan ƙirar harshen EleutherAI?
GPT-NeoX-20B yana ɗaya daga cikin manyan buɗaɗɗen ƙirar EleutherAI; sauran sun fito daga Google ko Meta.
Menene LM Evaluation Harness ake amfani dashi?
Ƙunƙarar kayan aiki ne da aka karɓa da yawa don ƙayyadaddun ƙima na ƙirar harshe akan ɗaruruwan ma'auni.
Ta yaya EleutherAI ta sami lissafin don horar da manyan samfura da wuri?
Rashin cibiyar bayanai na kamfani, EleutherAI ya dogara da gudummawar TPU da albarkatun GPU don horar da samfuran sa.