Jagorar Fasaha

Cakudawar Masana

Cakudar Kwararru (MoE) ƙirar ƙira ce wacce ke raba hanyar sadarwa zuwa manyan cibiyoyin sadarwa na musamman kuma tana kunna kaɗan ne kawai a kowace shigarwa.

Dubawa

Cakudar Kwararru (MoE) ƙirar ƙira ce wacce ke raba hanyar sadarwa zuwa manyan cibiyoyin sadarwa na musamman kuma tana kunna kaɗan ne kawai a kowace shigarwa. Yana ƙyale samfura su riƙe ilimi mai girma yayin kiyaye kowane tsinkaya cikin sauri da arha.

Cakudawar Kwararru wani shingen ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, jinkiri, da aminci a sikeli.

Zurfafa nutsewa

Ma'auni mai canzawa yana gudanar da kowane shigarwa ta cikin yadudduka masu yawa iri ɗaya, don haka yin ƙirar mafi wayo yawanci yana nufin sanya kowane ƙididdiga ya fi tsada. Cakudar Masana ta karya wannan hanyar. Yana maye gurbin babban layin gaba da ciyarwa tare da ƙwararrun cibiyoyin sadarwa da yawa tare da ƙaramin 'na'ura mai ba da hanya tsakanin hanyoyin sadarwa' wanda ke yanke shawarar wane ƙwararrun ke sarrafa kowace alama. Yawanci ƙwararrun 1 ko 2 ne kawai ke yin wuta, don haka ƙirar zata iya samun ɗaruruwan biliyoyin jimillar sigogi amma kawai kunna ƙaramin juzu'i kowace alama. Wannan shine dalilin da ya sa samfura kamar Mixtral 8x7B da jita-jita na gine-ginen da ke bayan GPT-4 sun isa babban inganci ba tare da ƙimar ƙimar ƙima ba. Cinikin ciniki yana da rikitarwa: duk ƙwararrun dole ne su dace da ƙwaƙwalwar ajiya, kuma na'ura mai ba da hanya tsakanin hanyoyin sadarwa na iya yin ɓarna ko kuma yin lodin wasu ƙwararru, don haka horo yana buƙatar daidaitawa a hankali.

Fahimtar Fasaha

Zuciyar MoE ita ce hanyar sadarwar gating, ƙaramin koyo wanda ke ƙima kowane ƙwararru don alamar mai shigowa kuma yana bibiyar alamar zuwa manyan-k mafi yawan maki (sau da yawa k=1 ko 2). Don dakatar da na'ura mai ba da hanya tsakanin hanyoyin sadarwa daga aika komai zuwa wasu ƴan ƙwararrun ƙwararrun da aka fi so, horo yana ƙara ƙarin 'asara mai daidaitawa' wanda ke azabtar da rashin daidaituwa. Domin k ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun Ƙwararru waɗanda kawai ke gudanar da kowace alama, ƙididdigewa (FLOPs) suna tsayawa kusan ko da yaushe yayin da kuke ƙara ƙarin ƙwararru, don haka jimillar ma'auni da ma'auni na kowane-token da kansa.

Ƙwararrun Ƙwararru na Ƙwararru

Cakudar Kwararru (MoE) ƙirar ƙira ce wacce ke raba hanyar sadarwa zuwa manyan cibiyoyin sadarwa na musamman kuma tana kunna kaɗan ne kawai a kowace shigarwa. Yana ƙyale samfura su riƙe ilimi mai girma yayin kiyaye kowane tsinkaya cikin sauri da arha. Cakudawar Kwararru wani shingen ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, jinkiri, da aminci a sikeli. Don gina zurfin fahimta, bi da Cakudawar Masana a matsayin samfurin aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, bayyana zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.

A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Cakudar Masana suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa tare da dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar Cakudawar Masana

MoE yana zama kayan aiki na asali don ƙira-ƙira mai iyaka saboda yana kawar da ƙarfi daga farashi. Yi tsammanin ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararrun ƙwararru waɗanda ke yin la'akari da ƙarin mahallin, da ingantattun dabaru don hidimar manyan ƙira mai ƙima akan ƙayyadaddun kayan aiki. Har ila yau, bincike yana magance matsalar ƙwaƙwalwar ajiya, tun da duk masana dole ne a ɗora su duk da cewa kaɗan ne ke gudana, ta hanyar ƙwararrun ƙwararru da ƙididdigewa. Kamar yadda buɗaɗɗen samfura kamar Mixtral da DeepSeek-MoE balagagge, ƙananan gine-ginen za su iya ƙarfafa mataimaka masu inganci akan ƙananan kasafin GPU.

Aiwatar da Gaskiyar Duniya

Mixtral 8x7B yana amfani da ƙwararru 8 kuma yana kunna 2 akan kowace alama, yana ba da kusan jumlolin 47B amma kawai ~ 13B yana aiki kowace alama don sauri, ƙima mai rahusa.

DeepSeek da Qwen suna jigilar manyan samfuran Harshen MoE waɗanda suka dace da ƙira masu yawa akan maƙasudai yayin da suke gudana tare da ƙananan ƙididdiga ta kowace alama.

Masu samar da Cloud LLM suna amfani da MoE don haka babban samfuri guda ɗaya zai iya yiwa masu amfani da yawa hidima da araha, tunda kowace buƙata tana haskaka ƴan ƙwararru ne kawai.

Google's A baya Canja Mai Canjawa ya kai sama da ma'auni tiriliyan ta amfani da hanya-1 na sama don ci gaba da sarrafa lissafin horo.

Hanyoyin Aiwatarwa

Cakudawar Masana a aikace

Mixtral 8x7B yana amfani da ƙwararru 8 kuma yana kunna 2 akan kowace alama, yana ba da kusan jumlolin 47B amma kawai ~ 13B yana aiki kowace alama don sauri, ƙima mai rahusa.

Mixtral 8x7B yana amfani da ƙwararrun 8 kuma yana kunna 2 a kowace alama, yana ba da kusan jimlar 47B jimlar amma kawai ~ 13B aiki kowace alama don sauri, Ƙungiyoyin ƙima mai rahusa yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Cakudawar Masana a aikace

DeepSeek da Qwen suna jigilar manyan samfuran Harshen MoE waɗanda suka dace da ƙira masu yawa akan maƙasudai yayin da suke gudana tare da ƙananan ƙididdiga ta kowace alama.

DeepSeek da Qwen suna jigilar manyan samfuran Harshen MoE waɗanda suka dace da ƙira masu yawa akan ma'auni yayin da suke gudana tare da ƙananan ƙididdige ƙididdiga ƙididdiga yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓaka ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Cakudawar Masana a aikace

Masu samar da Cloud LLM suna amfani da MoE don haka babban samfuri guda ɗaya zai iya yiwa masu amfani da yawa hidima da araha, tunda kowace buƙata tana haskaka ƴan ƙwararru ne kawai.

Masu ba da sabis na Cloud LLM suna amfani da MoE don haka babbar ƙirar ƙira ɗaya na iya bawa masu amfani da yawa damar yin amfani da su, tunda kowane buƙatu kawai yana haskaka ƙwararrun ƙwararrun Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suke ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da kuma bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Cakudawar Masana a aikace

Google's A baya Canja Mai Canjawa ya kai sama da ma'auni tiriliyan ta amfani da hanya-1 na sama don ci gaba da sarrafa lissafin horo.

Google's A baya Canja Mai Canjawa ya kai sama da simitin tiriliyan ta hanyar amfani da hanya-1 na sama don ci gaba da ƙididdige ƙididdiga ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da tsadar kuskure akan lokaci.

Hatsari & Tsare-tsare

!

Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.

!

Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.

!

Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.

Taswirar Hanya

1

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike