Jagorar Fasaha

Ray don Rarraba AI

Ray shine tsarin bude-bude wanda ke sauƙaƙa auna aikin Python da AI daga kwamfutar tafi-da-gidanka zuwa tarin dubban inji.

Dubawa

Ray shine tsarin bude-bude wanda ke sauƙaƙa auna aikin Python da AI daga kwamfutar tafi-da-gidanka zuwa tarin dubban inji. Yana da mahimmanci saboda yana ba da hanya mai sauƙi, haɗin kai don rarraba horo, daidaitawa, sarrafa bayanai, da hidima ba tare da sake rubuta lambar ku ga kowane ba.

Ray don Rarraba AI wani shingen ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli.

Zurfafa nutsewa

Babban ra'ayin Ray shine juya ayyukan Python na yau da kullun da azuzuwan zuwa raka'a da aka rarraba tare da ƙaramin canji. Ayyukan da aka yiwa alama azaman 'aiki' mai nisa yana gudana ba tare da jituwa ba akan kowane ma'aikaci a cikin tari; ajin da aka yiwa alama a matsayin 'dan wasan kwaikwayo' mai nisa ya zama sabis na gaskiya wanda ke rayuwa akan ma'aikaci. Ray yana dawo da makoma mara nauyi (nassoshi na abu) kuma yana sarrafa tsara lokaci, motsin bayanai ta wurin ajiyar abu da aka raba, da haƙurin kuskure. A saman wannan babban ɗakin karatu da aka gina manufa: Ray Train don horar da ƙirar ƙira, Ray Tune don binciken hyperparameter, Ray Data don kwararar bututun bayanai, RLlib don ƙarfafa koyo, da Ray Serve don sabis na ƙira mai ƙima. Wannan yana bawa gungu ɗaya damar sarrafa gabaɗayan aikin ML ƙarshe zuwa ƙarshe.

Fahimtar Fasaha

Maɓalli na farko sune ayyuka (marasa ƙasa, kiran aikin layi ɗaya) da ƴan wasan kwaikwayo (ma'aikata na ƙasa waɗanda ke riƙe abubuwa kamar samfurin da aka ɗora ko ƙira). Lokacin da kuka kira aiki mai nisa, nan da nan Ray ya dawo gaba kuma ya tsara aikin a cikin CPUs/GPUs da ke akwai; ka kira ray.get() don samun sakamako. Shagon abubuwan da aka rarraba cikin ƙwaƙwalwar ajiya tare da kwafin sifili mai raba ƙwaƙwalwar ajiya yana motsa manyan abubuwa kamar tsararru tsakanin ma'aikata yadda ya kamata, guje wa maimaita maimaitawa da yin bututun AI masu nauyi da bayanai cikin sauri.

Jagorar Ray don Rarraba AI

Ray shine tsarin bude-bude wanda ke sauƙaƙa auna aikin Python da AI daga kwamfutar tafi-da-gidanka zuwa tarin dubban inji. Yana da mahimmanci saboda yana ba da hanya mai sauƙi, haɗin kai don rarraba horo, daidaitawa, sarrafa bayanai, da hidima ba tare da sake rubuta lambar ku ga kowane ba. Ray don Rarraba AI wani shingen ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli. Don gina zurfin fahimta, bi da Ray don Rarraba AI a matsayin samfurin aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, bayyana zato, da kuma raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.

A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Ray don Rarraba AI suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa tare da dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar Ray don Rarraba AI

Ray ya zama kashin baya ga babban sikelin AI, wanda aka yi amfani da shi musamman wajen horarwa da hidimar manyan samfuran harshe. Yi tsammanin haɓakawa a takamaiman sabis na LLM (Ray Serve tare da vLLM), tsarin GPU iri-iri, haɗin kai tare da tafkunan bayanai da Kubernetes ta hanyar KubeRay, da ingantacciyar ƙira don ɗaukar nauyi mai ƙima. Yayin da samfura ke girma, rawar Ray a cikin ƙirƙira horarwar kuɗaɗe da yawa, bututun RLHF, da ba da ƙima a cikin dubunnan na'urori na iya haɓaka.

Aiwatar da Gaskiyar Duniya

Gudun Ray Tune don bincika ɗaruruwan haɗin haɗin hyperparameter a layi daya a cikin gungu na GPU don nemo mafi kyawun ƙirar ƙira.

Amfani da Ray Train don rarraba horon ƙirar koyo mai zurfi a cikin yawancin GPUs da nodes tare da ƙananan canje-canje na lamba

Gina bututun batch-inference tare da Ray Data don cin miliyoyin bayanai ta hanyar yawo su ta hanyar ƙira a cikin tari.

Ƙaddamar da ƙira da yawa a bayan madaidaicin atomatik guda ɗaya tare da Ray Serve don sarrafa zirga-zirgar samarwa mai canzawa

Hanyoyin Aiwatarwa

Ray don Rarraba AI a aikace

Gudun Ray Tune don bincika ɗaruruwan haɗin hyperparameter a layi daya a cikin gungu na GPU don nemo mafi kyawun tsarin ƙira.

Gudun Ray Tune don bincika ɗaruruwan haɗe-haɗe na hyperparameter a layi daya a cikin gungu na GPU don nemo mafi kyawun ƙirar ƙira Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Ray don Rarraba AI a aikace

Amfani da Ray Train don rarraba horon ƙirar koyo mai zurfi a cikin yawancin GPUs da nodes tare da ƙananan canje-canje na lamba.

Yin amfani da Ray Train don rarraba horo na ƙirar koyo mai zurfi a cikin yawancin GPUs da nodes tare da ƙananan canje-canje na lamba Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da kuma bin duk abubuwan da aka samu na yawan aiki da farashin kuskure a kan lokaci.

Ray don Rarraba AI a aikace

Gina bututun batch-inference tare da Ray Data don cin miliyoyin bayanai ta hanyar yawo su ta hanyar ƙira a cikin tari.

Gina bututun batch-inference tare da Ray Data don zura miliyoyin bayanai ta hanyar yawo su ta hanyar samfuri a cikin ƙungiyoyin tari yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Ray don Rarraba AI a aikace

Ƙaddamar da ƙira da yawa a bayan madaidaicin atomatik guda ɗaya tare da Ray Serve don sarrafa zirga-zirgar samarwa mai canzawa.

Aiwatar da samfura da yawa a bayan ƙarshen ƙarshen autoscaling guda ɗaya tare da Ray Serve don sarrafa madaidaicin zirga-zirgar zirga-zirgar ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Hatsari & Tsare-tsare

!

Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.

!

Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.

!

Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.

Taswirar Hanya

1

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike