Jagorar Fasaha

Zane-zane na Seldon Core da Inference

Seldon Core dandamali ne na bude-bude don tura samfuran koyo na inji akan Kubernetes, tare da fasalin fage: zane-zane.

Dubawa

Seldon Core dandamali ne na bude-bude don tura samfuran koyo na inji akan Kubernetes, tare da fasalin fage: zane-zane. Maimakon yin hidimar keɓantaccen samfuri ɗaya, yana ba ku damar sarkar ƙira, masu amfani da hanyar sadarwa, masu haɗawa, da taswira zuwa jadawali guda ɗaya wanda ke aiki azaman sabis ɗin turawa ɗaya.

Seldon Core da Inference Graphs wani shingen ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli.

Zurfafa nutsewa

Yawancin shari'o'in amfani da samarwa na gaske sun ƙunshi fiye da kiran ƙira ɗaya. Kuna iya aiwatar da shigarwar, bi da buƙatun zuwa ɗaya daga cikin samfura da yawa, gudanar da taro, sannan bayan aiwatar da sakamakon. Seldon Core yana bayyana wannan azaman jadawali da aka siffanta a cikin SeldonDeployment (ko, a cikin gine-ginen v2, ta hanyar Seldon Core Operator da MLServer). An gina jadawali daga nau'ikan abubuwan da za a sake amfani da su: Model yana ba da tsinkaya, Mai Canjawa yana canza abubuwan shigarwa ko fitarwa, Mai ba da hanya tsakanin hanyoyin sadarwa yana yanke shawarar wane yaro zai kira (ba da damar gwajin A/B da 'yan fashi da yawa), kuma Mai Haɗawa yana tattara abubuwan samarwa daga ƙira da yawa don haɗawa. Seldon yana goyan bayan tsare-tsare da yawa ta hanyar sabar da aka riga aka shirya da kuma naɗaɗɗen Python na al'ada, kuma yana fallasa ma'auni masu wadatarwa, rarrabawa, da shigar da kaya daga cikin akwatin don lura da bayyanawa.

Fahimtar Fasaha

jadawali jadawali jadawali ne a cyclic jadawali inda kowane kumburi ya kasance microservice tare da madaidaicin fa'ida, kuma mawaƙan Seldon (Mawaƙin sabis ɗin / mai zartarwa) yana bibiyar buƙata ta cikin jadawali kuma ya haɗa amsa. Saboda masu ba da hanya tsakanin hanyoyin sadarwa na iya aiwatar da dabaru masu amfani da makamai masu yawa, zirga-zirgar zirga-zirga na iya canzawa daidai gwargwado zuwa ingantattun samfura dangane da siginar lada. Seldon Core v2 yana ƙaddamar da jadawali daga kowane sabar ƙirar ƙira ta amfani da MLServer da Buɗe Ka'idar Inference, yana ba da damar yin hidimar samfuri da yawa da wuce gona da iri akan kayan aikin da aka raba.

Jagorar Seldon Core da Zane-zane

Seldon Core dandamali ne na bude-bude don tura samfuran koyo na inji akan Kubernetes, tare da fasalin fage: zane-zane. Maimakon yin hidimar keɓantaccen samfuri ɗaya, yana ba ku damar sarkar ƙira, masu amfani da hanyar sadarwa, masu haɗawa, da taswira zuwa jadawali guda ɗaya wanda ke aiki azaman sabis ɗin turawa ɗaya. Seldon Core da Inference Graphs wani shingen ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli. Don gina zurfin fahimta, bi Seldon Core da Inference Graphs azaman ƙirar aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu ke buƙatar yanke hukunci na ƙwararru.

A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Seldon Core da Inference Graphs suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa akan dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar Seldon Core da Hotunan Inference

Seldon yana motsawa zuwa na zamani, MLOps na tsakiya na bayanai tare da bututun Core v2 da ƙirar bayanai, da ƙarin haɗakarwa tare da gano ɓarna (Alibi Gano) da iya bayyanawa (Alibi Bayyana). Kamar yadda LLMs da tsarin wakili suka zama zane-zane na maidowa, samfura, da kayan aikin, taswirar jadawali-jari bisa dabi'a akan waɗannan ayyukan aiki. Yi tsammanin ƙarin ba da fifiko kan ingantattun samfura masu yawa, watsa shirye-shirye, da daidaitaccen kiyayewa ta yadda hadaddun tsarin AI masu matakai da yawa su kasance masu ɓarna kuma ana iya sarrafa su a samarwa.

Aiwatar da Gaskiyar Duniya

Mai ba da lamuni yana ɗaure Transformer wanda zafi-zafi ɗaya ke ɓoye fasali zuwa ƙirar ƙira, sannan Mai Canjawa wanda ke tsara makin, duk a matsayin SeldonDeployment guda ɗaya.

Kamfanin watsa labarai yana amfani da kullin na'ura mai ba da hanya tsakanin hanyoyin sadarwa yana gudanar da gungun 'yan bindiga da yawa don aika ƙarin zirga-zirga zuwa kowane samfurin shawarwarin yana samun lada mai girma.

Ƙungiya ta haɗa nau'ikan zamba guda uku tare da kumburin Combiner wanda ke daidaita makinsu kafin mayar da shawara ɗaya ga mai kira.

Mai inshorar da aka tsara yana haɗa rajistar kaya na Seldon da masu bayyana Alibi zuwa jadawali don haka za a iya gano kowane tsinkaya da kuma bayyana shi don tantancewa.

Hanyoyin Aiwatarwa

Seldon Core da Inference Graphs a aikace

Mai ba da lamuni yana ɗaure Transformer wanda zafi-zafi ɗaya ke ɓoye fasali zuwa ƙirar ƙira, sannan Mai Canjawa wanda ke tsara makin, duk a matsayin SeldonDeployment guda ɗaya.

Mai ba da lamuni yana ɗaure Transformer wanda zafi-zafi ɗaya ke ɓoye fasali a cikin ƙirar ƙira, sannan Mai Canjawa wanda ke tsara makin, duk kamar yadda ƙungiyoyin SeldonDeployment yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓaka ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da tsadar kuskure akan lokaci.

Seldon Core da Inference Graphs a aikace

Kamfanin watsa labarai yana amfani da kullin na'ura mai ba da hanya tsakanin hanyoyin sadarwa yana gudanar da gungun 'yan bindiga da yawa don aika ƙarin zirga-zirga zuwa kowane samfurin shawarwarin yana samun lada mai girma.

Kamfanin watsa labarai yana amfani da kullin na'ura mai ba da hanya tsakanin hanyoyin sadarwa da ke tafiyar da 'yan bindiga da yawa don aika da ƙarin zirga-zirga zuwa kowane samfurin shawarwarin yana samun sakamako mai girma Ƙungiyoyin yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure a kan lokaci.

Seldon Core da Inference Graphs a aikace

Ƙungiya ta haɗa nau'ikan zamba guda uku tare da kumburin Combiner wanda ke daidaita makinsu kafin mayar da shawara ɗaya ga mai kira.

Ƙungiya ta haɗa nau'ikan zamba guda uku tare da kumburin Combiner wanda ke daidaita makin su kafin su dawo da yanke shawara guda ɗaya ga ƙungiyoyin masu kira yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Seldon Core da Inference Graphs a aikace

Mai inshorar da aka tsara yana haɗa rajistar kaya na Seldon da masu bayyana Alibi zuwa jadawali don haka za a iya gano kowane tsinkaya da kuma bayyana shi don tantancewa.

Mai inshorar da aka tsara yana haɗa rajistar kaya na Seldon da masu ba da bayanin Alibi zuwa jadawali don haka kowane tsinkaya za a iya ganowa da kuma bayyana shi don tantancewa Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓaka ɗan adam don shari'o'i, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

Hatsari & Tsare-tsare

!

Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.

!

Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.

!

Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.

Taswirar Hanya

1

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike