Jagorar Fasaha

ONNX da Model Interoperability

ONNX (Open Neural Network Exchange) wani buɗaɗɗen daidaitaccen tsari ne don wakiltar ƙirar koyon injin ta yadda za su iya tafiya cikin yardar kaina tsakanin tsarin aiki da lokutan aiki.

Dubawa

ONNX (Open Neural Network Exchange) wani buɗaɗɗen daidaitaccen tsari ne don wakiltar ƙirar koyon injin ta yadda za su iya tafiya cikin yardar kaina tsakanin tsarin aiki da lokutan aiki. Yana ba ku damar horar da ƙira a cikin kayan aiki ɗaya, kamar PyTorch, da tura shi a wani yanayi ba tare da sake rubuta shi ba.

ONNX da Model Interoperability tubalin ginin fasaha ne wanda ke shafar ingancin samfurin, farashin kayayyakin more rayuwa, latency, da aminci a sikeli.

Zurfafa nutsewa

Tsarin tsari daban-daban (PyTorch, TensorFlow, scikit-learn) suna adana samfura a cikin tsarin da bai dace ba, wanda ke sa ƙaddamar da aiki mai raɗaɗi. ONNX, wanda aka ƙaddamar a cikin 2017 ta Microsoft da Facebook kuma yanzu ana gudanar da su a ƙarƙashin Linux Foundation, yana warware wannan ta hanyar ayyana tsarin fayil na gama-gari da daidaitaccen tsarin aiki (kamar Conv, MatMul, Relu) waɗanda ke bayyana samfuri azaman jadawali. Kuna fitar da samfurin horarwa zuwa fayil na .onnx, kuma kowane lokaci mai dacewa zai iya loda shi. Lokacin Runtime na ONNX yana aiwatar da jadawali yadda ya kamata a cikin kayan aiki daban-daban, yana amfani da haɓakawa kamar haɗakarwa da ƙididdigewa, da ƙididdige ƙididdigewa zuwa abubuwan baya kamar CPUs, NVIDIA GPUs (ta hanyar TensorRT), ko ƙwararrun masu haɓakawa. Wannan yana kawar da samfurin horo daga turawa.

Fahimtar Fasaha

Samfurin ONNX jadawali ne na lissafin lissafi: nodes masu aiki ne da aka zana daga sigar afareta saitin (sakewa), kuma gefuna suna ɗaukar tenors tare da ma'anar siffofi da iri. Masu fitarwa suna bin diddigin ko rubuta samfurin ku don ɗaukar wannan jadawali. Dangane da ra'ayi, ONNX Runtime partitions jadawali a kan 'masu samar da kisa' (CPU, CUDA, TensorRT, da dai sauransu), kowane mai sarrafa ma'aikatan da yake goyan bayan mafi kyau, kuma yana amfani da ingantaccen matakin jadawali kamar nadawa akai-akai da haɗin kumburi don saurin abubuwa.

Jagoran ONNX da Model Interoperability

ONNX (Open Neural Network Exchange) wani buɗaɗɗen daidaitaccen tsari ne don wakiltar ƙirar koyon injin ta yadda za su iya tafiya cikin yardar kaina tsakanin tsarin aiki da lokutan aiki. Yana ba ku damar horar da ƙira a cikin kayan aiki ɗaya, kamar PyTorch, da tura shi a wani yanayi ba tare da sake rubuta shi ba. ONNX da Model Interoperability tubalin ginin fasaha ne wanda ke shafar ingancin samfurin, farashin kayayyakin more rayuwa, latency, da aminci a sikeli. Don gina fahimta mai zurfi, bi da ONNX da Model Interoperability a matsayin samfurin aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, bayyana zato, da kuma raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.

A aikace, ƙungiyoyi masu ƙarfi masu amfani da ONNX da Model Interoperability suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa a kan dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar ONNX da Model Interoperability

ONNX tana ƙaddamar da kanta azaman yare don ƙaddamar da samfuri, musamman don hidimar gefe da giciye. Yi tsammanin faffadar ɗaukar hoto na mai aiki don manyan nau'ikan harshe da masu canji, ƙarin tallafi don ƙididdigewa da ƙididdige ƙididdigewa, da zurfafa haɗin kai tare da lokutan masu siyar da kayan masarufi. Yayin da yanayin halittu na kwakwalwan AI na musamman ke girma, tsarin tsaka-tsakin mai sayarwa kamar ONNX ya zama mafi mahimmanci, barin ƙungiyoyi su canza kayan aiki ba tare da sake fasalin injiniya ba, kuma ONNX Runtime yana ci gaba da fadada cikin wayar hannu da yanar gizo (ta hanyar WebAssembly).

Aiwatar da Gaskiyar Duniya

Ana fitar da mai rarraba hoto na PyTorch zuwa ONNX da gudanar da shi tare da ONNX Runtime akan sabar samarwa ta C++ ba tare da dogaro da Python ba.

Ƙaddamar da ƙira zuwa wayar hannu ko mai bincike ta hanyar Gidan Yanar Gizon Runtime na ONNX (WebAssembly) don ƙaddamar da na'urar.

Haɓaka na'urar taswira da aka fitar tare da NVIDIA TensorRT azaman mai bada ONNX Runtime mai ba da izini don ƙarancin jinkiri.

Ƙididdige samfurin ONNX zuwa int8 don rage girmansa da kuma hanzarta ƙaddamarwa akan CPUs na gefe.

Hanyoyin Aiwatarwa

ONNX da Model Interoperability a aikace

Ana fitar da mai rarraba hoto na PyTorch zuwa ONNX da gudanar da shi tare da ONNX Runtime akan sabar samarwa ta C++ ba tare da dogaro da Python ba.

Ana fitar da mai rarraba hoto na PyTorch zuwa ONNX da gudanar da shi tare da ONNX Runtime akan uwar garken samar da C ++ ba tare da ƙungiyoyin dogaro da Python yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararrakin gefe, da bin diddigin abubuwan samarwa da ƙimar kuskure akan lokaci.

ONNX da Model Interoperability a aikace

Ƙaddamar da ƙira zuwa wayar hannu ko mai bincike ta hanyar Gidan Yanar Gizon Runtime na ONNX (WebAssembly) don ƙaddamar da na'urar.

Aiwatar da samfuri zuwa wayar hannu ko mai bincike ta hanyar Gidan Yanar Gizon Runtime na ONNX (WebAssembly) don ƙayyadaddun na'urori yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

ONNX da Model Interoperability a aikace

Haɓaka na'urar taswira da aka fitar tare da NVIDIA TensorRT azaman mai bada ONNX Runtime mai ba da izini don ƙarancin jinkiri.

Haɓaka injin da aka fitar dashi tare da NVIDIA TensorRT a matsayin mai ba da izini na ONNX na Runtime don ƙananan Ƙungiyoyin latency yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da kuma bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

ONNX da Model Interoperability a aikace

Ƙididdige samfurin ONNX zuwa int8 don rage girmansa da kuma hanzarta ƙaddamarwa akan CPUs na gefe.

Ƙididdiga samfurin ONNX zuwa int8 don rage girmansa da kuma hanzarta ƙaddamarwa a kan gefen CPUs Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk abubuwan da aka samu da kuma farashi na kuskure akan lokaci.

Hatsari & Tsare-tsare

!

Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.

!

Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.

!

Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.

Taswirar Hanya

1

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike