Ubuyobozi bwa tekiniki

Seldon Core hamwe nigishushanyo mbonera

Seldon Core ni urubuga rufunguye rwo gukoresha imashini yiga imashini kuri Kubernetes, hamwe nibiranga igihagararo: ibishushanyo mbonera.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka Seldon Core hamwe nimbonerahamwe
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Instead of serving one isolated model, it lets you chain models, routers, combiners, and transformers into a single directed graph that runs as one deployable service.

Kwibira cyane

Byinshi mubikorwa byo gukoresha umusaruro bikubiyemo ibirenze guhamagarwa kwicyitegererezo. Urashobora kubanza kwinjiza, guhitamo icyifuzo kuri imwe muri moderi nyinshi, kuyobora ensemble, hanyuma nyuma yo gutunganya ibisubizo. Seldon Core irabigaragaza nkigishushanyo mbonera cyasobanuwe muri SeldonDeployment (cyangwa, mubwubatsi bwa v2, binyuze kuri Seldon Core Operator na MLServer). Igishushanyo cyubatswe muburyo bwakoreshwa muburyo bukoreshwa: Model ikora ibyahanuwe, Transformer ihindura ibyinjira cyangwa ibisohoka, Router ihitamo umwana wahamagara (itanga ibizamini bya A / B nibisambo bitwaje imbunda nyinshi), hamwe na Combiner ikusanya ibisubizo biva muburyo bwinshi bwo guterana. Seldon ishyigikira ibintu byinshi binyuze muri seriveri zabigenewe hamwe no gupakira ibicuruzwa bya Python, kandi bikagaragaza ibipimo bikungahaye, bikwirakwizwa, hamwe no kwishura ibicuruzwa biva mu gasanduku kugira ngo bibe byoroshye kandi bisobanurwa.

Gushyira mu bikorwa Isi

Uwatanze ingoyi ihindura Transformer imwe-ishyushye ikora ibiranga muburyo bw'icyitegererezo, hanyuma Transformer ikora amanota, byose nka SeldonDeployment.

Isosiyete ikora itangazamakuru ikoresha inzira ya Router ikoresha amabandi menshi yitwaje intwaro kugirango yohereze ingendo nyinshi muburyo ubwo aribwo buryo bwo gusaba bwinjiza ibihembo byinshi.

Itsinda rihuza moderi eshatu zuburiganya hamwe na Combiner node igereranya amanota yabo mbere yo gusubiza umwanzuro umwe umuhamagaye.

Umwishingizi ugengwa na Seldon yishyuza imizigo hamwe nabasobanuzi ba Alibi kubishushanyo mbonera kugirango buri gihanurwa gishobora gukurikiranwa no gusobanurwa kubigenzuzi.

Kazoza ka Seldon Core hamwe nimbonerahamwe

Seldon igenda yerekeza kuri moderi, yibanze kuri MLOps hamwe numuyoboro wa Core v2 hamwe nigishushanyo mbonera cya dataflow, hiyongereyeho gukomera hamwe na drift detection (Alibi Detect) no gusobanurwa (Alibi Sobanura). Nka LLMs hamwe na sisitemu ya agent ihinduka ibishushanyo mbonera byo kugarura, kwerekana, hamwe nibikoresho, ikarita yerekana ishusho yerekana ikarita bisanzwe kuriyi mirimo. Tegereza cyane kwibanda kubikorwa byinshi-bikora neza, bigenda neza, hamwe nubuziranenge bwubahirizwa kugirango sisitemu ya AI igoye, intambwe nyinshi ikomeze gukemurwa kandi igenzurwa mubikorwa.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Seldon Core and Inference Graphs quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Seldon Core and Inference Graphs?

Seldon Core ni urubuga rufunguye rwo gukoresha imashini yiga imashini kuri Kubernetes, hamwe nibiranga igihagararo: ibishushanyo mbonera. Aho kugirango ukorere icyitegererezo kimwe cyihariye, kireka urunigi rwerekana urunigi, router, kombineri, hamwe na transformateur mugishushanyo kimwe cyerekanwe gikora nka serivisi imwe yoherejwe.

Ni ubuhe buryo busobanura butandukanya Seldon Core na seriveri imwe y'icyitegererezo?

Seldon Core igufasha guhimba moderi, router, kombineri, hamwe na transformateur mugishushanyo kimwe cyerekana nka serivisi imwe.

Nibihe bishushanyo mbonera bya Seldon bihitamo umwana node yohereza icyifuzo kuri, gishobora gukora ibizamini bya A / B.

Router iyobora ibyifuzo byumwe mubana bayo kandi irashobora gushyira mubikorwa ibizamini bya A / B cyangwa amabandi yitwaje imbunda.

Ni ubuhe bwoko bw'ibigize buteranya ibisubizo biva muburyo bwinshi bwo guterana?

Combiner ihuza ibisubizo byabana benshi bigana mubisohoka kimwe, nuburyo amatsinda yubatswe.

Ni ubuhe bwoko bw'imiterere ya Seldon yerekana ishusho?

Igishushanyo mbonera cya Seldon kiyobowe nishusho ya acyclic aho buri node ari microservice hamwe nuburyo busanzwe bwo guhanura.

Muri Seldon Core v2, niyihe seriveri na protocole ituma moderi nyinshi ikorera mubishushanyo?

Core v2 ikuramo igishushanyo kiva muri seriveri yicyitegererezo ukoresheje MLServer hamwe na Porokireri Yugurura Porotokole ya moderi nyinshi ikorera.