Seldon Core hamwe nigishushanyo mbonera
Seldon Core ni urubuga rufunguye rwo gukoresha imashini yiga imashini kuri Kubernetes, hamwe nibiranga igihagararo: ibishushanyo mbonera.
Incamake
Instead of serving one isolated model, it lets you chain models, routers, combiners, and transformers into a single directed graph that runs as one deployable service.
Kwibira cyane
Byinshi mubikorwa byo gukoresha umusaruro bikubiyemo ibirenze guhamagarwa kwicyitegererezo. Urashobora kubanza kwinjiza, guhitamo icyifuzo kuri imwe muri moderi nyinshi, kuyobora ensemble, hanyuma nyuma yo gutunganya ibisubizo. Seldon Core irabigaragaza nkigishushanyo mbonera cyasobanuwe muri SeldonDeployment (cyangwa, mubwubatsi bwa v2, binyuze kuri Seldon Core Operator na MLServer). Igishushanyo cyubatswe muburyo bwakoreshwa muburyo bukoreshwa: Model ikora ibyahanuwe, Transformer ihindura ibyinjira cyangwa ibisohoka, Router ihitamo umwana wahamagara (itanga ibizamini bya A / B nibisambo bitwaje imbunda nyinshi), hamwe na Combiner ikusanya ibisubizo biva muburyo bwinshi bwo guterana. Seldon ishyigikira ibintu byinshi binyuze muri seriveri zabigenewe hamwe no gupakira ibicuruzwa bya Python, kandi bikagaragaza ibipimo bikungahaye, bikwirakwizwa, hamwe no kwishura ibicuruzwa biva mu gasanduku kugira ngo bibe byoroshye kandi bisobanurwa.
Ubushishozi
Igishushanyo mbonera ni igishushanyo cya acyclic cyerekanwe aho buri node ari microservice ifite intera isanzwe yo guhanura, hamwe na orchestre wa Seldon (orchestre ya serivise / umuyobozi) uhuza icyifuzo ukoresheje igishushanyo kandi ugahuza ibisubizo. Kuberako Routers ishobora gushyira mubikorwa bitwaje intwaro yitwaje amabandi, traffic irashobora guhinduka muburyo bwo kwerekana imiterere myiza ishingiye kubimenyetso byerekana ibihembo. Seldon Core v2 ikuramo igishushanyo kiva muri seriveri yicyitegererezo ya buri muntu ukoresheje MLServer na Open Inference Protocol, ituma moderi nyinshi ikora kandi ikarenza urugero kubikoresho bisangiwe.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka Seldon Core hamwe nimbonerahamwe
Seldon igenda yerekeza kuri moderi, yibanze kuri MLOps hamwe numuyoboro wa Core v2 hamwe nigishushanyo mbonera cya dataflow, hiyongereyeho gukomera hamwe na drift detection (Alibi Detect) no gusobanurwa (Alibi Sobanura). Nka LLMs hamwe na sisitemu ya agent ihinduka ibishushanyo mbonera byo kugarura, kwerekana, hamwe nibikoresho, ikarita yerekana ishusho yerekana ikarita bisanzwe kuriyi mirimo. Tegereza cyane kwibanda kubikorwa byinshi-bikora neza, bigenda neza, hamwe nubuziranenge bwubahirizwa kugirango sisitemu ya AI igoye, intambwe nyinshi ikomeze gukemurwa kandi igenzurwa mubikorwa.
Gushyira mu bikorwa Isi
Uwatanze ingoyi ihindura Transformer imwe-ishyushye ikora ibiranga muburyo bw'icyitegererezo, hanyuma Transformer ikora amanota, byose nka SeldonDeployment.
Isosiyete ikora itangazamakuru ikoresha inzira ya Router ikoresha amabandi menshi yitwaje intwaro kugirango yohereze ingendo nyinshi muburyo ubwo aribwo buryo bwo gusaba bwinjiza ibihembo byinshi.
Itsinda rihuza moderi eshatu zuburiganya hamwe na Combiner node igereranya amanota yabo mbere yo gusubiza umwanzuro umwe umuhamagaye.
Umwishingizi ugengwa na Seldon yishyuza imizigo hamwe nabasobanuzi ba Alibi kubishushanyo mbonera kugirango buri gihanurwa gishobora gukurikiranwa no gusobanurwa kubigenzuzi.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Seldon Core and Inference Graphs quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
TensorRT hamwe na moteri yerekana
Ibibazo bikunze kubazwa
What is Seldon Core and Inference Graphs?
Seldon Core ni urubuga rufunguye rwo gukoresha imashini yiga imashini kuri Kubernetes, hamwe nibiranga igihagararo: ibishushanyo mbonera. Aho kugirango ukorere icyitegererezo kimwe cyihariye, kireka urunigi rwerekana urunigi, router, kombineri, hamwe na transformateur mugishushanyo kimwe cyerekanwe gikora nka serivisi imwe yoherejwe.
Ni ubuhe buryo busobanura butandukanya Seldon Core na seriveri imwe y'icyitegererezo?
Seldon Core igufasha guhimba moderi, router, kombineri, hamwe na transformateur mugishushanyo kimwe cyerekana nka serivisi imwe.
Nibihe bishushanyo mbonera bya Seldon bihitamo umwana node yohereza icyifuzo kuri, gishobora gukora ibizamini bya A / B.
Router iyobora ibyifuzo byumwe mubana bayo kandi irashobora gushyira mubikorwa ibizamini bya A / B cyangwa amabandi yitwaje imbunda.
Ni ubuhe bwoko bw'ibigize buteranya ibisubizo biva muburyo bwinshi bwo guterana?
Combiner ihuza ibisubizo byabana benshi bigana mubisohoka kimwe, nuburyo amatsinda yubatswe.
Ni ubuhe bwoko bw'imiterere ya Seldon yerekana ishusho?
Igishushanyo mbonera cya Seldon kiyobowe nishusho ya acyclic aho buri node ari microservice hamwe nuburyo busanzwe bwo guhanura.
Muri Seldon Core v2, niyihe seriveri na protocole ituma moderi nyinshi ikorera mubishushanyo?
Core v2 ikuramo igishushanyo kiva muri seriveri yicyitegererezo ukoresheje MLServer hamwe na Porokireri Yugurura Porotokole ya moderi nyinshi ikorera.