HejuruUbuyobozi bukurikira
TensorRT hamwe na moteri yerekana
Tekiniki
Ubuyobozi bwa tekiniki
Seldon Core ni urubuga rufunguye rwo gukoresha imashini yiga imashini kuri Kubernetes, hamwe nibiranga igihagararo: ibishushanyo mbonera.
Umva iki gitaboAI-byavuzwe · ~2 min
Instead of serving one isolated model, it lets you chain models, routers, combiners, and transformers into a single directed graph that runs as one deployable service.
Byinshi mubikorwa byo gukoresha umusaruro bikubiyemo ibirenze guhamagarwa kwicyitegererezo. Urashobora kubanza kwinjiza, guhitamo icyifuzo kuri imwe muri moderi nyinshi, kuyobora ensemble, hanyuma nyuma yo gutunganya ibisubizo. Seldon Core irabigaragaza nkigishushanyo mbonera cyasobanuwe muri SeldonDeployment (cyangwa, mubwubatsi bwa v2, binyuze kuri Seldon Core Operator na MLServer). Igishushanyo cyubatswe muburyo bwakoreshwa muburyo bukoreshwa: Model ikora ibyahanuwe, Transformer ihindura ibyinjira cyangwa ibisohoka, Router ihitamo umwana wahamagara (itanga ibizamini bya A / B nibisambo bitwaje imbunda nyinshi), hamwe na Combiner ikusanya ibisubizo biva muburyo bwinshi bwo guterana. Seldon ishyigikira ibintu byinshi binyuze muri seriveri zabigenewe hamwe no gupakira ibicuruzwa bya Python, kandi bikagaragaza ibipimo bikungahaye, bikwirakwizwa, hamwe no kwishura ibicuruzwa biva mu gasanduku kugira ngo bibe byoroshye kandi bisobanurwa.
Uwatanze ingoyi ihindura Transformer imwe-ishyushye ikora ibiranga muburyo bw'icyitegererezo, hanyuma Transformer ikora amanota, byose nka SeldonDeployment.
Isosiyete ikora itangazamakuru ikoresha inzira ya Router ikoresha amabandi menshi yitwaje intwaro kugirango yohereze ingendo nyinshi muburyo ubwo aribwo buryo bwo gusaba bwinjiza ibihembo byinshi.
Itsinda rihuza moderi eshatu zuburiganya hamwe na Combiner node igereranya amanota yabo mbere yo gusubiza umwanzuro umwe umuhamagaye.
Umwishingizi ugengwa na Seldon yishyuza imizigo hamwe nabasobanuzi ba Alibi kubishushanyo mbonera kugirango buri gihanurwa gishobora gukurikiranwa no gusobanurwa kubigenzuzi.
Seldon igenda yerekeza kuri moderi, yibanze kuri MLOps hamwe numuyoboro wa Core v2 hamwe nigishushanyo mbonera cya dataflow, hiyongereyeho gukomera hamwe na drift detection (Alibi Detect) no gusobanurwa (Alibi Sobanura). Nka LLMs hamwe na sisitemu ya agent ihinduka ibishushanyo mbonera byo kugarura, kwerekana, hamwe nibikoresho, ikarita yerekana ishusho yerekana ikarita bisanzwe kuriyi mirimo. Tegereza cyane kwibanda kubikorwa byinshi-bikora neza, bigenda neza, hamwe nubuziranenge bwubahirizwa kugirango sisitemu ya AI igoye, intambwe nyinshi ikomeze gukemurwa kandi igenzurwa mubikorwa.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Seldon Core ni urubuga rufunguye rwo gukoresha imashini yiga imashini kuri Kubernetes, hamwe nibiranga igihagararo: ibishushanyo mbonera. Aho kugirango ukorere icyitegererezo kimwe cyihariye, kireka urunigi rwerekana urunigi, router, kombineri, hamwe na transformateur mugishushanyo kimwe cyerekanwe gikora nka serivisi imwe yoherejwe.
Seldon Core igufasha guhimba moderi, router, kombineri, hamwe na transformateur mugishushanyo kimwe cyerekana nka serivisi imwe.
Router iyobora ibyifuzo byumwe mubana bayo kandi irashobora gushyira mubikorwa ibizamini bya A / B cyangwa amabandi yitwaje imbunda.
Combiner ihuza ibisubizo byabana benshi bigana mubisohoka kimwe, nuburyo amatsinda yubatswe.
Igishushanyo mbonera cya Seldon kiyobowe nishusho ya acyclic aho buri node ari microservice hamwe nuburyo busanzwe bwo guhanura.
Core v2 ikuramo igishushanyo kiva muri seriveri yicyitegererezo ukoresheje MLServer hamwe na Porokireri Yugurura Porotokole ya moderi nyinshi ikorera.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
TensorRT hamwe na moteri yerekana
Tekiniki