Uhlolojikelele
I-Seldon Core iyinkundla yomthombo ovulekile yokuphakela amamodeli okufunda omshini ku-Kubernetes, enezici ezivelele: amagrafu okuqondisisa. Esikhundleni sokusebenzisa imodeli eyodwa eqhelile, ikuvumela ukuthi uhlanganise amamodeli, ama-routers, izihlanganisi, neziguquli zibe igrafu eyodwa eqondisiwe esebenza njengesevisi eyodwa engachitheka.
I-Seldon Core kanye ne-Inference Graphs iyibhulokhi yokwakha yobuchwepheshe ethinta ikhwalithi yemodeli, izindleko zengqalasizinda, ukubambezeleka, nokuthembeka esikalini.
I-Deep Dive
Izimo eziningi zokusetshenziswa kokukhiqiza zangempela zibandakanya ngaphezu kwekholi yemodeli eyodwa. Ungase ucubungule kuqala okokufaka, uhambise isicelo kwenye yamamodeli ambalwa, uqalise iqoqo, bese ngemva kokucubungula umphumela. I-Seldon Core iveza lokhu njengegrafu ye-inference echazwe ku-SeldonDeployment (noma, esakhiweni se-v2, nge-Seldon Core Operator ne-MLServer). Igrafu yakhiwe kusukela ezinhlotsheni zezingxenye ezisebenziseka kabusha: Imodeli inikeza izibikezelo, i-Transformer ilungisa okokufaka noma okuphumayo, i-Router enquma ukuthi iyiphi ingane okufanele ishayele (ivumela ukuhlolwa kwe-A/B nezigelekeqe ezihlome eziningi), futhi i-Combiner ihlanganisa okuphumayo okuvela kumamodeli amaningi ukuze kuhlanganiswe. I-Seldon isekela izinhlaka eziningi ngokusebenzisa amaseva apakishwe kusengaphambili nezisonga zePython zangokwezifiso, futhi iveza amamethrikhi anothile, ukulandelela okusabalalisiwe, nokuphuma komthwalo okhokhelwayo ngaphandle kwebhokisi ukuze kubonakale futhi kuchazeke.
I-Technical Insight
Igrafu ye-inference iyigrafu ye-acyclic eqondisiwe lapho inodi ngayinye iyisevisi encane ene-interface yokubikezela evamile, futhi i-orchestrator ye-Seldon (i-orchestrator/umabi wesevisi) ihambisa isicelo ngegrafu futhi ihlanganisa izimpendulo. Ngenxa yokuthi ama-Routers angasebenzisa ingqondo yezigelekeqe ezihlome eziningi, ithrafikhi ingashintsha ngokuguquguqukayo iye kumamodeli asebenza kangcono ngokusekelwe kumasiginali omvuzo obukhoma. I-Seldon Core v2 ihlukanisa igrafu kumaseva emodeli ngayinye isebenzisa i-MLServer kanye ne-Open Inference Protocol, ivumela ukunikezwa kwamamodeli amaningi futhi yeqe kuhadiwe okwabiwe.
I-Mastering Seldon Core kanye ne-Inference Graphs
I-Seldon Core iyinkundla yomthombo ovulekile yokuphakela amamodeli okufunda omshini ku-Kubernetes, enezici ezivelele: amagrafu okuqondisisa. Esikhundleni sokusebenzisa imodeli eyodwa eqhelile, ikuvumela ukuthi uhlanganise amamodeli, ama-routers, izihlanganisi, neziguquli zibe igrafu eyodwa eqondisiwe esebenza njengesevisi eyodwa engachitheka. I-Seldon Core kanye ne-Inference Graphs iyibhulokhi yokwakha yobuchwepheshe ethinta ikhwalithi yemodeli, izindleko zengqalasizinda, ukubambezeleka, nokuthembeka esikalini. Ukuze wakhe ukuqonda okujulile, phatha i-Seldon Core kanye ne-Inference Graphs njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho uhlelo olungakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa i-Seldon Core kanye ne-Inference Graphs athuthukisa izakhiwo, idatha, nokukhetha kwengqalasizinda ngokumelene nokuthembeka nezindleko. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka. Ngesikhathi esifanayo, Ukuthuthukisa ibhentshimakhi eyodwa kungafihla ubuthakathaka obubanzi besistimu. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka.
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imfundo yobuchwepheshe isiza amaqembu ukuthi akhethe isitaki esifanele, hhayi nje esisha.
Imfundo yobuchwepheshe isiza amaqembu ukuthi akhethe isitaki esifanele, hhayi nje esisha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Izinketho ezingcono zobunjiniyela zinciphisa izehlakalo ezinokwethenjelwa ekukhiqizeni.
Izinketho ezingcono zobunjiniyela zinciphisa izehlakalo ezinokwethenjelwa ekukhiqizeni. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Umbolekisi uhlanganisa i-Transformer leyo amakhodi ashisayo-kodwa eyifaka endaweni eyimodeli, bese kuba i-Transformer efometha isikolo, konke njenge-SeldonDeployment eyodwa.
Inkampani yemidiya isebenzisa i-Router node esebenzisa isigebengu esihlome ngezikhali eziningi ukuze ithumele ngokuguqukayo ithrafikhi eyengeziwe kunoma iyiphi imodeli yesincomo ezuza umvuzo wokuchofoza okuphezulu.
Ithimba lihlanganisa amamodeli amathathu okukhwabanisa ngenodi Yenhlanganisela elinganisa amaphuzu alo ngaphambi kokubuyisela isinqumo esisodwa kofonayo.
Umshwalense olawulwayo unamathisela ukugawulwa kwe-payload ye-Seldon kanye nabachazi be-Alibi kugrafu yokukhomba ukuze zonke izibikezelo zilandelelwe futhi zichazwe ukuze kucwaningwe.
Amaphethini Okusebenzisa
I-Seldon Core kanye ne-Inference Graphs isebenza
Umbolekisi uhlanganisa i-Transformer leyo amakhodi ashisayo-kodwa eyifaka endaweni eyimodeli, bese kuba i-Transformer efometha isikolo, konke njenge-SeldonDeployment eyodwa.
Umbolekisi uhlanganisa i-Transformer efakwe amakhodi ashisayo okukodwa endaweni eyimodeli, bese kuba i-Transformer efometha amaphuzu, wonke njengeqembu elilodwa le-SeldonDeployment ngokuvamile athola imiphumela engcono lapho echaza imikhawulo yekhwalithi ngaphambili, agcine indlela yokukhuphuka yomuntu ngamacala asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Seldon Core kanye ne-Inference Graphs isebenza
Inkampani yemidiya isebenzisa i-Router node esebenzisa isigebengu esihlome ngezikhali eziningi ukuze ithumele ngokuguqukayo ithrafikhi eyengeziwe kunoma iyiphi imodeli yesincomo ezuza umvuzo wokuchofoza okuphezulu.
Inkampani yabezindaba isebenzisa i-Router nodi esebenzisa isigelekeqe esihlome ngezikhali ukuze sithumele ngokuguqukayo ithrafikhi eyengeziwe kunoma iyiphi imodeli yesincomo ethola umvuzo wokuchofoza okuphezulu Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, agcine indlela yokukhuphuka kwabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Seldon Core kanye ne-Inference Graphs isebenza
Ithimba lihlanganisa amamodeli amathathu okukhwabanisa ngenodi Yenhlanganisela elinganisa amaphuzu alo ngaphambi kokubuyisela isinqumo esisodwa kofonayo.
Ithimba lihlanganisa amamodeli amathathu okukhwabanisa ngenodi Yenhlanganisela eyenza isilinganiso samaphuzu alo ngaphambi kokubuyisela isinqumo esisodwa kofonayo Amathimba ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka kwabantu yamakesi asemaphethelweni, futhi alandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Seldon Core kanye ne-Inference Graphs isebenza
Umshwalense olawulwayo unamathisela ukugawulwa kwe-payload ye-Seldon kanye nabachazi be-Alibi kugrafu yokukhomba ukuze zonke izibikezelo zilandelelwe futhi zichazwe ukuze kucwaningwe.
Umshwalense olawulwayo unamathisela ukuloga kwe-payload ye-Seldon kanye nabachazi be-Alibi kugrafu yokukhomba ukuze konke ukubikezela kulandelelwe futhi kuchazwe ukuze kuhlolwe amabhuku Amaqembu ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka kwabantu yamacala asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Ukuthuthukisa ibhentshimakhi eyodwa kungafihla ubuthakathaka obubanzi besistimu.
Izindleko zengqalasizinda nezokulungisa zivame ukubukelwa phansi.
Izikhala zokuphepha nokubonakala zingakhula njengoba izinhlelo ziba nzima kakhulu.
Ukuqalisa Umhlahlandlela
Chaza ukubambezeleka, ikhwalithi, nezindleko ezihlosiwe ngaphambi kokuqaliswa.
Chaza ukubambezeleka, ikhwalithi, nezindleko ezihlosiwe ngaphambi kokuqaliswa. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ibhentshimakhi ngaphansi komthwalo wangempela nezimo zedatha.
Ibhentshimakhi ngaphansi komthwalo wangempela nezimo zedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ukuqapha amathuluzi amaphutha, ukukhukhuleka, nomthelela wabasebenzisi.
Ukuqapha amathuluzi amaphutha, ukukhukhuleka, nomthelela wabasebenzisi. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Lungiselela izindlela zokuhlehlisa nezigameko ngaphambi kokukala.
Lungiselela izindlela zokuhlehlisa nezigameko ngaphambi kokukala. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.