Ubuyobozi bwa tekiniki

Gukurikirana ML hamwe na Prometheus na Grafana

Prometheus irashobora gukusanya imibare yibihe-byerekana ibipimo byerekanwe na serivisi zicyitegererezo, mugihe Grafana yerekana ibyo bipimo mubibaho no kubimenyesha.

Umva iki gitaboAI-byavuzwe · ~3 min

Kuriyi page3 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka ML Gukurikirana hamwe na Prometheus na Grafana
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Ibimenyetso byingirakamaro bya ML-serivisi birimo igipimo cyo gusaba, ubukererwe, amakosa, imikoreshereze yumutungo hamwe nincamake zatoranijwe zerekana, hamwe no kwita kuri karidinari hamwe n’ibanga.

Kwibira cyane

Prometheus ni sisitemu yo gukurikirana ikusanya imibare yumubare wuruhererekane, mubisanzwe mugukuraho ibipimo bya HTTP amaherezo yerekanwe na serivisi. Seriveri irashobora kohereza ibicuruzwa kubisabwa no kunanirwa, gupima umurongo wimbitse cyangwa umutungo wigihugu, hamwe na histogramu zo gutinda no gusaba ingano. Ibirango byemerera guterana kubiranga imipaka nkibihe byanyuma, imiterere yimiterere cyangwa verisiyo yicyitegererezo. Imiterere yimurikagurisha hamwe nubusobanuro bwibipimo bigomba kuba bihamye bityo ibibazo bisobanura icyo abakoresha bategereje. Grafana irashobora kubaza Prometheus no kwerekana umwanya-urukurikirane rw'ibibaho, imbonerahamwe no kumenyesha mu kibaho. Serivisi yingirakamaro ya ML ihuza ubuzima bwa serivisi nibimenyetso bijyanye nicyitegererezo: igipimo cyo gusaba, ubukererwe bwa p50 / p95, kode yamakosa, kwiyuzuzamo, ingano yicyiciro, ububiko bwa GPU hamwe nincamake yo guhanura. Serivisi n'ibimenyetso by'icyitegererezo bisubiza ibibazo bitandukanye. Imbonerahamwe yubukererwe bwiza ntabwo yerekana ko guhanura ari ingirakamaro; guhanura drift ntabwo bivuze byanze bikunze serivisi ihagaze. Ikirango gikaridinali gisaba ubwitonzi. Ibirango nkumukoresha ID, ikibazo cyibanze, gusaba indangamuntu cyangwa indangamuntu idafite imipaka irashobora gukora umubare munini wigihe cyurukurikirane, kongera ububiko nibibazo. Indangagaciro zumvikana ntizigomba gushyirwa mubipimo bya metrics. Koresha ibiti cyangwa ibimenyetso hamwe nigenzura ryogusuzuma hamwe nicyitegererezo kubijyanye na karidinari yo hejuru, hamwe na metrics kubiteranya hamwe no kugabura. Histogrammes ishyigikira guteranya mugihe cyose, mugihe abakiriya-uruhande rwincamake ingano ntishobora guterana muburyo bumwe. Sobanura imenyesha hafi yintego za serivisi zifatika kandi ushiremo idirishya ryigihe kugirango wirinde kwitabira urusaku rugufi. Inzira imenyesha ba nyirayo no kubagerageza. Icyitegererezo-cyiza cyo kumenyesha akenshi biterwa na labels yatinze cyangwa ibipimo byitondewe bya porokisi, kandi bigomba gucungwa ukundi kubimenyesha igihe. Ikibaho gikenera ibice bisobanutse, verisiyo yicyitegererezo, ibimenyetso byoherejwe hamwe nibisobanuro byanditse. Prometheus na Grafana batanga icyegeranyo hamwe n'amashusho; ntibahita basobanura ibipimo bya ML bifite ireme cyangwa ngo basobanure impamvu ubuhanuzi bwahindutse. Politiki yerekeye ubuzima bwite, kugumana no kugera kuri buri kimenyetso cyatanzwe na serivisi.

Gushyira mu bikorwa Isi

Icyitegererezo API yohereza ibicuruzwa bisabwa kubara hamwe nubukererwe bwa histogramu ukurikije impera nicyiciro. Prometheus ikuraho ibipimo byanyuma, kandi Grafana yerekana ibipimo nubukererwe bwijana.

Itsinda rikurikirana imikoreshereze ya GPU hamwe nuburebure bwumurongo hamwe nicyitegererezo cyo gusaba gutinda gutandukanya umutungo wuzuye no gutinda buhoro.

Ikibaho cyerekana guhanura-amanota yagabanijwe na label yerekana imipaka-verisiyo, ariko irinda indangamuntu zabakoresha nkibirango byerekana kuko buri gaciro kihariye gashiraho igihe cyurukurikirane.

Imenyesha ryaka iyo igipimo cyamakosa cyangwa ubukererwe birenze intego ya serivisi mugihe cyagenwe, mugihe raporo yihariye isuzuma ubuziranenge bwikitegererezo iyo ibirango bigeze.

Kazoza ka ML Gukurikirana hamwe na Prometheus na Grafana

Ikurikiranabikorwa rishobora gutera imbere mugihe itsinda rya serivisi rya ML ryumvikanye kumurongo muto usangiwe wo gusaba, ubukererwe, umutungo hamwe no guhanura-gukwirakwiza ibipimo bifite nyirubwite. Ikibaho kigomba kwerekana icyitegererezo cyasohotse kandi gitandukanya ubuzima bukora nubushakashatsi bwatinze. Ongera usubiremo amajwi yo kumenyesha nibyiza bitari byiza kugirango itsinda rihamagara risubize neza. Ikaridinari-nini hamwe nibiranga ibyiyumvo biri mubiti bigenzurwa cyangwa ibimenyetso aho kuba byapimwe cyane. Ibikoresho byiza bituma sisitemu ihinduka igaragara, mugihe indangarugero yihariye iracyasaba icyitegererezo nibicuruzwa.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the ML Monitoring with Prometheus and Grafana quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Gukurikirana ML ni iki hamwe na Prometheus na Grafana?

Prometheus irashobora gukusanya imibare yibihe-byerekana ibipimo byerekanwe na serivisi zicyitegererezo, mugihe Grafana yerekana ibyo bipimo mubibaho no kubimenyesha. Ibimenyetso byingirakamaro bya ML-serivisi birimo igipimo cyo gusaba, ubukererwe, amakosa, imikoreshereze yumutungo hamwe nincamake zatoranijwe zerekana, hamwe no kwita kuri karidinari hamwe n’ibanga.

Nigute Prometheus ikusanya metero muri serivisi ntangarugero?

Prometheus isanzwe ikuraho serivisi ya nyuma yerekana ibipimo muburyo bushyigikiwe.

Ni ubuhe bwoko bwa metric bujyanye no kubara ibyifuzo?

Counters ikurikirana monotonike yiyongera kuri rusange, hamwe nibisubirwamo bikemurwa nkuko inzira itangira.

Kuki wirinda indangamuntu nkikirango cya Prometheus?

Buri kirango cyihariye gishyiraho urukurikirane, bityo ibirango-byinshi bya karidinari birashobora kurenga ububiko nibibazo.

Ni iki amateka yubukererwe ashobora gutanga?

Histogrammes yandika indorerezi mu ndobo kandi ishyigikira isesengura ryubukererwe.

Ni ubuhe butumwa bwa Grafana bwerekana kuri serivisi zifatika?

Ibimenyetso byikitegererezo hamwe nicyitegererezo bifasha abashoramari gutandukanya serivisi zubuzima nimpinduka zimyitwarire.