Ubuyobozi bwa tekiniki

Impuzandengo ya Precision na PR-AUC

Ubusanzwe bw'ukuri bugaragaza ukuri kwa model uko kwibuka kwiyongera mu ntera z'ibyemezo.

Umva iki gitaboAI-byavuzwe · ~3 min

Kuriyi page3 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Ejo hazaza h'ubushobozi bwo kwemeza no PR-AUC
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Imbonerahamwe z'ubushobozi bwo kwemeza n'ubushobozi bwo kwemeza zifite akamaro iyo ibimenyetso by'ukuri biba bike, ariko ubunini bw'ubushobozi bwo kwemeza n'ubushobozi bwo kwemeza bw'ubushobozi bwo kwemeza ni uburyo butandukanye bukwiye kwitwa neza.

Kwibira cyane

Precision asks how many selected cases are positive. Recall asks how many of all positive cases have been selected. As a model's score threshold is lowered, more cases enter the selected set. Recall cannot decrease as the threshold is lowered, but precision can rise or fall depending on the newly included cases. A precision-recall curve traces this tradeoff. It is especially informative for a rare positive class because it directly exposes how many selected items are false alarms. A receiver operating characteristic curve answers a different question using the false-positive rate, whose denominator includes all actual negatives. Neither view removes the need to consider real decision costs. Average precision summarizes the precision-recall relationship by weighting precision values by the corresponding increases in recall. In a simple ranking without tied scores, it equals the average precision at the ranks occupied by positive cases. Suppose the only two positives appear first and third. The precisions at those positions are one and two-thirds, so average precision is about 0.833. The label PR-AUC can be ambiguous. Some reports mean trapezoidal integration of precision against recall; others use it loosely for average precision. Scikit-learn distinguishes average_precision_score from auc, which applies the trapezoidal rule. These values can differ because the interpolation assumptions differ. State the actual calculation. Precision depends on the prevalence of positives in the evaluation population. A score from a balanced sample may not describe a deployment setting where positives are rare. Report the positive fraction and evaluation design. Finally, a summary across thresholds does not select an operating threshold. Inspect the precision, recall and workload at the point where the model will actually be used.

Gushyira mu bikorwa Isi

Urutonde rw'isesengura rufite ibintu byinshi bisanzwe n'ibintu bike bifite akamaro. Ikigereranyo cya precision-recall kigaragaza ubusabane hagati yo kubona ibintu bifite akamaro byinshi no gusaba abasesenguzi gusuzuma ibitari ngombwa.

Mu ishusho y'irangamuntu itagira amanota angana, ibiri byiza biboneka bwa mbere n'icya gatatu. Precision kuri izo myanya ni 1 na kabiri, bityo ubusanzwe bw'ukuri buri hafi 0.833.

Itsinda rikoreshwa rya scikit-learn's average_precision_score ku bipimo by'ibimenyetso n'ibipimo by'ibisubizo. Rerekana urwego rw'ibimenyetso by'ukuri kandi ritakaza gusimbuza ibisubizo n'ibisubizo by'ukuri mbere yo kugenzura.

Ibyiciro bibiri by'ibipimo by'ibisubizo birimo ibipimo bitandukanye by'ibimenyetso by'ukuri. Umukozi w'ibipimo asubiza ibyo bipimo mbere yo kugereranya ibisubizo by'ubushobozi bwo kwemeza, kuko prevalence ihindura uko ubunini bw'ubushobozi bwo kwemeza bugomba gusobanurwa.

Ejo hazaza h'ubushobozi bwo kwemeza no PR-AUC

Dashboard z'isesengura zishobora gutuma ibipimo by'amanota birushaho kugaragara neza binyuze mu kwerekana ubwinshi bw'ibintu byiza, ibarurishamibare nyakuri y'ubuso n'ahantu nyakuri ho gukorera hafi y'amanota y'ingenzi. Itsinda rishinzwe isuzuma rishobora kwita cyane ku mubare w'ibibazo bifite akamaro bigaragara mu bushobozi bwa buri munsi bwagenwe, mu gihe itsinda ry'indi rishobora gukenera igipimo gito cya recall. Gukomeza kubika ibyahanuwe n'amanota bituma ibibazo nk'ibi bishobora gusubirwamo nta guhindura model. Mu gihe abaturage bahinduka, amatsinda agomba kongera gusuzuma ubusumbane ku makuru ahagarariye aho kwemeza ko umusaruro w'ubwiza bw'ibanze (average-precision) w'igihe cyashize wemeza umubare w'akazi cyangwa akamaro mu gihe kizaza.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Fata ikizamini cya Average Precision na PR-AUC

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Average Precision na PR-AUC ni iki?

Precision y'ubusanzwe isobanura ubunyangamugayo bw'umodeli uko recall yiyongera ku ntera z'ibyemezo. Imirongo ya precision-recall ifite akamaro iyo ibibazo byiza ari bike, ariko precision y'ubusanzwe n'ubuso bwa trapezoidal munsi y'iyo mirongo ni imibare itandukanye ikwiye kwitwa neza.

Ni igipimo ki precision ipima ku murongo w'isesengura watoranijwe?

Precision ipima isuku y'itsinda ryatoranijwe; recall ipima igice cy'ibyo byiza byose byabonetse.

Mu gutondeka hatarimo amanota angana, ibya mbere n'icya gatatu ni byo byiza gusa. Ni iyihe precision y'ubusanzwe ikurikira?

Precision ni imwe ku ya mbere y'ibya neza kandi igice bibiri ku ya kabiri. Impuzandengo yabyo ni igice cya gatanu ku cyenda, hafi 0.833.

Kuki ubuso bwa trapezoidal PR-AUC bushobora gutandukana na precision y'ubusanzwe?

Precision y'ubusanzwe ibara precision hakurikijwe increments za recall, mu gihe integration ya trapezoidal ihuza ibipimo by'imirongo ikoresheje uburyo butandukanye bw'ubuso.

Ni ibihe byinjiza bikomeza amakuru y'urutonde akeneye precision y'ubusanzwe?

Amanota atuma habaho isuzuma ku ntera z'ibyemezo. Ibyemezo bikomeye bibika gusa ahantu kamwe ko gukora kandi bigasiba amakuru menshi y'urutonde.

Dataseti ebyiri zifite ubwinshi butandukanye bw'ibintu byiza. Ni iki kigomba kujyana n'igereranya ry'amanota yabo ya precision-recall?

Precision ishingira ku bwinshi bw'icyiciro, bityo abaturage n'uburyo bwo gufata ingero ni ibikenewe mu context.