Ubuyobozi bwa tekiniki

Ibipimo bya NDCG hamwe nu rutonde

Ranking metrics evaluate the order of items rather than only whether individual labels are correct.

Umva iki gitaboAI-byavuzwe · ~3 min

Kuriyi page3 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. The Future of NDCG and Ranking Metrics
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Precision@k, recall@k, MAP, MRR and normalized discounted cumulative gain emphasize different aspects, so metric choice should match the ranking task and its relevance judgments.

Kwibira cyane

Ranking systems order candidates for a user or query. Evaluation should reflect where relevant results appear and how relevance is defined. Precision at k is the fraction of the top k results judged relevant. Recall at k is the fraction of all relevant candidates retrieved in the top k. Precision emphasizes the quality of the displayed set; recall emphasizes how much of the relevant set was found. Average precision summarizes precision at ranks where relevant items occur, and mean average precision (MAP) averages that value across queries. Mean reciprocal rank (MRR) uses the reciprocal of the rank of the first relevant result and averages across queries. MRR is useful when finding one good result quickly is the priority, but it largely ignores the quality of later ranks. Discounted cumulative gain (DCG) supports graded relevance. A gain function assigns larger value to more relevant items, while a logarithmic discount reduces credit for items lower in the list. Normalized DCG divides a ranking's DCG by the ideal DCG for that query, giving a score typically between zero and one when definitions align. This normalization makes values more comparable across queries with different relevance distributions, but aggregation choices still matter. Suppose a query has one highly relevant item and another mildly relevant item. Placing the highly relevant result first yields more DCG than placing it second. NDCG captures both graded relevance and rank position. It does not establish whether the relevance labels are unbiased or whether the candidate-generation process omitted useful items. Metrics can change with cutoff k, gain formula and label threshold. Report these choices and evaluate across the same query set. Offline metrics also do not fully capture user satisfaction, diversity, freshness, exposure bias or long-term outcomes. Use them alongside online experiments or human review when appropriate, while avoiding claims that a higher score alone proves a better user experience.

Gushyira mu bikorwa Isi

A search result list has five items and two are relevant. Precision@5 is 2/5, while recall@5 depends on how many relevant items exist in the full candidate set.

A user has three relevant items, and a system retrieves two within the top five. Recall@5 is 2/3 even though precision@5 is 2/5; the measures answer different questions.

For graded relevance, DCG rewards highly relevant items more when they appear near the top, using a gain and a logarithmic rank discount. NDCG divides by the ideal DCG for the same query to normalize the scale.

A recommendation team reports MRR when the first relevant result matters most and NDCG when multiple items and graded relevance across the list matter.

The Future of NDCG and Ranking Metrics

Ranking reports can improve by displaying top-k metrics, relevance definitions and per-query distributions rather than one aggregate number. Teams should choose MAP, MRR or NDCG based on whether the task values all relevant results, the first useful result or graded quality throughout the list. They should audit relevance judgments and candidate exposure, since metrics cannot reward items never retrieved for evaluation. Human satisfaction and diversity checks can complement offline scores. As ranking objectives evolve, preserve consistent historical definitions so trend comparisons remain meaningful.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the NDCG and Ranking Metrics quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is NDCG and Ranking Metrics?

Ranking metrics evaluate the order of items rather than only whether individual labels are correct. Precision@k, recall@k, MAP, MRR and normalized discounted cumulative gain emphasize different aspects, so metric choice should match the ranking task and its relevance judgments.

Two relevant items appear in the top five. What is precision@5?

Precision@k divides relevant results in the top k by k, so it is 2/5.

Two of three relevant candidates appear in the top five. What is recall@5?

Recall divides retrieved relevant items by the total relevant set: 2/3.

Which metric emphasizes the rank of the first relevant result?

MRR averages the reciprocal rank of the first relevant result.

How does ideal DCG contribute to normalized DCG?

NDCG compares the observed order with an ideal ordering for the same query.

Which task best matches MRR?

MRR is driven by the first relevant rank and is useful when an early useful result matters.