HAGAHA Farsamada

NDCG iyo Metrics Ranking

Ranking metrics evaluate the order of items rather than only whether individual labels are correct.

Dhageyso hagahanAI-waa laga sheekeeyay · ~3 min

Boggaan3 daqiiqo akhri
  1. Dulmar
  2. quusid qoto dheer
  3. Dhaqangelinta Adduunka-dhabta ah
  4. The Future of NDCG and Ranking Metrics
  5. Ku dhaqangelinta
  6. Sii wad Sahaminta
  7. Su'aalaha soo noqnoqda

Dulmar

Precision@k, recall@k, MAP, MRR and normalized discounted cumulative gain emphasize different aspects, so metric choice should match the ranking task and its relevance judgments.

quusid qoto dheer

Ranking systems order candidates for a user or query. Evaluation should reflect where relevant results appear and how relevance is defined. Precision at k is the fraction of the top k results judged relevant. Recall at k is the fraction of all relevant candidates retrieved in the top k. Precision emphasizes the quality of the displayed set; recall emphasizes how much of the relevant set was found. Average precision summarizes precision at ranks where relevant items occur, and mean average precision (MAP) averages that value across queries. Mean reciprocal rank (MRR) uses the reciprocal of the rank of the first relevant result and averages across queries. MRR is useful when finding one good result quickly is the priority, but it largely ignores the quality of later ranks. Discounted cumulative gain (DCG) supports graded relevance. A gain function assigns larger value to more relevant items, while a logarithmic discount reduces credit for items lower in the list. Normalized DCG divides a ranking's DCG by the ideal DCG for that query, giving a score typically between zero and one when definitions align. This normalization makes values more comparable across queries with different relevance distributions, but aggregation choices still matter. Suppose a query has one highly relevant item and another mildly relevant item. Placing the highly relevant result first yields more DCG than placing it second. NDCG captures both graded relevance and rank position. It does not establish whether the relevance labels are unbiased or whether the candidate-generation process omitted useful items. Metrics can change with cutoff k, gain formula and label threshold. Report these choices and evaluate across the same query set. Offline metrics also do not fully capture user satisfaction, diversity, freshness, exposure bias or long-term outcomes. Use them alongside online experiments or human review when appropriate, while avoiding claims that a higher score alone proves a better user experience.

Dhaqangelinta Adduunka-dhabta ah

A search result list has five items and two are relevant. Precision@5 is 2/5, while recall@5 depends on how many relevant items exist in the full candidate set.

A user has three relevant items, and a system retrieves two within the top five. Recall@5 is 2/3 even though precision@5 is 2/5; the measures answer different questions.

For graded relevance, DCG rewards highly relevant items more when they appear near the top, using a gain and a logarithmic rank discount. NDCG divides by the ideal DCG for the same query to normalize the scale.

A recommendation team reports MRR when the first relevant result matters most and NDCG when multiple items and graded relevance across the list matter.

The Future of NDCG and Ranking Metrics

Ranking reports can improve by displaying top-k metrics, relevance definitions and per-query distributions rather than one aggregate number. Teams should choose MAP, MRR or NDCG based on whether the task values all relevant results, the first useful result or graded quality throughout the list. They should audit relevance judgments and candidate exposure, since metrics cannot reward items never retrieved for evaluation. Human satisfaction and diversity checks can complement offline scores. As ranking objectives evolve, preserve consistent historical definitions so trend comparisons remain meaningful.

Ku dhaqangelinta

Maxay muhiim u tahay

  • Qiimaha iyo miisaaniyada. Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
  • Go'aamo cad. Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
  • Xakamaynta tayada. Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.

Iska ilaali

  • Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
  • Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
  • Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.

Tallaabooyinka xiga

  1. Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
  2. Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
  3. La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
  4. U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.

Sii wad Sahaminta

Warqad bilaash ah

Hel warbixinta maalinlaha ah ee AI

Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.

Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.

Is tijaabi

Take the NDCG and Ranking Metrics quiz

Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.

Bilow kedis

Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq

Su'aalaha soo noqnoqda

What is NDCG and Ranking Metrics?

Ranking metrics evaluate the order of items rather than only whether individual labels are correct. Precision@k, recall@k, MAP, MRR and normalized discounted cumulative gain emphasize different aspects, so metric choice should match the ranking task and its relevance judgments.

Two relevant items appear in the top five. What is precision@5?

Precision@k divides relevant results in the top k by k, so it is 2/5.

Two of three relevant candidates appear in the top five. What is recall@5?

Recall divides retrieved relevant items by the total relevant set: 2/3.

Which metric emphasizes the rank of the first relevant result?

MRR averages the reciprocal rank of the first relevant result.

How does ideal DCG contribute to normalized DCG?

NDCG compares the observed order with an ideal ordering for the same query.

Which task best matches MRR?

MRR is driven by the first relevant rank and is useful when an early useful result matters.