GUÍA Técnica

NDCG y métricas de clasificación

Ranking metrics evaluate the order of items rather than only whether individual labels are correct.

Escuche esta guíaNarrado por IA · ~3 min

En esta pagina3 minutos de lectura
  1. Descripción general
  2. Buceo profundo
  3. Implementación en el mundo real
  4. The Future of NDCG and Ranking Metrics
  5. Poniéndolo en práctica
  6. Sigue explorando
  7. Preguntas frecuentes

Descripción general

Precision@k, recall@k, MAP, MRR and normalized discounted cumulative gain emphasize different aspects, so metric choice should match the ranking task and its relevance judgments.

Buceo profundo

Ranking systems order candidates for a user or query. Evaluation should reflect where relevant results appear and how relevance is defined. Precision at k is the fraction of the top k results judged relevant. Recall at k is the fraction of all relevant candidates retrieved in the top k. Precision emphasizes the quality of the displayed set; recall emphasizes how much of the relevant set was found. Average precision summarizes precision at ranks where relevant items occur, and mean average precision (MAP) averages that value across queries. Mean reciprocal rank (MRR) uses the reciprocal of the rank of the first relevant result and averages across queries. MRR is useful when finding one good result quickly is the priority, but it largely ignores the quality of later ranks. Discounted cumulative gain (DCG) supports graded relevance. A gain function assigns larger value to more relevant items, while a logarithmic discount reduces credit for items lower in the list. Normalized DCG divides a ranking's DCG by the ideal DCG for that query, giving a score typically between zero and one when definitions align. This normalization makes values more comparable across queries with different relevance distributions, but aggregation choices still matter. Suppose a query has one highly relevant item and another mildly relevant item. Placing the highly relevant result first yields more DCG than placing it second. NDCG captures both graded relevance and rank position. It does not establish whether the relevance labels are unbiased or whether the candidate-generation process omitted useful items. Metrics can change with cutoff k, gain formula and label threshold. Report these choices and evaluate across the same query set. Offline metrics also do not fully capture user satisfaction, diversity, freshness, exposure bias or long-term outcomes. Use them alongside online experiments or human review when appropriate, while avoiding claims that a higher score alone proves a better user experience.

Implementación en el mundo real

A search result list has five items and two are relevant. Precision@5 is 2/5, while recall@5 depends on how many relevant items exist in the full candidate set.

A user has three relevant items, and a system retrieves two within the top five. Recall@5 is 2/3 even though precision@5 is 2/5; the measures answer different questions.

For graded relevance, DCG rewards highly relevant items more when they appear near the top, using a gain and a logarithmic rank discount. NDCG divides by the ideal DCG for the same query to normalize the scale.

A recommendation team reports MRR when the first relevant result matters most and NDCG when multiple items and graded relevance across the list matter.

The Future of NDCG and Ranking Metrics

Ranking reports can improve by displaying top-k metrics, relevance definitions and per-query distributions rather than one aggregate number. Teams should choose MAP, MRR or NDCG based on whether the task values all relevant results, the first useful result or graded quality throughout the list. They should audit relevance judgments and candidate exposure, since metrics cannot reward items never retrieved for evaluation. Human satisfaction and diversity checks can complement offline scores. As ranking objectives evolve, preserve consistent historical definitions so trend comparisons remain meaningful.

Poniéndolo en práctica

Por qué es importante

  • Costo y presupuesto. Las decisiones de arquitectura impulsan el rendimiento y los costos operativos durante años.
  • Decisiones más claras. La educación técnica ayuda a los equipos a elegir la pila adecuada, no sólo la más nueva.
  • control de calidad. Mejores opciones de ingeniería reducen los incidentes de confiabilidad en la producción.

cuidado con

  • La optimización de un punto de referencia puede ocultar debilidades más amplias del sistema.
  • Los costos de infraestructura y mantenimiento a menudo se subestiman.
  • Las brechas de seguridad y observabilidad pueden crecer a medida que los sistemas se vuelven más complejos.

Próximos pasos

  1. Defina objetivos de latencia, calidad y costos antes de la implementación.
  2. Comparación en condiciones realistas de carga y datos.
  3. Monitoreo de instrumentos para detectar errores, deriva e impacto para el usuario.
  4. Prepare rutas de reversión y respuesta a incidentes antes de escalar.

Sigue explorando

Boletín gratuito

Recibe el resumen diario de IA

Tres noticias verificadas sobre IA cada mañana de lunes a viernes, explicadas con claridad. Gratis para siempre y sin anuncios.

Un correo cada día laborable. Date de baja con un clic. Nunca vendemos ni compartimos tu dirección.

Ponte a prueba

Take the NDCG and Ranking Metrics quiz

Corrección inmediata en cada respuesta y un certificado para compartir, con un ID verificable, cuando apruebas un curso.

Empezar el cuestionario

Apoya la educación gratuita sobre IA. AI Understanding es una organización sin fines de lucro 501(c)(3): sin anuncios ni muros de pago, nunca. Hacer una donación

Preguntas frecuentes

What is NDCG and Ranking Metrics?

Ranking metrics evaluate the order of items rather than only whether individual labels are correct. Precision@k, recall@k, MAP, MRR and normalized discounted cumulative gain emphasize different aspects, so metric choice should match the ranking task and its relevance judgments.

Two relevant items appear in the top five. What is precision@5?

Precision@k divides relevant results in the top k by k, so it is 2/5.

Two of three relevant candidates appear in the top five. What is recall@5?

Recall divides retrieved relevant items by the total relevant set: 2/3.

Which metric emphasizes the rank of the first relevant result?

MRR averages the reciprocal rank of the first relevant result.

How does ideal DCG contribute to normalized DCG?

NDCG compares the observed order with an ideal ordering for the same query.

Which task best matches MRR?

MRR is driven by the first relevant rank and is useful when an early useful result matters.