Guide-linked quiz · Medium Level
Retrieval Metrics: Recall@K, MRR and nDCG Quiz
Choose Recall@K, MRR, and nDCG based on ranking goals and relevance labels, and understand what retrieval scores leave unmeasured.
Question 1 of 8
What does Recall@K measure?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- What does Recall@K measure?
- The rank of only the first relevant item
- The fraction of known relevant items retrieved within the top K results
- The generation quality of a final answer
- The average latency of a search
- Which aspect does MRR emphasize?
- The total number of relevant results after rank K
- Graded relevance of every result
- Whether a generated answer cites a source
- How high the first relevant result appears in the ranking
- What type of judgment can nDCG use?
- Graded relevance, with lower-ranked items discounted
- Only a model’s output token count
- Whether a request timed out
- Only exact-match labels for the generated answer
- Why might MRR be suitable when users need one result quickly?
- It rewards retrieving every relevant item equally
- It measures whether all documents were indexed
- It rewards placing the first relevant item near the top
- It evaluates answer factuality directly
- What does Recall@K fail to distinguish by itself?
- The number K used
- Different orderings of relevant items that are both within the top K
- Whether the relevant set is known
- The query text
- Why can incomplete relevance judgments distort retrieval metrics?
- An actually relevant but unjudged result may be treated as nonrelevant
- Metrics automatically fill in all missing labels
- Every query has exactly one relevant result
- Judgments affect only model latency
- What should be reported when comparing nDCG implementations?
- Only the retrieval model name
- The number of GPU cores
- Only the prompt template
- The gain and discount conventions, cutoff, and aggregation
- Does a high retrieval Recall@K prove that a RAG answer is correct?
- Yes, if K is at least ten
- Yes, because relevant documents guarantee faithful synthesis
- No; it measures retrieval coverage, not final answer correctness
- No, because retrieval cannot be evaluated
Keep testing yourself
More quizzes picked for your level.