引导式测验 · 中等 等级

检索质量测验

检查检索相关性、召回率和精确度、排名、当前证据、权限、无法回答的查询和缺失的支持。

相关引导路径检索质量
问题 1 的 8

检索系统的recall@k衡量什么？

预览每个问题8 问题

当您参加测验时，就会出现答案和解释。

  1. 检索系统的recall@k衡量什么？
    • 第一个返回的相关文档的排名位置
    • 实际相关的前 k 个结果的比例
    • 前k个中找到的所有相关文档的份额
    • 系统返回k个结果所花费的时间
  2. A retrieval evaluation cares whether the best evidence appears near the top. What kind of metric addresses that concern?
    • A rank-aware metric
    • A server uptime metric
    • A count of stored files
    • A tokenizer vocabulary size
  3. An exact order code is missed by semantic search, while a paraphrased question is missed by keyword search. What should the team inspect?
    • Only the number of documents stored
    • Whether every user asked the same question
    • The appearance of the search button
    • Each retrieval method’s blind spots on fixed examples
  4. A team adds hybrid retrieval and reranking. How should it judge whether the change helped?
    • Compare only the highest similarity score after the change
    • Evaluate both versions on the same fixed labeled examples
    • Assume more retrieved passages always improve answers
    • Count the number of model parameters rather than results
  5. A retrieved passage loses the sentence that qualifies its claim. What failure pattern should the reviewer flag?
    • The source document was necessarily false
    • The user must have asked an unanswerable question
    • A passage was cut away from its qualification
    • The search system returned too few languages
  6. In the guide’s constructed example, five passages are returned and three are relevant. What is precision at five?
    • Three out of five, or 60%
    • Three out of four, or 75%
    • Five out of four, or 125%
    • One out of five, or 20%
  7. Why should retrieval tests include access restrictions and unanswerable queries?
    • To increase the average similarity score
    • To check that the system avoids unauthorized evidence and unsupported answers
    • To ensure every query returns a document
    • To replace relevance labels
  8. A passage is about the right product but describes an older version. What does this show?
    • The passage must rank first because it shares keywords
    • The query has no retrieval requirements
    • A high similarity score proves the answer
    • Topical relevance alone may not provide evidence for the specific version or date in the question