引导式测验 · 中等 等级

重新排序模型测验

测试检索器和重新排序器的角色，比较交叉编码器与双编码器，并检查候选集的列表排序。

相关引导路径模型重新排序
问题 1 的 8

在典型的两阶段检索管道中，重新排序器的工作是什么？

预览每个问题8 问题

当您参加测验时，就会出现答案和解释。

  1. 在典型的两阶段检索管道中，重新排序器的工作是什么？
    • 对候选人候选名单的相关性重新评分和重新排序
    • 从数百万份文档中提取最初的候选者
    • 将文档存储在数据库中
    • 生成最终的自然语言答案
  2. Besides MS MARCO, on which dataset did Nogueira and Cho report strong results for their BERT passage reranker?
    • 图像网
    • TREC-CAR
    • 图书馆演讲
    • SQuAD only
  3. 为什么不能使用跨编码器重排序器直接搜索数百万个文档？
    • 它仅适用于图像
    • 它无法读取文本
    • 必须为每个查询文档对重新计算其分数，这在规模上太慢了
    • 根本不需要计算
  4. 双编码器相对于交叉编码器的主要优点是什么？
    • 细粒度相关性更准确
    • 它总是完美地重新排序结果
    • 它不需要训练数据
    • 它的文档嵌入可以预先计算，使检索快速且可扩展
  5. How can a reranker affect context quality in a retrieval-augmented generation pipeline?
    • It can move more relevant retrieved candidates higher in the context shortlist, but does not guarantee correctness
    • It ensures every retrieved passage is factually correct
    • It creates missing documents in the corpus
    • It removes the need to evaluate retrieval
  6. In listwise reranking, what does the model consider together?
    • Only one document with no query
    • A query and a set of candidate documents when deciding their ordering
    • Each document embedding before any candidate retrieval
    • A single relevance label for the full training corpus
  7. What should a team verify before interpreting reranker scores as probabilities?
    • Whether every score is above zero
    • Whether the first-stage retriever was removed
    • Whether the scores have been calibrated and evaluated for that use
    • Whether the model has more parameters than the retriever
  8. What limitation does a reranker inherit from the first-stage retrieval system?
    • It always returns a calibrated probability
    • It removes the need for retrieval
    • It guarantees a correct generated answer
    • It cannot promote a relevant document that was never included in the candidate set