가이드 연계 퀴즈 · 중간 레벨
검색 품질 퀴즈
검색 관련성, 컷오프 시 재현율 및 정밀도, 순위, 현재 증거, 권한, 답변할 수 없는 쿼리 및 누락된 지원을 확인하세요.
질문 1 의 8
Recall@k는 검색 시스템에 대해 무엇을 측정합니까?
모든 질문 미리보기8 질문
퀴즈를 풀면 정답과 설명이 나타납니다.
- Recall@k는 검색 시스템에 대해 무엇을 측정합니까?
- 반환된 첫 번째 관련 문서의 순위 위치
- 실제로 관련된 상위 k개 결과의 비율
- 상위 k에 있는 모든 관련 문서의 점유율
- 시스템이 k개의 결과를 반환하는 데 걸리는 시간
- A retrieval evaluation cares whether the best evidence appears near the top. What kind of metric addresses that concern?
- A rank-aware metric
- A server uptime metric
- A count of stored files
- A tokenizer vocabulary size
- An exact order code is missed by semantic search, while a paraphrased question is missed by keyword search. What should the team inspect?
- Only the number of documents stored
- Whether every user asked the same question
- The appearance of the search button
- Each retrieval method’s blind spots on fixed examples
- A team adds hybrid retrieval and reranking. How should it judge whether the change helped?
- Compare only the highest similarity score after the change
- Evaluate both versions on the same fixed labeled examples
- Assume more retrieved passages always improve answers
- Count the number of model parameters rather than results
- A retrieved passage loses the sentence that qualifies its claim. What failure pattern should the reviewer flag?
- The source document was necessarily false
- The user must have asked an unanswerable question
- A passage was cut away from its qualification
- The search system returned too few languages
- In the guide’s constructed example, five passages are returned and three are relevant. What is precision at five?
- Three out of five, or 60%
- Three out of four, or 75%
- Five out of four, or 125%
- One out of five, or 20%
- Why should retrieval tests include access restrictions and unanswerable queries?
- To increase the average similarity score
- To check that the system avoids unauthorized evidence and unsupported answers
- To ensure every query returns a document
- To replace relevance labels
- A passage is about the right product but describes an older version. What does this show?
- The passage must rank first because it shares keywords
- The query has no retrieval requirements
- A high similarity score proves the answer
- Topical relevance alone may not provide evidence for the specific version or date in the question