Gids-gekoppelde quiz · Middelmatig Niveau

Kwaliteitsquiz voor ophalen

Controleer de relevantie van het ophalen, de terugroepactie en de precisie bij een cutoff, de rangschikking, actueel bewijsmateriaal, machtigingen, onbeantwoordbare vragen en ontbrekende ondersteuning.

Gerelateerde gidspadenOphaalkwaliteit
Vraag 1 van 8

Wat meet recall@k voor een ophaalsysteem?

Bekijk elke vraag8 vragen

Antwoorden en uitleg verschijnen terwijl je de quiz doet.

  1. Wat meet recall@k voor een ophaalsysteem?
    • De rangpositie van het eerste relevante document dat wordt geretourneerd
    • Het aandeel van de top k resultaten dat daadwerkelijk relevant is
    • Het aandeel van alle relevante documenten gevonden in de top k
    • De tijd die het systeem nodig heeft om k resultaten te retourneren
  2. A retrieval evaluation cares whether the best evidence appears near the top. What kind of metric addresses that concern?
    • A rank-aware metric
    • A server uptime metric
    • A count of stored files
    • A tokenizer vocabulary size
  3. An exact order code is missed by semantic search, while a paraphrased question is missed by keyword search. What should the team inspect?
    • Only the number of documents stored
    • Whether every user asked the same question
    • The appearance of the search button
    • Each retrieval method’s blind spots on fixed examples
  4. A team adds hybrid retrieval and reranking. How should it judge whether the change helped?
    • Compare only the highest similarity score after the change
    • Evaluate both versions on the same fixed labeled examples
    • Assume more retrieved passages always improve answers
    • Count the number of model parameters rather than results
  5. A retrieved passage loses the sentence that qualifies its claim. What failure pattern should the reviewer flag?
    • The source document was necessarily false
    • The user must have asked an unanswerable question
    • A passage was cut away from its qualification
    • The search system returned too few languages
  6. In the guide’s constructed example, five passages are returned and three are relevant. What is precision at five?
    • Three out of five, or 60%
    • Three out of four, or 75%
    • Five out of four, or 125%
    • One out of five, or 20%
  7. Why should retrieval tests include access restrictions and unanswerable queries?
    • To increase the average similarity score
    • To check that the system avoids unauthorized evidence and unsupported answers
    • To ensure every query returns a document
    • To replace relevance labels
  8. A passage is about the right product but describes an older version. What does this show?
    • The passage must rank first because it shares keywords
    • The query has no retrieval requirements
    • A high similarity score proves the answer
    • Topical relevance alone may not provide evidence for the specific version or date in the question