Kuis Kualitas Pengambilan

Jawaban dan penjelasan muncul saat Anda mengikuti kuis.

1. Apa yang diukur oleh recall@k untuk sistem pengambilan?
   • The rank position of the first relevant document returned
   • The share of the top k results that are actually relevant
   • The share of all relevant documents found in the top k
   • The time taken for the system to return k results
2. Evaluasi pengambilan memperhatikan apakah bukti terbaik muncul di dekat bagian atas. Metrik seperti apa yang mengatasi permasalahan tersebut?
   • A rank-aware metric
   • A server uptime metric
   • A count of stored files
   • A tokenizer vocabulary size
3. Kode urutan yang tepat akan terlewatkan oleh penelusuran semantik, sementara pertanyaan yang diparafrasekan akan terlewatkan oleh penelusuran kata kunci. Apa yang harus diperiksa tim?
   • Only the number of documents stored
   • Whether every user asked the same question
   • The appearance of the search button
   • Each retrieval method’s blind spots on fixed examples
4. Sebuah tim menambahkan pengambilan hybrid dan pemeringkatan ulang. Bagaimana seharusnya mereka menilai apakah perubahan tersebut membantu?
   • Compare only the highest similarity score after the change
   • Evaluate both versions on the same fixed labeled examples
   • Assume more retrieved passages always improve answers
   • Count the number of model parameters rather than results
5. Bagian yang diambil kehilangan kalimat yang memenuhi syarat klaimnya. Pola kegagalan apa yang harus ditandai oleh pengulas?
   • The source document was necessarily false
   • The user must have asked an unanswerable question
   • A passage was cut away from its qualification
   • The search system returned too few languages
6. In the guide’s constructed example, five passages are returned and three are relevant. What is precision at five?
   • Three out of five, or 60%
   • Three out of four, or 75%
   • Five out of four, or 125%
   • One out of five, or 20%
7. Why should retrieval tests include access restrictions and unanswerable queries?
   • To increase the average similarity score
   • To check that the system avoids unauthorized evidence and unsupported answers
   • To ensure every query returns a document
   • To replace relevance labels
8. A passage is about the right product but describes an older version. What does this show?
   • The passage must rank first because it shares keywords
   • The query has no retrieval requirements
   • A high similarity score proves the answer
   • Topical relevance alone may not provide evidence for the specific version or date in the question