গাইড লিঙ্ক ক্যুইজ · মাঝারি স্তর
RAG মূল্যায়ন মেট্রিক্স এবং RAGAS কুইজ
RAG মূল্যায়ন সম্পর্কে আপনার উপলব্ধি পরীক্ষা করুন: বিশ্বস্ততা, উত্তরের প্রাসঙ্গিকতা, প্রসঙ্গ নির্ভুলতা এবং প্রত্যাহার এবং এলএলএম বিচারকরা কীভাবে সেগুলি স্কোর করেন।
প্রশ্ন 1 এর 8
Which metric checks whether every claim in the answer is supported by the retrieved context?
প্রতিটি প্রশ্নের পূর্বরূপ দেখুন8 প্রশ্ন
আপনি কুইজ নেওয়ার সাথে সাথে উত্তর এবং ব্যাখ্যাগুলি উপস্থিত হয়।
- Which metric checks whether every claim in the answer is supported by the retrieved context?
- Answer relevance
- Context recall
- Faithfulness
- Context precision
- Which of these metrics requires a ground-truth reference answer for each test question?
- Context recall
- Faithfulness
- Answer relevance
- Response latency
- What does context precision measure?
- How quickly chunks are retrieved
- Whether the answer is short
- How many documents are in the index
- Whether the relevant retrieved chunks are ranked near the top
- How does RAGAS estimate answer relevance?
- By counting words shared by answer and context
- By generating questions the answer would respond to and comparing them to the original question with embeddings
- By asking the user to rate each answer
- By checking the answer against a reference with exact string match
- A system shows high context recall but low context precision. What is the most likely fix?
- Improve ranking, for example by adding a reranker
- Switch to a smaller generation model
- Remove the reference answers
- Lower the number of test questions
- Why can a perfectly faithful answer still be wrong?
- Faithfulness only checks grammar
- Faithfulness ignores the retrieved context
- It can faithfully repeat an outdated or incorrect document
- Faithful answers are always too short
- Why should teams pin the judge model and settings when comparing RAG systems?
- Pinning makes the judge free to run
- Judges only work with one vector database
- Pinning removes the need for test questions
- LLM-judge scores vary with the judge model and prompt, so comparisons need identical settings
- Retrieval returns the right passages, but the answer adds unsupported details. Where should the team look first?
- The chunking strategy
- The prompt or the generation model
- The embedding model
- The number of documents indexed