গাইড লিঙ্ক ক্যুইজ · সহজ স্তর
এআই ইভালুয়েশন বেসিক কুইজ
গ্রহণযোগ্যতার মানদণ্ড সেট করুন, হোল্ড-আউট ডেটা থেকে আলাদা বিকাশ করুন, একটি বেসলাইনের সাথে তুলনা করুন, টাস্ক-ফিট চেক নির্বাচন করুন এবং অনিশ্চয়তা এবং সীমা নথিভুক্ত করুন।
প্রশ্ন 1 এর 8
What should a team define before evaluating an AI system?
প্রতিটি প্রশ্নের পূর্বরূপ দেখুন8 প্রশ্ন
আপনি কুইজ নেওয়ার সাথে সাথে উত্তর এবং ব্যাখ্যাগুলি উপস্থিত হয়।
- What should a team define before evaluating an AI system?
- Acceptance criteria for inputs, expected outputs, tolerable errors, and escalation
- A press release about model quality
- A single average score
- A deployment date only
- How should development examples differ from a held-out evaluation set?
- Use the held-out set for prompt tuning every day
- Use development examples for iteration and reserve held-out examples to test choices
- Mix both sets before every run
- Keep no record of which examples were used
- What happens when a team repeatedly tunes on its final test set?
- The test set becomes larger
- The score becomes a baseline
- The test set becomes another development set
- The model automatically generalizes better
- Which comparison can show whether added model complexity provides practical benefit?
- Compare only with last week’s best score
- Compare with a simple baseline
- Compare against a random deployment date
- Compare with a different task’s benchmark
- For a summarizer, which evaluation checks does the guide recommend?
- Server uptime and account age
- Pixel similarity and frame rate
- Factual consistency and coverage
- প্রশিক্ষণ যুগের সংখ্যা
- How should a team verify an AI agent’s completed action?
- Trust its success message
- Count how many tools it called
- Check the authoritative final state and unintended side effects
- Ask the same model whether it succeeded
- Why might a rare failure deserve more attention than many harmless wording differences?
- Consequences of the failure can outweigh frequent low-impact variations
- Rare events are always measurement errors
- Wording differences cannot be evaluated
- The average score must be ignored
- What should an evaluation document about its limitations?
- That every real-world case was tested
- Where the evaluation does not represent actual use
- Only the name of the model
- That uncertainty has been eliminated