গাইড লিঙ্ক ক্যুইজ · মাঝারি স্তর
এজেন্ট ভারা এবং harnesses কুইজ
এজেন্ট লুপ এবং টুল ডিসপ্যাচ, স্টপিং রুলস এবং ইরর হ্যান্ডলিং পরীক্ষা করে এবং কেন একই মডেল হার্নেস জুড়ে ভিন্নভাবে স্কোর করে।
প্রশ্ন 1 এর 8
What is an agent harness?
প্রতিটি প্রশ্নের পূর্বরূপ দেখুন8 প্রশ্ন
আপনি কুইজ নেওয়ার সাথে সাথে উত্তর এবং ব্যাখ্যাগুলি উপস্থিত হয়।
- What is an agent harness?
- The model's neural network weights
- The code around a model that runs the loop, executes tools and decides when to stop
- A dataset for training agents
- এক ধরনের জিপিইউ
- Which is an example of a stopping rule?
- Using a larger model
- A maximum number of steps or a cost budget
- Adding more tools
- Changing the font of outputs
- What did the SWE-agent project emphasise?
- That models need no tools
- An agent-computer interface designed for models, with concise viewers and immediate feedback
- That bigger GPUs solve all agent problems
- Removing the loop entirely
- Why can the same model score differently on SWE-bench in different reports?
- The benchmark changes every hour
- Scores reflect the model plus harness, tools, step limits and retry policy
- Models forget their training between runs
- Scores are randomly assigned
- How should a harness usually handle a failed tool call?
- Crash the entire run immediately
- Return the error to the model as a tool result it can react to
- Silently ignore it
- Restart the computer
- What is the purpose of capping tool output size and marking truncation?
- To hide information from users
- To keep context manageable and let the model know to search or page for more
- To make tools run faster on the GPU
- To prevent the model from using tools
- When fairly comparing two models as agents, what should you hold constant?
- Only the model's name
- The harness, prompt, tools, step limit and retry policy
- Nothing; vary everything
- The date of the test only
- A harness pauses before large refund tool calls for human approval. What design principle does this show?
- Context compaction
- Gating side-effecting tools with permissions or confirmation
- Parallel function calling
- Embedding fine-tuning