Jagorar Fasaha

Agent Scafolding da Harnesses

An agent harness, or scaffold, is the code around a language model that turns it into an agent: it runs the loop of calling the model, executing the tools it requests, feeding results back, and deciding when to stop.

  • 3 min karatu
  • An sabunta ta ƙarshe
A wannan shafi3 min karatu
  1. Dubawa
  2. Zurfafa nutsewa
  3. Dabarun Tasiri
  4. The Future of Agent Scaffolding and Harnesses
  5. Aiwatar da Gaskiyar Duniya
  6. Hatsari & Tsare-tsare
  7. Taswirar Hanya
  8. Ci gaba da Bincike
  9. Tambayoyin da ake yawan yi

Dubawa

It matters because the harness strongly shapes results, so the same model can score very differently on the same benchmark depending on how its tools, context and error handling are designed.

Zurfafa nutsewa

A language model on its own produces text. An agent needs a program that repeatedly asks the model what to do, performs the action, and shows the model what happened. That program is the harness. Its core parts are the loop, tool definitions, tool dispatch, context management, stopping rules and error handling. The loop sends the conversation so far to the model. If the model requests a tool, the harness validates the arguments, runs the tool, and appends the result. If the model gives a final answer, the loop ends. Stopping rules add limits: a maximum number of steps, a token or cost budget, a timeout, or a check such as tests passing. Tool design has large effects. The SWE-agent project from Princeton researchers, published in 2024, argued that agents need an agent-computer interface designed for models, with concise file viewers, search commands and immediate feedback on bad edits, and showed this improved results over giving the model a plain shell. Output formatting matters too: truncating huge outputs, summarising errors clearly and returning structured results help the model act correctly. Context management decides what the model sees as the history grows: keeping recent steps, summarising older ones, or storing notes in files. Error handling decides whether a failed tool call crashes the run or is returned to the model as information it can react to. This is why benchmark numbers need context. On coding benchmarks such as SWE-bench, reported scores for one model vary across scaffolds, retry policies and step limits. A common misconception is that a leaderboard number measures the model alone; it measures the model plus harness plus settings. Products such as command-line coding agents are, in large part, carefully engineered harnesses around a model.

Dabarun Tasiri

Kudin da kasafin kuɗi

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.

Shawarwari masu haske

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.

Kula da inganci

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.

The Future of Agent Scaffolding and Harnesses

Model providers increasingly ship their own agent products and software development kits, which standardises some harness patterns such as tool schemas, permissions and context compaction. Protocols for connecting tools to models, such as the Model Context Protocol, make tool integration more reusable. Harness design is likely to remain a meaningful source of performance differences, and evaluations are moving toward reporting the scaffold alongside the model. For builders, careful tool design, clear stopping rules and good logging will keep mattering regardless of which model is underneath.

Aiwatar da Gaskiyar Duniya

A coding agent harness gives the model tools to view files, edit specific line ranges and run tests, then loops until tests pass or a step limit is reached.

A research assistant harness stops the loop after 20 tool calls and asks the model for a summary with sources, preventing runaway costs.

A team replaces a raw shell tool with a file editor that shows a short window of lines and reports syntax errors immediately, and their agent's success rate on internal tasks improves without changing the model.

A customer operations agent harness intercepts any refund tool call above a set amount and pauses for human approval before executing it.

Hatsari & Tsare-tsare

  • Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.

  • Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.

  • Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.

Taswirar Hanya

  1. Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.

  2. Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.

  3. Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.

  4. Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.

Ci gaba da Bincike

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Agent Scaffolding and Harnesses quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Fara tambayoyi

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Tambayoyin da ake yawan yi

What is Agent Scaffolding and Harnesses?

An agent harness, or scaffold, is the code around a language model that turns it into an agent: it runs the loop of calling the model, executing the tools it requests, feeding results back, and deciding when to stop. It matters because the harness strongly shapes results, so the same model can score very differently on the same benchmark depending on how its tools, context and error handling are designed.

What is an agent harness?

The harness is the surrounding program that turns a text-generating model into an agent.

Which is an example of a stopping rule?

Stopping rules end the loop based on limits like step counts, budgets, timeouts or success checks.

What did the SWE-agent project emphasise?

SWE-agent argued that tools designed for models improve results over a plain shell.

Why can the same model score differently on SWE-bench in different reports?

A benchmark score measures the whole system, not the model alone.

How should a harness usually handle a failed tool call?

Returning actionable errors lets the model correct its approach instead of ending the run.