GHID tehnic

Agent schele și hamuri

An agent harness, or scaffold, is the code around a language model that turns it into an agent: it runs the loop of calling the model, executing the tools it requests, feeding results back, and deciding when to stop.

  • 3 minute de citit
  • Ultima actualizare
Pe această pagină3 minute de citit
  1. Prezentare generală
  2. Scufundare în profunzime
  3. Impact strategic
  4. The Future of Agent Scaffolding and Harnesses
  5. Implementare în lumea reală
  6. Riscuri și balustrade
  7. Foaia de parcurs de implementare
  8. Continuați să explorați
  9. Întrebări frecvente

Prezentare generală

It matters because the harness strongly shapes results, so the same model can score very differently on the same benchmark depending on how its tools, context and error handling are designed.

Scufundare în profunzime

A language model on its own produces text. An agent needs a program that repeatedly asks the model what to do, performs the action, and shows the model what happened. That program is the harness. Its core parts are the loop, tool definitions, tool dispatch, context management, stopping rules and error handling. The loop sends the conversation so far to the model. If the model requests a tool, the harness validates the arguments, runs the tool, and appends the result. If the model gives a final answer, the loop ends. Stopping rules add limits: a maximum number of steps, a token or cost budget, a timeout, or a check such as tests passing. Tool design has large effects. The SWE-agent project from Princeton researchers, published in 2024, argued that agents need an agent-computer interface designed for models, with concise file viewers, search commands and immediate feedback on bad edits, and showed this improved results over giving the model a plain shell. Output formatting matters too: truncating huge outputs, summarising errors clearly and returning structured results help the model act correctly. Context management decides what the model sees as the history grows: keeping recent steps, summarising older ones, or storing notes in files. Error handling decides whether a failed tool call crashes the run or is returned to the model as information it can react to. This is why benchmark numbers need context. On coding benchmarks such as SWE-bench, reported scores for one model vary across scaffolds, retry policies and step limits. A common misconception is that a leaderboard number measures the model alone; it measures the model plus harness plus settings. Products such as command-line coding agents are, in large part, carefully engineered harnesses around a model.

Impact strategic

Cost și buget

Deciziile de arhitectură generează performanța și costurile de operare de ani de zile.

Decizii mai clare

Educația tehnică ajută echipele să aleagă stiva potrivită, nu doar cea mai nouă.

Controlul calității

Opțiuni de inginerie mai bune reduc incidentele de fiabilitate în producție.

The Future of Agent Scaffolding and Harnesses

Model providers increasingly ship their own agent products and software development kits, which standardises some harness patterns such as tool schemas, permissions and context compaction. Protocols for connecting tools to models, such as the Model Context Protocol, make tool integration more reusable. Harness design is likely to remain a meaningful source of performance differences, and evaluations are moving toward reporting the scaffold alongside the model. For builders, careful tool design, clear stopping rules and good logging will keep mattering regardless of which model is underneath.

Implementare în lumea reală

A coding agent harness gives the model tools to view files, edit specific line ranges and run tests, then loops until tests pass or a step limit is reached.

A research assistant harness stops the loop after 20 tool calls and asks the model for a summary with sources, preventing runaway costs.

A team replaces a raw shell tool with a file editor that shows a short window of lines and reports syntax errors immediately, and their agent's success rate on internal tasks improves without changing the model.

A customer operations agent harness intercepts any refund tool call above a set amount and pauses for human approval before executing it.

Riscuri și balustrade

  • Optimizarea unui punct de referință poate ascunde slăbiciunile mai largi ale sistemului.

  • Costurile de infrastructură și întreținere sunt adesea subestimate.

  • Lacunele de securitate și observabilitate pot crește pe măsură ce sistemele devin mai complexe.

Foaia de parcurs de implementare

  1. Definiți obiectivele de latență, calitate și cost înainte de implementare.

  2. Benchmark în condiții realiste de încărcare și date.

  3. Monitorizarea instrumentelor pentru erori, deriva și impactul utilizatorului.

  4. Pregătiți căile de retragere și răspuns la incident înainte de scalare.

Continuați să explorați

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Agent Scaffolding and Harnesses quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Quiz Start

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Întrebări frecvente

What is Agent Scaffolding and Harnesses?

An agent harness, or scaffold, is the code around a language model that turns it into an agent: it runs the loop of calling the model, executing the tools it requests, feeding results back, and deciding when to stop. It matters because the harness strongly shapes results, so the same model can score very differently on the same benchmark depending on how its tools, context and error handling are designed.

What is an agent harness?

The harness is the surrounding program that turns a text-generating model into an agent.

Which is an example of a stopping rule?

Stopping rules end the loop based on limits like step counts, budgets, timeouts or success checks.

What did the SWE-agent project emphasise?

SWE-agent argued that tools designed for models improve results over a plain shell.

Why can the same model score differently on SWE-bench in different reports?

A benchmark score measures the whole system, not the model alone.

How should a harness usually handle a failed tool call?

Returning actionable errors lets the model correct its approach instead of ending the run.