AI CompendiumA public chart of the language
Agents & Harness

Harness

also called Scaffold, Agent framework

Everything around the model that makes it an agent.

Definition

The software wrapper that gives the model its tools, instructions, permissions and context management, and that runs the agent loop. The model reasons; the harness does everything physical.

Two products using the identical model can differ enormously in usefulness purely because of harness quality — how context is assembled, how tools are described, how failures are surfaced. It is where most engineering effort lives.

Harness quality is where much of the perceived difference between products lives, and it is also why model-versus-model comparisons so often mislead: the same model behind a better harness outperforms it behind a worse one. When you evaluate, evaluate the pair.

How people use it
Comparing two coding assistants on the same model.
"Same model underneath. The one that wins is better at pruning context and giving clearer tool errors."
Worked examples

Swapping harnesses beat swapping models

Two teams use the same model; one reports far better results on the same task.

The difference is tooling: a real filesystem, a code-execution tool, tests wired in, context managed properly. The lesson is to improve the harness before reaching for a more expensive model.

What the harness owns

Listing the components you are responsible for.

Tool definitions and execution, permission checks, context assembly and trimming, retries, logging, cost accounting and the exit condition. The model only supplies judgement; everything else is yours to get right or wrong.

Sources
  • blogDemystifying evals for AI agents ↗Anthropic Engineering · 2026

    Gives working definitions for harness, task, trial, grader, transcript and outcome, and argues you must evaluate the model and harness together and judge final environment state, not just the last message.

  • blogEffective harnesses for long-running agents ↗Anthropic Engineering · 2025

    The initializer-plus-incremental-sessions pattern for work that outlives a context window, and the four ways it fails: doing too much, losing context between sessions, declaring victory early, not testing end to end.

  • blogScaling managed agents: decoupling the brain from the hands ↗Anthropic Engineering · 2026

    Separates model, harness, durable session log and execution sandbox — the architecture that makes long-running agents survive crashes and tool boundaries.

Related terms