HarnessTax: How Much Does the Harness Matter for Coding Agents?
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
HarnessTax: How Much Does the Harness Matter for Coding Agents?
Unofficial Hacker News client; not affiliated with Y Combinator.
Yashjain413 · · focus · HN ↗
With coding agents, what I’ve noticed is that a simple task can often be handled with a fairly simple harness. But the hidden cost is really around context. One of the more interesting things I’ve seen is that two different harnesses can make a similar number of model calls while consuming a very different amount of context.
I think I recently came across a paper comparing Claude Code and Pi that touched on this. More context, more tooling, focused context, simpler loops, all of these can lead to very different costs and performance, even when the number of model calls looks similar.