‹ BackHN Continuity

Thread

HarnessTax: How Much Does the Harness Matter for Coding Agents?

233 points · 99 comments · matt_d

  1. Otterly99 · · focus · HN ↗
    The most astonishing thing to me is that Pi harness is basically as efficient as the Codex/Claude.

    I wonder if the same is true for the smaller models in the 9-32B range? I would expect that these models need more steering, but again I was not expecting this result either.

    1. illiac786 · · focus · HN ↗
      It’s more efficient, no? Token wise at least.
      1. Otterly99 · · focus · HN ↗
        You're right sorry, I meant as accurate (in terms of performance, not speed). I would have expected giving access to more elaborate functions to an agent would give better results, but it turns out 4 tools are enough.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.