HarnessTax: How Much Does the Harness Matter for Coding Agents?
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
HarnessTax: How Much Does the Harness Matter for Coding Agents?
Unofficial Hacker News client; not affiliated with Y Combinator.
lukax · · focus · HN ↗
E.g. for editing files with Claude models you should use Edit(file_path, old_string, new_string, replace_all) but with GPT models you should use apply_patch_call(patch) (where patch is a custom patch string with custom grammar).
It appears newer models are better at narive harness tool calls and worse at custom tools that look similar to default tools.
<a href="https://lucumr.pocoo.org/2026/7/4/better-models-worse-tools/" rel="nofollow">https://lucumr.pocoo.org/2026/7/4/better-models-worse-tools/
sn0n · · focus · HN ↗
Or is that just why my model likes to break out of the sandbox, going strait to exec shell command and editing files using python on the cli?