HarnessTax: How Much Does the Harness Matter for Coding Agents?
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
HarnessTax: How Much Does the Harness Matter for Coding Agents?
Unofficial Hacker News client; not affiliated with Y Combinator.
spike021 · · focus · HN ↗
Do harnesses and therefore sending the queries directly to the LLM providers have caching and other benefits that OpenRouter does not provide? Would I get any of those benefits if I simply proxied any requests to the major providers' harnesses through OpenRouter? Or only if the requests go straight from the harness to the provider's API?
grave0x · · focus · HN ↗
Its literally me realizing they don't have a good solution for it. Context should be local. It saves money and potential LLM confusion.
Plus i can foresee a bunch of other deterministic context and session handling being just plain unrealized due to the default we have currently