<a href="https://frontierharness.org/" rel="nofollow">https://frontierharness.org/ allegedly this is on the Pareto frontier, though I don't know how good of a benchmark this really is. it seems to focus on one-shot type tasks, whereas the real utility of one harness over another seems to make itself known in long running tasks.
also this is a very limited static snapshot with one model as backend, I wish there were more consistently refreshed and diversified harness benchmarks.
scuppernong · · focus · HN ↗
also this is a very limited static snapshot with one model as backend, I wish there were more consistently refreshed and diversified harness benchmarks.
polotics · · focus · HN ↗
hypfer · · focus · HN ↗
It happens more often than you think, especially when VRAM is limited!
dgellow · · focus · HN ↗