Thread

1. scuppernong · 1790914426 · focus · HN ↗

   <a href="https:&#x2F;&#x2F;frontierharness.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;frontierharness.org&#x2F; allegedly this is on the Pareto frontier, though I don&#x27;t know how good of a benchmark this really is. it seems to focus on one-shot type tasks, whereas the real utility of one harness over another seems to make itself known in long running tasks.

   also this is a very limited static snapshot with one model as backend, I wish there were more consistently refreshed and diversified harness benchmarks.

   1. cdelsolar · 1790925454 · focus · HN ↗

      i&#x27;ve seen &quot;Pareto frontier&quot; literally 500 thousand times in the last two weeks or so, and maybe once or twice before that. Can someone please explain what happened recently

      1. vrganj · 1790927405 · focus · HN ↗

         People realized AI is expensive and wanted a cool techy way to say &quot;good bang for your buck&quot;

         1. scuppernong · 1790969152 · focus · HN ↗

            not really what it means. also the Pareto frontier is literally drawn in what I linked

            1. vrganj · 1791018775 · focus · HN ↗

               Yeah, it&#x27;s a pretentious way to draw a line where you find good value.

               1. scuppernong · 1791043772 · focus · HN ↗

                  i think you still don&#x27;t understand what it means. there&#x27;s nothing personal about it. the point you pick along the frontier is what&#x27;s personal to you and your needs. the frontier itself is not.

                  1. [deleted] · 1791063782 · focus · HN ↗

                     [deleted]

Unofficial Hacker News client; not affiliated with Y Combinator.