‹ BackHN Continuity

Thread

Show HN: JevBench, a reproducible benchmark for typed decision models

154 points · 39 comments · florianstandhar

  1. swyx · · focus · HN ↗
    jev ceo on why he eschewed benchmarking: <a href="https:&#x2F;&#x2F;www.latent.space&#x2F;i&#x2F;216783460&#x2F;privacy-benchmarking-and-trusting-intelligence" rel="nofollow">https:&#x2F;&#x2F;www.latent.space&#x2F;i&#x2F;216783460&#x2F;privacy-benchmarking-an...
    1. meander_water · · focus · HN ↗
      They released some examples of what their workflow evals are like. I&#x27;m sure you could reverse engineer a benchmark from that

      <a href="https:&#x2F;&#x2F;evals.typesafe.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;evals.typesafe.ai&#x2F;

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.