Thread

1. breadislove · 1785959360 · focus · HN ↗

   On what do you guys test the model. Its very dubious that there is no common retrieval benchmark such as browsecomp plus or similar tested. And what metric do you report?

   1. krm01 · 1785960775 · focus · HN ↗

      Keeping track of any AI progress is becoming harder by the day, because there's ambiguity around common/clear/consistent benchmarks. Everything is constantly skewed into favourable directions.

      1. alansaber · 1785969427 · focus · HN ↗

         TBF gaming benchmarks is not something new to AI

Unofficial Hacker News client; not affiliated with Y Combinator.