Thread

1. godbox · 1790804536 · focus · HN ↗

   What a snooze fest. Another model that does not meaningfully improve on intelligence or price compared to its peers. Google has basically announced that they've "caught up" with the rest. I think they've been doing great work in the Flash department so seeing this is... underwhelming?

   1. augment_me · 1790805344 · focus · HN ↗

      I found that Google does not benchmaxx as much as the other providers. Of you look at real-case evaluation like lm-arena, even the 3.8 flash is often near the top despite its benchmark index being worse.

      1. sourweasel · 1790810885 · focus · HN ↗

         I noticed this recently with the user submitted benchmarks on Kaggle. For these obscure tests that the models haven't seen, Gemini 3.8 is often on par or beating other frontier models. Gemini is a bit shite at the game checkers though, for some weird reason it performs poorly on those benchmarks.

Unofficial Hacker News client; not affiliated with Y Combinator.