Thread

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

741 points · 330 comments · snehesht

SuperV1234 · 1791126129 · focus · HN ↗
We're getting closer and closer to the day we can have an Opus-like model running locally. The dream!
1. bitexploder · 1791130900 · focus · HN ↗
  That is right now. This model is easily as good as Sonnet5 / Opus 4.7 on DeepSWE. I have benched over half of DeepSWE now on a 3 bit Flash Next quant and it is at parity with Sonnet and Opus 4.6/4.7. It finishes most of the tasks they do. Overall it is within 1 point.
  FWIW Qwen 3.8 27B is just slightly behind and basically Sonnet 5 high. I have been benching these models. We have Opus at home. :)

Unofficial Hacker News client; not affiliated with Y Combinator.