‹ BackHN Continuity

Thread

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

793 points · 354 comments · snehesht

  1. SuperV1234 · · focus · HN ↗
    We're getting closer and closer to the day we can have an Opus-like model running locally. The dream!
    1. stymaar · · focus · HN ↗
      It depends on what you mean by “Opus-like”, because if you mean “as strong as Opus 4.6 for agentic coding” then Qwen3.8-27B has been there for the past two months.

      But if you mean “as strong as current-gen Opus” then it's probably never gonna happen, but it doesn't really matter since we're long into the diminishing returns for performance improvements: I haven't notice any major leap between 4.6 and 5.5 in my daily usage, and I'm convinced that with a fact enough piecs of hardware I would be using local Qwen exclusively (I'm using it daily but only at night for long running tasks because they take much more time than Opus due to the compounding effects of my slow GPU and Qwen's verbosity).

      1. system2 · · focus · HN ↗
        I would be forever happy with Opus 4.8.
        1. bitexploder · · focus · HN ↗
          Flash next is /really/ close. It is at parity with 4.7 as far as I can tell and basically where Opus 4.8 was. It is a genuinely good model. And I run it at home on $1500 of GPU at 125 t/s :)
          1. fsiefken · · focus · HN ↗
            Running an nvidia card at full load, would cost me ~100 euro of electricty each month (europe). Of course one wouldn't have usage caps.

            Where the internet was a subscription 15 euro subscription to encyclopaedic knowledge, an genAI subscription is renting a researcher/programmer for 100 euro.

            1. stymaar · · focus · HN ↗
              > (europe)

              Given the massive difference in electricity price between different european countries, adding "Europe" doesn't bring much context.

              1. magicalhippo · · focus · HN ↗
                Even with a country. Here in Norway we have multiple price zones, and at times there can be 100x difference between them, often 10x. All due to lack of transmission capacity between northern and southern zones.
                1. stymaar · · focus · HN ↗
                  TIL, thanks.

                  In France we have the same price in all continental France, there are whole regions that are poorly connected to the grid (Britanny and the French Riviera) or even remote islands like Corsica or even the islands in the Indian Ocean and the West Indies but the price is still the same as elsewhere.

                  1. magicalhippo · · focus · HN ↗
                    There has been a lot of talk about abolishing it, and have one zone. But the gris will still be bottlenecked between certain regions, at least for decades, so opponents argue it could lead to grid instability or inefficiencies.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.