‹ BackHN Continuity

Thread

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

741 points · 330 comments · snehesht

  1. b212 · · focus · HN ↗
    I tried to run Qwen 3.6 27b locally a few months ago and all those synthetic tests do tell you something and quite a lot of people were very excited about that model but honestly? It wasn’t even close to default mode in Cursor or Sonnet at the time.

    I’m all for local models and I do want them to be the future but I wonder when, and if ever, we’ll catch up to a level of, let’s say Opus 4.6. I guess it’s currently doable but requires $50k hardware?

    1. ApatheticCosmos · · focus · HN ↗
      I started using Claude right before 4.5 came out, and 4.6 is where it turned a corner for my use.

      Qwen 3.8 Flash Next is there. 3.8 27b is fairly close.

      I'm excited to see what Qwen 4 will bring.

      I'm running on a 128GB Strix Halo for Flash Next and an Intel Arc Pro B70 (32GB) for 27b.

      1. MattyRad · · focus · HN ↗
        I just used 5.5 xhigh reasoning to make a massive implementation spec (for a vibey throwaway project/exploration, not anything important, burned 80% of the 5h window), now my Strix is in the process of implementing it.

        I think there's probably low-hanging fruit to outsource reasoning from rote read/writes.... Just speculation though, I'm not a token optimization expert.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.