Thread

1. SuperV1234 · 1791126129 · focus · HN ↗

   We're getting closer and closer to the day we can have an Opus-like model running locally. The dream!

   1. latentsea · 1791130325 · focus · HN ↗

      We are already there. Prior to Strata the best I could run was Qwen3.8-27B at Q6, which itself is already at like Opus 4.5/4.6 level, and now with Strata on an R9700 and 64GB of RAM I can run Qwen3.8-Flash-Next IQ3_XXS at 60 t/s. It's even better. You can run it on even more modest hardware with Strata too.

      Plus they announced Qwen4-Flash. It's not released yet, but it's the same architecture as Qwen3.8-Flash-Next, which now runs fast on consumer hardware.

      Opus at home is a thing now.

      1. konaraddi · 1791134300 · focus · HN ↗

         Another 2-5 years from now, it may even become accessible to most people (current barriers being cost and technical expertise, bottleneck is cost).

         1. trvz · 1791139624 · focus · HN ↗

            The mentioned “Qwen3.8-27B at Q6“ can be run on a <1500$ Mac mini and with the barest technical expertise.
         2. latentsea · 1791163839 · focus · HN ↗

            Good thing is you don't need your own technical expertise anymore.

Unofficial Hacker News client; not affiliated with Y Combinator.