Thread

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

741 points · 330 comments · snehesht

snehesht · 1791118313 · focus · HN ↗
I tried it and it worked surprisingly well. On my machine (Nvidia 4090, 128GB DDR5, Ryzen 7950x3d) I'm getting 124 tokens per sec, thought to share it here.
<a href="https://huggingface.co/Qwen/Qwen3.8-Flash-Next" rel="nofollow">https://huggingface.co/Qwen/Qwen3.8-Flash-Next
1. proc0 · 1791119012 · focus · HN ↗
  Do you know how it compares to Qwen 3.8 27B? I really want to compare the distilled ones with harness versus the full MoE versions.
  1. incognito124 · 1791120233 · focus · HN ↗
    Qwen 3.8 flash next is way better than 27B. It's so good I dont even use claude anymore
    snehesht · 1791120397 · focus · HN ↗
    Yeah I agree, I'm running it with Pi didn't notice much difference compared to lower tier models and the speed, of course.
    nicce · 1791121400 · focus · HN ↗
    I am running 27B with Deepseek Harness these days and somehow just by using it, without any parameter changes, the model feels even more intelligent.
    DoctorOetker · 1791134188 · focus · HN ↗
    do LLMs tend to be homesick when not used in the same harness they sat in during some training phase?
    Bnjoroge · 1791146758 · focus · HN ↗
    iirc there was a sectionin Qwen’s paper where they talked anout how they post-trained flash or 3.8 to work just as well regardless of the harness or eval used. I think that used to be true but not sure if it is any longer

Unofficial Hacker News client; not affiliated with Y Combinator.