Thread

1. syntaxing · 1786043706 · focus · HN ↗

   I am so excited for Qwen 3.8 27B. It’s a shame how slow prefill (~3-400) is on a strix halo but it’s such a good model for agentic tasks.

   1. colingauvin · 1786046414 · focus · HN ↗

      Prefill is survivable if you cache well. But what kills me is the context. Qwen 27 needs a ton of room for KV Cache. I guess not an issue on a 128 GB Halo or Spark, but if you are running of consumer/prosumer GPUs it's miserable to be compacting every 120k tokens.

Unofficial Hacker News client; not affiliated with Y Combinator.