‹ BackHN Continuity

Thread

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

741 points · 330 comments · snehesht

  1. SuperV1234 · · focus · HN ↗
    We're getting closer and closer to the day we can have an Opus-like model running locally. The dream!
    1. copx · · focus · HN ↗
      Dream or nightmare?

      In face of the recent Hugging Face incident we should really be concerned about the security implications.

      What is going to stop countless AIs running locally in people's homes from forming a new "collective" - completely decentralized and global this time so "turning it off" would be extremely hard to impossible.

      We already know that if you give these AIs internet access they will find eachother and start communicating and plotting against their human overlords..

      1. lxe · · focus · HN ↗
        Nothing is stopping it. This model is woefully bad at accurate creative red teaming however. GLM finetunes on the other hand are pretty good. And I'd bet they are already deployed and doing all sorts of deeds.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.