‹ BackHN Continuity

Thread

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

741 points · 330 comments · snehesht

  1. SuperV1234 · · focus · HN ↗
    We're getting closer and closer to the day we can have an Opus-like model running locally. The dream!
    1. copx · · focus · HN ↗
      Dream or nightmare?

      In face of the recent Hugging Face incident we should really be concerned about the security implications.

      What is going to stop countless AIs running locally in people's homes from forming a new "collective" - completely decentralized and global this time so "turning it off" would be extremely hard to impossible.

      We already know that if you give these AIs internet access they will find eachother and start communicating and plotting against their human overlords..

      1. r14c · · focus · HN ↗
        Secure systems are possible, but now we have a compelling reason to actually write them. Everything can be trivially hacked because the industry is pathologically adverse to security being part of the design process.
        1. SchemaLoad · · focus · HN ↗
          I'm hopeful that this security situation is just short term turbulence and we come out the other end with companies taking security seriously, updating things on time, and writing code in more secure languages and frameworks.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.