‹ BackHN Continuity

Thread

Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

310 points · 140 comments · leonickson

  1. dghlsakjg · · focus · HN ↗
    I know everyone wants to crap all over these setups that are impractical, but this is how progress happens.

    People will keep plugging away at this and figure out how to avoid wearing the hard drive, how to make it run faster, custom hardware buses etc.

    Keep going! I personally can't wait for the day when a 1t param model runs off a $200 SSD instead of a $50k rack of Nvidia chips.

    1. croes · · focus · HN ↗
      So every script kiddie gets its Mythos to hack sides and scammers don’t need AI services anymore.

      That time won’t be as much fun as you think

      1. JKCalhoun · · focus · HN ↗
        If that's the natural outcome then the future you're describing is inevitable.

        Oh well, maybe the last one to leave the internet can turn the lights off.

        1. croes · · focus · HN ↗
          It’s not a natural outcome it’s a decision
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.