‹ BackHN Continuity

Thread

Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

310 points · 140 comments · leonickson

  1. sallymander · · focus · HN ↗
    "As far as we know, that is the first time a model of this class has run natively on a phone.".

    I feel like I've seen a similar statement on a lot of these streaming weight projects.

    400b model on an iPhone: <a href="https:&#x2F;&#x2F;x.com&#x2F;anemll&#x2F;status&#x2F;2035901335984611412" rel="nofollow">https:&#x2F;&#x2F;x.com&#x2F;anemll&#x2F;status&#x2F;2035901335984611412

    1. leonickson · · focus · HN ↗

      [dead]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.