Thread

Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

310 points · 140 comments · leonickson

adrianco · 1785822145 · focus · HN ↗
This looks useful, you can increase the RAM cache so if you have a Mac with 24-32GB it should speed up a lot and still run models that wouldn’t normally fit. I’m going to run some tests…

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.