‹ BackHN Continuity

Thread

Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

310 points · 140 comments · leonickson

  1. erelong · · focus · HN ↗
    Is there something that already runs like this on android / linux ( / windows)? (ollama or something?)

    Or could this be ported to work on other such platforms?

    edit: AI mentions a "BigMoeonEdge" project

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.