‹ BackHN Continuity

Thread

Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

310 points · 140 comments · leonickson

  1. gizmodo59 · · focus · HN ↗
    The web and connecting to other services is very important for almost all of my use cases. While I believe we are going to get better and faster models, the web index is certainly not downloadable and maintainable for 99.99% of the folks who are able to use local models. Any good solutions exist?
    1. morgoo · · focus · HN ↗
      If you're really into self-hosting I've been experimenting with SearXNG and early signs are promising
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.