‹ BackHN Continuity

Thread

From the creator of Redis; run LLM locally with ds4

359 points · 103 comments · fibo

  1. liuliu · · focus · HN ↗
    If you are interested in high-end models with high-end Apple Silicon, also try out Local Code: <a href="https:&#x2F;&#x2F;releases.drawthings.ai&#x2F;p&#x2F;public-beta-of-local-code-by-draw" rel="nofollow">https:&#x2F;&#x2F;releases.drawthings.ai&#x2F;p&#x2F;public-beta-of-local-code-b... It is currently in TestFlight (and will open-source next week), supporting vision with DeepSeek 4.1 Flash, Qwen 3.8 27B and DeepSeek 4 Flash 0731 without vision. Custom quants &amp; SSD streaming to make these big models work with 64GiB and above devices (and of course, Qwen works with devices with 16GiB and above).
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.