‹ BackHN Continuity

Thread

From the creator of Redis; run LLM locally with ds4

359 points · 103 comments · fibo

  1. doctorpangloss · · focus · HN ↗
    the problem is the dsv4 checkpoint so quantized isn't very good
    1. [deleted] · · focus · HN ↗

      [deleted]

    2. c0rruptbytes · · focus · HN ↗
      not my experience

      the ds4 quants were very good beating the unsloth quants <a href="https:&#x2F;&#x2F;github.com&#x2F;michaelasper&#x2F;benchmarks&#x2F;blob&#x2F;main&#x2F;deepseek-v4-flash-0731-pi-on-slop-code-bench.md" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;michaelasper&#x2F;benchmarks&#x2F;blob&#x2F;main&#x2F;deepsee...

      1. dotancohen · · focus · HN ↗
        That&#x27;s quite the statement - unsloth quants are amazing.
    3. ilaksh · · focus · HN ↗
      Which ds4 checkpoint for which model exactly did you test? Don&#x27;t they have multiple different versions and quantization levels?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.