‹ BackHN Continuity

Thread

From the creator of Redis; run LLM locally with ds4

359 points · 103 comments · fibo

  1. doctorpangloss · · focus · HN ↗
    the problem is the dsv4 checkpoint so quantized isn't very good
    1. ilaksh · · focus · HN ↗
      Which ds4 checkpoint for which model exactly did you test? Don't they have multiple different versions and quantization levels?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.