Thread

From the creator of Redis; run LLM locally with ds4

359 points · 103 comments · fibo

simoiacos · 1790972158 · focus · HN ↗
Nothing comparable but inspired from DwarfStar I wrote a little inference engine for Intel Xe-LP (no XMX) 32GB laptops. The only model supported right now is a quantized Gemma-4, but I don't exclude in the future to support other MoE of similar size. Too bad we have no Qwen 3.8 35B-A3B yet.
I'm also looking into expanding the protocol and the engine to support various steering techniques.
<a href="https://github.com/simoneiacomino/xenolith" rel="nofollow">https://github.com/simoneiacomino/xenolith
1. ilaksh · 1790978043 · focus · HN ↗
  I wish someone would add Intel support to ds4. And also improve AMD support.
  Maybe Intel and AMD should help them with that.
  1. simoiacos · 1790979328 · focus · HN ↗
    Yeah I see the value but I built Xenolith to target smaller models.
    I heard antirez saying that he designed DwarfStar also to be forked and tuned to everyone's specific needs. Do you have a specific machine/spec in mind?
    ilaksh · 1790979951 · focus · HN ↗
    The recent Intel GPU/AI cards. Really the same type of models as ds4

Unofficial Hacker News client; not affiliated with Y Combinator.