Thread

1. HoldOnAMinute · 1790977329 · focus · HN ↗

   How is this different from other LLM runners?

   1. simonw · 1790980403 · focus · HN ↗

      It's more likely to work. Most LLM runners are meant to work with any model, which means there are all kinds of ways you might misconfigure them in a way that causes function tooling not to work, or performance to be less than you would like.

      DwarfStar's selling point is that it only supports a small set of carefully chosen models, but it supports them really well.

      1. locknitpicker · 1791003572 · focus · HN ↗

         I'm sorry, it's hard for me to understand what point you were trying to make. So existing LLM runners are designed to support all models, and they run all models, but they might be misconfigured? And DS4 is better because it's unable to run all models?

         1. simonw · 1791009986 · focus · HN ↗

            It has better defaults.

            1. aflinik · 1791022811 · focus · HN ↗

               Does that imply that with enough effort spent on fine-tuning the configuration, other LLM runners can achieve similar results?

               1. simonw · 1791068670 · focus · HN ↗

                  Yes.

Unofficial Hacker News client; not affiliated with Y Combinator.