Thread

1. mugul · 1789976719 · focus · HN ↗

   Quite impressed by the energy people are putting into making OSS Jev-like models.

   I understand the hype but I wonder: what are the use cases for this kind of model? Could it be used in the context of coding agents, or is it more relevant in totally different situations?

   1. vidarh · 1789977653 · focus · HN ↗

      Consider every situation where you "force" an LLM to output only a choice / category, or a set of them. If you have workflows like that, you're now being promised significant cost- and latency reduction.

      For coding agents it'd only be useful in a subset of situations. E.g. you could imagine using one to classify bash tool calls into safe and unsafe for example.

Unofficial Hacker News client; not affiliated with Y Combinator.