Thread

Ollaya – Ollama for open-source, Jev-style decision models

618 points · 145 comments · Ardakilic

george_max · 1790362784 · focus · HN ↗
Has anyone actually seen better or the same results with Laya compared to Jev? From my experience, Laya performs significantly worse. It's less confident and often makes wrong decisions with more complex queries.
1. scronkfinkle · 1790363124 · focus · HN ↗
  Yes. JEV generalizes better because they probably have an enormous corpus and trained on it for a long time. Laya's out of the box model is much weaker. However, in the age of LLM's it's incredibly easy and cheap to generate large datasets to fine tune laya for your task, and the training loop is pretty quick and cheap too.
  It's so easy that I question why I would ever pay for JEV when eventually I'll have done enough random things that I will also have a large corpus and likely a general model as well.
  1. _menelaus · 1790380114 · focus · HN ↗
    If you're so inclined it would be easy, fast and cheap to distill Jev for your task.

Unofficial Hacker News client; not affiliated with Y Combinator.