‹ BackHN Continuity

Thread

Ollaya – Ollama for open-source, Jev-style decision models

618 points · 145 comments · Ardakilic

  1. george_max · · focus · HN ↗
    Has anyone actually seen better or the same results with Laya compared to Jev? From my experience, Laya performs significantly worse. It's less confident and often makes wrong decisions with more complex queries.
    1. scronkfinkle · · focus · HN ↗
      Yes. JEV generalizes better because they probably have an enormous corpus and trained on it for a long time. Laya's out of the box model is much weaker. However, in the age of LLM's it's incredibly easy and cheap to generate large datasets to fine tune laya for your task, and the training loop is pretty quick and cheap too.

      It's so easy that I question why I would ever pay for JEV when eventually I'll have done enough random things that I will also have a large corpus and likely a general model as well.

      1. mtkd · · focus · HN ↗
        Isn't the point of Jev that it generalises better?

        It's a fast classifier you can use out-the-box, ~1.5bn tokens is about $40 (I've been hammering it)

        It just works ... a whole bunch of low-level/low-importance workflow stuff that was getting farmed out to small/fast LLM models now has a competitive alternative ... and bits that hadn't even been considered to go into some external descision/classifier service can be tested/deployed at ~$0.00003/req

        I don't get this wall of negativity on it, it's genuinely innovative/useful tech ... would expect HN to be more positive, regardless of whether it's the absolute best execution

        1. not_a_bot_4sho · · focus · HN ↗
          I didn't see any negativity in the post you replied to.

          I think the point being made is that Jev is great but it has no competitive moat, and open source versions will very soon catch up if their secret sauce is just synthetic data.

          (Whether or not that is true, I don't know.)

          1. killingtime74 · · focus · HN ↗
            It's probably true because even for Frontier LLM models there are many competitors now.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.