‹ BackHN Continuity

Thread

Ollaya – Ollama for open-source, Jev-style decision models

618 points · 145 comments · Ardakilic

  1. ranyume · · focus · HN ↗
    >Run decision models locally.

    >example is a text classification task instead of a decision

    1. OgAstorga · · focus · HN ↗
      text classification is equivalente to decision. This is exactly the same thing Jev does.
      1. abirch · · focus · HN ↗
        Jev does it more efficiently because it doesn&#x27;t use an LLM <a href="https:&#x2F;&#x2F;typesafe.ai&#x2F;blog&#x2F;introducing-system-one-models-and-jev" rel="nofollow">https:&#x2F;&#x2F;typesafe.ai&#x2F;blog&#x2F;introducing-system-one-models-and-j...
        1. rockinghigh · · focus · HN ↗
          Their marketing language is misleading. They must still use some transformer language model backbone to encode the text input (BERT or decoder-only LLM). The biggest difference is the output, instead of auto-regressively generating tokens, they produce probabilities over a bounded set of decisions (more flexible classification).
          1. [deleted] · · focus · HN ↗

            [deleted]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.