‹ BackHN Continuity

Thread

Ollaya – Ollama for open-source, Jev-style decision models

618 points · 145 comments · Ardakilic

  1. neop1x · · focus · HN ↗
    There is also a small wrapper over an unmodified llamacpp binary which implements jev decision API on any llamacpp-supported model. It is different than Leya&#x2F;Kime - raw label softmax, not calibrated! But can sometimes be enough I guess. <a href="https:&#x2F;&#x2F;github.com&#x2F;NakliTechie&#x2F;llamacpp-jev" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;NakliTechie&#x2F;llamacpp-jev
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.