‹ BackHN Continuity

Thread

Ollaya – Ollama for open-source, Jev-style decision models

618 points · 145 comments · Ardakilic

  1. alex7o · · focus · HN ↗
    Guys I have a real q, what is the difference between an instruct based re-ranker and laya/jev I just don't see it.

    Edit: One is that jev/laya are tuned to have better probabilities, but a reranker can be fine tuned to do that as well. And jev/laya use RLCD?

    1. kakugawa · · focus · HN ↗
      Jev's value becomes more apparent when the task is a moving target. eg an auto-mode classifier.
      1. c10o · · focus · HN ↗
        Exactly. Just think about a discord or twitch moderation bot that screens messages in real-time. When the streamer starts playing a game, the whole context switch in an instant and comments like «kill them» will suddenly have a whole different meaning.
        1. alex7o · · focus · HN ↗
          Yea but a re-ranker can do that too if instruct trainrd. You update the instruction on which it is ranking the the values, a.k.a it is classifying them.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.