‹ BackHN Continuity

Thread

OpenJev

722 points · 296 comments · ilreb

  1. wuhhh · · focus · HN ↗
    I don't understand how this is different from oai "structured output" (and whatever the similar paradigm was on Sonnet ~3.7 back then) which everyone moved on from. On their gh they say:

    "Jev is TypeSafe's closed service for runtime-defined semantic decisions. This project reproduces that interface pattern with open models; it does not reproduce Jev's undisclosed model or training"

    As someone else pointed out it isn't actually Jev... can someone enlighten me

    1. messh · · focus · HN ↗
      In Jev you pass options in the input and its output just gives some probability for each. Oai structured output just follows a schema. The exact output is still generated and there is no probability
      1. brokensegue · · focus · HN ↗
        you can ask structured output for probabilities...not that they necessarily mean anything.
        1. cheesecakegood · · focus · HN ↗
          In theory Jev “calibrates” the probabilities, meaning a probability of 20% is optimized to happen near 20% of the time, which as you point out traditional models with schemas do NOT optimize for at all
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.