‹ BackHN Continuity

Thread

Introducing System One Models and Jev

1989 points · 520 comments · albelfio

  1. big_toast · · focus · HN ↗
    It seems like the docs[0] are a better explanation? The comparison to llm tokens is kinda confusing.

    It looks like the model takes as input a state (structured text? not sure if multi-modal) and a question (as a "Choice", "Score", or "Noul") with some additional augmentations possible. Then outputs the question's answers as appropriate (e.g. a choice, accompanying probabilities, confidence).

    Edit: On the AI primer page, it looks like they do the RLCD on a pre-trained base model?

    [0]:<a href="https:&#x2F;&#x2F;docs.typesafe.ai&#x2F;concepts&#x2F;system-one" rel="nofollow">https:&#x2F;&#x2F;docs.typesafe.ai&#x2F;concepts&#x2F;system-one

    1. CompleteSkeptic · · focus · HN ↗
      CEO here - that is right!

      I do agree that the comparison to LLM tokens is hard to understand (also because output tokens are not comparable).

      But yes, text or structured state (like a JSON with multiple pieces of text in) -&gt; decisions out (e.g. choice maps to &quot;match&quot; statement, &quot;score&quot; maps to sorting, &quot;noul&quot; short for bernoulli maps to if-statements)

      1. Flere-Imsaho · · focus · HN ↗
        Hi - first congratulations, System One looks really promising.

        The Doom demo really help me, at least, to understand how System One differs from LLMs. However the first demo (Side-by-side demonstration) - I&#x27;m struggling to understand what is going on here!

        1. davideg · · focus · HN ↗
          I was confused at first too, but it makes more sense when you read about their primitives. E.g. <a href="https:&#x2F;&#x2F;docs.typesafe.ai&#x2F;primitives&#x2F;noul" rel="nofollow">https:&#x2F;&#x2F;docs.typesafe.ai&#x2F;primitives&#x2F;noul

          The demo is showing System One producing its output in parallel very quickly and for little cost compared to an LLM generating its answers token-by-token. The &quot;noul&quot; type is used to evaluate a yes&#x2F;no question and return the probability that the answer is yes.

          So this demo is showing System One offering much more nuanced responses and specific probabilities compared to an LLM&#x27;s more crude responses (e.g. LLM shows &quot;true&quot; or &quot;false&quot; compared to &quot;0.9&quot; or &quot;0.07&quot; probabilities that the answer to some question is true).

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.