‹ BackHN Continuity

Thread

Contrastive Language Models

176 points · 59 comments · erichocean

  1. fxwin · · focus · HN ↗
    I really hope that "System One" won't stick around as a new buzzword simply meaning "fast".
    1. TeMPOraL · · focus · HN ↗
      It already did, since 15 years ago.

      <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Thinking,_Fast_and_Slow" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Thinking,_Fast_and_Slow

      1. fxwin · · focus · HN ↗
        i&#x27;m well aware of the origin and meaning of the term

        &gt; &quot;System 1&quot; is fast, instinctive and emotional

        this implies more than just &quot;fast&quot;, which is precisely why i don&#x27;t like its present usage

        1. samusiam · · focus · HN ↗
          I think System 1 is a great term. System 1 is fast, intuitive, and automatic. It describes decision-making that happens without explicit reasoning or deliberation. System 2 is the opposite: it&#x27;s the more deliberate, &quot;executive functioning&quot; side of cognition -- the part that reasons through a problem before arriving at an answer. That&#x27;s also what state-of-the-art LLMs do before they respond. Jev doesn’t do that kind of reasoning. It just decides.
          1. fxwin · · focus · HN ↗
            so whats the difference between this and a non-reasoning LLM, or just any generic classifier method that necessitates a new term? there is nothing more intuitive or automatic about jev or this than any of the other currently used AI models
            1. aoeusnth1 · · focus · HN ↗
              The difference is the the joint embedding of actions and state which are fined tuned for certain outcomes. The bulk of the weights are just a forward pass on an LLM (Nemotron).
              1. fxwin · · focus · HN ↗
                is that how jev works too? how do these differences make those approaches more &quot;instinctive and emotional&quot;? I know they&#x27;re different on a technical level, I&#x27;m asking which characteristic difference necessitates the use of this loaded term from pop psych
                1. aoeusnth1 · · focus · HN ↗
                  Oh, an LLM forward pass is also like system1. The action embedding just makes it more useful for tasks or classification. If it has a small fixed computation budget it&#x27;s similar to system1 than system2 (like a thinking budget, or agent harness).
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.