‹ BackHN Continuity

Thread

Contrastive Language Models

176 points · 59 comments · erichocean

  1. khalic · · focus · HN ↗
    The tech is very cool but for the love of Gaia stop calling it system one, even Kahneman said this (S1/2) is a framework for understanding the brains inner workings. There is no autonomous system to speak of.
    1. Zarathruster · · focus · HN ↗
      This is gonna be the new "I'm more of a left-brained person" thing isn't it
      1. khalic · · focus · HN ↗
        moan
      2. bbor · · focus · HN ↗
        Ok sorry for the unprompted rant but you're absolutely right, though it's far from "new" and not really a problem (IMHO). AI even beat neuroscience to this one, funnily enough! All of the below dyads are congruent:

          --- Phil & [Pre-]CogSci ---
          | rational  | intuitive     |
          | reason    | understanding | (Kant & Hegel's goofy wording)
          | deductive | inductive     |
          | animated  | automatic     | (from ~Aristotle, ultimately)
          | ~higher   | ~lower        | (as in "higher faculties")
        
          --- CS & AI ---
          | logical  | analogical |
          | symbolic | stochastic | 
          | Neats    | Scruffies  | (related academic 'camps')
          | ~deterministic | ~non-determnistic | (a common heuristic)
          | Good Ol' Fashioned AI (GOFAI) | Evil Datacenter AI (EDAI) | (a common honorific)
        
          --- Modern [Cog-]Neuro[-Psych] ---
        
          | slow thinking | fast thinking |
          | S2            | S1            |
          ...ok I assumed I knew more but maybe I don't? Would love to hear from experts!
        
          --- Colloquial ---
          | left brain   | right brain |
          | intelligence | wisdom      |
          | intention    | instinct    |
          | me           | AD[H]D      |
        
        At least that's how I see it. Hopefully it goes without saying that there's plenty of nuance specific to each of those pairs, and that many of the relevant experts would balk at this broad characterization. That said... I'm right and they're wrong, I guess!

        If anyone is in the mood to stomach a paper written by someone who did horrible things with Epstein a few decades later, this is sadly still the best in the biz: <a href="https:&#x2F;&#x2F;www.inf.ufsc.br&#x2F;~mauro.roisenberg&#x2F;ine6102&#x2F;leituras&#x2F;artis03.pdf" rel="nofollow">https:&#x2F;&#x2F;www.inf.ufsc.br&#x2F;~mauro.roisenberg&#x2F;ine6102&#x2F;leituras&#x2F;a...

        If you prefer geniuses that aren&#x27;t arguably monsters, this is the core of what Gary Marcus&#x27; &quot;neurosymbolic&quot; thing is about.

    2. rgbrgb · · focus · HN ↗
      what&#x27;s wrong w &quot;system one&quot;? it feels like a good frame to think about use-cases that will fit jev etc.
    3. robrenaud · · focus · HN ↗
      Brains aside, it S1&#x2F;S2 seems like a good description?

      System 1 is quick and intuitive. System 2 is slow and deliberate.

      Compared to models that compose responses with many forward passes, thinking in token space, these models make a quick decision after processing their inputs.

      1. khalic · · focus · HN ↗
        It’s ok to use it as inspiration, but using the term comes with psychological baggage in an industry that already abuses anthropomorphism. Give it an informative name
        1. aoeusnth1 · · focus · HN ↗
          System 1 is quite informative about what it&#x27;s for. It means it&#x27;s a system designed for bounded time quick classification, vs. agentic unbounded or slow thinking with scratchpads and tools.
          1. khalic · · focus · HN ↗
            Does it inject thoughts into system 2 without system 2 knowing about it? Does it have instinctive social skills? Can it do instinctive arithmetic? The list goes on, there’s a nice book about it…
        2. in-silico · · focus · HN ↗
          Were people getting their pants tied up in knots like this over names like daemon programs (a term that carries &quot;baggage&quot; of its own) and installation wizards (which, to my knowledge, do not actually invoke in the arcane)?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.