‹ BackHN Continuity

Thread

Thinking fast and slow in AI: The role of metacognition (2021)

177 points · 84 comments · teleforce

  1. simianwords · · focus · HN ↗
    This has already been solved by GPT 5 Adaptive reasoning. A single model that knows when to reason or not based on a thinking parameter we provide (like xhigh). What’s the relevancy to post it today?

    edit: why is this downvoted?

    1. lelanthran · · focus · HN ↗
      > This has already been solved by GPT 5 Adaptive reasoning. A single model that knows when to reason or not based on a thinking parameter we provide (like xhigh). What’s the relevancy to post it today?

      Tell me you didn't read Daniel Khaneman's book without telling me you didn't read Daniel Khaneman's book.

      1. simianwords · · focus · HN ↗
        Asking earnestly, I don’t know what you mean by this reply. I know what system 1 and 2 is. But this has already been solved using same model.
        1. lelanthran · · focus · HN ↗
          > I know what system 1 and 2 is. But this has already been solved using same model.

          No, it hasn't. Maybe you have a different definition of System 1 and System 2. I last read the book well over a decade ago (2011, maybe? 2012?), but System 1 and System 2 are different systems. IOW, System 2 is not a more computational version of System 1.

          The argument you made implies that System 2 is just a more capable System 1, which is not what the book (nor this paper, AIUI) proposes.

          In computery terms, System 1 runs in O(1) time, System 2 runs in O(log n) (or maybe just O(n)) time.

          This means that any System 1 will run the input once through the heuristics, using the same computational power and taking the same time whether the input is 100 tokens or 1 million tokens, for quick but perhaps wrong decision (not "answer"). We don't have LLMs that do that. We have System 2 - run in O(log n) time and produce an answer.

          System 1 is completely bereft of thought.

          1. hoppp · · focus · HN ↗
            The difference in humans is consciousness. System 1 is subconscious and fast, system 2 is conscious and slow.

            System 1 can do multiple passes and all that, the speed is related to how aware are you of the computation occuring and system 2 must be consciously managed.

            Example: You write a quick reply to a comment - thats system 1

            You add two four digit numbers in your head - that will be system 2 unless you are very good, then it can be system 1 also

            Why? Because memory allocations and addition computations are manually managed.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.