‹ BackHN Continuity

Thread

Don't be fooled–LLMs don't reason

75 points · 159 comments · leopoldj

  1. reliablereason · · focus · HN ↗
    Dont be fooled. Reasoning does not happen in the prediction of the next token, it happens virtually in the text that is created.

    The next token prediction is just "the hardware" following the underlying rules. Like the basic set of rules.. in a sense similar to how the "game of life" does not really contain gliders. Gliders are just a self stabilised system that arrises from the simple rules.

    1. lstodd · · focus · HN ↗
      I think the question is if the "rules" however captured can express reasoning.

      My position is that it is not possible.

      1. qarl · · focus · HN ↗
        Do you agree that an LLM in a harness is Turing complete?

        Seems so to me.

        So explain then what you mean by "not possible".

        1. lstodd · · focus · HN ↗
          Turing complete does not mean reasoning. Zuse did turing complete computers in 1940s.
          1. qarl · · focus · HN ↗
            Turing complete means being able to compute any computable output.

            So what about reasoning is not computable in your mind?

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.