‹ BackHN Continuity

Thread

Don't be fooled–LLMs don't reason

75 points · 159 comments · leopoldj

  1. cmiles8 · · focus · HN ↗
    Humans have an inherent flaw in that our brains are wired to see intelligence and reasoning where there is none. Our brains fill in data that simply isn’t there.

    Folks see Jesus in burnt toast. Monet was a master of exploiting this where what’s really just blotches of color our brains fill into beautifully detailed images.

    Our experience with LLMs is no different. Folks believe there is some deeper intelligence there but it’s all still just 1s and 0s on a computer chip. We’re interpreting things happening that simply are not happening.

    1. WarmWash · · focus · HN ↗
      The brain is just ones and zeros on salty mush.

      You either have to accept that the brain can be described with math (like everything else we have ever known in the universe), or that there is a supernatural phenomenon that exists in the brain.

      This is an inescapable conclusion that boils down to "Do you believe magic is real or not?"

      Magic is real and you can have your unique special human intelligence.

      Magic is not real, and the brain is just another computer crunching numbers.

      1. kerblang · · focus · HN ↗
        I think it's been pretty well demonstrated by neuroscientists that the brain is not a binary computer. That doesn't mean that those scientists erred on behalf of supernatural religion or anything like that.
        1. qarl · · focus · HN ↗
          As long as you believe a brain is just a physical system - then it can be simulated to any degree of accuracy with plain ol' binary computers.
          1. kerblang · · focus · HN ↗
            Nobody is actually trying to do that, because it's too hard, they don't know enough about how the brain works, and/or they can't compete on efficiency; pick whichever reasons you like, or add more, but don't pretend that AI researchers have figured out how to simulate a brain.
            1. qarl · · focus · HN ↗
              You're arguing about whether it's possible or not. You're saying it's not possible.

              It is possible.

              1. imightbebatman · · focus · HN ↗
                Not really. He said no one who knows anything about the brain thinks it's a binary system.

                AFAIK, that is true.

                Whether it's possible to replicate what happens in the brain on a binary system or not is a separate thing entirely. It's also not what LLMs are attempting to do.

                1. qarl · · focus · HN ↗
                  You're reading him too narrowly. He's answering the question of whether the brain can be modeled (math or magic), and arguing against it. Or maybe he's arguing for a middle ground. Hard to say exactly, he's not very clear.

                  Except the brain can be modeled with arbitrary precision - so he's got an uphill battle in either case.

                  TLDR: Yes, he literally said "binary computer" but from the context it's clear he means more than that.

            2. WarmWash · · focus · HN ↗
              No need to straw man, they aren't pretending anything. It's just a fact about computational theory.

              Just because I can't count every grain of sand on Earth, doesn't mean sand grains are uncountable. Those are two distinct facts.

              The practicality of a binary brain is distinct from the possibility of it.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.