Dont be fooled. Reasoning does not happen in the prediction of the next token, it happens virtually in the text that is created.
The next token prediction is just "the hardware" following the underlying rules. Like the basic set of rules.. in a sense similar to how the "game of life" does not really contain gliders. Gliders are just a self stabilised system that arrises from the simple rules.
All these "AI can't" arguments seem to secretly rely on the assumption that human reasoning/sentience/whatnot is dependent on a soul (or any equivalent metaphysical entity). Everything else is handwaving.
I agree - many are. But there's another camp to watch - LeCun/etc don't believe in a soul but also don't believe that LLMs are capable, because they don't contain the right neural network.
I'd argue that they're still intuitively trying to keep intelligence in the gaps, as humans like to do. Or maybe they're mad they bet on the wrong horse... or maybe both. Hard to say.
> because they don't contain the right neural network.
I'm totally onboard with that as a plausible argument, but I think the architectural limitations with respect to consciousness are very deliberate rather than some lack of technology. We've invested huge sums of money and human effort to create tools with explicit goals that are completely at odds with consciousness or AGI. If we had invested similarly with the clear goal of creating something with agency, self-determination, neuroplasticity, etc. instead of controllability, repeatability, reliability, I think we would be there already.
Maybe. I'm just suspicious of the certainty of the people who are certain of it.
And... I remember (all of six years ago) back when language was considered the pinnacle of the human mind. Sure, animals might be smart, but they don't have language!
The moment LLMs appeared it suddenly took a back seat to physical navigation and child rearing.
Feels like more gap seeking to me. But time will tell.
reliablereason · · focus · HN ↗
The next token prediction is just "the hardware" following the underlying rules. Like the basic set of rules.. in a sense similar to how the "game of life" does not really contain gliders. Gliders are just a self stabilised system that arrises from the simple rules.
qarl · · focus · HN ↗
Kind of like how a brain is just a bag of molecules. Molecules can't reason either.
strbean · · focus · HN ↗
qarl · · focus · HN ↗
I'd argue that they're still intuitively trying to keep intelligence in the gaps, as humans like to do. Or maybe they're mad they bet on the wrong horse... or maybe both. Hard to say.
strbean · · focus · HN ↗
I'm totally onboard with that as a plausible argument, but I think the architectural limitations with respect to consciousness are very deliberate rather than some lack of technology. We've invested huge sums of money and human effort to create tools with explicit goals that are completely at odds with consciousness or AGI. If we had invested similarly with the clear goal of creating something with agency, self-determination, neuroplasticity, etc. instead of controllability, repeatability, reliability, I think we would be there already.
qarl · · focus · HN ↗
And... I remember (all of six years ago) back when language was considered the pinnacle of the human mind. Sure, animals might be smart, but they don't have language!
The moment LLMs appeared it suddenly took a back seat to physical navigation and child rearing.
Feels like more gap seeking to me. But time will tell.
strbean · · focus · HN ↗
And now we are finding that cetaceans have language more complex than out own :)
Agreed with you on all points!