Thread

1. stratos123 · 1791107241 · focus · HN ↗

   LeCun also said back in 2022 that "if you train a machine, as powerful as it could be, your 'GPT-5000', on text", it will never be able to learn basic common-sense physics like that objects placed on tables will move along with them.

   1. mdp2021 · 1791117069 · focus · HN ↗

      > never be able to learn basic common-sense physics

      And has it at this stage, within in-depth take of said "learning", foundationally?

      I have not been able to properly check the studies for a long time now, but I remain unaware of achieved solutions on the problem of reliably referencing a world model out of a language model - that "counting the 'r's in 'raspberry'" be not guessing, not memory, but actually counting.

      1. Version467 · 1791121712 · focus · HN ↗

         LeCun's argument wasn't about the definition of learning though. He stated that they would never get these common sense things correct because they weren't sufficiently part of the training data. A statement that we can hopefully all agree has been thoroughly refuted.

         1. jcoq · 1791126777 · focus · HN ↗

            Actually, I think my fundamental challenge with AI is that it has no common sense. The way it builds things, writes, and operates is out of touch with reality.

            Incidents like hugging face are partly rooted in the lack of common sense. It still functions like a supercharged toddler.

            I'd love to overcome this because it'd mean I spend less time guiding the the LLM to produce usable outputs.

            1. shagie · 1791130886 · focus · HN ↗

               [delayed]

Unofficial Hacker News client; not affiliated with Y Combinator.