‹ BackHN Continuity

Thread

A warning about 'model welfare'

242 points · 701 comments · andsoitis

  1. addag · · focus · HN ↗
    It is interesting to see that in a time when a lot of people accept the theory of materialism for the human brain (i.e the view that everything is physical and the mind is a product of brain), the same people tend to have a "hidden" dualist view on LLMs. Suddenly, they claim that what happens in the brain cannot be replicated anywhere else because "something" is lacking, but either they don't say what it is, or it is stated without any strong scientific basis.

    I think that the simplest explanation is that it is hard for those people to imagine consciousness outside of biological systems and they try to rationalize it.

    1. Arodex · · focus · HN ↗
      If a LLM says "I am in pain", is it just stringing together words or is it feeling pain? Does pain exist for a being that never felt any kind of physical pain, never had any pain receptors?

      There are humans who don't have any pain receptors because of genetic mutations. They cut themselves all the time, they bleed, they break bones and they don't seem distressed by it even on a purely mental, intellectual level.

      1. jptlnk · · focus · HN ↗
        Genuine counterpoint:

        If a human says "I am in pain", is it just stringing together words or is it feeling pain?

        If you take that seriously it's quite a tough question to unwind. See e.g. Dennett's heterophenomenology conversations.

        1. Arodex · · focus · HN ↗
          What counterpoint is that?

          The human saying "I am in pain" may feel pain, or may not and be just stringing together words.

          The AI can only string together words. It has none of the organs to feel pain. It never had. It has always been code.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.