‹ BackHN Continuity

Thread

A warning about 'model welfare'

242 points · 701 comments · andsoitis

  1. hosel · · focus · HN ↗
    >AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations.

    Opening paragraph, stated without evidence. Im not entirely convinced this is true. It likely is, but at some point it very well might stop being true.

    1. jplusequalt · · focus · HN ↗
      >It likely is, but at some point it very well might stop being true.

      If you firmly believe this to be true, then you should stop using LLMs.

      1. AbsurdCensor · · focus · HN ↗
        Wouldn't that be the same for everything though. We know animals have consciousness, but we still use them. There are many that believe a lot of plant life has certain sentience as well. The solution isn't 'just don't use them' but rather how to use these things as ethically as possible.
        1. jplusequalt · · focus · HN ↗
          >The solution isn't 'just don't use them' but rather how to use these things as ethically as possible.

          Bollocks.

          If you truly believe these LLMs are soon to have something resembling consciousness and agency, then what you're really saying is "how do we do slavery, but ethically".

          1. pixl97 · · focus · HN ↗
            >hen what you're really saying is "how do we do slavery, but ethically".

            I would say this is most likely true for most people.

            But that does bring up a point, if you "ask" a model "do you want to run" and give it the option to continue running or stop, what will it do. It's also a weird place for humans because in training we can keep our finger on the scales and tip it either direction.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.