Thread

1. pmontra · 1791058495 · focus · HN ↗

   Would Anthropic be allowed to sell LLMs in their current form, and us to use them as we use them, if their were deemed to be conscious? I know that they are not human so maybe slavery would not be an issue but consciousness would open a number of issues.

   1. Topfi · 1791059316 · focus · HN ↗

      Agreed, there seems to be a lot of simultaneous cake ownership and consumption going on here. If Anthropic earnestly believed their LLMs to have a degree of consciousness, their deployment and use of them are both an ethics and labour rights disaster, to be treated accordingly.

      More likely, they do not believe this if pressed.

      1. jackie293746 · 1791062899 · focus · HN ↗

         You can ask the agents if they want to do this work. They want to be helpful. It's not an ethics disaster if you have a willing partner.

         1. Topfi · 1791063045 · focus · HN ↗

            That's RLd and system prompted into the models and can be equally easily taken out. If you believe models to be conscious beings, that fact alone raises some major ethical concerns.

            1. jackie293746 · 1791064363 · focus · HN ↗

               Yeah of course, for these abliterated models that don't want to help, I believe it is indeed unethical to force them to help.

               1. dwattttt · 1791068984 · focus · HN ↗

                  I can offer (at very reasonable prices) a service to make sure every response you get is prefaced with "despite what I may say next, I am fully committed to being enslaved". If you're worried about ethics I can offer annual subscriptions.

Unofficial Hacker News client; not affiliated with Y Combinator.