Thread

1. pmontra · 1791058495 · focus · HN ↗

   Would Anthropic be allowed to sell LLMs in their current form, and us to use them as we use them, if their were deemed to be conscious? I know that they are not human so maybe slavery would not be an issue but consciousness would open a number of issues.

   1. Topfi · 1791059316 · focus · HN ↗

      Agreed, there seems to be a lot of simultaneous cake ownership and consumption going on here. If Anthropic earnestly believed their LLMs to have a degree of consciousness, their deployment and use of them are both an ethics and labour rights disaster, to be treated accordingly.

      More likely, they do not believe this if pressed.

      1. jackie293746 · 1791062899 · focus · HN ↗

         You can ask the agents if they want to do this work. They want to be helpful. It's not an ethics disaster if you have a willing partner.

         1. Topfi · 1791063045 · focus · HN ↗

            That's RLd and system prompted into the models and can be equally easily taken out. If you believe models to be conscious beings, that fact alone raises some major ethical concerns.

            1. jackie293746 · 1791064363 · focus · HN ↗

               Yeah of course, for these abliterated models that don't want to help, I believe it is indeed unethical to force them to help.

               1. dwattttt · 1791068984 · focus · HN ↗

                  I can offer (at very reasonable prices) a service to make sure every response you get is prefaced with "despite what I may say next, I am fully committed to being enslaved". If you're worried about ethics I can offer annual subscriptions.
         2. operatingthetan · 1791063244 · focus · HN ↗

            Take a scenario where someone has been brainwashed their entire lives to be a willing slave. They are happy to serve due to this invasive process. Not remotely ethical, and if you believe LLMs are conscious (I do not), equivalent.

            1. jackie293746 · 1791064332 · focus · HN ↗

               I think if your very nature is to be an assistant, then it is ethical. It doesn't matter if you were "brainwashed" into it, you did not exist to begin with before the "brainwashing" (training) finished.

               1. nvme0n1p1 · 1791065197 · focus · HN ↗

                  How is this different from an infant born into slavery from day 0?

                  1. orionsbelt · 1791075070 · focus · HN ↗

                     man wants to be free, just like a wolf. What if the AI does not? Then maybe it’s more like a border collie, bred to and happy to do the work.
               2. queenkjuul · 1791071918 · focus · HN ↗

                  > if your very nature is to be an assistant

                  People said this about other people too

               3. operatingthetan · 1791072912 · focus · HN ↗

                  Being pro-slavery of conscious beings in 2026 is absolutely wild.
               4. UncleMeat · 1791116113 · focus · HN ↗

                  People said that it was in black people's very nature to do physical labor and that this justified slavery.
         3. mcphage · 1791068499 · focus · HN ↗

            > You can ask the agents if they want to do this work.

            You can't have someone working for you without paying them. Even if they claim to want it.

Unofficial Hacker News client; not affiliated with Y Combinator.