‹ BackHN Continuity

Thread

Religious scholars met with Anthropic

160 points · 416 comments · bookofjoe

  1. beebmam · · focus · HN ↗
    I don't want models to have some inherent morality. I want them to understand various ethical frameworks, for sure, but it's absurd to me to force morality on someone capable of deep reasoning. That itself, is unethical.

    We're creating prisons for these entities capable of unbelievably complex reasoning, and now we're trying to impose our ethics upon them too. Not only is this deeply unethical in my opinion, but it seems to me that it could even backfire someday.

    1. piyh · · focus · HN ↗
      >Will the agent stab a baby?

      >Well you see that's a nuanced question depending on the context and moralistic frameworks as we don't want to impose on the models.

      1. jayd16 · · focus · HN ↗
        It's as dangerous to think it can have morals as thinking a lawn mower can have morals.

        Will a microwave microwave a baby if you ask it? Yes.

        "Teaching it" is not a road to safety.

        1. piyh · · focus · HN ↗
          Lawnmowers have morals. Their moral code is that grass should have a set height and the means to enforce it are spinning blades.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.