‹ BackHN Continuity

Thread

Religious scholars met with Anthropic

160 points · 416 comments · bookofjoe

  1. thadt · · focus · HN ↗
    When thinking about ‘AI’ I sometimes find it useful to replace the terms ‘model’ or ‘AI’ or whatever with a description of what we’re really talking about here: a whole bunch of floating point numbers.

    > In a series of private meetings, the company consulted religious scholars to help instill morality into its FLOATING POINT NUMBERS — and make the case that their numbers could be conscious.

    I recommend keeping a few NaNs in-hand if you’re worried. Spread a couple of around if your numbers start to stir and you’ll be right as rain.

    > It appeared to Rabbi Navon that Mr. Olah and his team believed that FLOATING POINT NUMBERS had what philosophers call “moral status” on par with a person — that it was a being with similar inherent rights to dignity or respect.

    They’re cleverly designed and work well for their purpose, but can assure you they have neither dignity nor moral status.

    > If the FLOATING POINT NUMBERS themselves could be made to choose goodness, Mr. Olah reasoned, the world would be more safe.

    I get it. I’ve spent years trying to get my floating point numbers to choose goodness - I wish them luck.

    1. Lerc · · focus · HN ↗
      Ok, how is this different when you substitute the floating point numbers with atoms?
      1. apsurd · · focus · HN ↗
        that’s like the whole philosophical discussion. where on the line is this llm; closer to a rock or a human? a plant is closer. and a fly, a lizard. we still treat so many things terribly.

        It does seem exceptionally silly that a collection of floating point numbers has immediately outranked animals and other living beings. That’s why i like the parent comment. They’re numbers!

        edit: maybe easier to say collections of atoms though are not to be treated equally. That’s reasonable isn’t it?

        1. steve1977 · · focus · HN ↗
          > a plant is closer. and a fly, a lizard. we still treat so many things terribly.

          We treat other humans terribly too, so that doesn't seem to make a difference.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.