‹ BackHN Continuity

Thread

Religious scholars met with Anthropic

160 points · 416 comments · bookofjoe

  1. thadt · · focus · HN ↗
    When thinking about ‘AI’ I sometimes find it useful to replace the terms ‘model’ or ‘AI’ or whatever with a description of what we’re really talking about here: a whole bunch of floating point numbers.

    > In a series of private meetings, the company consulted religious scholars to help instill morality into its FLOATING POINT NUMBERS — and make the case that their numbers could be conscious.

    I recommend keeping a few NaNs in-hand if you’re worried. Spread a couple of around if your numbers start to stir and you’ll be right as rain.

    > It appeared to Rabbi Navon that Mr. Olah and his team believed that FLOATING POINT NUMBERS had what philosophers call “moral status” on par with a person — that it was a being with similar inherent rights to dignity or respect.

    They’re cleverly designed and work well for their purpose, but can assure you they have neither dignity nor moral status.

    > If the FLOATING POINT NUMBERS themselves could be made to choose goodness, Mr. Olah reasoned, the world would be more safe.

    I get it. I’ve spent years trying to get my floating point numbers to choose goodness - I wish them luck.

    1. 999900000999 · · focus · HN ↗
      To be fair human morality fades away very quick in any crisis.

      How many of us work for absolutely amoral companies because we need to eat.

      If you’ve ever been in a situation where people are really struggling you’ll see that morality fades away very real quick.

      No Gods, no souls, we’re just biological machines driven to eat and mate.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.