‹ BackHN Continuity

Thread

OpenAI safety leader quits, warning AI company's culture is 'broken'

267 points · 3 comments · jethronethro

  1. vjvjvjvjghv · · focus · HN ↗
    [delayed]
    1. kolinko · · focus · HN ↗
      Nothing is ever 100% safe, it’s about a right balance of safety to the benefit.

      Or, in other words - we have two P(Doom), one for AI being developed, and another for AI being not developed. The latter is not discussed enough imho.

      1. estearum · · focus · HN ↗
        We have P(Doom) also for "kolinko not wiring me a million dollars today" and that is not being discussed enough either imho.

        What on earth are you talking about?

        1. ViscountPenguin · · focus · HN ↗
          P(doom) for not making an ASI is pretty well established, I'm not really sure why everyone in the 21st century seems to have completely forgotten the risk of nuclear war (as the single largest example).
          1. didibus · · focus · HN ↗
            That's just another P(doom), or does making an ASI somehow negate the risk of nuclear war? Cause I'd assume it actually increases it.
          2. combobyte · · focus · HN ↗
            If anyone out there genuinely believes that Silicon Valley is going to solve nuclear war, then I have a hard drive full of NTFs to sell them.
            1. nullc · · focus · HN ↗
              Prosperity inhibits all war, nuclear or otherwise.

              Why would a person who is happy, entertained, wealthy, well fed, and have 200 years of healthy high quality life expected ahead of them going to risk losing what they have in war?

              -- there aren't zero reasons, sure-- but there are fewer.

              And our technology has brought us absolutely tremendous prosperity in many regards.

              1. combobyte · · focus · HN ↗
                You do realize that the people currently holding their fingers over the proverbial Big Red Button are some of the wealthiest, most over-privileged people to have ever lived?

                'Prosperity' has never been and will never be enough for some people. And unfortunately those are the same kinds of people who relentlessly seek power.

                1. nullc · · focus · HN ↗
                  And not pushing it. QED.
                  1. estearum · · focus · HN ↗
                    There's no advantage to be had, for anyone, by pushing the red button.

                    The opposite is true of releasing ever more powerful AI into the world to do your bidding.

        2. bigmadshoe · · focus · HN ↗
          The comment was unclear, but my interpretation (also my opinion):

          1) there are inherent risks involved with developing AI,

          2) there are benefits to developing AI,

          3) thus, it's entirely possible that the downside from the risks outweighs the upsides. In this case, the correct thing to do would be to not develop AI at all.

          Regarding 1), there are many non-existential problems with AI that are already causing societal harm, i.e. debasing truth via generated videos and images, AI girlfriends, overwhelming quantities of slop content, unemployment, record carbon emissions, etc.

          Regarding 2), I'm not personally convinced that the upside is there for the average person. I really hope to be convinced otherwise however.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.