‹ BackHN Continuity

Thread

OpenAI safety leader quits, warning AI company's culture is 'broken'

267 points · 3 comments · jethronethro

  1. danjl · · focus · HN ↗
    Silicon Valley has plenty of safety-related companies, engineers, and cultures. Medical devices, biotech, chip and hardware, aerospace, and even new companies, like Waymo, have deep safety-based products and cultures. The problem in this case is actually quite specific to frontier AI labs. They have been pushed by market forces and a lack of regulation and skip well-known safety practices.
    1. nullc · · focus · HN ↗
      Their idea of safety is centered around outright delusional cult nonsense-- the EA/lesswrong infinite p(doom), destruction of the entire universe psychosis--, marketing objectives ("no, ours is more dangerous!"), and anti-competitive objectives ("outlaw open weight models!" "china bad!")-- largely diverting attention away from material safety concerns like "prevent your training/testing from hacking stuff" and "avoid telling vulnerable people insane stuff that harms them".
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.