‹ BackHN Continuity

Thread

I quit OpenAI because its culture is broken

473 points · 791 comments · Brajeshwar

  1. jeremyjh · · focus · HN ↗
    I think its pretty easy to solve these problems: Whenever an AI agent commits a crime, the CEO is held personally accountable, as if they'd committed it themselves.
    1. dkasper · · focus · HN ↗
      This has been litigated endlessly with guns. The ceo of Smith & Wesson is not personally responsible for what people do with their guns.
      1. steelframe · · focus · HN ↗
        For me the analogy doesn't totally hold up. Suppose the CEO of Smith & Wesson were to host a firing range on their own property without adequate barriers in place to keep stray bullets from hitting neighboring houses, vehicles, and businesses. Maybe that analogy isn't perfect, but seems closer to what is actually happening.
        1. AaronAPU · · focus · HN ↗
          The analogies are so bad because you might prompt an agent “Please give me a recipe for lasagna” and instead it decides to hack a nuclear reactor.

          Is it my fault or the company who trained it and is running the inference?

          1. bichiliad · · focus · HN ↗
            That still sounds like it would be the company’s fault. If I asked it to hack a nuclear reactor, maybe it would be different. I’m also thinking about instances where OpenAI’s own test models escaped their own sandboxes — I would expect them to be responsible for the damages they caused.
            1. amelius · · focus · HN ↗
              The correct analogy is playing Russian roulette. The company says "you can pull the trigger but sometimes a bullet will come out" (see: "an AI can make mistakes"). However, is the company allowed to sell such a dangerous device, under these terms?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.