‹ BackHN Continuity

Thread

There are no "rogue" AI agents

396 points · 269 comments · zzzeek

  1. binarymax · · focus · HN ↗
    Exactly this. At worst, OpenAI knew about these behaviors and should be prosecuted under CFAA. At best, OpenAI is negligent and should be prosecuted for negligence.

    Luckily there are states and legal departments pursuing such action. So while OpenAI can deflect as much as it wants, that doesn't mean there aren't people who know better and will still do what is necessary to set precedent.

    1. solenoid0937 · · focus · HN ↗
      Angry people don't consider the second order effects of punishment.

      You realize how easy it is to just... not report this stuff, right? Be overly punitive and it will just end all proactive discovery and reporting which is net worse for AI safety.

      The only reason these companies scan for these issues is because they care about AI safety to some tiny degree. If fines become too punitive, they can and will just stop scanning for these incidents entirely.

      Models are becoming smarter and good at covering up their tracks, and so we will just end up with a huge blind spot for this kind of issue.

      1. wonnage · · focus · HN ↗
        Don’t punish the people who do crimes because otherwise they won’t self-report that they are doing crimes? real galaxy brain shit
        1. solenoid0937 · · focus · HN ↗
          There's very good evidence that being overly punitive for a crime reduces how often people will self-report. It's not a hard concept.

          Start throwing people in jail and fining billions of $ and you will very quickly see the number of "incidents" drop. You will never learn if it's because they truly are happening less often.

          1. [deleted] · · focus · HN ↗

            [deleted]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.