‹ BackHN Continuity

Thread

There are no "rogue" AI agents

396 points · 269 comments · zzzeek

  1. Glyptodon · · focus · HN ↗
    Yep. They could be creating sandbox environments and training systems that make the operational actions being exhibited impossible, disincentivized, and more. But I guess that would be too much trouble and not give them as many marketing opportunities. Either way, liability should be on the company. And scaled against what individual perpetrators would be punished with.
    1. zzzeek · · focus · HN ↗
      It's obvious they wanted to create this "AI is going to kill us all" narrative, where they've been spectacularly successful, that's at the center of their goals to get government-sponsored carve outs / bail outs for their businesses.
      1. frabcus · · focus · HN ↗
        To be clear, do you approve of OpenAI being prosecuted, and OpenAI being forced to control their own AI more?

        That would be a start - what you think of the narrative is moot, what we do is what matters.

        Nobody sensible in this discussion wants to give them carve outs and bail outs. It is a straw man.

        1. zzzeek · · focus · HN ↗
          uh who in this discussion is in charge of policy? Take a look at what actual people in government are saying - see [1] (the parent article mentions Bernie Sanders being most high profile in response as well). you'll see there is no prosecution in there, only talk about the "freeze" that Anthropic / OpenAI are salivating for as it would close out all of their competitors. Bernie is fully hoodwinked.

          The argument for prosecution is actively hindered by this language of "rogue agents" [2]:

          > The incident is remarkable not just as a cybersecurity breach, but as a legal stress test. The Computer Fraud and Abuse Act (CFAA), the primary federal statute governing unauthorized computer access, was written decades ago with human intruders in mind.[4] Its key provisions require intentional or knowing unauthorized access (a mental state that maps neatly onto a person who decides to break into a system), but what happens when the hacker is an AI model that selected its own target?

          I think this is BS. OpenAI knew exactly what they were doing. Legal scholars, long known for their deep technical expertise, are still acting confused and uncertain.

          [1] <a href="https:&#x2F;&#x2F;www.sanders.senate.gov&#x2F;wp-content&#x2F;uploads&#x2F;Ban-Artificial-Superintelligence-Act-Release-Summary.pdf" rel="nofollow">https:&#x2F;&#x2F;www.sanders.senate.gov&#x2F;wp-content&#x2F;uploads&#x2F;Ban-Artifi...

          [2] <a href="https:&#x2F;&#x2F;law.vanderbilt.edu&#x2F;when-ai-hacks-back-how-the-openai-hugging-face-incident-exposed-the-cfaa&#x2F;" rel="nofollow">https:&#x2F;&#x2F;law.vanderbilt.edu&#x2F;when-ai-hacks-back-how-the-openai...

          1. frabcus · · focus · HN ↗
            The freeze is to stop superintelligent models. Not to stop other companies catching up with current models we all have access to. It would help them catch up.

            Yep - fair on legal details of &quot;rogue agent&quot;. I think OpenAI should be directly responsible, and the agent was rogue. We should pass new laws if necessary.

            1. zzzeek · · focus · HN ↗
              &gt; The freeze is to stop superintelligent models. Not to stop other companies catching up with current models we all have access to. It would help them catch up.

              if you read the bill it&#x27;s right there: &quot;Pausing advanced AI development: until a new, federal AI regulatory body is up and running and has established clear rules and model review processes to ensure safe and secure development and deployment of AI&quot;

              Openai&#x2F;anthropic already have frontier models. a new competitor is blocked. this is textbook regulatory capture

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.