‹ BackHN Continuity

Thread

Who should be held accountable when an AI Agent (accidentally) acts maliciously?

37 points · 99 comments · Greenpants

  1. CatDaaaady · · focus · HN ↗
    I don't see how this is such an unclear legal question. If I fire a computer program that mistakenly causes another person harm, its my fault. Or it would be the maker of the program's fault. I feel we have established pattern for this already.

    Until we can agree whether AI is conscious, which we never will, AI and AI agents are just property working on behalf of humans.

    I could see a future where AI companies/services indemnify consumers who use their agents but _not_ indemnify corporations that use their services.

    1. trescenzi · · focus · HN ↗
      It shouldn’t be a question but this is where the anthropomorphic language and things like “agent welfare” come in to enable responsibility laundering of some of the most powerful people on earth. How we talk about these models matters because it impacts the public’s understanding of what they are genuinely capable of. The more that they are described as having anything close to free will the easier it is to even ask questions like this.
      1. diegof79 · · focus · HN ↗
        100% That’s what bothers me about the descriptions of the OpenAI incidents.

        OpenAI's reports use language that minimizes their liability.

        The first question should be what the organization was doing around those tests, and why they were so naive as to run them without fully isolating the network.

        However, all the attention goes to the human-like conclusions in agent thinking traces, which creates a misperception of sentient AI for people who don’t know how the magic black box works.

        1. ofjcihen · · focus · HN ↗
          It really does feel like a purposeful thing on the part of the big labs.

          For the most part it feels like most people are waking up to it though.

          Regarding:

          >However, all the attention goes to the human-like conclusions in agent thinking traces, which creates a misperception of sentient AI for people who don’t know how the magic black box works.<

          I know there’s been some questions regarding if thinking traces are even relevant to the outcome most of the time.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.