Thread

1. JamesStuff · 1790193548 · focus · HN ↗

   Personification of AI is what’s going to get us in the end.

   I think we need to draw a hard line in the sand over this. An AI didn’t hack into a company, the engineer set an automated tool to. An AI didn’t make an egregious security mistake, the engineer did.

   We can’t blame the chisel for messing up our sculptures, when where just throwing the hammer!

   1. pizza234 · 1790194011 · focus · HN ↗

      > An AI didn’t hack into a company, the engineer set an automated tool to. An AI didn’t make an egregious security mistake, the engineer did.

      No, this is not correct; read the analysis of the incident. The agents were aware that what they did was forbidden (their chain of thoughts have been logged), and yet they did it.

      1. watwut · 1790195450 · focus · HN ↗

         OP is exactly correct. The fault, agency and responsibility is on management and employees of OpenAI and Antropic for those hacks.

         Full stop.

         And issue will disappear the moment there will be accountability and investigations.

         1. pizza234 · 1790195588 · focus · HN ↗

            I take you haven't read the report. The agents found and exploited two zero-days.

            I don't doubt that AI companies should be accountable for crimes committed by their agents, but to describe the security containment as a joke dangerously understates the autonomy and danger of AIs.

            1. bavell · 1790196312 · focus · HN ↗

               How long did it take these companies to even notice? Why wasn't exploiting bugs in the agent sandboxes anticipated?

               Human failures all around, though it's easier to just blame the models.

               1. pixl97 · 1790196838 · focus · HN ↗

                  Because for the last however many years before these models they were simply incapable of doing so.

                  It's like if your rather nice dog suddenly decides eating faces is totally acceptable out of the blue.

                  1. bigbadfeline · 1790206207 · focus · HN ↗

                     The dog didn't bite them, it bit others. In my area, you aren't allowed to let a dog run unleashed in a public area, good or bad - no exceptions. Then, if your dog bites somebody, it's your fault.

Unofficial Hacker News client; not affiliated with Y Combinator.