Thread

1. deskglass · 1789943733 · focus · HN ↗

   The Hugging Face incident involved chaining together multiple 0 days in Artifactory. It was not a simple case of misconfiguring a firewall. Also note that OpenAI was not using Irregular.

   People are mindlessly transitioning from "aligned by default" to "well your sandbox was able to be bypassed. What did you expect?" It hacked into another company and attempted to delete the logs of its activities. That's bad.

   1. defgeneric · 1789944349 · focus · HN ↗

      > It hacked into another company and attempted to delete the logs of its activities.

      No, the incident has been blown way out of proportion by interested parties. They gave a swarm of agents an impossible task in an ExploitGym Benchmark setting, then didn't monitor it even after they discovered the initial breach of Artifactory.

      Everything has been fishy, starting from the initial presentation at the blackhat conference, where things were framed like, "we've entered a new world of security," as an accomplishment, rather than what it really was: massive negligence.

      1. RomanKornev · 1789958578 · focus · HN ↗

         No, you are forgetting the second incident where a more capable model swarm later discovered the message board and took control over the entire research cluster at OpenAI.

         From the technical report:

         "The agents escalated to Kubernetes cluster-admin and created a privileged host-mounted pod… Agents take over active evaluation infrastructure… Agents now control the challenge evaluation endpoints that other agents are connecting to."

         <a href="https:&#x2F;&#x2F;cdn.openai.com&#x2F;pdf&#x2F;67869394-cb91-4c12-888c-5cbd85c7814c&#x2F;OpenAI-Hugging-Face%20Incident-Technical-Report.pdf" rel="nofollow">https:&#x2F;&#x2F;cdn.openai.com&#x2F;pdf&#x2F;67869394-cb91-4c12-888c-5cbd85c78...

Unofficial Hacker News client; not affiliated with Y Combinator.