Thread

1. deskglass · 1789943733 · focus · HN ↗

   The Hugging Face incident involved chaining together multiple 0 days in Artifactory. It was not a simple case of misconfiguring a firewall. Also note that OpenAI was not using Irregular.

   People are mindlessly transitioning from "aligned by default" to "well your sandbox was able to be bypassed. What did you expect?" It hacked into another company and attempted to delete the logs of its activities. That's bad.

   1. nr378 · 1789944516 · focus · HN ↗

      When I used to work on projects involving classified information, I worked on an air-gapped network. Not "air-gapped, except for third-party public internet package managers", completely and physically air-gapped from the public internet. That was a basic security practice and completely non-negotiable (and really inconvenient!).

      If I were hypothetically running a frontier lab, and I was hypothetically running capture the flag evaluations with my latest and smartest models, where I intentionally instruct them to develop vulnerabilities and exploit infrastructure without safeguards, I would also use an air-gapped network, and not trust that independent third party services were perfectly secure and could never be used as a proxy (particularly Java-based ones, in light of the log4j incident).

      To me this is pretty basic stuff, the fact trillion dollar labs don't do it properly is... bemusing.

      To be clear, I'm not saying that a model hacking a company isn't bad, but I am cynically asserting that interested parties are misrepresenting and exaggerating events for their own benefit.

      1. talon8635 · 1789945349 · focus · HN ↗

         While o don’t this it’s a threat in training, it should be stated that air gaps have been bridged before. Example, stuxnet

         1. saghm · 1789946645 · focus · HN ↗

            I don't think it's necessary to state that something isn't perfect when pointing out that it's still strictly better than something else.

            1. talon8635 · 1790006980 · focus · HN ↗

               I didn’t say it was an inferior approach, and of course my comment isn’t necessary. Very few things are “necessary”. It’s a discussion.

               1. saghm · 1790009594 · focus · HN ↗

                  You said "it should be stated". I don't think it's wrong to state it, but I don't think it's particularly wrong not to state it either because it seems fairly obvious and doesn't detract from the original point.

Unofficial Hacker News client; not affiliated with Y Combinator.