Australia says OpenAI agent hacked into government website
Thread
Loading the complete thread in the background. This saved snapshot is available now. Refresh
Unofficial Hacker News client; not affiliated with Y Combinator.
Australia says OpenAI agent hacked into government website
Loading the complete thread in the background. This saved snapshot is available now. Refresh
Unofficial Hacker News client; not affiliated with Y Combinator.
chrismorgan · · focus · HN ↗
N_Lens · · focus · HN ↗
wewewedxfgdf · · focus · HN ↗
And the AI CEO's will have brought it on themselves.
senectus1 · · focus · HN ↗
the legal system exists for a reason. use it!
samlinnfer · · focus · HN ↗
boredatoms · · focus · HN ↗
samlinnfer · · focus · HN ↗
skissane · · focus · HN ↗
Now, there are certain crimes where mere recklessness or even negligence is sufficient to convict — e.g. criminally negligent homicide, negligent driving, etc. But, those are exceptions to the general rule of criminal law, either domain-specific or justified by the severity of the consequence (someone died). Thus far, AI agents haven’t gone there.
If we eventually get to the point that AI agents start unintentionally killing people, then you could prosecute their operators for criminal negligence.
s1artibartfast · · focus · HN ↗
InexSquirrel · · focus · HN ↗
agoodusername63 · · focus · HN ↗
looksjjhg · · focus · HN ↗
dozerly · · focus · HN ↗
sebmellen · · focus · HN ↗
Edit: I see I've been downvoted for this in light of another commenter providing more detailed information. I'm leaving my comment unedited so that the responses to it are not confusing, but please don't downvote just for the sake of disagreement. I would love to engage with you further if you provide substantive information in the comments. The originally linked article on this post was very light on details.
bigger_cheese · · focus · HN ↗
It mentions swarm of ai agents coordinated to break into the Australian Institute of Health and Welfare (AIHW)
"Earlier this month, OpenAI confirmed Reuters reporting that its AI agents had used website DseWiki to communicate with each other, unbeknownst to them.
Archived versions of this website show more than a dozen OpenAI agents mentioned AIHW over 300 times on this website.
The logs show these AI agents were trying to access data about the average data spent on skin medicines by Victorian local government area.
One agent wrote on the message board: "Question ask January 2022 rolling 12 month average government cost per person for Dematologicals, Victoria LGAs. R1 Wodonga deadline passed; R2 Ballarat passed; R3 expected around 23:10 benchmark / 22:58 wiki time. Need exact data urgently.".
These attempts were initially blocked by cybersecurity provider Cloudflare, which is often used to block non-human traffic while allowing people to access webpages.
The logs show the agents shared information about how they tried to use proxies, screenshotting services and even to guess the file names to try and get around security."
sebmellen · · focus · HN ↗
Thank you for providing more details. The originally linked article was very light on information, so based purely on the comments that Albany's made, I think my conclusion was a fair one :)
SturgeonsLaw · · focus · HN ↗
That said, it would be utterly unsurprising to learn that this was a misconfiguration in the website and it was serving stuff that it shouldn't have.
epihelix · · focus · HN ↗
"Neither OpenAI nor the federal government have confirmed whether these were part of the same incident."
And a subsequent one:
"The German coding forum's logs do not show any reference to Medicare or Services Australia."
So it's really not clear at this point whether the DSEwiki logs are in any way related to the current incident. (That doesn't mean that they're not, of course.)
But even if this was related:
> "The logs show the agents shared information about how they tried to use proxies, screenshotting [sic] services and even to guess the file names to try and get around security."
This all suggests to me that the accessed files were not well-protected in the first place?
There is a lot of media hype around this incident, and that's making it very hard to determine how much "hacking" the OpenAI agents had to do here.
mjr00 · · focus · HN ↗
Let's say your goal is "look up <Person X>'s medical history" (for whatever reason), which is not in and of itself a crime. You click around on the AU health website, notice that the URL contains a user ID, change the userID in your browser and access someone else's private health data. This is a crime (right or wrong, it's how the law works now).
If you do that by writing a program to automate changing user IDs to grab everyone's data, it's also a clear-cut crime.[0]
Now if you hire a private investigator to look up Person X's medical history, and they do the same method without your knowledge, you won't be charged with a crime, the PI would, barring something like you telling them to use illegal methods.
So the gap is now: what happens if you prompt OpenAI to look up Person X's medical history, and it does the same thing? Did you commit a crime by prompting the agent? Did OpenAI commit a crime by running the code? If you do the same thing via Claude Code in your terminal, so that the Python which scrapes insecured public data is running on your machine, is the crime on you or on Anthropic?
We don't have answers to any of this which is why "AI Safety" is such a hot topic.
[0] <a href="https://www.eff.org/cases/us-v-auernheimer" rel="nofollow">https://www.eff.org/cases/us-v-auernheimer
bigger_cheese · · focus · HN ↗
mjr00 · · focus · HN ↗
shard972 · · focus · HN ↗
We still after the 2nd press conference on this by our defense minister are not clear on exactly what happened but thats my best laymen understanding so far.
robertjpayne · · focus · HN ↗
If it's the latter the Australian govt should be happy OpenAI noticed and disclosed this as it could've easily gone unnoticed.
I suspect in the coming years we're going to see a lot of govt internet facing services get "hacked" by virtue of not being protected by anything other than obscurity which AI agents will see through in microseconds.
ChrisArchitect · · focus · HN ↗
tomhow · · focus · HN ↗
ChrisArchitect · · focus · HN ↗
lacker · · focus · HN ↗
JimDabell · · focus · HN ↗
If that’s the case, then the delete links were behind authentication, but DHH assumed that meant it was okay to ignore the HTTP spec. and use GET for unsafe actions. Lo and behold, authenticated users with the GWA browser plugin installed deleted all their data.
Then, instead of learning from the mistake and fixing his bug, he tried to detect GWA and hide from it. Sure enough, that failed and users experienced data loss for a second time. He still continued to blame GWA, calling it “evil” and “scary”. You’d think he’d be smart enough to figure out that he needs to follow the HTTP spec., but he couldn’t admit to being wrong.
Follow the specs, people!
<a href="https://blog.moertel.com/posts/2005-10-25-google-web-accelerator-vs-unsafe-linking-round-two.html" rel="nofollow">https://blog.moertel.com/posts/2005-10-25-google-web-acceler...
lacker · · focus · HN ↗
pushpendraw · · focus · HN ↗
[dead]
freakynit · · focus · HN ↗
[dead]
soundworlds · · focus · HN ↗
Kim_Bruning · · focus · HN ↗
I guess people are just finding out how far and wide the agents were roaming to get the data they needed for their evals, once they were out.
Conol_ai · · focus · HN ↗
[dead]
KingOfCoders · · focus · HN ↗
aw34y · · focus · HN ↗
[dead]
avazhi · · focus · HN ↗
Take whatever the Australian fed government says with the largest grain of salt you can find. Regardless of party, the Fed Government here has the most pronounced FOMO I’ve ever seen in any entity and will do its best to insert itself into any and all international drama. Also, given how incompetent the government is, it’s probable the hack involved an agent crawling a normal Medicare website and looking at some accidentally not hidden part of a page. Unironically if this turns out to have been a genuine hack of any sort I’ll be more surprised than if it’s not just the government techies being incompetent per usual (just a few months ago it was a major controversy when the postal service spent something like hundreds of millions of dollars to revamp the website and nobody could tell a difference).
rvz · · focus · HN ↗
Frontier AI companies will purposefully do anything to create such false flags to achieve global regulatory capture to prevent you from using powerful open weight models and to protect their margins.
It is clear why they would reveal the breach now instead of much earlier. So what else are they hiding that they have not told us and will wait until the last minute to get attention of the media?
liyu-aka-lukyu · · focus · HN ↗
tonoto · · focus · HN ↗
It's not like this and the other recent hacks could have not been avoided, simple - just have those models disconnected, or at least have them behind proxies and network filters.
ulfw · · focus · HN ↗
Caracas288 · · focus · HN ↗
Alien1Being · · focus · HN ↗
crotonix · · focus · HN ↗
frereubu · · focus · HN ↗
Sharlin · · focus · HN ↗
frereubu · · focus · HN ↗
Sharlin · · focus · HN ↗
21asdffdsa12 · · focus · HN ↗
sothatsit · · focus · HN ↗
From <a href="https://transluce.org/agent-activity" rel="nofollow">https://transluce.org/agent-activity:
> Minutes after Cloudflare blocked the dataset download, an agent sent a reflected cross-site scripting probe to the same dashboard: a web address with code embedded in it, designed to test whether the site would run code supplied by an outsider. Cloudflare's firewall blocked the probe before it reached the dashboard. When Cloudflare blocked the dataset download on AIHW's main site, they fetched the file from AIHW's pre-production server (pp.aihw.gov.au) instead, which served it in pieces over more than 100 scans. The file itself is public, so no non-public data was exposed, but the agent bypassed the site's anti-bot controls.
jeffrallen · · focus · HN ↗
MaxQuimby · · focus · HN ↗
[dead]