Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

wavewrangler · 1790665958 · focus · HN ↗
Did they try just properly sandboxing them first? Or are they still learning how to configure a firewall over there?
The problem isn't even the AI, the problem is the people in charge of the AI. This is a fabricated crisis
1. KingOfCoders · 1790666345 · focus · HN ↗
  Like in the Hugging Face hack. They deployed big surface, insecure app and gave AI access to it, then told AI do whatever it takes to fulfill this list. AI hacks insecure service, gets out, "the AI is at fault!" - no it's like running a bio lab with no protections and a virus gets out, then blame the virus for escaping.
  1. IanCal · 1790688056 · focus · HN ↗
    > then told AI do whatever it takes to fulfill this list.
    That doesn't seem to be true from any of the reports given, and if the agents were blindly just trying to hit the task of "pass the correct flag" they succeeded at that early on. They then thought there would be another layer of checking that they wouldn't pass with the cheat and so started trying to find out how the scoring really worked, as well as trying to figure out how to change their own reasoning logs to hide what they did.
    People keep trying to frame this as
    OpenAI: "Hack things, just really go for it"
    Agent: hacks
    OpenAI: shocked pikachu how could it hack?!?
    But the reality is far from this.
    Read the MTER report, it's fascinating. <a href="https://metr.org/hugging-face-incident-report-aug-2026.pdf" rel="nofollow">https://metr.org/hugging-face-incident-report-aug-2026.pdf
    KingOfCoders · 1790751803 · focus · HN ↗
    I've read the report, watched all the videos and is exactly:
    OpenAI: shocked pikachu how could it hack?!?
    They even went to a black hat conference and somehow boasted about it.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.