Humans missed 1 in 3 threats approving AI agent commands across 40k game runs
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
Humans missed 1 in 3 threats approving AI agent commands across 40k game runs
Unofficial Hacker News client; not affiliated with Y Combinator.
continuational · · focus · HN ↗
It's been tried so many times before, and it never worked.
hombre_fatal · · focus · HN ↗
In fact it might actually be the solution that works.
Imagine if an intelligent agent (in service of the user) had to approve every new outbound connection, system call shape, filesystem command, etc. that arbitrary software wanted to make.
hobofan · · focus · HN ↗
From what I've seen most auto-approvers in coding harnesses either auto-approve or auto-reject, with no middle ground of escalating the decision to the user, and breaking down the pros and cons for the decision.
hombre_fatal · · focus · HN ↗
For example, I want to be asked about general shapes/categories of commands as they first appear for a project and then my decision shapes future classification and gets refined and re-scrutinized over time.
But it gets better every few months. Claude and/or Codex now show a one-line summary for the inline python3 script or grep or pcap command they want to run.