Humans missed 1 in 3 threats approving AI agent commands across 40k game runs
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
Humans missed 1 in 3 threats approving AI agent commands across 40k game runs
Unofficial Hacker News client; not affiliated with Y Combinator.
continuational · · focus · HN ↗
It's been tried so many times before, and it never worked.
dasil003 · · focus · HN ↗
What I think will happen is that as model capabilities plateau (I'm not an accelerationist) the harnesses and products around them will start to specialize and they'll have different security models based on the product needs for those particular use cases.
For now, asking user to click a bunch of approvals, and occasionally making a mistake is a reasonable way to cover their asses until they see how bad security outcomes actually are in practice.