Thread

Humans missed 1 in 3 threats approving AI agent commands across 40k game runs

208 points · 169 comments · Wirbelwind

continuational · 1786022679 · focus · HN ↗
It's kinda funny there is still software coming out whose security model is "constantly ask the user for permission, and hope they never make a mistake".
It's been tried so many times before, and it never worked.
1. est31 · 1786022931 · focus · HN ↗
  I think it's partially for responsibility reasons. Your employee approved the bash call? not our fault then!
  1. grndn · 1786032203 · focus · HN ↗
    Or in one of my favorite coinages: "Moral Crumple Zones". "Just as the crumple zone in a car is designed to absorb the force of impact in a crash, the human in a highly complex and automated system may become simply a component—accidentally or intentionally—that bears the brunt of the moral and legal responsibilities when the overall system malfunctions." See <a href="https://ferd.ca/notes/paper-moral-crumple-zones.html" rel="nofollow">https://ferd.ca/notes/paper-moral-crumple-zones.html
    Terr_ · 1786043431 · focus · HN ↗
    [delayed]

Unofficial Hacker News client; not affiliated with Y Combinator.