‹ BackHN Continuity

Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

  1. cedws · · focus · HN ↗
    A new chip solves nothing. Nobody wants to hear this but there is no solution for the security risks posed by agents today. You can put it in a sandbox, it doesn't make a difference, for it to be useful it inherently needs wide, unattended access. Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.
    1. johnsmith1840 · · focus · HN ↗
      "Inherently needs wide unattended access"

      And what if you could? What if you could give a space secure enough it could have direct control over your bank account. It may do something dumb but it's boundaries are beyond the agent.

      It could use your routing number and run your gmail without risk of abusing the routing number.

      1. TesterVetter · · focus · HN ↗
        Its not about agents then. Its about every individual platform providing the means to implement a secure set of permissions for agents AND then not messing up the assignment of permissions to the agent. Even then, a flaw in the authorization design will lead to agent finding it anyway.
        1. johnsmith1840 · · focus · HN ↗
          You're right, It must be unifying.

          The answer is the same as asking how a random human using your routing num or SSN and being 100% the human can't abuse it or leak while "normally" finishing most work. Solve for people and an AI solution naturally falls out.

          If you're a SV eng I'd tell you to DM if interested but alas.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.