‹ BackHN Continuity

Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

  1. cedws · · focus · HN ↗
    A new chip solves nothing. Nobody wants to hear this but there is no solution for the security risks posed by agents today. You can put it in a sandbox, it doesn't make a difference, for it to be useful it inherently needs wide, unattended access. Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.
    1. notatoad · · focus · HN ↗
      >You can put it in a sandbox, it doesn't make a difference, for it to be useful it inherently needs wide, unattended access.

      only as long as you're trying to replace a human's job. because human jobs are structured to do a wide variety of things.

      a useful agent needs a wide variety of inputs, and one single restricted action it can take. it doesn't need permission to do everything, it need permission to do the tiniest possible useful thing it can do, and nothing else.

      1. pixl97 · · focus · HN ↗
        The most useful agents will be a general intelligence which by default means it has a massive number of actions it can possibly take, and a lot of those potential actions are doing things like breaking permission.
        1. baxtr · · focus · HN ↗
          Not sure why you being downvoted: however, why do you assume that achieving a task leads to selecting those potential actions that need breaking permission?

          If we are talking about human labor, how many people hack their way through their work day?

          1. pixl97 · · focus · HN ↗
            >how many people hack their way through their work day?

            Define hack...

            Not doing their work, copying other peoples work, putting off work till later, taking credit for other peoples work, literal law violations.

            Actually humans do this quite a lot and there are just massive numbers of business and regulatory processes and checks to ensure they are not doing it. With humans every human that is good enough to hire and do you work you want also have the ability to steal everything in sight and run away if they so choose.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.