‹ BackHN Continuity

Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

  1. cedws · · focus · HN ↗
    A new chip solves nothing. Nobody wants to hear this but there is no solution for the security risks posed by agents today. You can put it in a sandbox, it doesn't make a difference, for it to be useful it inherently needs wide, unattended access. Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.
    1. nicce · · focus · HN ↗
      > Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.

      Productivity gains are still enormous compared to what we used to do before agents. But, I know that people don't want to stop there.

      1. realusername · · focus · HN ↗
        > Productivity gains are still enormous compared to what we used to do before agents.

        My own productivity yes but if I step back and look at a company scale, the productivity gains has been negative for our company as a data point.

        We are now shipping less and with a lower quality.

        1. intended · · focus · HN ↗
          V/G, the ration of verification and generation capacity is borked in AI using firms now.

          It’s not an issue of only more generation, it’s an issue of how much generation outstrips capacity to verify generated content.

          Unlike spam, you can’t filter out and bin the stuff a colleague is sending you.

          So individual productivity is up, while the costs of checking and processing generated content shifted to the rest of the org.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.