‹ BackHN Continuity

Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

  1. cedws · · focus · HN ↗
    A new chip solves nothing. Nobody wants to hear this but there is no solution for the security risks posed by agents today. You can put it in a sandbox, it doesn't make a difference, for it to be useful it inherently needs wide, unattended access. Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.
    1. nicce · · focus · HN ↗
      > Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.

      Productivity gains are still enormous compared to what we used to do before agents. But, I know that people don't want to stop there.

      1. realusername · · focus · HN ↗
        > Productivity gains are still enormous compared to what we used to do before agents.

        My own productivity yes but if I step back and look at a company scale, the productivity gains has been negative for our company as a data point.

        We are now shipping less and with a lower quality.

        1. 8n4vidtmkvmk · · focus · HN ↗
          How are you shipping less?

          I believe the lower quality but is quality so bad you are afraid to ship it now?

          1. realusername · · focus · HN ↗
            AI also had a negative impact on the CI and on time spent to review code & documents so because of that, we're also shipping less
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.