‹ BackHN Continuity

Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

  1. cedws · · focus · HN ↗
    A new chip solves nothing. Nobody wants to hear this but there is no solution for the security risks posed by agents today. You can put it in a sandbox, it doesn't make a difference, for it to be useful it inherently needs wide, unattended access. Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.
    1. nicce · · focus · HN ↗
      > Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.

      Productivity gains are still enormous compared to what we used to do before agents. But, I know that people don't want to stop there.

      1. realusername · · focus · HN ↗
        > Productivity gains are still enormous compared to what we used to do before agents.

        My own productivity yes but if I step back and look at a company scale, the productivity gains has been negative for our company as a data point.

        We are now shipping less and with a lower quality.

        1. 8n4vidtmkvmk · · focus · HN ↗
          How are you shipping less?

          I believe the lower quality but is quality so bad you are afraid to ship it now?

          1. krageon · · focus · HN ↗
            You cannot ship things that don't work unless you work for Microsoft or Oracle or I guess IBM
            1. hdjrudni · · focus · HN ↗
              I guess, but why are you even submitting/merging code that doesn't work? Like how does it even get that far that you're blocking other people from getting stuff done?

              I guess I won't deny that we've had more build breakages than usual over the past couple months but they get resolved super quick. We don't hesitate to roll broken code back if something manages to slip in.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.