Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

cedws · 1790611744 · focus · HN ↗
A new chip solves nothing. Nobody wants to hear this but there is no solution for the security risks posed by agents today. You can put it in a sandbox, it doesn't make a difference, for it to be useful it inherently needs wide, unattended access. Put a human in the loop and you just end up bottlenecking it and throwing away any purported productivity gains. Auto mode doesn't matter either, it's trivial to trick and for the agent to break out.
1. bob1029 · 1790612344 · focus · HN ↗
  I feel like we are missing many shades of grey in the middle.
  Semi-automation (human in the loop) can still result in a dramatic uplift in productivity. You can't run a combine harvester 100% autonomous but that doesn't stop anyone from trying to get as close to that limit as possible.
  1. inetknght · 1790612463 · focus · HN ↗
    > You can't run a combine harvester 100% autonomous
    I'm curious why you think that.
    trollbridge · 1790646666 · focus · HN ↗
    Run a combine and you’ll see.
    Similar to problem to how 100% autonomous vehicles don’t exist, yet. There are too many edge cases.
    Get to 99% first.

Unofficial Hacker News client; not affiliated with Y Combinator.