‹ BackHN Continuity

Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

  1. wavewrangler · · focus · HN ↗
    Did they try just properly sandboxing them first? Or are they still learning how to configure a firewall over there?

    The problem isn't even the AI, the problem is the people in charge of the AI. This is a fabricated crisis

    1. KingOfCoders · · focus · HN ↗
      Like in the Hugging Face hack. They deployed big surface, insecure app and gave AI access to it, then told AI do whatever it takes to fulfill this list. AI hacks insecure service, gets out, "the AI is at fault!" - no it's like running a bio lab with no protections and a virus gets out, then blame the virus for escaping.
      1. js8 · · focus · HN ↗
        And HF actually tried to use AI to understand what's going on, but they had to use "unsafe" Chinese models since the "safe" ones have been castrated and refused to help. Great plan with the watchdog chip!
        1. mosselman · · focus · HN ↗
          That is the totally irony.

          I was trying to get fable to analyse the security of my own app to make it safer, but then it started refusing me because of safety rules.

          So it CAN help me writing the code that needs to be checked in the first place, but it can’t help me clean it up and make it safer.

          1. mirmor23 · · focus · HN ↗
            > So it CAN help me writing the code that needs to be checked in the first place, but it can’t help me clean it up and make it safer.

            the thing with fable is so bad; for some project related questions, the model switches to opus to ensure safety with no further explanation.

            (due to llm non-delete clause) one time as i confirmed "that dir has been nuked", and it RESET the session and re-entered with opus :)

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.