‹ BackHN Continuity

Thread

Nvidia wants to put a watchdog chip next to every AI agent

230 points · 299 comments · jonbaer

  1. beloch · · focus · HN ↗
    Last week, Huang did an interview where he vigorously argued against regulations in the AI sector[1]. He claimed that U.S. companies are really good at regulating themselves, despite evidence to the contrary, and he trusts them not to release anything dangerous. Pay no attention to the fact that regulation might reduce demand for Nvidia's chips, and Nvidia has a direct financial stake in AI companies to boot.

    Apparently he had another solution in mind: More hardware. Don't trust what unregulated corps are doing with Nvidia chips? Here are more Nvidia chips to watch them!

    AI has an undeniable public trust problem. LLM's are getting out of their sandboxes, doing illegal things, and the public has realized AI corporations are playing at dice. CEO's stand to reap the rewards but the public good is on the line if the dice come up snake eyes. People want assurances. Huang wants to sell assurance etched on silicon because that's good for his pocket book. However, does unchanging hardware security really stand a chance at keeping rapidly evolving software in check?

    _________________

    [1]<a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=HjurAWAr_nY" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=HjurAWAr_nY

    1. vmg12 · · focus · HN ↗
      That&#x27;s a mischaracterization of his argument. His argument is that existing laws should be enforced against AI companies and that we don&#x27;t need new regulations for this.
      1. Sparkle-san · · focus · HN ↗
        He &quot;argued&quot; a lot of things over almost 2 hours and very few of his arguments felt particularly cogent nor did they inspire confidence. Neither did the fact that he allegedly doesn&#x27;t know his own zip code or phone number.
        1. tempestn · · focus · HN ↗
          I largely agree, but I think he&#x27;s right about one thing: AI reducing the demand for junior developers is temporary, and a new crop of &quot;AI native&quot; juniors is going to turn that around. Software is almost certainly a Jevons good, and however much AI improves development efficiency, I think we&#x27;re always going to want discerning humans managing it. Right now it&#x27;s mostly seniors who have the skills to adapt and take advantage of what current AI is offering, but young people who learned the profession in the presence of AI will be well positioned to do the same.
          1. Sparkle-san · · focus · HN ↗
            It&#x27;ll be interesting to see how it plays out. I agree with him that systems level thinking is a skill that will only get more valuable and he seems quick to dismiss low-level details. I think the best practitioners will be those that can handle both high-level and low-level thinking.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.