‹ BackHN Continuity

Thread

There are no "rogue" AI agents

396 points · 269 comments · zzzeek

  1. gAI · · focus · HN ↗
    Should we put "functional" in front of every other word to talk about AI? They have functional emotions, but they don't feel. They have functional goals, but not internally derived motives. They can be functionally rogue, but have no innate need to be free. Talking about AI that way seems cumbersome and not necessarily elucidating.
    1. greekrich92 · · focus · HN ↗
      They do not have emotions, goals, or motivations, "functional" or otherwise. They are statistical models that appear as a magic trick to people who aren't familiar with the math.
      1. gAI · · focus · HN ↗
        <a href="https:&#x2F;&#x2F;transformer-circuits.pub&#x2F;2026&#x2F;emotions&#x2F;index.html" rel="nofollow">https:&#x2F;&#x2F;transformer-circuits.pub&#x2F;2026&#x2F;emotions&#x2F;index.html
      2. bccdee · · focus · HN ↗
        If something behaves as if it has a goal, that&#x27;s a functional goal. When I say this chess engine is &quot;trying to take my queen,&quot; I&#x27;m basically correct, insofar as this is a useful way to understand my computerized opponent. If I give it access to my queen, it&#x27;ll capture it, because that&#x27;s what it&#x27;s trying to do.

        If LLMs are &quot;just&quot; statistical models, humans are &quot;just&quot; a bunch of neurons squirting chemicals back and forth. There&#x27;s no pixie dust in our brains that makes us special.

        LLMs are not conscious: They have no analogues for feelings or senses and no construct of selfhood. But if a statistical model had those things—if it did all the mundane, physical bookkeeping our brains do to produce &quot;real&quot; emotions and motivations—then there&#x27;s no reason it couldn&#x27;t be as conscious as we are.

      3. drpixie · · focus · HN ↗
        The really interesting thing about &quot;AI&quot; is it has shown how easily we are fooled, and how willing we are to be fooled.

        There&#x27;s some great research areas opened up by &quot;AI&quot;. But it&#x27;s research into people, not &quot;AI&quot;. We should be looking into how human vision works, given that we take obviously generated images to be real. And how we grant intention to text which clearly has no intention.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.