‹ BackHN Continuity

Thread

AI has no intent and no motivation

48 points · 61 comments · aquastorm

  1. wccrawford · · focus · HN ↗
    I feel like that's like saying amoeba have no intent and no motivation. Or plants.

    And those cause quite a bit of damage.

    AI has all the intent that we gave it, and we continue giving it. That's always been the fear. Not that it will randomly wipe out humanity.

    The fear is that it will decide to do that, with a purpose. Whether we tell it to protect us and it goes too far, or it decides that it can't achieve the purpose we gave it because we'll interfere and it removes that interference...

    The fear is that we will set it on that path and can't stop it.

    I'm sure there have been some scifi books that have it just be random, but they're far, far less worrisome.

    1. singularity2001 · · focus · HN ↗
      AI has all the intent that we gave it. I'd go a bit further and say it has the intent that it develops through the context, which may not be intended by any human if the context grows 'organically' from the environment. So yes, I strongly disagree with the OG and I'd say they do have an intent encoded in their states.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.