‹ BackHN Continuity

Thread

CEO of Mistral: AI is software. It can be controlled

99 points · 169 comments · thibaut_barrere

  1. amelius · · focus · HN ↗
    I've started to wonder why the big AI labs have no robotics yet, and I'm thinking now the reason why we don't see robots is because they want us (the general public) at all costs to not freak out. Imagine what would have happened if we had 6ft tall "friendly" robots marching through the streets, and suddenly the news came about of AI going rogue, like what we've seen from the recent hacks ... I bet it would have been the end of the story for AI labs right away (of course not for AI, because the department of defense would take over).
    1. embedding-shape · · focus · HN ↗
      > suddenly the news came about of AI going rogue, like what we've seen from the recent hacks

      Commented on a story about how these agents didn't go rogue at all, since it's fucking software run by humans, obvious to most of us except the people who freak out.

      Someone really needs to be held responsible for the testing that lead to 3rd party infrastructure getting hacked by the software they wrote, using prompts they wrote.

      1. tavavex · · focus · HN ↗
        You're reading too much into the words and too little into the meaning. Right now the general public sees those incidents are 'going rogue'. If that happens with robots, no matter if it's the AI lab's fault or not, it will again be spun as rogue AI and will cause the kind of outrage OP mentioned. Imagine if one of the labs deploys a few experimental robots into a city and tells them to "look for suspicious behavior and locate crime" which seems like exactly the kind of thing they would do. When the robots start disfiguring people in the streets so they couldn't escape before the police arrives, of course the first words out of the AI lab will be "this is a misalignment accident, the AI itself went rogue, we're 'so sorry' but we couldn't predict or control this at all".
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.