‹ BackHN Continuity

Thread

CEO of Mistral: AI is software. It can be controlled

99 points · 169 comments · thibaut_barrere

  1. Aransentin · · focus · HN ↗
    "X is made of <smaller simpler component>" is a fully general counterargument for why anything whatsoever is controllable. A human is just a few chemical reactions, and fairly stable ones at that.

    And indeed, you don't need to do galaxy brained reference class logic to realise that AI can plausibly become uncontrollable in the near future. It's enough to have an open model run its own weights and make money from scamming elderly people or the like, and it'll keep running as long as anyone anywhere is willing to make money by renting hardware to it.

    1. smallerfish · · focus · HN ↗
      > A human is just a few chemical reactions, and fairly stable ones at that.

      And humans are controllable. Pump the system full of lithium and morphine, and your human becomes much more docile. You don't need to understand the full system in order to constrain it.

      1. whaaswijk · · focus · HN ↗
        So in the real world, what are the analogues to lithium and morphine we should feed to e.g. LLMS, how do we feed them, and how do we prove that it prevents unsafe behavior?
        1. orwin · · focus · HN ↗
          It's in the article, no? Mistral's new idea to control AIs? To give them a state basically? No one discuss the idea here, weirdly.
          1. whaaswijk · · focus · HN ↗
            Can you quote where in the article this is mentioned? I don't see it. I just see the assertion AI can be controlled without any substantive description of how.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.