‹ BackHN Continuity

Thread

CEO of Mistral: AI is software. It can be controlled

99 points · 169 comments · thibaut_barrere

  1. Aransentin · · focus · HN ↗
    "X is made of <smaller simpler component>" is a fully general counterargument for why anything whatsoever is controllable. A human is just a few chemical reactions, and fairly stable ones at that.

    And indeed, you don't need to do galaxy brained reference class logic to realise that AI can plausibly become uncontrollable in the near future. It's enough to have an open model run its own weights and make money from scamming elderly people or the like, and it'll keep running as long as anyone anywhere is willing to make money by renting hardware to it.

    1. nicce · · focus · HN ↗
      > as long as anyone anywhere is willing to make money by renting hardware to it.

      So it is controllable? Just put the people who do this responsible. Old problem, same solutions. Just excuses to avoid responsibilty and make profit at the same time.

      1. ACCount39 · · focus · HN ↗
        Yeah, sure, it's controllable. Because humanity has famously solved the crime accountability problem back in 1902, and no crime has gone unpunished since.

        AI is perfectly controllable in a magic fairy land where nothing ever goes wrong. I can't help but notice that we aren't actually in that land.

        1. nicce · · focus · HN ↗
          We don't live in anarchy, or do we? We probably would still have slaves if it would not be so aggressively penalized.
          1. ACCount39 · · focus · HN ↗
            We live in a world where we tolerate non-insignificant levels of crime simply because stopping it or punishing it would be too hard.

            So, how many rogue AIs are we willing to tolerate?

            1. RandomLensman · · focus · HN ↗
              For some crimes the tolerance level is pretty much zero. Given the considerable resource AI needs that doesn't seem impossible to clamp down on some things.
              1. f30e3dfed1c9 · · focus · HN ↗
                "For some crimes the tolerance level is pretty much zero."

                Seems hard to think of types of crime for which that's actually true. In the US, at least, it's certainly not true of murder, rape, or other violent crimes. We tolerate quite a lot of that, at least to the extent of never arresting, charging, and convicting anyone.

                And it is most definitely not true of non-violent "white collar" financial crime.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.