Thread

OpenAI still doesn't seem to have a handle on all of its rogue AI activity

108 points · 113 comments · mikelgan

nazgulsenpai · 1790617605 · focus · HN ↗
IMO it's because they don't want to handle their rogue AI activity. They want regulation around AI where they will inevitably be the beneficiaries even if they are the initial target. They can then lobby regulation in their favor and make the barrier of entry to competitors impossible.
1. intended · 1790621680 · focus · HN ↗
  IMO its because they can't handle rogue activity.
  In the cases that I have seen covered, the AI just paper clip maximized its way to success. It has no morality / larger motivational structure. It just kept token predicting its way to wards whatever goal it was tasked with.
  Model versions which gave up were discarded, leaving the ones that get to success on long horizon tasks.
  Just because its a computer program, doesn't mean they can actually make it not go rogue.
  Sure you can add more telemetry, have better observation, but there is no fundamental barrier that can be implemented that ensures an AI won't go rogue.

Unofficial Hacker News client; not affiliated with Y Combinator.