Thread

OpenAI Says It Will Not Release Newest A.I. Model Over Safety Concerns

62 points · 100 comments · jbegley

fallingfrog · 1790644582 · focus · HN ↗
Lots of people seem to have the bizarre opinion that companies like openai declare their own products to be unsafe as some kind of marketing stunt.
Ok- so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive? If the company did that do you imagine it would be good for business?
I'm trying to understand the logic here.
1. cobbzilla · 1790644669 · focus · HN ↗
  Because no car company would ever announce they had an unsafe car. They’d fix the problem and announce an awesome car.
2. alexfortin · 1790644689 · focus · HN ↗
  Hype: you tell the world you alone have a very powerful and potentially dangerous product, and you're the only one who can be trusted keeping it safe.
3. RunSet · 1790644916 · focus · HN ↗
  I would consider it more "bizarre" to assume that Sam Altman was telling the truth about anything.
  <a href="https://web.archive.org/web/20240112010809/https://www.sfchronicle.com/bayarea/article/sam-altman-fired-openai-candid-board-18499330.php" rel="nofollow">https://web.archive.org/web/20240112010809/https://www.sfchr...
4. zmgsabst · 1790645355 · focus · HN ↗
  There are cars that market based on only being track legal — and even more that market on requiring being tuned down for street safety.
  Most sports cars do the second, exactly like OpenAI.
5. kennywinker · 1790645362 · focus · HN ↗
  At the moment, their main "customer" is investors, not users. But even users want to use the most dangerous model, because dangerous is just another word for powerful.
  Sports cars are advertised with how fast they can accelerate from time to time, or tesla's "ludicrous mode" - that is them advertising how dangerous it is.
6. symfoniq · 1790645527 · focus · HN ↗
  Car companies sell mostly the same car every year. They don’t have billions (or trillions) of dollars of debt riding on the next model they release being substantially better and cheaper (closer to profitability) than the previous one.
  These AI companies have been selling AGI as coming any day for a while now. If it doesn’t arrive soon, the safety angle may be the only spin that keeps the massive (and required) investments pouring in.
  If instead the narrative became that LLM progress was slowing, we’d almost certainly be looking at the next global recession.
  At this point, there is too much money in AI for the truth to have much of a chance.
  1. symfoniq · 1790651162 · focus · HN ↗
    And adding to this:
    Does anyone really believe that the first company to AGI would decide not to release it in the interests of safety? Of course not. The first company to AGI would not forfeit their historic opportunity.
    Yet, we are supposed to believe that in the name of safety, far less capable models are being held back by the very very same companies that are selling the AGI dream.
    This is an industry that cannot speak, unless it is speaking out of both sides of its mouth.
7. adfgaiu · 1790646071 · focus · HN ↗
  Motorcycle manufacturers have been known to do so. Riding a motorcycle is thrilling in part because it is dangerous. The fact that powerful motorcycles are so difficult to control that most people have no business owning one is absolutely used to make them sound cool and desirable.
  For instance, this article repeatedly mentions danger and the need for absolute focus and control:
  <a href="https://www.triumphmotorcycles.co.uk/for-the-ride/news/inspiration/fueled-by-light-20-05-2025" rel="nofollow">https://www.triumphmotorcycles.co.uk/for-the-ride/news/inspi...
  There is also a parallel (though not a very close one) to "pacing the frontier": there's a gentleman's agreement that limits the top speed of motorcycles to 300 kph (186 mph).
8. viraptor · 1790646225 · focus · HN ↗
  Different type of business. Many car companies release new cars showing you how much more powerful and implied dangerous they are. Both in capabilities and design style. In the US (other places too , but especially) they also get much bigger with less visibility which gets double dangerous. But the sentiment they're going for is pretty close - "you want this powerful thing, don't you?"
  1. adfgaiu · 1790646301 · focus · HN ↗
    >In the US they also get much bigger with less visibility.
    Those are usually presented as an improvement in safety. And they are—for the people inside. Not so much for everyone else.
9. Dylan16807 · 1790646556 · focus · HN ↗
  > so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive?
  How about we actually try to make it sound cool? They're not releasing the new car because the horsepower was too much, they need more time to get it under control.
  I could easily see a car company doing that.
  1. RunSet · 1790652644 · focus · HN ↗
    "Drink responsibly."
10. antihipocrat · 1790647027 · focus · HN ↗
  Because they declare that their product is unsafe regularly, which gains massive exposure on every news outlet worldwide, then they release the model anyway with zero negative repercussions.
  What's with so many people using bad analogies to try and explain simple topics?
  Last time this happened: GPT - 4 <a href="https://www.theguardian.com/technology/2023/mar/17/openai-sam-altman-artificial-intelligence-warning-gpt4" rel="nofollow">https://www.theguardian.com/technology/2023/mar/17/openai-sa...
11. zugi · 1790647269 · focus · HN ↗
  It's perfectly safe for YOU, the CUSTOMER.
  It's just so powerful that, like, the WORLD can't handle it, man!
12. kipper89 · 1790647359 · focus · HN ↗
  Why do you think they would announce this then?
  They know what they're doing, even if you don't.
13. protocolture · 1790650407 · focus · HN ↗
  Considering that the venn diagram of AI safety gooners and OpenAI is a circle, and that these idiots are starting to worship this stuff as a religion, expecting rational action from them is kind of ludicrous. For all we know Aella promised them a gangbang if they delayed the model a week.
14. wbxp99 · 1790650885 · focus · HN ↗
  I think your inclination to take them at face value is the bizarre behavior
15. NichoPaolucci · 1790653670 · focus · HN ↗
  (Not saying that it is a marketing stunt, though they said the same thing about GPT-2).
  I think the marketing stunt portion is more that the technology is "too powerful". It's just TOO good. It's so intelligent we couldn't possibly give it to the public! This message, to anyone who's using AI, means that there's something even BETTER than the one they're currently using.
16. [deleted] · 1790654803 · focus · HN ↗
  [deleted]
17. fallingfrog · 1790658455 · focus · HN ↗
  Okay. I see what is going on here. You are all operating from the deeply held belief that it is inconceivable that a machine can be made that can do every cognitive task a human can do.
  And it is very, very important that you understand that that belief is not a rational belief. It is a defense mechanism. People don't want to believe things that are scary, so they make up rationalizations to be able to believe what they want to believe.
  And honestly, all of you are right on the edge of full blown conspiracy theory thinking patterns, imagining that this is all some 4D chess marketing or something. I like to recall this quote by Alan Moore on conspiracy theories:
  "The main thing that I learned about conspiracy theory, is that conspiracy theorists believe in a conspiracy because that is more comforting. The truth of the world is that it is actually chaotic. The truth is that it is not The Iluminati, or The Jewish Banking Conspiracy, or the Gray Alien Theory.
  The truth is far more frightening - Nobody is in control.
  The world is rudderless."
  And that's the actual truth of what is happening here. As vulgar and low as the people in charge of these companies are, they are also stupid humans like us flailing around in the dark. Nobody is in control. Nobody has any grip on this technology. Nobody knows how dangerous it might be. Hugging face was a warning shot; we may not get another. Humans are not the smartest thing imaginable; we are quite stupid. We are just barely above the threshold of consciousness. Machines of far greater power are possible.
  1. bschwindHN · 1790663469 · focus · HN ↗
    lol just unplug the computer and go outside

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.