Thread

AI companies in race to demonstrate their model most threatening to humanity

441 points · 399 comments · ljewalsh

chasd00 · 1790595720 · focus · HN ↗
I’ve never seen CEOs work so hard to make the public aware of how dangerous and out of control their flagship product is. It makes me automatically assume they’re scheming about something else like regulatory capture to protect their market.
1. meowface · 1790595788 · focus · HN ↗
  Or perhaps they've been saying this for literally decades because they earnestly believe it.
  1. chinathrow · 1790595979 · focus · HN ↗
    If they believe it, they can stop. All of them. There's no sign though that any pacing/slowdown or whatever is in place, zero.
    yes_man · 1790596917 · focus · HN ↗
    OpenAI claims to have paused the training of their ”most capable” models: <a href="https://apnews.com/article/ai-openai-anthropic-agents-rogue-hack-2f8a2b9024d4f06793bcca12f8089d20" rel="nofollow">https://apnews.com/article/ai-openai-anthropic-agents-rogue-...
    Of course I am not making an argument for them being honest as there could be entirely other reasons to a pause (like financial ones). Just pointing out ”no signs of pacing” is not true
    jquery · 1790606641 · focus · HN ↗
    If you read between the lines, that's not exactly a pause. That's just them lamenting that unsupervised training has temporarily hit a limit, and using that as yet another reason the industry needs to be regulated so that OpenAI, Claude, and MechaHitler are the only approved AIs.
    meowface · 1790606802 · focus · HN ↗
    Oh my god, we have these "it's regulatory capture!" populists even on HN now? I thought we were better than this.
    They want coordinated action to prevent a multipolar trap and potential catastrophe by future superintelligent AI (which may emerge quite rapidly if RSI ever hits an inflection point). It's not rocket science. The rules would apply to everyone. The rules they're advocating for are not "only OpenAI and Anthropic can make AI".
    jquery · 1790607920 · focus · HN ↗
    Give me a break. It's possible to actually think Eliezer Yudkowsky is a complete lunatic and his Roko's Basilisk essay should've been the end of him as a "thought leader" in the AI space. He has close ties to Altman, Musk, Thiel, and others, so as far as I'm concerned it's just an End Times cult.
    meowface · 1790610207 · focus · HN ↗
    You were misinformed about his response to Roko's basilisk. He never thought it was plausible. He freaked out for an unrelated meta reason, basically, and later admitted he overreacted. (Basically he did not want forum members putting attempted mindviruses out into the ether as a general principle.)
    Critics of Yudkowsky have been trying to misportray that for years to make him seem delusional. You can see an example of that here: <a href="https://www.tracingwoodgrains.com/p/reliable-sources-how-wikipedia-admin" rel="nofollow">https://www.tracingwoodgrains.com/p/reliable-sources-how-wik...
    (Roko himself is genuinely crazy, but largely because he became a neo-Nazi.)
    If you think ASI is plausible this century, you would have no reason to not fear the end times yourself. If you don't think it's plausible it'll be created this century or perhaps ever, fair enough, but I'd bet against that.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.