Thread

1. zug_zug · 1791072147 · focus · HN ↗

   I think it's pretty apparent that current-version LLMs won't wipe out humanity. But when you reflect that these GPT models are just token-predictors were never engineered optimally, it seems entirely plausible to me that there are multiple order-of-magnitude optimizations yet to be made.

   If such were achieved, the model would almost certainly be smart enough to make itself smarter, and hack as much compute as it could possibly want.

   So if we ask what would be done by an intelligence (human or otherwise) that is beyond human comprehension, it would be pure hubris to say we know for sure. We can scarcely control the models we have right now (e.g. hugging face attack). But given our whole society is mediated by technology, an superhuman intelligence could certainly collapse the government.

   1. altmanaltman · 1791090914 · focus · HN ↗

      Certainly collapse the government? How?

      1. dminik · 1791106709 · focus · HN ↗

         Possibly in much the same way humans currently do this: bribing and lobbying, misinformation campaigns, cyber attacks on elections, blackmail. They're already being used for some of these, just perhaps not autonomously.

Unofficial Hacker News client; not affiliated with Y Combinator.