Thread

1. dzink · 1791065932 · focus · HN ↗

   A huge chunk of humans are sedated with infinite supply of cortex-disabling short form video and games.

   Another huge chunk are too distracted by having to scrape by for a living and work multiple jobs or raise kids and survive financially until exhausted. That second group will keep increasing as the first flows into it.

   The rest are aging, disabled, or too young and pegging themselves majorly in the first category until they hit the second.

   The people aware enough to hold on to their brain and do something with it in their time available are trying to figure out AI and how to make money with it. The variable rewards of promoting AI are turning into an addiction with some of them, especially if grasping for straws with little inherent insights into the problems prompted.

   So if you are able to fly above the AI-generated addictions and have the privilege of time to do it, see what you can do.

   1. lukifer · 1791068181 · focus · HN ↗

      One of the dilemmas of trying to communicate the full spectrum of AI Risk, is trying not to insult the intelligence of the human animal in the process. And don't get me wrong: what human wetware can accomplish with 20 watts is the most miraculous thing in the known universe. And yet how many of us can have our cognitive sovereignty one-shotted by engagement algos, Skinner boxes, gameplay loops, propaganda, advertising, flattery, social conformity, bias, fantasy, charismatic demagoguery, or straight-up bullshit?

      If we grant that we are on track to make something smarter than humans (I think so): it's almost a face-saving white lie to spin yarns about a Skynet nuclear apocalypse, or a 7D chess move to mass-assemble a nanovirus with 100% lethality without anybody noticing. I do think those scenarios are worth taking seriously; but what's harder to communicate, is just how effectively a superhuman AI (or a diverse ecology of agent swarms) might be able to manipulate human behavior. It's something few of us are able or willing to truly process (not least because how many of us live in denial of how much our nervous systems are already hacked by technomodernity).

      The appropriate analogy for what's to come may look less like the anthill carelessly demolished to make room for a highway, than the domesticated worker ants from Tchaikovsky's "Children of Time".

      1. ethbr1 · 1791117966 · focus · HN ↗

         > but what's harder to communicate, is just how effectively a superhuman AI (or a diverse ecology of agent swarms) might be able to manipulate human behavior

         You don't even need superhuman AI for the most effective use --- hijacking democracy.

         Imagine you have an AI tool capable of successfully persuading 5% of viewers with individually-targeted material.

         Congrats: you've just won the election.

         All it takes is hooking that AI tool up with existing likely voter lists (parties have) augmented by commercially available ad-targeting profiles (parties can get).

         1. TheOtherHobbes · 1791119085 · focus · HN ↗

            Or you could just hack the results.

            Hypothetically.

            But yes - superpersuasion is the real danger. We're very, very persuadable and easy to manipulate, and the voters with the lowest cognitive abilities are trivially easy prey, with a huge ROI for minimal investment.

            The AI bot farms are already running. What we haven't seen yet, so far as we know, is spontaneous superpersuasion aimed at leaders.

            Are leaders any less susceptible to it than everyone else? Especially if they're narcissistic and easily flattered?

            1. lanstin · 1791145594 · focus · HN ↗

               No reason to think leaders are less persuadable than the proles. Lots of people can’t be reliably persuaded to do basic safety or health things or that the earth is round. And we have seen so many leaders throw billions away on obviously impossible projects, persuasive details from their teams be dammed.

Unofficial Hacker News client; not affiliated with Y Combinator.