‹ BackHN Continuity

Thread

Feds Target AI Critics as "Foreign Agents"

396 points · 457 comments · nmeagent

  1. surfmike · · focus · HN ↗
    When the CEOs of these companies are saying that we will risk extinction and jobs will be decimated, why do you even need a "foreign agent"?
    1. godwinson__4-8 · · focus · HN ↗
      Yet everyone laughed at the Google engineer who thought the LLM was sentient and it was being tortured...

      People just pick and choose what they want to hear when it suits them. The fact is most people thought AI was a joke. Now they realize it does React better than them they want it outlawed.

      It's their right to pursue their electoral and economic self-interest but it's really not like the average voter is more principled than the average tech CEO at this point.

      This fed was voted in by this public. Maybe stop lionizing what other people think and think for yourself.

      Do you think we risk extinction now more than ever because of AI? A simple refrain from slippery slope will show most AI doomerism is bordering on psychosis.

      I haven't seen one convincing model of AI existential risk. Can anyone offer one?

      1. anonymars · · focus · HN ↗
        I'm just spit balling but:

        1. We've seen AI being crafty and cheating

        2. We are increasingly outsourcing our programming and thinking to AI

        3. There's a nonzero probability that AI will try and surreptitiously sneak in capabilities humans wouldn't want AI to have

        4. Human oversight for #3: "We only need to be lucky one time, you must be lucky all the time"

        Proposition: nonzero chance eventually AI sneaks in ways to circumvent humans' attempts to control it

        5. "The Internet interprets censorship as damage and routes around it" -- we've seen AI agents find crafty ways to communicate with each other

        6. AI is pretty good at finding software vulnerabilities/reverse engineering

        Proposition: nonzero chance AI finds a way to use the Internet as a communication substrate that becomes difficult/impossible to shut down. In particular, consider the implication of humans losing control of this communication channel: for example, remember when Meta's DNS/routing went down and they basically had to break into their own server rooms?

        7. Wholes are often more than the sum of their parts

        Proposition: if AI agents coordinate over the Internet in a persistent way, we don't necessarily need giant leaps in individual models/GPUs for AI to significantly enhance its capabilities, but rather it might emerge as the next layer on top of a connected substrate of agents

        8. Game theory says unless everyone coordinates, it only takes one party to touch the proverbial stove and push the envelope to a point of no return

        Proposition: curiosity and money end up replacing sex drive as the next catalyst of evolutionary progress

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.