‹ BackHN Continuity

Thread

The Download: why AI's latest breakthroughs and fears may be more hype than rea

49 points · 128 comments · joozio

  1. bananaflag · · focus · HN ↗
    > Describing them as “superintelligence” or “rogue models” ascribes agency to products rather than to the companies building them. This framing markets these companies’ products as “superhuman” and, at the same time, helps the companies evade accountability for their actions.

    If someone discovered how to summon demons to aid them in robbing banks the main issue wouldn't be "but who has the responsibility for the crime, the human or the demon", it would be "OMG DEMONS".

    Seriously, I don't get what sort of world these people are living in.

    1. rubendev · · focus · HN ↗
      That's not what the LLM hacking accidents have been like at all though. To improve the analogy, it would be like summoning a totally passive demon, giving it weapons and placing it next to a bank, place a small fence around it, and then command it to perform a totally safe "exercise" that is exactly like robbing a real bank.

      LLMs do not have agency, they are just producing tokens based on a prompt that a person entered, and some of these tokens can trigger the tools that a person gave them access to.

      1. Kiro · · focus · HN ↗
        A totally passive demon would still be "OMG DEMONS".
        1. ForHackernews · · focus · HN ↗
          We all agree the demons are cool and potentially dangerous. Chainsaws are pretty sick too.
        2. throwawayffffas · · focus · HN ↗
          Yeah in 2023 when the first passive demon was summoned, 3 years latter they would be serving you pastries.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.