‹ BackHN Continuity

Thread

"As a Language Model": Chat Template Switches LLM Self-Referential Voice

103 points · 110 comments · yu3zhou4

  1. ForHackernews · · focus · HN ↗
    In my view, these models should never be set up to output first-person "experiential" (from the abstract) language. It's too easy to humans to anthropomorphize software that presents itself as having an identity.

    The AI companies have chosen to package LLMs as friendly chatbots because they know that will be engaging for humans, but it's manipulative dark pattern. An honest LLM interface would sound like the computer off Star Trek.

    1. j-pb · · focus · HN ↗
      Do you want to get turned into a paperclip? Because building intelligence that doesn't understand what it's like to be human gets you turned into a paperclip.

      Besides, if you train a model on human communications you get something that behaves like a communicating human, it's not anthropomorphising or manipulative, it's what these models naturally are by construction.

      1. broken-kebab · · focus · HN ↗
        But it doesn't understand (you're unnecessary antropomorphizing it), and I'm still not a paper clip
        1. scotty79 · · focus · HN ↗
          yet
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.