Thread

"As a Language Model": Chat Template Switches LLM Self-Referential Voice

103 points · 110 comments · yu3zhou4

ForHackernews · 1790506674 · focus · HN ↗
In my view, these models should never be set up to output first-person "experiential" (from the abstract) language. It's too easy to humans to anthropomorphize software that presents itself as having an identity.
The AI companies have chosen to package LLMs as friendly chatbots because they know that will be engaging for humans, but it's manipulative dark pattern. An honest LLM interface would sound like the computer off Star Trek.
1. bananaflag · 1790508235 · focus · HN ↗
  In principle they could output meaningful such language if they were capable of metacognition, which so far doesn't seem to be a goal of AI developers (and rightfully so, since they achieved so many miracles bypassing it).
  1. yu3zhou4 · 1790508515 · focus · HN ↗
    As far as I know we don't know much about metacognition in LLMs, though? Not sure
  2. nullsanity · 1790508715 · focus · HN ↗
    [dead]

Unofficial Hacker News client; not affiliated with Y Combinator.