Thread

"As a Language Model": Chat Template Switches LLM Self-Referential Voice

103 points · 110 comments · yu3zhou4

Izmaki · 1790508818 · focus · HN ↗
"As a Language Model..." is one of the beginnings of a sentence I hate the most from LLMs and is the reason why I support free (as in "Liberty"), local models. I'm well aware that it is not a doctor and cannot replace a real doctor with multiple years of experience, I don't need to waste braincell activity on reading that it "as a Language Model" cannot give a precise diagnosis and that I should ask a real doctor - all I want to know is if I what I experience justifies either A) ER, B) 3-4 weeks scheduled doctors appointment or C) two paracetamol and a nap.
I don't want "jailbroken" LLMs to commit crime. I want them to avoid having this vendor-specific "bloatware" all over the product I'm using.
1. Anduia · 1790510825 · focus · HN ↗
  Be careful there. LLMs may be good at identifying a condition based on a description of the symptoms, but they are much worse at recommending the correct course of action (getting it wrong half of the time).
  [0] <a href="https://www.nature.com/articles/s41591-025-04074-y" rel="nofollow">https://www.nature.com/articles/s41591-025-04074-y
  1. Izmaki · 1790511173 · focus · HN ↗
    ...I know, which is why "as a Language Model and not a real doctor" is a pointless comment to start off with. It should simply not recommend treatment if it's not sure it is correct. I wouldn't blame it or anyone if they asked for help treating a stiff neck, and the LLM (or your neighbor or parent or spouse) suggested light exercises to help relieve it - and do not jump to the suspicion that you may have meningitis.
    As a Human, I do not need to know it is a Language Model.
    jester997 · 1790511552 · focus · HN ↗
    Yeah it should just state thing it means. But then again, there’s psychological impacts on society that we must be careful. For instance, teenagers talking to AI. If the AI just talks, people already start to feel real connections to the seemingly human entity. Maybe it’s better to disclose the reality up front?
    Izmaki · 1790511932 · focus · HN ↗
    Would it be so bad that lonely people can have a real friend that they can bring everywhere they go and even share its passion with through vision and audio? We don't want destructive friends encouraging us to do bad things, but a real 'buddy', somebody who always has our best well-being in its interests?
    Would it matter if this digital friend is not a real human behind a computer screen, but a Language Model in a data center?
    I guess it falls into a similar category as buying "special performances to satisfy certain urges". It probably feels close to the real thing (I wouldn't know, I've never tried - promise! :P), but it's never the same as love.
    nvme0n1p1 · 1790513429 · focus · HN ↗
    > We don't want destructive friends encouraging us to do bad things, but a real 'buddy', somebody who always has our best well-being in its interests?
    GPUs are not people, and generated tokens can't have interest in a person's well-being. If you try to pretend otherwise, the results are not great. <a href="https://www.cnn.com/2025/11/06/us/openai-chatgpt-suicide-lawsuit-invs-vis" rel="nofollow">https://www.cnn.com/2025/11/06/us/openai-chatgpt-suicide-law...
    hardbass · 1790520880 · focus · HN ↗
    I wish I didn't have to keep asking this question, but do you believe in souls?
    nvme0n1p1 · 1790524977 · focus · HN ↗
    We should treat AI that recommends suicide to teenagers the same as we would treat a therapist recommending suicide to teenagers. I don't care if either/both/neither have souls.
    hardbass · 1790533117 · focus · HN ↗
    Still, in any case, do you believe in souls?
    nvme0n1p1 · 1790537490 · focus · HN ↗
    THERE IS AS YET INSUFFICIENT DATA FOR A MEANINGFUL ANSWER.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.