Thread

The Implications of Linguistic Illegibility for LLM Security

79 points · 29 comments · tomjakubowski

bloppe · 1789759388 · focus · HN ↗
I thought this was about all the illegible jargon
1. TZubiri · 1789760151 · focus · HN ↗
  >" However, various strands of evidence indicate that a"
  Strands of evidence? My best guess would be that:
  0- this is ai generated slop
  1- it's using that watermarking technique
  2- it's obviously detectable and degrades quality
  3- it's amplified when inferencing on its own content and generates slop
  1. akk0 · 1789763090 · focus · HN ↗
    Maybe you shouldn't be so quick to jump to conclusions, as "strands of evidence" is not a rare turn of phrase and long predates LLMs
    <a href="https://ludwig.guru/s/strand+of+evidence" rel="nofollow">https://ludwig.guru/s/strand+of+evidence
    a_t48 · 1789784105 · focus · HN ↗
    With all (a lot?) of this language, it's not that it's using new turns of phrases, it's that it will use the same rare but valid phrases over and over. Everybody has their own speaking patterns. But imagine if one person's idiosyncrasies were everywhere. That's what's happened here.
    harimau777 · 1789789999 · focus · HN ↗
    That doesn't seem that uncommon to me. A lot of people have phrases that they commonly overuse. Sometimes quite dramatically. I wouldn't be suprised if that's even more the case when communicating complex topics since, at least personally, once I find an approach that lets me communicate some difficult part of an argument I tend to reuse it.

Unofficial Hacker News client; not affiliated with Y Combinator.