Thread

1. WithinReason · 1790430559 · focus · HN ↗

   This is getting tiring. Watermarking has no effect on model output quality when implemented correctly. It's somewhat like swapping a random RNG seed to the seed 42, and detecting what the seed was from a random sequence. The sequence generated from the seed 42 is just as random as any other seed. There couldn't be a quality difference. And yes, the output from an LLM is a conditional random sequence of tokens from a distribution determined by a model.

   1. arcticbull · 1790430910 · focus · HN ↗

      Model companies are doing this for themselves anyways, it’s so they don’t feed generated content back into the slopper and collapse the model. From that angle it over time contributes to better model quality.

      1. charcircuit · 1790452748 · focus · HN ↗

         Feeding synthetic data made from the model does not cause collapse. Anthropic would not care about distillation if it just caused people's models to suck.

Unofficial Hacker News client; not affiliated with Y Combinator.