I’ve been trying to put my finger on what it is that is happening when the robot writes stuff like “3 campuses, one app” example, I’m glad the author was able to identify it as chat context leaking through.
The other version of it is the robot over-indexing on some part of the prompt and leaving comments places. An example is I ask it to prefer integration tests using TestContainers, it starts adding comments to every new test saying “Real services, no mocks” or something.
And yes, I have a line in my *.MD saying not to do that.
I think lots of AI tells these days are leaks from the ai/writer connection into text for the reader. It partly feels like the inevitable result of RLHF with the wrong human's feedback ("I did it! Pick me!") and partly feels like thinking tokens leaking into the main text.
"Here's the argument, in plain terms", "It's not just X, it's Y", "It's worth stating precisely", "The sharper distinction here"... They're things that gesture toward the relationship between the text and the prompt, making it clear where it matched the author's expectations and where it deviated.
Not that humans are immune from coding/writing for their boss instead of their user/reader!
weakfish · · focus · HN ↗
The other version of it is the robot over-indexing on some part of the prompt and leaving comments places. An example is I ask it to prefer integration tests using TestContainers, it starts adding comments to every new test saying “Real services, no mocks” or something.
And yes, I have a line in my *.MD saying not to do that.
unholiness · · focus · HN ↗
"Here's the argument, in plain terms", "It's not just X, it's Y", "It's worth stating precisely", "The sharper distinction here"... They're things that gesture toward the relationship between the text and the prompt, making it clear where it matched the author's expectations and where it deviated.
Not that humans are immune from coding/writing for their boss instead of their user/reader!