I’ve been trying to put my finger on what it is that is happening when the robot writes stuff like “3 campuses, one app” example, I’m glad the author was able to identify it as chat context leaking through.
The other version of it is the robot over-indexing on some part of the prompt and leaving comments places. An example is I ask it to prefer integration tests using TestContainers, it starts adding comments to every new test saying “Real services, no mocks” or something.
And yes, I have a line in my *.MD saying not to do that.
I just used Opus 5.5 for something other than coding, and after about a dozen chat messages (some of which were genuinely amazing), it got LLM brainrot, and started suggesting dumb, irrelevant stuff, ignoring previously established facts, and talking in PR doublespeak.
weakfish · · focus · HN ↗
The other version of it is the robot over-indexing on some part of the prompt and leaving comments places. An example is I ask it to prefer integration tests using TestContainers, it starts adding comments to every new test saying “Real services, no mocks” or something.
And yes, I have a line in my *.MD saying not to do that.
torginus · · focus · HN ↗