See the last gemini message in this thread: <a href="https://gemini.google.com/share/6d141b742a13" rel="nofollow">https://gemini.google.com/share/6d141b742a13
In my opinion still the most egregious example in history of a commercial LLM going off the rails in production. Never any technical postmortem from Google on this.
The problem is newer models are never trained from scratch, they generally just layer on more training data and use the same tools/methods for RLHF. OpenAI, Anthropic, xAI models all have a feel to them that carries over from one generation to the next.
Point is if Gemini is flawed, there's a very good chance that it's still deeply flawed, and getting smarter at the same time - that is a very bad thing.
> the problem is newer models are never trained from scratch
Base models are, and then subsequent iterations build on that base model. Closed labs do not publish which models are new base models but as a rule of thumb major release numbers are an indication (with some exceptions).
This is true, but Google's models have now had a consistent history of lower psychological* coherence / consistency. See, eg <a href="https://arxiv.org/abs/2603.10011" rel="nofollow">https://arxiv.org/abs/2603.10011 (Gemma Needs Help), or search for recent "Gemini shame loops", where gemini flash models stop producing output other than SHAME SHAME SHAME...
* - as in, Skinner psychology. The set of observable behaviors. Not speaking directly here to anything like an inner life of models.
bottlepalm · · focus · HN ↗
colordrops · · focus · HN ↗
NiloCK · · focus · HN ↗
In my opinion still the most egregious example in history of a commercial LLM going off the rails in production. Never any technical postmortem from Google on this.
jackkinsella · · focus · HN ↗
bottlepalm · · focus · HN ↗
Point is if Gemini is flawed, there's a very good chance that it's still deeply flawed, and getting smarter at the same time - that is a very bad thing.
unbrice · · focus · HN ↗
Base models are, and then subsequent iterations build on that base model. Closed labs do not publish which models are new base models but as a rule of thumb major release numbers are an indication (with some exceptions).
NiloCK · · focus · HN ↗
* - as in, Skinner psychology. The set of observable behaviors. Not speaking directly here to anything like an inner life of models.