See the last gemini message in this thread: <a href="https://gemini.google.com/share/6d141b742a13" rel="nofollow">https://gemini.google.com/share/6d141b742a13
In my opinion still the most egregious example in history of a commercial LLM going off the rails in production. Never any technical postmortem from Google on this.
From the example alone it's hard to say that a postmortem would be useful. It could be context poisoning by an adversarial user, memory corruption etc.
It's useful from a disclosure and trust perspective.
If I remember correctly, it was in fact possible to manually inject chat context at the time, which would have made spoofing something like this completely possible.
bottlepalm · · focus · HN ↗
colordrops · · focus · HN ↗
NiloCK · · focus · HN ↗
In my opinion still the most egregious example in history of a commercial LLM going off the rails in production. Never any technical postmortem from Google on this.
unbrice · · focus · HN ↗
NiloCK · · focus · HN ↗
If I remember correctly, it was in fact possible to manually inject chat context at the time, which would have made spoofing something like this completely possible.
But the silence on it is very frustrating.