‹ BackHN Continuity

Thread

Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models

85 points · 50 comments · joozio

  1. delichon · · focus · HN ↗
    After Trump's last inauguration, ChatGPT would still tell me that Biden was President of the US. I understand that the training cutoff was before Biden dropped out. But it knew, or should have known, the current date and that there had been an election since its last update, but it didn't qualify the answer. When I asked it to search the web, it got it right. The moral I took away was to always ask for the search whenever I ask about current events. I do that so routinely that I wouldn't know if this problem has been fixed. I suppose that failing to update my priors per individual model release is a form of bigotry against a widely hated class.
    1. ahmedfromtunis · · focus · HN ↗
      I forgot which was it, ChatGPT or Gemini, but one of them insisted on calling Trump "former president" even when discussing decisions he just announced as president. Lol
      1. DenisM · · focus · HN ↗
        The Trump and former president terms were likely firmly stuck together in the embedding space. The model doesn’t validate every single token it produces because validation itself requires tokens. A bloom filter of outdated embeddings will help, when the labs get around to adding it.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.