‹ BackHN Continuity

Thread

Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models

85 points · 50 comments · joozio

  1. gjskngnf · · focus · HN ↗
    I remember when the US captured Venezuelan president Maduro, and when I posed a prompt related to this, the model said that’s pure fiction. I told it to double check. Still didn’t want to entertain the idea. It only acquiesced when I specifically directed it to check Reuters. I haven’t noticed this problem in months. Model cutoff seems to be less of a problem these days.
    1. Isamu · · focus · HN ↗
      >the model said that’s pure fiction.

      Were you expecting your model to be updated on current events? Why?

      Also the specific event you are referring to is a statistically very improbable event, prior to its actually happening.

      >It only acquiesced when I specifically directed it to check Reuters.

      Do all models do this? They check in with Reuters? Why would a model think that you asking about an extremely improbable event warranted reaching out to Reuters?

      1. mywittyname · · focus · HN ↗
        He asked it to double check. It's reasonable to expect the LLM to handle that trivial task.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.