‹ BackHN Continuity

Thread

Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models

85 points · 50 comments · joozio

  1. gjskngnf · · focus · HN ↗
    I remember when the US captured Venezuelan president Maduro, and when I posed a prompt related to this, the model said that’s pure fiction. I told it to double check. Still didn’t want to entertain the idea. It only acquiesced when I specifically directed it to check Reuters. I haven’t noticed this problem in months. Model cutoff seems to be less of a problem these days.
    1. InsideOutSanta · · focus · HN ↗
      Came here to say the same thing. Models used to rely heavily on world knowledge from their training data. They are now much better at tool use and deciding when to research a topic, rather than just answering from memory.

      I wonder how much that extends to using LLMs for programming. I assume most knowledge of programming language syntax still comes from training data.

      1. NegativeLatency · · focus · HN ↗
        I find they generally do ok, but a few lines in an AGENTS.md or manual prompting to verify stuff against current docs/source, and check for current version of software helps a lot.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.