Thread

1. amelius · 1790701891 · focus · HN ↗

   If these models are so smart, can't _they_ select the right model for each task?

   1. SkyBelow · 1790703329 · focus · HN ↗

      These models have a knowledge cutoff that don't just prevent them from knowing about themselves (especially since most data about the model doesn't even exist until after the model is created), but they also don't know about other recent models. Sure, they can search and use other sources, even make some guesses based on the models they do know, but their default stance is more akin to "User asked about model X, model X doesn't exist, maybe it was an hallucination or mistake, let me do a web search...", but that assumes they have web search and are willing to spend tokens on it.

      Personally I've taken to having a list of 3 to 4 models in default context with some ordering on which to prefer. Things like GPT 6 Luna is cheap very cheap, use it. Because otherwise the model will assume Haiku or such is the good cheap model to use.

      The speed I'm having to update that document has not gone unnoticed.

Unofficial Hacker News client; not affiliated with Y Combinator.