Beating GPT-5.6 Sol on retrieval with 100x cheaper open models
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
Beating GPT-5.6 Sol on retrieval with 100x cheaper open models
Unofficial Hacker News client; not affiliated with Y Combinator.
jillesvangurp · · focus · HN ↗
The key challenge is to pick the right model for the right task or sub task and doing that automatically rather than manually. A big part of the problem here is that everybody is picking the most expensive and resource intensive models by default just in case they hit something that is a bit more difficult to get right. It's overkill. Most work people actually do is completely routine and would not have been a challenge for most of the mainstream OSS models.
I'm starting to suffer a bit from model fatigue. There are announcements almost on a daily basis about this or that new model. I can't keep up with that and I don't have time to try them out or evaluate them. I don't want to waste brain cycles on which one to use. I just want to get shit done without micromanaging AI models.
All this marketing BS and confusing naming isn't helping either. It seems a lot of that is just about tricking people into picking the expensive model so they'll burn through more tokens.
drob518 · · focus · HN ↗