Beating GPT-5.6 Sol on retrieval with 100x cheaper open models
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
Beating GPT-5.6 Sol on retrieval with 100x cheaper open models
Unofficial Hacker News client; not affiliated with Y Combinator.
linux_devil · · focus · HN ↗
jmalicki · · focus · HN ↗
If you have a workload that is going to be very heavy, incurring a large training cost to make a cheaper model work well with the dataset will be dramatic cost reduction. Most large AI workloads can't afford, or truly need, the expense or capability of GPT 5.6 Sol when cheaper models can do.
Of course you could skip that and just use GPT-5.6 Sol everywhere instead. If you're running a fast food restaurant you could hire Michelin star chefs to make your burger and fries without further training. Or you could have a training program for teenagers, a sourcing program, etc. to scale up to your chain to still get consistent quality without needing that level of cost in each store, but replacing it with a centralized repeatable process.