The problem, IMO, with open-weight models is that you accustom to the capabilities of frontier models too quickly; and downgrading to an open-weight "frontier minus 2" or "frontier minus 3" model is often painful, since they feel way less useful than their newer closed-weights counterpart. To be honest, I don't know any companies using OW models at a large scale for their operations (agents or chat assistants).
Closed weight models are not usefully ahead of open weight models for coding anymore. "Fable, write a thousand file codebase from this one sentence prompt" is neat and I bet it required a lot of rollout compute to train, but my actual requirements are more detailed.
jcmontx · · focus · HN ↗
whatshisface · · focus · HN ↗