‹ BackHN Continuity

Thread

The Economics of Open-Weight Inference

58 points · 27 comments · marinesebastian

  1. jcmontx · · focus · HN ↗
    The problem, IMO, with open-weight models is that you accustom to the capabilities of frontier models too quickly; and downgrading to an open-weight "frontier minus 2" or "frontier minus 3" model is often painful, since they feel way less useful than their newer closed-weights counterpart. To be honest, I don't know any companies using OW models at a large scale for their operations (agents or chat assistants).
    1. barbazoo · · focus · HN ↗
      For chat I can see, less so for LLM use in automation for example, there it makes much less of a difference I can imagine.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.