‹ BackHN Continuity

Thread

The Economics of Open-Weight Inference

58 points · 27 comments · marinesebastian

  1. jcmontx · · focus · HN ↗
    The problem, IMO, with open-weight models is that you accustom to the capabilities of frontier models too quickly; and downgrading to an open-weight "frontier minus 2" or "frontier minus 3" model is often painful, since they feel way less useful than their newer closed-weights counterpart. To be honest, I don't know any companies using OW models at a large scale for their operations (agents or chat assistants).
    1. physicsguy · · focus · HN ↗
      That is true if you're using them as chatbots but for something behind a product it's largely OK as long as it meets the requirements.
      1. datsci_est_2015 · · focus · HN ↗
        I haven’t used open weight models yet, but this would match my intuition given I haven’t experienced a noticeable increase in code quality this calendar year. If open weight models are already on par with January frontier models that’s already enough for me to automate most of the manual parts of my work (I.e. not “architecting”).

        And once frontier models can architect (turn business requirements into engineered systems) then I guess no one needs a job because that’s the digital singularity.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.