Thread

1. PowerElectronix · 1790861141 · focus · HN ↗

   It'd be a shame if their two main sources of income (openai and anthropic) were to go bust...

   1. TuxSH · 1790870236 · focus · HN ↗

      I doubt it will change much, inference (not training) is very profitable and demand for inference is quite high. See: Mistral serving GLM on their own servers.

      1. PowerElectronix · 1790928516 · focus · HN ↗

         Pure inference would have to compete with other service providers and even local hardware that becomes capable of running models for a price if hardware demand by openAI and Anthropic dwindles.

         That is a very commodify market and as such I expect power cost per query ends up setting the pricing.

         1. TuxSH · 1790974402 · focus · HN ↗

            > if hardware demand by openAI and Anthropic dwindles

            Would it ever? Demand for inference (and I suppose the same applies for training) _increases_ when models get cheaper.

            I suppose real risk is that one player aggressively cuts margins (say, AWS) and others follow suite. However the release of increasingly more capable, exclusive closed-weight models prevents this to an extent.

Unofficial Hacker News client; not affiliated with Y Combinator.