‹ BackHN Continuity

Thread

The Economics of Open-Weight Inference

58 points · 27 comments · marinesebastian

  1. augment_me · · focus · HN ↗
    I think an interesting point is that hardware as of today still has no utility value after its reported lifetime has elapsed, which prevents neolabs and smaller labs from getting older HW clusters as the banks are not willing to give out loans against them. There is no agreed upon pricing for "expired" A100 clusters or similar.

    This is clearly not true, and we are starting to see compute markets, but only for rental prices/H, not for the hardware itself. I feel like there is some artificial moat being built here to stimulate sales of new hardware, because an H100 at 1/16th the price will have comparable dollar/FLOP as Vera Rubin.

    1. csmoak · · focus · HN ↗
      <a href="https:&#x2F;&#x2F;www.stoaexchange.com&#x2F;">https:&#x2F;&#x2F;www.stoaexchange.com&#x2F; is an exchange for hardware itself and has market data for prices over time.
      1. whatshisface · · focus · HN ↗
        It looks like they have a persuasive landing page and a place to insert my email.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.