‹ BackHN Continuity

Thread

Samsung is expected to more than double output of its HBM4 and HBM4E DRAM

562 points · 458 comments · giuliomagnifico

  1. amelius · · focus · HN ↗
    Will that be enough for AI's hunger?
    1. GoToRO · · focus · HN ↗
      It will be just in time for when AI will run very well on consumer hardware and the need for data centers will collapse.
      1. IshKebab · · focus · HN ↗
        That's never going to happen. By the time you can run current frontier models on your $10k desktop the frontier will have massively advanced and people will want those models instead.
        1. bunderbunder · · focus · HN ↗
          I’m not so sure about that. Already AI vendors are back to cutting prices to try and keep customers from cutting back on their usage. My own employer is working hard at pivoting to much smaller fine-tuned models for established use cases, and seeing model performance improvement in addition to large inference cost reductions. Being able to run them locally hasn’t exactly been a disaster for devex, either.

          It may turn out that demand for SOTA frontier models isn’t so limitless after all.

          1. pixl97 · · focus · HN ↗
            Every product follows demand curves. At a price of 0 you could find infinite usage. This has nearly zero relation to how much it costs to provide the product.
            1. trombuance · · focus · HN ↗
              >At a price of 0 you could find infinite usage

              Infinite demand isn't a thing. Even if they'd offer free compute forever (not likely possible) I and many others would still use local models that we have full control over and that do not harvest our personal data.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.