‹ BackHN Continuity

Thread

Samsung is expected to more than double output of its HBM4 and HBM4E DRAM

562 points · 458 comments · giuliomagnifico

  1. amelius · · focus · HN ↗
    Will that be enough for AI's hunger?
    1. GoToRO · · focus · HN ↗
      It will be just in time for when AI will run very well on consumer hardware and the need for data centers will collapse.
      1. IshKebab · · focus · HN ↗
        That's never going to happen. By the time you can run current frontier models on your $10k desktop the frontier will have massively advanced and people will want those models instead.
        1. blurbleblurble · · focus · HN ↗
          It's going to happen very soon, which is why these frontier labs are scrambling to shut down open source language models. There's an existential risk threatening their obscene returns.
          1. IshKebab · · focus · HN ↗
            > It's going to happen very soon

            Why? You can't just assert it. There are very good reasons to think it won't happen soon, and you've given no reasons to think it will happen soon.

            1. dwedge · · focus · HN ↗
              You asserted that it was never going to happen first
              1. geysersam · · focus · HN ↗
                But he gave a reason for that. "Before that happens the frontier will move". Why do you think it will happen anyway? Do you think the frontier will not move fast enough that local models are unable to catch up, or do you think people will prefer local models at a point. Or something else?
            2. blurbleblurble · · focus · HN ↗
              Because everything is converging on a backlog of huge efficiency gains established in research, waiting to be combined. Looped transformers, a whole host of diffusion techniques and new quantization techniques, maturation of ternary distillation and new ways to separate logic from stuff that can be looked up. It would surprise me if most frontier models were actually even that big at that point in terms of active params. I highly doubt it.
          2. mrlonglong · · focus · HN ↗
            It is for that reason they are being archived and torrented as a very large middle finger.
          3. [deleted] · · focus · HN ↗

            [deleted]

          4. [deleted] · · focus · HN ↗

            [deleted]

          5. usef- · · focus · HN ↗
            I feel like cost competitiveness of local has been going down, if anything, not up. API providers can use hardware more and have scale efficiencies. Do you see any reason this will reverse?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.