Thread

Samsung is expected to more than double output of its HBM4 and HBM4E DRAM

562 points · 458 comments · giuliomagnifico

fooker · 1789929721 · focus · HN ↗
What's the main blocker (other than the current inflated cost) for using HBM instead of DRAM as the primary memory for consumer electronics?
1. nutjob2 · 1789930193 · focus · HN ↗
  Nothing except CPU manufacturer choices. Mac laptops use it and they're consumer products.
  People will have to get used to buying a fixed amount of RAM with their CPU but thats unlikely to be a problem.
  1. fooker · 1789930550 · focus · HN ↗
    Apple's "unified memory" marketing is so strong that even tech literate people seem to have this misconception!
    They have managed to pull this sort of thing off many many times. <a href="https://en.wikipedia.org/wiki/Reality_distortion_field" rel="nofollow">https://en.wikipedia.org/wiki/Reality_distortion_field
    Rohansi · 1789931691 · focus · HN ↗
    Yup, the only reason Macs have higher memory bandwidth is because they use more memory channels, which gives them a wider bus. Both Intel and AMD only allow more than dual channel memory on server class processors these days.
    kstrauser · 1789932140 · focus · HN ↗
    The “Apple only does X better because they do Y” thing has been a meme for ages. I remember dismissals like “PowerPC is only faster at math because it has more integer units” or something along those lines, and thinking, uh, isn’t that a good thing?
    pixl97 · 1789932901 · focus · HN ↗
    Depends on the expense trade off.
    If I get 10% more performance for 50% more cost it really depends on one's needs, for example.
    Rohansi · 1789933212 · focus · HN ↗
    I am just saying it's not magic and x86 is capable of doing the same. Quad channel memory used to be more common in consumer hardware but now it looks like you don't even have the option anymore for desktops. AMD's Strix Halo was the first sign to reversing that (it has quad channel memory!) and hopefully we see more of that in the future.
    colejohnson66 · 1789936359 · focus · HN ↗
    AMD does market segmentation and limits consumer chips to dual-channel. You need to cough up the dough and get Threadripper for quad-channel. Or even more for Threadripper Pro to get octa-channel.
    Rohansi · 1789938300 · focus · HN ↗
    As I mentioned above AMD's Strix Halo has quad channel memory and is consumer level. But yes, other than that everything is segmented away.
    torginus · 1789940605 · focus · HN ↗
    Afaik steam deck is quad channel, despite it being a pretty low end chip (with a decent GPU though)
    Rohansi · 1789947051 · focus · HN ↗
    Kind of but not really. DDR5 splits your typical 64-bit channel into two 32-bit subchannels meaning the bus width is not increased. These subchannels are not always advertised because it's a just a feature of DDR5. Actually adding more channels increases bus width, which is what meaningfully improves memory bandwidth.
    pdpi · 1789937135 · focus · HN ↗
    There's a qualitative difference between "they're doing a different thing" and "they're doing the same thing, tuned differently". GP is saying that this is a case of "they just tuned it differently".
    This distinction doesn't change what the performance numbers look like today, but it does inform what changes would be necessary for those numbers to look different tomorrow. E.g. Apple Silicon isn't fundamentally orders of magnitude more efficient than x86, they just used smaller features. Newer Intel and AMD chips made on equivalent processes _also_ get similar efficiency gains.
    sroussey · 1789944313 · focus · HN ↗
    There are AMD and Intel devices on similar process (not talking about A20Pro or M6 which are set to ship later this week), and they do not get the same gains.
    And honestly, they have historically had different markets.
    When the design is for only one customer, you don't need to generalize things, and those things you generalize to give different customers different options has costs.
    AMD will soon be a larger customer for TSMC than Apple (NVIDIA is already there) so Apple's pre-booking new processes is likely to be gone in the near future.
    JohnBooty · 1789945405 · focus · HN ↗
    "You're only better than me at sports because you practice more and try harder!"
    Dylan16807 · 1790000992 · focus · HN ↗
    The point is that "unified architecture" is a buzzword unrelated to what actually makes things fast.
    Rohansi · 1790006615 · focus · HN ↗
    It does make some things faster because you can share memory between CPU, GPU, etc. without copying. But not everything.
    Kon5ole · 1789932901 · focus · HN ↗
    The memory bandwidth is a small thing compared to the massive win you get by not having to move data between two memory pools at all.
    Rohansi · 1789933929 · focus · HN ↗
    Depends on your workload. And AMD has supported unified memory long before Apple Silicon existed anyway.
    fooker · 1789935147 · focus · HN ↗
    Often you don't move memory around as a programmer, but that's exactly what happens in the background.
    It's the address space that's unified, not always the physical hardware.
    The data movement (when needed) is handled transparently in the background by page faults and other tricks.
    Rohansi · 1789958942 · focus · HN ↗
    Moving memory around is a bottleneck. Non-unified memory usually means copying over the PCIe bus which is way slower than RAM (and way way slower than VRAM). Actually unified memory means you don't need to copy anything at all though which is the absolute best case for performance.
    [deleted] · 1790001137 · focus · HN ↗
    [deleted]
    throwaway85825 · 1789938870 · focus · HN ↗
    Except strix halo.
    PunchyHamster · 1789944131 · focus · HN ↗
    Threadripper have that extra bandwidth and M5 still is faster
    Dylan16807 · 1789953772 · focus · HN ↗
    Can you link a specific benchmark?
    Keep in mind that non-Pro threadripper is still only 256 bits wide and Pro is 512. And the memory is 30% slower than with an M5. So an M5 Ultra has 3x the memory bandwidth of the best threadripper.
    Melatonic · 1789979375 · focus · HN ↗
    Don't some AMD full server CPUs have 12 memory channels ?
    Dylan16807 · 1790000667 · focus · HN ↗
    Yes, some do. So similar bandwidth to a Max but with lots of slower cores. Half as much as an Ultra.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.