Thread

M5 Ultra Mac Studio Review

269 points · 262 comments · piotrgrabowski

simonw · 1790001122 · focus · HN ↗
The numbers I was most interested in are tucked away in a chart towards the bottom - the speed comparison of the Mac Studios v.s. a RTX 5090:
```
  Qwen3.8 27B tokens&#x2F;sec generation speed

  Prompt size    8K    64K   128K   256K
  RTX 5090 PC    59    51    44     n&#x2F;a
  M5 Ultra       48    39    32     24
  M3 Ultra       31    23.5  20     15
```
A whole bunch more comparison numbers in this section: <a href="https://www.macstories.net/stories/m5-ultra-mac-studio-review-the-dream-mac-for-local-ai-agents/#mx-pc" rel="nofollow">https://www.macstories.net/stories/m5-ultra-mac-studio-revie...
1. gpugreg · 1790003246 · focus · HN ↗
  Those RTX 5090 numbers are bad. You can get over 200 tps with ninfer using NVFP4 and MTP.
  1. beastman82 · 1790006689 · focus · HN ↗
    can confirm.
    I dont' know why people spend huge money on these and Spark. The 5090 is running qwen 3.8 at 200+ tps!! That's 1-2 orders of magnitude faster.
    mathisfun123 · 1790006888 · focus · HN ↗
    same reason they spend huge amounts of money on rolexes when seikos work better (the tech crowd isn't immune from vanity).
    throwaway27448 · 1790008593 · focus · HN ↗
    If you seriously think apple products are nothing but a status item, you're deluding yourself and probably have been for decades.
    [deleted] · 1790009537 · focus · HN ↗
    [deleted]
    _hugerobots_ · 1790009722 · focus · HN ↗
    This 1000%. Data centres don't equate to medium sized labs and businesses. A stack of Macs is up and running without digging trenches, an electrician on staff and a department of PhDs to justify the spend.
    bigyabai · 1790009889 · focus · HN ↗
    It's likely that a stack of Macs will draw more power for slower prefill/decode than equivalently priced Nvidia GPUs. If power efficient inference is the goal, Macs are a non-starter.
    _hugerobots_ · 1790011541 · focus · HN ↗
    So if it isn't a comparative ability, now it's a power cost issue? This reads like goal post moving.
    bigyabai · 1790020736 · focus · HN ↗
    Oh, it's absolutely both. The power you waste waiting for TFTT on prefill will absolutely compound at the "medium sized labs and businesses" scale.
    mathisfun123 · 1790010469 · focus · HN ↗
    If you seriously think apple cares about anything other than cell phones, you're deluding yourself and probably have been for decades.
    tom_ · 1790012081 · focus · HN ↗
    They've been selling phones for less than 20 years at this point? Though I suppose 1.9 is not equal to 1, so it gets the plural.
    throwaway27448 · 1790012438 · focus · HN ↗
    ...did you mean profit? I don't think they're manufacturing iphones just on the hope they delight you. This is also true of Google et al.
    I don't get these weird parasocial emotional attachments/beefs people have with brands. Talk to a therapist.
    mathisfun123 · 1790015341 · focus · HN ↗
    brother my point is they don't care about their product offerings outside of their phones. this post/thread is about one of their product offerings which is not a phone which is inferior to their competitors'. simple.
    selectodude · 1790015822 · focus · HN ↗
    My M1 Pro MBP is 6 years old and continues to be the best computer I own, so if that’s Apple not trying, god help everybody else once they do.
    mathisfun123 · 1790016695 · focus · HN ↗
    [dead]
    brookst · 1790027608 · focus · HN ↗
    <a href="https://forums.macrumors.com/threads/we-need-to-discuss-the-m6-gpu.2489966/" rel="nofollow">https://forums.macrumors.com/threads/we-need-to-discuss-the-...
    bigyabai · 1790119070 · focus · HN ↗
    What in that thread is particularly impressive or noteworthy? According to the benchmarks I've seen, M6 raster performance is actually less efficient than M5 in many scenarios.
    [deleted] · 1790013082 · focus · HN ↗
    [deleted]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.