Thread

1. LarsDu88 · 1790632413 · focus · HN ↗

   This was absurdly soon.

   I was also shocked by how quickly AMD acquired Talaas. AMD may be preparing for the next way (ultra fast inference, and embodied AI inference)

   1. ahartmetz · 1790632827 · focus · HN ↗

      AMD has acquired "AI stuff" for several billions at this point, yet somehow, doing "AI stuff" on their GPU/NPU stack still seems to be troublesome. Well, that is what I read from others anyway. Inference with llama.cpp on AMD GPUs pretty much just works.

      1. sheepscreek · 1790645066 · focus · HN ↗

         Who says that? I’m having a blast with rocm powering my R9700. Been able to run all models on day 0 at comparable speeds to Nvidia with similar memory bandwidth. Software is no longer the main bottleneck for AMD.

         1. __rito__ · 1790655499 · focus · HN ↗

            Mind sharing pointers to how to do DL things in AMD?

            I don't know anything.

            Things like training a Vision/RL/LM, downloading and running LMs, etc.

            1. imjonse · 1790657717 · focus · HN ↗

               just use torch/vllm/sglang/llama.cpp and the rest of the ecosystem, most have decent support for AMD, it's not that different from CUDA once you get it working (and it is much easier now than it used to)
         2. whateverboat · 1790657033 · focus · HN ↗

            I didn't know their consumer cards had rocm.

            1. ahartmetz · 1790722513 · focus · HN ↗

               There is a support list, and last time I looked, what was and wasn't on the list didn't look very systematic.

Unofficial Hacker News client; not affiliated with Y Combinator.