AMD has acquired "AI stuff" for several billions at this point, yet somehow, doing "AI stuff" on their GPU/NPU stack still seems to be troublesome. Well, that is what I read from others anyway. Inference with llama.cpp on AMD GPUs pretty much just works.
I bet soon enough we can just ask AI to port stuff from CUDA to whatever language AMD is using. This is how nVidia will become a victim of their own success.
Keep going... extrapolate out further. There's a conclusion you beley will be true, but haven't fully thought through why that conclusion must be true if CUDA is no longer the moat it once was.
LarsDu88 · · focus · HN ↗
I was also shocked by how quickly AMD acquired Talaas. AMD may be preparing for the next way (ultra fast inference, and embodied AI inference)
ahartmetz · · focus · HN ↗
amelius · · focus · HN ↗
wmf · · focus · HN ↗
fragmede · · focus · HN ↗
nwah1 · · focus · HN ↗
fragmede · · focus · HN ↗
tybit · · focus · HN ↗
fragmede · · focus · HN ↗
homosapien97 · · focus · HN ↗
vlovich123 · · focus · HN ↗
alightsoul · · focus · HN ↗