I wonder what would "compute" mean if cpus were more efficient at matrix multiplication say 15 years ago. And on the flipside, what it would take to say train a frontier model entirely on cpus in the future.
16 years ago, Intel CPUs finally got GPUs integrated inside of them. So they did get better at matrix multiplication 15 years ago.
15 years ago was Sandy Bridge, which added the Intel HD Graphics GPU inside of the processor. MMX was almost 30 years ago.
tolugenius · · focus · HN ↗
Dwedit · · focus · HN ↗
alfiedotwtf · · focus · HN ↗
Dwedit · · focus · HN ↗