‹ BackHN Continuity

Thread

What if we stopped using GPUs? [video]

51 points · 18 comments · sandslash

  1. tolugenius · · focus · HN ↗
    I wonder what would "compute" mean if cpus were more efficient at matrix multiplication say 15 years ago. And on the flipside, what it would take to say train a frontier model entirely on cpus in the future.
    1. actionfromafar · · focus · HN ↗
      I wonder what "compute" would mean if CPUs were more efficient at matrix multiplication and vendors had the balls to pair each core to its own dedicated DDR and a star interconnect between.
      1. pjmlp · · focus · HN ↗
        It could be like the connection machine or something like that.

        There is plenty of matrix multiplication in SIMD, but it isn't widely explored.

        1. aeve890 · · focus · HN ↗
          >There is plenty of matrix multiplication in SIMD, but it isn't widely explored.

          Like in the existing SIMD technology?

          1. pjmlp · · focus · HN ↗
            Yes, like in the existing SIMD technology, ask your AI friend for code samples.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.