‹ BackHN Continuity

Thread

How GLM built its own inference infrastructure

411 points · 285 comments · whiteros_e

  1. dada216 · · focus · HN ↗
    We built a complete production-grade inference service from scratch on a cluster of more than 100,000 Chinese-made AI accelerators. All production inference for GLM-5.3-Flash runs on this system.
    1. dzonga · · focus · HN ↗
      very few people comprehend - how much of an asteroid level event for western AI labs this is.

      china has cheap abundant power, now they can make their own inference chips (which was supposed to be a chokepoint), their models yeah can be 6 months behind the frontier - but most people don't need frontier models - small models r more than enough.

      my only wish was labs like Mistral would make their own inference chips or partner up eg with established / new chip makers or companies like Oxide.

      1. g023 · · focus · HN ↗
        While the North American models say 'No', the chinese models say 'Go Go Go'. I guess we'll see whether the anti-consumer wins over the pro-consumer.
        1. jchook · · focus · HN ↗
          From my understanding Chinese companies are pushing for open global cooperation on AI, as well as Meta.

          Only the US sees this as a competition, new space race, Cold War, etc.

          1. shostack · · focus · HN ↗
            So effectively, trying to undercut their competitor to reduce its wealth and power?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.