‹ BackHN Continuity

Thread

How GLM built its own inference infrastructure

411 points · 285 comments · whiteros_e

  1. zicohacks · · focus · HN ↗
    US chip export restrictions may actually be an advantage for China's AI Infrastructure. Chinese companies are forced to speed up developing their own AI chips
    1. aurareturn · · focus · HN ↗
      US chip export winners and losers:

      Winners: Huawei, SMIC, CXMT,Chinese ASML-competitors, OpenAI, Anthropic, Amazon, Microsoft, Google, Meta.

      Losers: Chinese AI labs, Nvidia, AMD, TSMC, Micron, SK Hynix, Samsung, Intel.

      Any company that depends on Nvidia hardware such as OpenAI, Anthropic, AWS are winners. It means less competition for Nvidia chips and services. If you think Nvidia chips are expensive now, imagine if Chinese companies can buy them freely. Also for American AI labs, it also means they can stay ahead of Chinese AI labs in compute capacity.

      The American hardware makers lost the lobby fight in Washington.

      1. throwaw12 · · focus · HN ↗
        I wonder why Chinese AI labs are losers?

        In the short term maybe yes, in the long term, maybe they are the winners, they can build on top of cheap inference stack and eventually win on pricing

        1. aurareturn · · focus · HN ↗
          Because having unrestricted access to both American and Chinese hardware is better than only Chinese hardware. Long term or short term. More suppliers the better.
          1. bigmadshoe · · focus · HN ↗
            Perhaps the future Chinese hardware would not be so cheap or performant had Nvidia export controls not been put into place.
            1. klrefg · · focus · HN ↗
              Logically one would expect it to be relatively more expensive and less performant because it does not have to compete with Nvidia’s hardware.
              1. bigmadshoe · · focus · HN ↗
                I'm not sure I agree. The market pressure for this innovation might not have been there with Nvidia chips still available. In this case it is coming from necessity.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.