‹ BackHN Continuity

Thread

How GLM built its own inference infrastructure

411 points · 285 comments · whiteros_e

  1. zicohacks · · focus · HN ↗
    US chip export restrictions may actually be an advantage for China's AI Infrastructure. Chinese companies are forced to speed up developing their own AI chips
    1. HarHarVeryFunny · · focus · HN ↗
      China themselves recognize this. After Trump relaxed sanctions and allowed NVIDIA H200 sales to China on a case by case basis, the Chinese government stepped in to essentially block it!

      In addition to Huawei who make the Ascend series that Ziphu are using, there are also at least a half dozen or so other Chinese companies also making their own AI accelerators.

      1. 0xbadcafebee · · focus · HN ↗
        And this wouldn't have happened if we had tried to get them to buy our hardware rather than trying to gatekeep. Protectionism never works in the long term.
        1. freakynit · · focus · HN ↗
          US companies should now be more worried about Chinese companies flooding the market with their, hopefully, very affordable GPU's. The scale at which they can manufacture stuff is unmatched anywhere else. Nvidia can kiss goodbye to their 75%+ profit margins.

          Almost everyone knew that these sanctions would backfire within a few years. You can't really put sanctions that have noticeable negative effects on bigger economies. They only work for small to medium economies. I believe sanctions on any economy in top 10 would fail.

          1. verdverm · · focus · HN ↗
            pretty sure they'll be fine for a while, between the build out and import bans, I don't expect demand to slow enough to let supply catch up

            Nvidia are likely more concerned about AMD taking market share, and I suspect that geopolitics will leave US/China GPUs with largely non overlpping customer bases.

            1. overfeed · · focus · HN ↗
              > I suspect that geopolitics will leave US/China GPUs with largely non overlpping customer bases

              That's not what's happening in the auto-industry, Chinese EVs are easily outselling American ones. Why would GPUs be any different?

              1. verdverm · · focus · HN ↗
                Import bans, like we have on Chinese EVs in the US. The US already restricts other countries access to Huawei hardware

                This is another example where we might ask "why would it be any different?"

                1. HarHarVeryFunny · · focus · HN ↗
                  I've got to wonder how long the US will still be able get much of the world to go along with requests like this. Europe is already showing some spine and refused to join Trump's war with Iran, and Italy and Spain have also recently shown Trump the middle finger.

                  It'd be ironic if Europe ended up banning ASML (a Dutch company) from shipping to US instead!

                  1. PorciiVorbesc · · focus · HN ↗
                    >It'd be ironic if Europe ended up banning ASML (a Dutch company) from shipping to US instead!

                    ASML's Dutch EUV machines depend on importing US made EUV light sources from California to build them, and depends on sales of their machines to the US to stay afloat since they're not exactly flying off the shelves domestically.

                    So maybe the EU is not that stupid and suicidal to cripple their economy further by cutting off one of their biggest pay-piggies for no reason.

                    In fact, as an anecdote to your hypothetically scenario, the US is the one with the most leverage since if they want, they can ban the export of EUV light sources to ASML and sell them instead to Canon and Nikon, sinking ASML and propping up Japan's semi industry instead, if relations sour and they see Japan as a warmer ally than the EU. Hypothetical.

                    1. HarHarVeryFunny · · focus · HN ↗
                      FYI, Nikon and Canon don't rely on ASML-owned Cymer anymore - they use a domestic Japanese supplier instead, Gigaphoton.
                      1. PorciiVorbesc · · focus · HN ↗
                        Nikon and Canon (gigaphoton) don't have EUV (yet)
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.