‹ BackHN Continuity

Thread

How GLM built its own inference infrastructure

411 points · 285 comments · whiteros_e

  1. zicohacks · · focus · HN ↗
    US chip export restrictions may actually be an advantage for China's AI Infrastructure. Chinese companies are forced to speed up developing their own AI chips
    1. menaerus · · focus · HN ↗
      It was evident that this will happen.

      > Compared with our initial baseline on the same hardware, we achieved a 3× improvement in end-to-end serving performance, reaching hardware efficiency and per-token cost comparable to mainstream NVIDIA GPUs. This demonstrates that Chinese chips can support frontier-model inference efficiently and economically at scale.

      1. gpt5 · · focus · HN ↗
        I’ll just note that NVidia’s moat has never been inference, and there are many chips used at a much larger scale than Chinese chips for inference like TPUs and AMD chips.

        The other part is that it’s a bit of a meme here to say that the chip restriction is actually helping China (or shall I say, coordinated effort?). For once, we know that China has put a lot of pressure on the US to relax these controls multiple times. In addition to large chip smuggling networks (e.g. 22% of NVidia’s worldwide revenue magically comes from Singapore, and the ratio has been growing).

        Lastly, assuming acceleration in AI (which we ARE seeing), there might not be time to China to catch up. The best estimate right now is that the first EUV chips from China will not come out before 2030. By that time who knows how powerful AI will be.

        All I’m saying is that the discussion is so one sided and a bit baselesss with no nuance, that it seems either a meme/groupthink in the community or coordinated. If anything, the data suggests that the US should increase its export controls and better track the tech supply chain if it wants to further curb Chinese progress.

        1. pianopatrick · · focus · HN ↗
          When you say AI will be powerful, what do you mean? Like in terms of national power, will AI let the US fight and win a war against China despite China's size, manufacturing base and possession of nuclear weapons? Will AI let the US beat the Chinese in manufacturing costs and scale despite China's greater adoption of industrial robots and larger number of skilled workers? Or will AI just be really good at writing software?

          Because if the AI is just really good at writing software, I am not sure why China has to "catch up". Seems to me China can just treat AI like other technologies. Let the US pay most of the R&D costs, then come after and treat the technology as a commodity. Sell it better and cheaper and at scale.

          I am not sure why it's a big deal for China if China is a few months behind the US in terms of the very frontier AI. Just like I'm not sure if it's a big deal which country has the biggest super computer in the world.

          1. gpt5 · · focus · HN ↗
            If AI is super human, it can beat any nation with today’s technology. It can recursively self improve while suppressing any other lab (think about how good it is in hacking computer systems).

            I am not inventing a winner take it all scenario, that is what driving the race.

            1. pianopatrick · · focus · HN ↗
              But, like, how does that smarts lead to beating nations with today's technology? How would an AI stop an incoming nuclear ballistic missile? I've heard on podcasts with MIT professor Ted Postol that based in the laws of physics intercepting these is basically impossible, because of the speeds and physics involved. Can AI discover new physics to overcome those limitations?

              If AI cannot stop nuclear ballistic missiles, then how does AI give the US power over China? Seems to me that after AI we have the same mutually assured destruction we have today. In which case America cannot really stop China from progressing or threaten China too much.

              Seems to me being super human intelligent does not inherently guarantee power. Just like the smartest person in the world does not always win in a fist fight or a gun fight or war. I.e. Stephen Hawking might have been smart, but he did not have physical strength and power. Power and smarts are not always related.

              1. gpt5 · · focus · HN ↗
                I just gave you a scenario above - that it hacks every computer system in China, including those controlling nuclear missiles. But a super intelligent AI can invent scenarios that almost by definition we cannot think of.
                1. pianopatrick · · focus · HN ↗
                  I would assume that the computer systems in China that control nuclear missiles, as well as our computer systems that control nuclear missiles, are air gapped and therefore not hackable no matter how smart the AI is.
                  1. gpt5 · · focus · HN ↗
                    This only demonstrates imposed limits you are able to imagine, not what’s possible in all scenarios. A super intelligent AI can bribe, social engineer and do anything it wants. No system is foolproof.
                    1. klrefg · · focus · HN ↗
                      Well yes in an imaginary world everything is possible. We are less close to what you’re describing than to having flying cars.
                      1. gpt5 · · focus · HN ↗
                        Gotta love the bot accounts here
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.