‹ BackHN Continuity

Thread

How GLM built its own inference infrastructure

411 points · 285 comments · whiteros_e

  1. zicohacks · · focus · HN ↗
    US chip export restrictions may actually be an advantage for China's AI Infrastructure. Chinese companies are forced to speed up developing their own AI chips
    1. menaerus · · focus · HN ↗
      It was evident that this will happen.

      > Compared with our initial baseline on the same hardware, we achieved a 3× improvement in end-to-end serving performance, reaching hardware efficiency and per-token cost comparable to mainstream NVIDIA GPUs. This demonstrates that Chinese chips can support frontier-model inference efficiently and economically at scale.

      1. HSO · · focus · HN ↗

        [dead]

        1. menaerus · · focus · HN ↗
          Look into the history clases will be enough. Why would I need to prove anything to a random stranger on the internet?
        2. goodmythical · · focus · HN ↗
          Isn't it common knowledge that every better mouse trap breeds smarter mice?
          1. conmod278 · · focus · HN ↗
            Future AI systems will eke out every last blood drop of performance from any kind of hardware. Not even a single bit flip will go to waste.
        3. Tadpole9181 · · focus · HN ↗
          Third party here, I feel like I'm missing something. Your comment seems somewhat pointed and I don't understand what exactly you're asking for?

          Weren't they just saying that it's self-evident that preventing a manufacturing superpower - one with a significant pool of industrial engineers and effectively unlimited money & government backing - from acquiring some good is a temporary measure? Because if they have sufficient incentive, they would just... Learn to build it themselves?

          After all, their entire nation is built around building things, and catching up / leap-frogging is much easier than starting from scratch.

          1. HSO · · focus · HN ↗

            [dead]

            1. browningstreet · · focus · HN ↗
              > in 2022, mainstream and westoid virtualism opinion was ``china is cut off from the future now`` (cue the clownface here). ``we cut off chinas legs`` yadayada

              maybe where you were paying attention. were they also certain that americans wouldn't be paying the tariffs?

              but lots of people who saw what china was doing with renewable energy and EVs rightly suggested this would put them on the path of independence w/r/t GPUs and LLMs.

              this isn't like the ol' days where "japan can't do software". we knew china can.

              your attitude isn't warranted.

        4. dvngnt_ · · focus · HN ↗
          It was one of the reasons why Jensen was against the export controls
          1. swyx · · focus · HN ↗
            well, yknow, apart from his vested interest in having 1.4 billion more people to sell GPUs to
          2. HSO · · focus · HN ↗
            for sure, but like the other respondent said, he was talking his own book

            and also, arguably jensen`s track record is such that i wouldnt exactly lump him with the mainstreamers )))

        5. chvid · · focus · HN ↗
          Yes - I am old enough to remember the Biden admin’s October 7th sanctions, and the chatter about the US having another unipolar moment.
        6. ux266478 · · focus · HN ↗
          The mainstream consensus on PRC silicon has been "the gap exists, but is closing" for a long time[1][2]. I think you might be confusing the algorithmically-cast shadows on the cave wall that you're sat in front of for a reasonable and unbiased sample. Can you provide any reason to believe that your data points are actually generalizable? From your tone it sounds more like you're a victim of getting outrage baited into engagement, and mistaking observations made in that envelope for a high quality data source. You gotta watch out for that mate.

          [1] - <a href="https:&#x2F;&#x2F;www.eastwestcenter.org&#x2F;sites&#x2F;default&#x2F;files&#x2F;private&#x2F;iegwp001_1.pdf#:~:text=move%20from%20catching-up%20to%20forging-ahead%20in%20semiconductors" rel="nofollow">https:&#x2F;&#x2F;www.eastwestcenter.org&#x2F;sites&#x2F;default&#x2F;files&#x2F;private&#x2F;i...

          [2] - <a href="https:&#x2F;&#x2F;www.usitc.gov&#x2F;publications&#x2F;332&#x2F;journals&#x2F;chinese_semiconductor_industrial_policy_prospects_for_success_jice_aug_2019.pdf#:~:text=China&#x27;s%20gap%20with%20leading%20international%20semiconductor%20firms%20has%20consistently%20narrowed%20over%20time" rel="nofollow">https:&#x2F;&#x2F;www.usitc.gov&#x2F;publications&#x2F;332&#x2F;journals&#x2F;chinese_semi...

          1. HSO · · focus · HN ↗

            [dead]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.