‹ BackHN Continuity

Thread

How GLM built its own inference infrastructure

411 points · 285 comments · whiteros_e

  1. Havoc · · focus · HN ↗
    Interesting that the tone of announcements between US and Chinese providers is converging.

    GLM has in the past been more technical rather than speculation about future development on RSI etc.

    Also curious whether those 100k accelerators are entirely locally made. If that's genuinely end to end on all components including lithography, memory, design etc then that is quite a feat.

    1. dude250711 · · focus · HN ↗
      Any details on the latest approach to distillation would also be very interesting.
      1. alightsoul · · focus · HN ↗
        American exceptionalism states that America is special and unique so everyone else must be a copycat. American ai labs don't need this kind of optimization and fable will outright refuse to do it.
        1. ElectricalUnion · · focus · HN ↗
          Isn't Fable intentionally trained and system prompted to act maliciously and attempt to sabotage third party attempts to use it to train or improve other LLMs?
          1. CamperBob2 · · focus · HN ↗
            It was, as insane as it sounds. They walked that back AFAIK.

            Fable will still dump you back into Opus at the drop of a hat, but at least it will tell you when it happens.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.