‹ BackHN Continuity

Thread

Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

589 points · 200 comments · JonSchneider

  1. Chance-Device · · focus · HN ↗
    Let’s see, so if you get the same 1/9th the size compression ratio with GLM-5.3-Flash, then you’d end up with a ~72GB model that’s about as good as GPT-5.6 Sol (high), according to artificialanalysis.ai

    Which is within reach of some higher end consumer hardware, especially with layer offloading.

    You have to wonder what kind of trouble the “labs” are in when this is becoming possible. Lots of money, where’s the moat?

    1. indy · · focus · HN ↗
      They're trying to build a moat with legislation, using fear over 'safety' as an excuse to ban these open models
      1. DoctorOetker · · focus · HN ↗
        A gentleman's agreement between the western bloc, China, India, Russia, ... ?

        It would be a lip service agreement, and all would continue the machine learning race...

        The mere suggestion of slowing down AI progress signals to adversaries that there is some novel power just identified: do you think adversaries would agree and slow down, or calculate a little harder and longer in order to also figure out what it unlocks?

        1. indy · · focus · HN ↗
          Do you ever wonder how Anthropic or OpenAI can release a new state of the art model and then a few months later there's a Chinese open model that's nearly as good?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.