‹ BackHN Continuity

Thread

Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

589 points · 200 comments · JonSchneider

  1. cregy · · focus · HN ↗
    On openrouter I had to filter out glm 5.3 flash instances running fp4 - making sure it only ran fp8 - as the quantized models kept going crazy / off track.

    Assume bonsai has the same ticks

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.