‹ BackHN Continuity

Thread

Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

589 points · 200 comments · JonSchneider

  1. danbrooks · · focus · HN ↗
    Nice! Does anyone know how this compares to the Unsloth quantizations of this model? <a href="https:&#x2F;&#x2F;unsloth.ai&#x2F;docs&#x2F;models&#x2F;qwen3.8#run-qwen3.8-guide">https:&#x2F;&#x2F;unsloth.ai&#x2F;docs&#x2F;models&#x2F;qwen3.8#run-qwen3.8-guide
    1. 0xbadcafebee · · focus · HN ↗
      Came to ask the same. From my really rough understanding, it seems like Unsloth&#x27;s method allows a slightly higher precision at a higher file size, while PrismML&#x27;s uses a different approach to achieve a smaller size (and presumably less precision).
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.