‹ BackHN Continuity

Thread

Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

589 points · 200 comments · JonSchneider

  1. respectattentio · · focus · HN ↗
    Never heard of Bonsai before, but that looks great and promising for local on-device inference.

    Yet, seems like there is still another year for improvements.

    I like local models (but not mainly using them) for offline needs.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.