‹ BackHN Continuity

Thread

Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

589 points · 200 comments · JonSchneider

  1. hedora · · focus · HN ↗
    RAM requirements? My current rule of thumb is “a byte per parameter”, but I doubt this runs in 1/9th that (~ 3GiB).

    Also, perf speedup?

    1. jjcm · · focus · HN ↗
      I'm seeing around 7.9GB of ram, 120 tokens/s on a 6000 pro blackwell.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.