Thread

1. getcrunk · 1785893228 · focus · HN ↗

   Anyone compare this to ternary bonsai vs the 1 bit

   1. woadwarrior01 · 1785922282 · focus · HN ↗

      I haven't compared it for perf, but at first glance this appears to be an LLM (text-only) while both binary and ternary bonsai 27B models are VLMs (where the vision tower and the adapter MLP weights are unquantized and kept in float16).

Unofficial Hacker News client; not affiliated with Y Combinator.