Thread

1. panny · 1791121753 · focus · HN ↗

   I'm far less interested in how good a big expensive model is on hardware 99% of people can't afford and would rather see what runs best on a chromebook or mobile phone with 8GB of RAM.

   1. MrDrMcCoy · 1791121987 · focus · HN ↗

      Ternary Bonsai 2 might be for you.

      1. luke-stanley · 1791124495 · focus · HN ↗

         I might try running the expert pruned Coder model but yes, that PrismML Bonsai 2 Ternary 27B model is from the Qwen 3.8 27B model, which has better intelligence density (Artificial Analysis says), without the MoE disk use or architecture complexity (if you care about that)! There are also DFlash 2 models for it too (though in my experience this only measured faster for parallel requests, but I have a 3090). I am curious about the phone acceleration for Bonsai 2!

Unofficial Hacker News client; not affiliated with Y Combinator.