Thread

1. Aurornis · 1789682169 · focus · HN ↗

   These are small enough that you can run them entirely in the browser <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;webml-community&#x2F;ternary-bonsai-2-webgpu-kernels" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;webml-community&#x2F;ternary-bonsai...

   Remember to clear the downloaded weights afterward.

   Like the last model, it&#x27;s amazing they work as well as they do. Use it for any longer task and they fall apart spectacularly and in interesting ways.

   1. SXX · 1789692885 · focus · HN ↗

      Sadly crashing on Pixel 9 Pro, but I guess phone GPU with 16GB RAM total wouldnt be enough anyway.

      1. 14u2c · 1789695335 · focus · HN ↗

         Runs on my 16GB M2 Air (firefox). ~7 tok&#x2F;s

Unofficial Hacker News client; not affiliated with Y Combinator.