I did a WebGPU-based HTML Single-File Chat Application even for larger models. It just depends on your machine. It is cool to show people what can be done on their machines without installing anything. It also works in air-gapped environments.
Thanks for sharing. I tried the online demo, which downloaded the model but, unfortunately, couldn't start it. (It says " Invalid magic number
Make sure your local server is running and CORS is enabled.")
I think you've fixed it! I just tested it, now it works. (In both Chrome on Windows with NVidia 1060 gpu w/ 6 GB vram, which is what it wasn't working on yesterday, and on Safari on 2026 Mac Mini M4 with 24 GB of RAM. The former is pretty slow, around 1 tok/sec, the latter is fast at 18 tok/sec.)
Yeah, I found a bug during model load occurring with Firefox and low VRAM machines. It is fixed now, thanks!
The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the more VRAM of the mini you can also run Qwen 3.8 27b :)
I really like to showcase this to non-tech people to show what their home machines already can do WITHOUT INSTALLATION in an air-gapped scenario! And given all the recent fuss, we should not trust the big providers at all with important data.
moooff · · focus · HN ↗
<a href="https://github.com/moooff/HermitUI" rel="nofollow">https://github.com/moooff/HermitUI
logicallee · · focus · HN ↗
moooff · · focus · HN ↗
FireFox seems broken in the current Version i.e. i can reproduce the bug. Working on it.
Which browser do you use?
logicallee · · focus · HN ↗
moooff · · focus · HN ↗
The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the more VRAM of the mini you can also run Qwen 3.8 27b :)
I really like to showcase this to non-tech people to show what their home machines already can do WITHOUT INSTALLATION in an air-gapped scenario! And given all the recent fuss, we should not trust the big providers at all with important data.
logicallee · · focus · HN ↗