Thread

1. panny · 1791121753 · focus · HN ↗

   I'm far less interested in how good a big expensive model is on hardware 99% of people can't afford and would rather see what runs best on a chromebook or mobile phone with 8GB of RAM.

   1. MaxikCZ · 1791123691 · focus · HN ↗

      The reason models running on low vram are not talked about enough is because they are just not worth it. Qwen3.8 27b changed that, but even 24gb vram is too low for it. Running better model faster at 12gb vram is where its now at, and thats why you see people talkin about it

Unofficial Hacker News client; not affiliated with Y Combinator.