Agree. I took a look at these last few months, did a write-up: <a href="https://languageops.com/blog/ai-safety-pdoom-local-vs-frontier/" rel="nofollow">https://languageops.com/blog/ai-safety-pdoom-local-vs-fronti... and I don't know if I agree or not on outlawing completely, but I think an age restriction *at least* like for alcohol, firearms and driving would be not unwise.
They're pretty basic and hallucinate a lot. There are some hard limits to how good you can get on a model that fits on a phone.
Qwen3 and Gemma level models that run on mid-high end laptops and desktops can be pretty good. Not frontier grade, but shockingly competent for something that runs on a single PC. But the hardware you need to run those fast is at least $1000-$2000. Cheap hardware can run them, but slooooooow.
Tepix · · focus · HN ↗
luxpir · · focus · HN ↗
mitxela · · focus · HN ↗
redoxate · · focus · HN ↗
api · · focus · HN ↗
Qwen3 and Gemma level models that run on mid-high end laptops and desktops can be pretty good. Not frontier grade, but shockingly competent for something that runs on a single PC. But the hardware you need to run those fast is at least $1000-$2000. Cheap hardware can run them, but slooooooow.
ourcat · · focus · HN ↗
Also tried the "Locally Uncensored" setup on a 3060 laptop, which worked surprisingly well.