Running local LLMs on your Mac: what fits, what's free, and what's overkill
Thread
Loading the complete thread in the background. This saved snapshot is available now. Refresh
Unofficial Hacker News client; not affiliated with Y Combinator.
Running local LLMs on your Mac: what fits, what's free, and what's overkill
Loading the complete thread in the background. This saved snapshot is available now. Refresh
Unofficial Hacker News client; not affiliated with Y Combinator.
Ledgermellow · · focus · HN ↗
[dead]
reftel · · focus · HN ↗
WakeUpPeople · · focus · HN ↗
y42 · · focus · HN ↗
>There are others — MLX-native runtimes, llama.cpp directly — but Ollama and LM Studio cover 95% of people reading this.
Sure, but... MLX native runtime have a lot of advantages right? and they are not necessarily more complicated like eg ollama. It's worth to mention them, too.
Coming to the next missing part: use cases.
Running it locally competes with dozens of freely available chat bots. And for most simple parts, seriously, you don't need that sophisticated payed AI service. But then: how do local model's perform exactly here: let's start with coding, image generation and more? Like stuff that I probably really want to run locally.
fron · · focus · HN ↗
the_real_cher · · focus · HN ↗
reassess_blind · · focus · HN ↗
viggio24 · · focus · HN ↗
b3ing · · focus · HN ↗
* nativ
* omlx
* mtplx