Thread

1. nialv7 · 1791123089 · focus · HN ↗

   There are so many AI generated inference engine for local models now, each of them are generally narrower but they are all faster than llama.cpp. Maybe llama.cpp needs to rethink their strategies...

   1. mkatx · 1791151858 · focus · HN ↗

      Does anything else support Pascal gpu's though?

Unofficial Hacker News client; not affiliated with Y Combinator.