Thread

1. throwa356262 · 1790427463 · focus · HN ↗

   The sad part of this is that all those powerful NPUs are basically paperweight.

   35-50 low power TOPS taking 1/5 of the die area and not being used by anyone...

   1. samrus · 1790428884 · focus · HN ↗

      We cantnrun local models on them? They must have some sort of api exposed right? Qualcomm has the Snapdragon Neural Processing Engine iirc

      1. InfraScaler · 1790435402 · focus · HN ↗

         Yes, you can. Of course relatively limited, but you absolutely can run local models.

         Based on my own testing, the Windows drivers are a bit restricted to do some more advanced stuff, and it may be due to some security issues in the past? at least that is what I gathered from exploring this issue with GLM 5.3

Unofficial Hacker News client; not affiliated with Y Combinator.