Thread

1. altano · 1789931545 · focus · HN ↗

   How much memory does this use of the test machine's (M3 Max) 128 GB unified memory?

   1. WASDx · 1789932887 · focus · HN ↗

      The model is only 0.3B params so probably not much.
   2. putna · 1789934829 · focus · HN ↗

      Physical footprint: 560.4M Physical footprint (peak): 778.0M
   3. ImJasonH · 1789951842 · focus · HN ↗

      I had Fable one-shot the same demo from the same weights on an iPhone 15 Pro and it decides in ~40ms.

Unofficial Hacker News client; not affiliated with Y Combinator.