Thread

1. jahala · 1789835553 · focus · HN ↗

   Is this at all possible to run locally on a MacBook pro m5 (48gb ram)? What kind of performance could I expect? Or would you run this somewhere in the cloud? What HW / which provider would you choose (single user for exploration only)

   1. nacs · 1789865672 · focus · HN ↗

      Easily. It took around 4GB VRAM on my nvidia card so a 48GB unified mem should have no issue. < 1s inference

Unofficial Hacker News client; not affiliated with Y Combinator.