Thread

1. AHASIC · 1785816514 · focus · HN ↗

   I read a comment on here a few months back I wanna restate. Basically, there is a good chance that Apple is betting that the LLMs in the future will be so efficient that those that consumers will use everyday will be easily computed by the iPhone or even bigger ones on Macs. Honestly makes the most sense that we are heading that way in a few years latest.

   1. Mistletoe · 1785817190 · focus · HN ↗

      What hardware advances would we need to see for that to happen? It feels like everything in that arena has kind of plateaued.

      1. bobbylarrybobby · 1785818526 · focus · HN ↗

         The models themselves have far from plateaued. Maybe someone finds a way to get a really capable model down to, say, 12GB of ram. Then we'd be in business.

         1. swiftcoder · 1785824402 · focus · HN ↗

            Agreed. We've just seen DeepSeek post-train their ~300 billion parameter flash model to outperform their 1.6 trillion parameter pro model, in the space of a few months. There would seem to still be quite a few opportunities on the table to bring big model smarts down to the smaller models

Unofficial Hacker News client; not affiliated with Y Combinator.