‹ BackHN Continuity

Thread

Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

310 points · 140 comments · leonickson

  1. AHASIC · · focus · HN ↗
    I read a comment on here a few months back I wanna restate. Basically, there is a good chance that Apple is betting that the LLMs in the future will be so efficient that those that consumers will use everyday will be easily computed by the iPhone or even bigger ones on Macs. Honestly makes the most sense that we are heading that way in a few years latest.
    1. greggsy · · focus · HN ↗
      The innovation curve doesn’t always reward the innovators. It pays to let others test the waters before you.
      1. dd8601fn · · focus · HN ↗
        Especially if you’re Apple and your expertise and reputation is in making privacy conscious devices and cloud services that are exceptionally user friendly.

        Then you go to the AI labs and say, “We see you’ve spent a trillion dollars on that model… we’ll write you a check today to let us run it how we want.”

        Skips the ugly horse race and massive risk while focusing on what they do better than anyone.

        And they’re the only ones who have cultivated the trust with normal people to be able to say, “We now have the only AI service that can safely reference your personal info without giving it all to strangers.”

        They could possibly end up the second biggest winners in this insane hype cycle… without having had to compete on making a sota model.

        1. dghlsakjg · · focus · HN ↗
          Apple has a real knack for not being first mover but being “best” mover. They didn’t invent tablets or mp3 players or thin laptops or ARM laptops, but once they entered those markets they absolutely became the definitional product for the entire category.

          We don’t talk about AVP.

          1. red_green_yell · · focus · HN ↗
            Don’t forget AirPods, Apple TV, and Apple Watch. They were not first but they are currently best. The Alexa thing and AVP are notable fails.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.