‹ BackHN Continuity

Thread

Laya on Mac M4 CoreML Offline

178 points · 34 comments · putna

  1. PaulRobinson · · focus · HN ↗
    Local LLMs are the future, and one of the reasons I think the data centre furore is just going to end in a market crash.

    LLMs that can reliably be used for control problems are the future, and I think classic/deep RL has generally been overlooked for years for a whole host of problems by wider industry because it felt inaccessible. The first thing I thought of when I saw Jev (and then Laya), was "this might move the needle in a really, really interesting way".

    Local LLMs that can reliably be used for control problems smash through a lot of barriers I'm interested in, and this intrigues me a lot. Guess I'm about to become a big Laya fan if it can run on this kind of hardware to this performance.

    1. frag · · focus · HN ↗
      that&#x27;s not a local LLM. If it&#x27;s local, it doesn&#x27;t matter in this case. Laya is a System 1 &quot;AI&quot;, namely works like a classifier, given a state and questions, it shoots probabilities for each. I publish an episode tomorrow about Laya and Typesafe AI on <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;@DataScienceatHome" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;@DataScienceatHome

      Stay tuned ;)

      1. EagnaIonat · · focus · HN ↗
        I’ve found they start to fail the more classifications you have, long before your typical ML classifier.

        To me it’s like a solution looking for a problem that is already solved.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.