‹ BackHN Continuity

Thread

Laya on Mac M4 CoreML Offline

178 points · 34 comments · putna

  1. imranq · · focus · HN ↗
    Based on my admittedly limited research, it seems like you should use Laya for much more deterministic tasks where you have some training data. It won't be as good as Jev for zero shot cases.
    1. jwpapi · · focus · HN ↗
      I think it can make a lot of sense to make a set with jev and then train laya on that set and do the rest with laya for saving $
      1. adinb · · focus · HN ↗
        I did that on a little macbook m4 last night on my model of the innate immune system—fine tuning took 15m or so. Just wish it had a larger context window
        1. jwpapi · · focus · HN ↗
          How about runpod
          1. adinb · · focus · HN ↗
            No need—small and light enough was able to do everything offline, though runpod would work fine, though it‘d be be a quick job
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.