‹ BackHN Continuity

Thread

Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data

158 points · 43 comments · Betelbuddy

  1. alightsoul · · focus · HN ↗
    So would it be a 42 trillion parameter model, because that's how many tokens there are in the training data?
    1. k__ · · focus · HN ↗
      Does that mean, it's not compressed anymore?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.