‹ BackHN Continuity

Thread

Can gzip be a language model?

414 points · 165 comments · networked

  1. northlondoner · · focus · HN ↗
    Reminded me Google&#x27;s earlier paper, &quot;Language Modeling Is Compression&quot; <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2309.10668" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2309.10668

    Learning being a compression is also recently proposed as Gibbs compression proposition.

    See Gibbs randomness-compression proposition <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2505.23869v5" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2505.23869v5

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.