‹ BackHN Continuity

Thread

Can gzip be a language model?

414 points · 165 comments · networked

  1. elendilm · · focus · HN ↗
    Good article.

    Compression is a property of language.

    A seemingly simple sentence like "I had lunch" has enormous amount of information compressed inside it.

    The word lunch is a compressed form of "having food at noon" while "noon" in turn is a compressed form of "Sun's position against Earth's rotation" and so on and so forth.

    Every sentence has layers of compressed sentences. How many layers one chooses to decompress is up to the person.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.