‹ BackHN Continuity

Thread

Can gzip be a language model?

414 points · 165 comments · networked

  1. segmondy · · focus · HN ↗
    I think not. it's true that a large language model compresses knowledge and allows us to decompress knowledge. but gzip compresses data and not knowledge. with a LM you can decompress various forms of knowledge from the same data. gzip is a 1 to 1 kind of decompression where as an LM is a 1 to infinity kind of decompression.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.