‹ BackHN Continuity

Thread

Alan Kay: Shannon gave us a way of dealing with noisy channels [video]

151 points · 36 comments · behoove

  1. MarkusWandel · · focus · HN ↗
    Did he though? TMK Shannon did specifically not give a way to deal with noisy channels, no. He invented a way to quantify what could be sent on a noisy channel if you figure out the optimal way to do it. This is very similar to "no matter what you figure out about faster travel, you can't go faster than light in a vacuum".

    Calculating the limit is easy with Shannon's theorem. Approaching it in practice is hard.

    1. PunchyHamster · · focus · HN ↗
      > Calculating the limit is easy with Shannon's theorem. Approaching it in practice is hard.

      Many modern modulations already operate basically on Shannon's limit for a given band/SNR. Well, on raw data, the encoding almost always use some kind of error correction so the decoded bitrate is few % lower than the wire one

      1. tverbeure · · focus · HN ↗
        That’s understating the importance of the error coding. The modulation scheme is almost a side show, it’s the modern error coding algorithms (LDPC or Turbo coding) that allows you to get arbitrary close to the Shannon limit.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.