These are my Information Theory and Coding notes from my third year, first semester, at BITS Pilani, Dubai Campus. Electronics and communication course.
I started sharing my handwritten study notes online in 2013, when I was an undergrad. The reasoning was plain: if I understood something well enough to get through it, someone else deserved the same chance to learn from it. That decision held. At least one person in the world has studied from my notes every single day since 2013.
Information theory asks a precise question: how much information can a channel carry, and how much of it survives in transit? These notes work through the answers: entropy, channel capacity, Shannon’s theorems, error-correcting codes. Shannon’s theorems are where the subject becomes surprising. They tell you what is possible and what is not, and they draw that line with mathematics. Error-correcting codes take the theory and apply it, protecting data against the noise that channels introduce.
The PDF is embedded on this page. Read it here or download it.
Learn. Share. Repeat.