---

Syllabus for EL 606: Information Theory
Polytechnic University

---

• Information measures: entropy, relative entropy and mutual information.
• Asymptotic equipartition property.
• Entropy rates of stochastic processes (brief).
• Data compression.
• Channel capacity.
• Differential entropy and the Gaussian channel.
• Rate distortion theory (brief).
• Network information theory (brief).

---

Last modified May 21, 2002.