Syllabus for Elec 535: Information
and Coding Theory
Rice University, Fall 1996, Fall 1997, Spring 1999
- Information Theory
- Information measures:
entropy, relative entropy and mutual information.
- Asymptotic
equipartition property.
- Entropy rates of
stochastic processes.
- Data compression.
- Channel capacity.
- Differential entropy
and the Gaussian channel.
- Coding Theory
- Linear block codes:
the generator and parity check matrices, Hamming codes.
- Introduction to finite
fields.
- Cyclic codes, Reed-Solomon
codes.
- Convolutional codes
and the Viterbi algorithm.
- Trellis coded
modulation
- Turbo codes
Last modified May 21, 2002.