Course Description:This course introduces fundamental theory and techniques for efficient representation and processing of video signals. In this semester, we will focus on signal processing techniques for video communications. Topics to be covered include: introduction to video systems, Fourier analysis of video signals, properties of the human visual system, motion estimation, basic video compression techniques, video communication standards, and stereo video processing. A mini-project is required.

Prerequisites: EL512, E630, and graduate status. Instructor approval required for senior students. This course can be used to form a two-course sequence with EL512.

Instructor: Professor Yao Wang, LC256, (718)-260-3469, yao@vision.poly.edu, http://eeweb.poly.edu/~yao

Course Schedule:Monday 3:35-5:50 PM

Office Hour: Monday 1:00-3:00, Thursday 2:00-4:00

Text Book:Y. Wang, J. Ostermann, and Y.Q.Zhang, Video Processing and Communications. Prentice Hall, 2002.

Recommended Readings:A. N. Netravali and B. G. Haskell, Digital Pictures – Representation, Compression and Standards, 2^nd ed. Plenum Press, 1995.

Grading Policy:Homework 50%, Project (including project presentation and report) 50%. No exams.

• Basics of analog and digital video: color video formation and specification, analog TV system, video raster, digital video formats (Chap. 1, 1 lecture)
• Frequency domain analysis of video signals, spatial and temporal frequency response of the human visual system. (Chap. 2, 1 lecture)
• Scene, camera, and motion modeling, 3D motion and projected 2D motion, models for typical camera/object motions. (Chap. 5, 1 lecture)
• 2D motion estimation: optical flow equation, different motion estimation methods (pel-based, block-based, mesh-based, global motion estimation, multi-resolution approach) (Chap. 6, 2 lecture)
• Basic compression techniques: information bounds for lossless and lossy source coding, binary encoding, scalar/vector quantization (Chap. 8, 2 lecture)
• Waveform-based coding: transform coding, predictive coding including motion compensated prediction and interpolation, block-based hybrid video coding, scalable video coding (Chap. 9 and 11, 2 lecture)
• Video compression standards (H.261 and H.263, MPEG1, MPEG2, MPEG4, MPEG7). (Chap. 13, 2 lecture)
• Error control in video communications (Chap. 14, 1 lecture)
• Stereo and multiview sequence processing (Chap. 12, 1 lecture)