Polytechnic University, Electrical Engineering
EL6123 ---- Video Processing, Spring 2009
http://eeweb.poly.edu/~yao/EL6123

Course Description: This course introduces fundamental theory and techniques for efficient representation and processing of video signals. Topics to be covered include: introduction to video systems, Fourier analysis of video signals, properties of the human visual system, motion estimation, basic video compression techniques, video communication standards, and stereo video processing. A term-project is required.

Prerequisites: EL5123, E6303, and graduate status. Instructor approval required for senior students. This course can be used to form a two-course sequence with EL5123.

Instructor: Professor Yao Wang, LC256, (718)-260-3469, Email:  yao at poly dot email, http://eeweb.poly.edu/~yao

Course Schedule: Wed. 3:00-5:40 PM

Office Hour: Monday 4-5PM, Wed. 10-11AM, or by email.

Text Book:Y. Wang, J. Ostermann, and Y.Q.Zhang, Video Processing and Communications. Prentice Hall, 2002.

Grading Policy:  Y. Exam 1: 30%, Exam 2: 30%, Programming assignments: 10%, Project (depending on project accomplishment, presentation and final report): 30%.

Homework Policy: Homework problems will be assigned but not graded. Solutions will be  provided. Please check against the solutions carefully. Some homework assignments will require programming and testing. Only these parts need to be submitted and graded and counted towards final grade.

Tentative Course Schedule

  • Basics of analog and digital video: color video formation and specification, video raster, frequency domain characterization of video signals, analog TV systems (color multiplexing and demultiplexing).   (Chap. 1, 1 lecture, 1/21)  Lecture Note;
  • Frequency domain analysis of video signals, spatial and temporal frequency response of the human visual system (Chap 2). Lecture note ; Digital video format and video format conversion (Sec. 1.5) (from last lecture note). (1 lecture, 1/28);
  • 2D motion estimation, Part I: 3D and 2D motion modeling, and basic motion estimation methods (Sec. 5.1,5.5, 6.1-6.4, 1 lecture, 2/4). Lecture note;
  • Project plan due (2/11)
  • 2D motion estimation, Part II: advanced techniques (mesh-based, global motion estimation, multi-resolution approach) (Sec. 6.5-6.10, 2/11). Lecture note;
  • Basic compression techniques, Part I: information bounds for lossless and lossy source coding, binary encoding techniques (LZW, Arithmetic Coding, Sec. 8.1-8.4, 2/18). Lecture note  
  • Midterm review. Review notes
  • First Exam (3/4)
  • Basic compression techniques, Part II: scalar and vector quantization (Chap. 8.5,-9.6, 2/25). Lecture note
  • Waveform-based coding: transform coding, predictive coding (Sec. 9.1, 9.2, 3/11). Lecture note
  • Spring break (3/16-3/20)
  • Midterm Project Report due (3/26)
  • Video coding: motion compensated prediction and interpolation, block-based hybrid video coding, scalable video coding (Sec. 9.3 and Chap. 11, 3/26). Lecture note
  • Video compression standards (H.261 and H.263, MPEG1, MPEG2, MPEG4, H.264). (Chap. 13, 4/1, 4/8, 2 lectures). Lecture note
  • Stereo and multiview video processing (Chap 12, 4/15), Lecture note
  • Error control in video communications and video streaming over Internet and wireless networks (Chap. 14,15, 1 lecture, 4/22). Lecture note 1 (Error control), Lecture note 2 (video streaming, by Dapeng Wu)
  • Second exam (4/29) 
  • Project Presentation and final report due  (5/6, 1-5:30 PM)
  • Sample exams:
    1. S07_midterm_w_solution;
    2. S07_final_w_solution;
    3. S08_midterm;
    4. S08_final.

Last updated: 4/23/2009, Yao Wang