Polytechnic University, Electrical Engineering
EL6123 ---- Video Processing, Spring 2010
http://eeweb.poly.edu/~yao/EL6123


Course Description: This course introduces fundamental theory and techniques for efficient representation and processing of video signals. Topics to be covered include: introduction to video systems, Fourier analysis of video signals, properties of the human visual system, motion estimation, basic video compression techniques, video communication standards, and stereo video processing. A term-project is required.

Prerequisites: EL5123, E6303, and graduate status. Instructor approval required for senior students. This course can be used to form a two-course sequence with EL5123.

Instructor: Professor Yao Wang, LC256, (718)-260-3469, Email:  yao at poly dot edu. Homepage: http://eeweb.poly.edu/~yao

Course Schedule: Thursday 3:00-5:40 PM

Office Hour: Monday 4-5PM, Thur. 10-11 AM or by email.

Text Book:Y. Wang, J. Ostermann, and Y.Q.Zhang, Video Processing and Communications. Prentice Hall, 2002.

Grading Policy:  Y. Exam 1: 30%, Exam 2: 30%, Programming assignments: 10%, Project (depending on project accomplishment, presentation and final report): 30%.

Homework Policy: Homework problems will be assigned but not graded. Solutions will be  provided. Please check against the solutions carefully. Some homework assignments will require programming and testing. Only these parts need to be submitted and graded and counted towards final grade.

Tentative Course Schedule

  • Basics of analog and digital video: color video formation and specification, video raster, frequency domain characterization of video signals, analog TV systems (color multiplexing and demultiplexing).   (Chap. 1, 1 lecture, 1/21)  Lecture Note;
  • Frequency domain analysis of video signals, spatial and temporal frequency response of the human visual system (Chap 2). Lecture note ; Digital video format and video format conversion (Sec. 1.5) (from last lecture note). (1 lecture, 1/28);
  • 2D motion estimation, Part I: 3D and 2D motion modeling, and basic motion estimation methods (Sec. 5.1,5.5, 6.1-6.4, 1 lecture, 2/4). Lecture note;
  • Project plan due (2/11)
  • 2D motion estimation, Part II: advanced techniques (mesh-based, global motion estimation, multi-resolution approach) (Sec. 6.5-6.10, 2/11). Lecture note;
  • Basic compression techniques, Part I: information bounds for lossless and lossy source coding, binary encoding techniques (LZW, Arithmetic Coding, Sec. 8.1-8.4, 2/18). Lecture note  
  • Basic compression techniques, Part II: scalar and vector quantization (Chap. 8.5,-9.6, 2/25). Lecture note
  • First Exam, 3/4 ;  Midterm Review notes
  • Waveform-based coding: transform coding, predictive coding (Sec. 9.1, 9.2, 3/11). Lecture note
  • Spring break (3/15-3/19)
  • Midterm Project Report due (3/25)
  • Video coding: motion compensated prediction and interpolation, block-based hybrid video coding, scalable video coding (Sec. 9.3 and Chap. 11, 3/25). Lecture note
  • Video compression standards (H.261 and H.263, MPEG1, MPEG2, MPEG4, H.264). (Chap. 13, 4/1, 4/8, 2 lectures). Lecture note, Review Paper on SVC
  • Stereo and multiview video processing (Chap 12, 4/15), Lecture note
  • Error control in video communications and video streaming over Internet and wireless networks (Chap. 14,15, 1 lecture, 4/22). Lecture note 1 (Error control), Lecture note 2 (video streaming, by Dapeng Wu)
  • Second exam (4/29) 
  • Project Presentation and final report due  (5/6, 1-5:50 PM)
  • Sample exams:
    1. S07_midterm_w_solution;
    2. S07_final_w_solution;
    3. S08_midterm;
    4. S08_final. solution
    5. S09 midterm,  solution
    6. S09 final, solution
    7. S10 midterm, solution

Last updated: 4/26/2010, Yao Wang