EL612 ---- Video Processing

Polytechnic School of Engineering of New York University

Dept. Electrical & Computer Engineering
EL6123 ---- Video Processing, Spring 2014
http://eeweb.poly.edu/~yao/EL6123

Course Description: This course introduces fundamental theory and techniques for efficient representation and processing of video signals. Topics to be covered include: introduction to video systems, Fourier analysis of video signals, properties of the human visual system, motion estimation, basic video compression techniques, video communication standards, and stereo video processing. A term-project is required in the second half of the semester.

Prerequisites: EL5123, E6303, and graduate status. Instructor approval required for senior students.

Instructor: Professor Yao Wang, MTC2 Room 9.107, (718)-260-3469, Email: yw523 at nyu dot edu. Homepage: http://eeweb.poly.edu/~yao

Course Schedule: Wed 3:00-5:30 PM, RH705

Office Hour: Monday 1-3PM, Wed. 10-12 AM or appointment by email.

Text Book:Y. Wang, J. Ostermann, and Y.Q.Zhang, Video Processing and Communications. Prentice Hall, 2002.

Grading Policy: One Exam: 60%, Programming assignments: 10%, Project (depending on project plan, project accomplishment, presentation and final report): 30%.

Homework Policy: Homework problems will be assigned but not graded. Solutions will be provided. Please check against the solutions carefully. Some homework assignments will require matlab programming. Only these parts need to be submitted and graded and counted towards final grade.

Project Guidelines (updated 1/16/2013)

Link to textbook site

Project presentation schedule (List from F11)

Sample Video Data

Tentative Course Schedule

Week 1 (1/29): Basics of analog and digital video (Chap. 1) Lecture Note (updated 2/5/13), more complete note including color; Frequency domain analysis of video signals, spatial and temporal frequency response of the human visual system (Chap 2). Lecture note (updated 2/5/13), more complete note including review of multidimensional FT;
Week 2 (2/5) : 2D motion estimation, Part I: 3D and 2D motion modeling, and basic motion estimation methods (Sec. 5.1,5.5, 6.1-6.4). Lecture note (Updated 2/5/13);
Week 3 (2/12) 2D motion estimation, Part II: advanced techniques (mesh-based, global motion estimation, multi-resolution approach) (Sec. 6.5-6.10). Lecture note;
Week 4 (2/19): Video stabilization, panoramic video generation, debluring. Lecture note (uploaded 2/22/13)
Week 5 (2/26): Basic compression techniques, Part I: information bounds for lossless and lossy source coding, binary encoding techniques (LZW, Arithmetic Coding, Sec. 8.1-8.4). Lecture note
Week 6 (3/5) : Basic compression techniques, Part II: scalar and vector quantization (Chap. 8.5,-9.6). Lecture note
Week 7 (3/12): Waveform-based coding: transform coding, predictive coding (Sec. 9.1, 9.2). Lecture note (updated 4/12/2012)
Spring break (3/17-3/21)
Week 8 (3/26): Project plan due
Week 8 (3/26): Video coding: motion compensated prediction and interpolation, block-based hybrid video coding (Sec. 9.3). Lecture note (updated 4/12/2012); Scalable coding (Chap 11), Lecture note, Review Paper on SVC (updated 4/12/2012).
Week 9 (4/2): Exam
Week 10 (4/9) and Week 11 (4/16): Video compression standards (H.261 and H.263, MPEG1, MPEG2, MPEG4, H.264/AVC, H.264/SVC,H.265/HEVC, AVS). (Chap. 13, 4/10, 4/17, 2 lectures). Lecture note (part 1), Lecture note (part 2) (updated 4/12/2012);
Week 12 (4/23): Stereo and multiview video processing (Chap 12), Lecture note (updated 4/22/2012)
Week 13 (4/30): Error control in video communications and video streaming over Internet and wireless networks (Chap. 14,15). Lecture note 1 (Error control).
Week 14 (5/7): Video quality assessment
Week 15 (5/14): Project Presentation and final report due
Sample exams:

Last updated: 1/20/2014, Yao Wang