Polytechnic School of
Engineering of New York University
Dept. Electrical &
---- Video Processing, Spring 2014
Course Description: This course introduces fundamental theory and
techniques for efficient representation and processing of video signals. Topics
to be covered include: introduction to video systems, Fourier analysis of video
signals, properties of the human visual system, motion estimation, basic video
compression techniques, video communication standards, and stereo video
processing. A term-project is required in the second half of the semester.
Prerequisites: EL5123, E6303, and graduate status. Instructor
approval required for senior students.
Instructor: Professor Yao Wang, MTC2 Room 9.107, (718)-260-3469,
Email: yw523 at nyu
dot edu. Homepage: http://eeweb.poly.edu/~yao
Course Schedule: Wed 3:00-5:30 PM, RH705
Monday 1-3PM, Wed.
10-12 AM or appointment by email.
Text Book:Y. Wang, J. Ostermann, and Y.Q.Zhang,
Video Processing and Communications. Prentice Hall, 2002.
Grading Policy: One Exam: 60%, Programming assignments: 10%, Project
(depending on project plan, project accomplishment, presentation and final
Homework Policy: Homework problems will be assigned but not graded.
Solutions will be provided. Please check against the solutions carefully. Some
homework assignments will require matlab programming. Only these parts need to
be submitted and graded and counted towards final grade.
Project Guidelines (updated 1/16/2013)
Link to textbook site
Project presentation schedule (List from
Tentative Course Schedule
- Week 1 (1/29): Basics of analog and digital video (Chap. 1) Lecture Note (updated
2/5/13), more complete
note including color; Frequency domain analysis of video signals, spatial and temporal
frequency response of the human visual system (Chap 2). Lecture note (updated
2/5/13), more complete note including review of multidimensional FT;
- Week 2 (2/5) : 2D motion estimation, Part I: 3D and 2D motion
modeling, and basic motion estimation methods (Sec. 5.1,5.5,
6.1-6.4). Lecture note (Updated
- Week 3 (2/12) 2D motion estimation, Part II: advanced techniques
(mesh-based, global motion estimation, multi-resolution approach) (Sec.
6.5-6.10). Lecture note;
- Week 4 (2/19): Video stabilization, panoramic video generation, debluring. Lecture note (uploaded 2/22/13)
- Week 5 (2/26): Basic compression techniques, Part I: information
bounds for lossless and lossy source coding,
binary encoding techniques (LZW, Arithmetic Coding, Sec. 8.1-8.4). Lecture note
- Week 6 (3/5) :
Basic compression techniques, Part II: scalar
and vector quantization
(Chap. 8.5,-9.6). Lecture note
- Week 7 (3/12): Waveform-based coding: transform coding, predictive
coding (Sec. 9.1, 9.2). Lecture note
- Spring break (3/17-3/21)
- Week 8 (3/26): Project plan due
- Week 8 (3/26): Video coding: motion compensated prediction and
interpolation, block-based hybrid video coding (Sec. 9.3). Lecture note (updated 4/12/2012); Scalable
coding (Chap 11), Lecture note, Review Paper on SVC (updated
- Week 9 (4/2):
- Week 10 (4/9) and Week 11 (4/16): Video compression standards
(H.261 and H.263, MPEG1, MPEG2, MPEG4, H.264/AVC, H.264/SVC,H.265/HEVC, AVS). (Chap. 13, 4/10, 4/17, 2 lectures). Lecture note (part 1), Lecture note (part 2) (updated
- Week 12 (4/23): Stereo and multiview video processing (Chap 12), Lecture note (updated 4/22/2012)
- Week 13 (4/30): Error control in video communications and video
streaming over Internet and wireless networks (Chap. 14,15). Lecture note 1 (Error control).
- Week 14 (5/7): Video quality assessment
- Week 15 (5/14): Project Presentation and final report due
- Sample exams:
- S09 midterm, solution
- S09 final,
- S10 midterm,
- S12 final
- S13 exam,
Last updated: 1/20/2014, Yao Wang