EE 636 - Digital Video Processing
2008 Spring

Assoc. Prof. Gözde Bozdagi Akar
Dept. of Electrical and Electronics Eng.
D121-1, 210 2341, bozdagi@metu.edu.tr
www.eee.metu.edu.tr/~bozdagi/EE_706.htm

 

The purpose of this course is to present a comprehensive description of digital video processing. The course will start with characteristics of basic analog video systems. Digital video concepts will then be presented. Topics will include filtering, enhancement and motion estimation. Finally a comprehensive description of digital video compression techniques such as H.26x and MPEG-x; transmission of digital video information will be presented.

Course Outline

  • Introduction / Course overview
  • Basics of analog and digital video: color video formation and specification, analog TV system, video raster, digital video formats, spatial and temporal frequency response of the human visual system. 
  • Motion analysis: Real vs apparent motion, motion modeling, spatial-temporal constraint methods (optical flow equation), block-matching methods, mesh-based methods, global motion estimation, multi-resolution approach, motion segmentation   
  • Video Image Filtering: Motion compensated filtering, enhancement, deinterlacing, standards conversion, superresolution 
  • Video compression: information bounds for lossless and lossy source coding, transform coding, predictive coding, motion compensated coding, scalable video coding,  multiview/stereo/mesh coding, video compression standards and Applications
  • Digital Video Communication: video streaming, error resilience, error concealment


Textbook

Digital Video Processing, A. Murat Tekalp, Prentice-Hall, ISBN 0-13-190075-7, August 1995.

Reference Books

·         Video Processing and Communications, Y. Wang, J. Ostermann, Y. Zhang, Prentice Hall, 2002.

·         Digital Video: An Introduction to MPEG-2, B.G. Haskell, A. Puri, and A.N. Netravali, Chapman & Hall, 1997.

·         Motion Analysis and Image Sequence Processing, edited by M.I. Sezan and R.L. Lagendijk, Kluwer Academic Publishers, 1993.

Reference journals

  • IEEE Transactions on Image Processing
  • IEEE Transactions on Circuits and Systems for Video Technology
  • IEEE Transactions on Multimedia Signal Processing: Image Communications
  • International Journal of Computer Vision

Grading

Midterm: 20%
Assignments: 15%
Final Exam: 30%
Term Project (presentation+demo+final report): 35%

 

Assignments

 

There will be three reading assignments, two programming assignments and two problem assignments. All assignments are due before the lecture hours. Reading and problem assignments will be given as printed out. Programming assignments will be sent by e-mail.  Reading assignments will be summary of the given paper. It should be about one page,  and you should explain the main contributions and the important points of the proposed methods in your own words.    
      

 

Project Requirements

 

  • The project requires reading of papers in one of the areas related to the course, implement/compare different approaches and if possible propose your own improvements.
  • Each project may be performed by a single student or a group of two students. However the proposed work for each individual should be identified in the proposal, and the actual contributions of each individual should be identified in the report.
  • Before you sign up for a project, please consider carefully the equipment requirements and what equipment you have access to.


Proposal should include

  • Project title and team members
  • An abstract  in one paragraph or two describing the project scope
  • Detailed project plan   

Preliminary report should include

  • Project title and team members
  • An abstract 
  • Literature survey
  • Revised project plan
  • Your accomplishments and remaining work
  • Hardware and software requirements
  • List of references 

 Final report should include

  • Project title and team members
  • An abstract  
  • Your results and conclusion
  • Your source code in a CD and user manual
  • List of references  

 

Important dates

 

 

Proposal due: 7. March. 2008

Preliminary report due: 4. April. 2008

Midterm: 2. May. 2008

Final report due: 30. May. 2008

 

 

Possible Project Topics and References

 

Deblocking Filter implementation

  • Peter List, Anthony Joch, Jani Lainema, Gisle Bjøntegaard, and Marta Karczewicz, “Adaptive Deblocking Filter”,  IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003.

Distributed Video Coding

  • Lei Wei, Yao Zhao, and Anhong Wang, “ Improved Side-Information in Distributed Video Coding” Proceedings of the First International Conference on Innovative Computing, Information and Control - Volume 2, 2006.
  • Mei Guo, Yan Lu, Feng Wu, Shipeng Li, Wen Gao, “Distributed video coding with spatial correlation exploited only at the decoder”, IEEE International Symposium on Circuits and Systems (ISCAS), pp. 41-44, 2007.

Multiview Distributed Video Coding

 

Activity detection

  • Dhruv Mahajan and Nipun Kwatra and Sumit Jain and Prem Kalra and Subhashis Banerjee, “A Framework for Activity Recognition and Detection of Unusual Activities”, ICVGIP, 2004
  • C. A. Dimoulas, K. A. Avdelidis, G.M. Kalliris, and G. V. Papanikolaou, “Joint Wavelet Video Denoising andMotion Activity Detection in Multimodal Human Activity Analysis: Application to Video-Assisted Bioacoustic/PsychophysiologicalMonitoring”, EURASIP Journal on Advances in Signal Processing, Volume 2008 ,  Issue 1  (January 2008).

 

Aerial survelliance

  • Yi Li, Indriyati Atmosukarto, Masaharu Kobashi, Jenny Yuen and Linda G. Shapiro, “Object and Event Recognition for Aerial Surveillance”, Optics and Photonics in Global Homeland Security. Edited by Saito, Theodore T. Proceedings of the SPIE, Volume 5781, pp. 139-149 (2005).
  • Jongrae Kim, Yoonsoo Kim, “Moving ground target tracking on dense obstacle areas using UAVs, “  in print.

 

Forground/background segmentation

  • Darren E. Butler et. al. , “Real-Time Adaptive Foreground/Background Segmentation”,  EURASIP Journal on Applied Signal Processing, Volume 2005 ,  Issue 1  (January 2005)