UNLV Retrospective Theses & Dissertations 1-1-2006 An improved algorithm for deinterlacing video streams Christopher Weiss University of Nevada, Las Vegas Follow this and additional works at: https://digitalscholarship.unlv.edu/rtds Repository Citation Weiss, Christopher, "An improved algorithm for deinterlacing video streams" (2006). UNLV Retrospective Theses & Dissertations. 2082. http://dx.doi.org/10.25669/f2rv-104d This Thesis is protected by copyright and/or related rights. It has been brought to you by Digital Scholarship@UNLV with permission from the rights-holder(s). You are free to use this Thesis in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s) directly, unless additional rights are indicated by a Creative Commons license in the record and/ or on the work itself. This Thesis has been accepted for inclusion in UNLV Retrospective Theses & Dissertations by an authorized administrator of Digital Scholarship@UNLV. For more information, please contact [email protected]. AN IMPROVED ALGORITHM FOR DEINTERLACING VIDEO STREAMS by Christopher Weiss Bachelor of Science University of Nevada, Las Vegas 1997 A thesis submitted in partial fulfillment of the requirements for the Master of Science Degree in Computer Science School of Computer Science Howard R. Hughes College of Engineering Graduate College University of Nevada, Las Vegas December 2006 Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. UMI Number: 1441739 INFORMATION TO USERS The quality of this reproduction is dependent upon the quality of the copy submitted. Broken or indistinct print, colored or poor quality illustrations and photographs, print bleed-through, substandard margins, and improper alignment can adversely affect reproduction. In the unlikely event that the author did not send a complete manuscript and there are missing pages, these will be noted. Also, if unauthorized copyright material had to be removed, a note will indicate the deletion. UMI UMI Microform 1441739 Copyright 2007 by ProQuest Information and Learning Company. All rights reserved. This microform edition is protected against unauthorized copying under Title 17, United States Code. ProQuest Information and Learning Company 300 North Zeeb Road P.O. Box 1346 Ann Arbor, Ml 48106-1346 Reproduced witfi permission of tfie copyrigfit owner. Furtfier reproduction profiibited witfiout permission. Thesis Approval The Graduate College University of Nevada, Las Vegas November 30 . 2q06 The Thesis prepared by Christopher Allen Weiss Entitled An Improved Algorithm for Deinterlacing Video Streams is approved in partial fulfillment of the requirements for the degree of Master of Science in Computer Science Examination Committee Chair y I ' Dean of the Graduate College Emmination Committee Member Examination Committee Member Graduate College Faculty Representative 11 Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. TABLE OF CONTENTS ABSTRACT...........................................................................................................................................iv LIST OF FIGURES..............................................................................................................................v ACKNOWLEDGEMENTS.............................................................................................................. vi CHAPTER 1 INTRODUCTION .................................................................................................... 1 Problems Arise With Interlacing............................................................................................... 3 CHAPTER 2 METHODS OF MEASURE..................................................................................5 CHAPTER 3 REVIEW OF PREVIOUS METHODS.............................................................. 8 Line Averaging............................................................................................................................. 10 Field Insertion............................................................................................................................... II Linear Vertical-Temporal Filtering..........................................................................................13 Vertical-Temporal Median Filtering........................................................................................14 Edge-Based Line Averaging....................................................................................................16 Motion-Compensated Vertical-Temporal Median Filtering..............................................19 CHAPTER 4 NEW METHOD ..................................................................................................... 22 Video Object Planes......................................................................................................................22 Difference Image Creation..........................................................................................................24 Canny Edge Detection.................................................................................................................26 Video Object Plane Bounding Box Extraction.................................................................... 31 Video Object Plane Based Deinterlacing................................................................................ 33 CHAPTER 5 COMPARATIVE RESULTS...................................... 39 CHAPTER 6 SUMMARY AND CONCLUSIONS ............................................................... 42 APPENDIX SOURCE CODE .................................................................................on CD-ROM REFERENCES....................................................................................................................................44 VITA ...................................................................................................................................................... 46 m Reproduced witti permission of ttie copyrigfit owner. Furtfier reproduction profiibited witfiout permission. ABSTRACT An Improved Algorithm For Deinterlacing Video Streams by Christopher Weiss Dr. Evangelos Yfantis. Examination Committee Chair Professor of Computer Seience University of Nevada, Las Vegas The MPEG-4 standard for computerized video incorporates the concept of a video object plane. While in the simplest case this can be the full rectangular frame, the standard supports a hierarchical set of arbitrary shaped planes, one for each content- sensitive video object. Herein is proposed a method for extracting arbitrary planes from video that does not already contain video object plane information. Deinterlacing is the process of taking two video fields, each at half the height of the finalized image frame, and combining them into that finalized frame. As the fields are not captured simultaneously, temporal artifacts may result. Herein is proposed a method to use the above mentioned video object planes to calculate the intra-field motion of objects in the video stream and correct for such motion leading to a higher quality deinterlaced output. IV Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. LIST OF FIGURES Eigure I General deinterlacing function....................................................................................... 8 Figure 2 Linear (non-motion compensation) deinterlacing..................................................... 9 Figure 3 Line-averaged deinterlaced frame.................................................................... 10 Figure 4 Artifacts introduced by field insertion........................................................................ 12 Figure 5 Vertical-temporal filtering weights...........................................................................13 Figure 6 Vertical-temporal filtered image ................................................................................. 14 Figure 7 Vertical-temporal median filter..................................................................................15 Figure 8 Vertical-temporal 3-tap median filtering....................................................................16 Figure 9 Edge line averaging edge detection........................................................................17 Figure 10 Edge line averaging pixel interpolation...................................................................17 Figure 11 Edge line averaged image......................................................................................... 18 Figure 12 Block-based sum of absolute error ...........................................................................19 Figure 13 M otion compensating vertical-temporal median filter........................................20 Figure 14 Motion compensated vertical-temporal median filtered frame........................ 21 Figure 15 Difference image function..........................................................................................24 Figure 16 Even field (n).................................................................................................................25 Figure 17 The next even field (n+2)...........................................................................................25 Figure 18 Difference image of fields n and n+2 (border added).........................................25