Be) (Bexncbe) \(Be
Total Page:16
File Type:pdf, Size:1020Kb
US 20090067508A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2009/0067508 A1 Wals (43) Pub. Date: Mar. 12, 2009 (54) SYSTEMAND METHOD FOR BLOCK-BASED Related U.S. Application Data PER-PXEL CORRECTION FOR FILMI-BASED SOURCES (60) Provisional application No. 60/971,662, filed on Sep. 12, 2007. (75) Inventor: Edrichters als Publication Classification (51) Int. Cl. Correspondence Address: H04N II/02 (2006.01) LAW OFFICE OF OUANES. KOBAYASH P.O. Box 4160 (52) U.S. Cl. ............................ 375/240.24; 375/E07.076 Leesburg, VA 20177 (US) (57) ABSTRACT (73) Assignee: Broadcom Corporation, Irvine, A system and method for block-based per-pixel correction for CA (US) film-based sources. The appearance of mixed film/video can be improved through an adaptive selection of normal deinter (21) Appl. No.: 12/105,664 laced video relative to inverse telecine video. This adaptive selection process is based on pixel difference measures of (22)22) Filed: Apr.pr. 18,18, 2008 sub-blocks within defined blocks of ppixels. SOURCE FILM FRAMES Frame 1 Frame 2 Fram Frame 4 Frame 5 Frame 6 INTERLACED 3:2 VIDEO (BE) 9.(BE) (BEXNCBE)( \(BE). FIELD PHASE DEINTERLACED FRAMES USING REVERSE 3:2 SOURCE OF f BWD WD AWG B WD B FWD AWG B) FWD BD MISSING FIELD Patent Application Publication Mar. 12, 2009 Sheet 1 of 4 US 2009/0067508 A1 I'61) CIE?OV/THE_LNIEC] €)NISTSEIN\/H-] Z.8ESHE/\EH Patent Application Publication Mar. 12, 2009 Sheet 2 of 4 US 2009/0067508 A1 W9. s W9. US 2009/0067508 A1 Mar. 12, 2009 SYSTEMAND METHOD FOR BLOCK-BASED 0011. Unfortunately, many films that have undergone tele PER-PXEL CORRECTION FOR cine have been Subsequently edited using video equipment FILM-BASED SOURCES that ignores the original film cadence. The result is “mixed content where normal video is overlaid on top of film that has undergone a telecine process (e.g., 3:2). If inverse telecine is 0001. This application claims priority to provisional appli performed on Such video, the video-mode parts appear to be cation No. 60/971,662, filed Sep. 12, 2007, which is incorpo “weaved as well, which is visually unappealing. rated by reference herein, in its entirety, for all purposes. 0012. One solution to this problem is to turn off telecine for certain portions of the screen and use a normal video BACKGROUND mode deinterlacer for those cases. What is needed therefore is an efficient mechanism for detecting the regions that contain 0002 1. Field of the Invention Video-mode content and appropriately Switching to video 0003. The present invention relates generally to television mode for those regions. signal decoding and, more particularly, to a system and method for block-based per-pixel correction for film-based SUMMARY SOUCS. 0004 2. Introduction 0013. A system and/or method for block-based per-pixel 0005 Modern high-resolution and high-definition televi correction for film-based sources, Substantially as shown in sions require a method for displaying lower-resolution field and/or described in connection with at least one of the figures, based content (e.g., SDTV. 1080i) in a high quality way. Some as set forth more completely in the claims. types of field-based content can be created through the con version of a progressive source (such as film) using a process BRIEF DESCRIPTION OF THE DRAWINGS commonly referred to as telecine. 0014. In order to describe the manner in which the above 0006 To illustrate the telecine process, consider for recited and other advantages and features of the invention can example the process of converting 24 frame/s film to 59.94 Hz be obtained, a more particular description of the invention NTSC video. NTSC is made up of fields, which are made up briefly described above will be rendered by reference to spe of every other horizontal scanline. One field contains all the cific embodiments thereof which are illustrated in the odd numbered scanlines, while the next field contains all the appended drawings. Understanding that these drawings even numbered Scanlines. A frame is then the combination of depict only typical embodiments of the invention and are not two consecutive fields viewed at the same time. This process therefore to be considered limiting of its scope, the invention is called interlacing. will be described and explained with additional specificity 0007. The conversion of 24 frame/s file to 29.97 frame/s and detail through the use of the accompanying drawings in NTSC interlaced video is known as 3:2 pulldown. In this which: conversion, there are approximately four frames of film for 0015 FIG. 1 illustrates an example of a telecine process. every five frames of NTSC video. These four frames are 0016 FIG. 2 illustrates an example of sub-blocks within a “stretched into five by exploiting the interlaced nature of block of pixels. NTSC video. To illustrate this relation, consider the 3:2 pull 0017 FIG. 3 illustrates an embodiment of a processing down of FIG. 1. block in a motion-adaptive deinterlacer (MAD) that weaves 0008. As illustrated, forevery NTSC frame, there are actu fields together. ally two fields, one for the odd-numbered lines of the image, 0018 FIG. 4 illustrates a flowchart of a process of the designated as the top field (TF), and one for the even-num present invention. bered lines, designated as the bottom field (BF). There are, therefore, ten NTSC fields for every four film frames. To DETAILED DESCRIPTION accommodate this “stretching the telecine process alter nately places the first film frame across two fields, the second 0019 Various embodiments of the invention are discussed frame across three fields, the third frame across two fields, in detail below. While specific implementations are dis and the fourth frame across three fields. The cycle repeats cussed, it should be understood that this is done for illustra itself completely after four film frames have been converted. tion purposes only. A person skilled in the relevant art will As illustrated, the TF of the second film frame and the BF of recognize that other components and configurations may be the fourth film frame are duplicate copies. used without parting from the spirit and scope of the inven 0009. The particular pulldown method that is applied is tion. based on the type of film and the type of display format (e.g., 0020. When normal video is overlaid on top of film that NTSC, PAL, etc.). As such, various other pulldown methods has undergone a telecine process (e.g., 3:2), objectionable Such as 2:2, 5:5, 6:4, 8:7, etc. can be used for a given appli artifacts can occur when an inverse telecine process is per cation formed. For example, titles (or tickers) that move or fade may 0010. To display field-based content that is generated by a be laid over film material. When this mixed content is passed particular telecine process on a modern television display, it is to an intelligent MPEG encoder, the encoder can sometimes therefore necessary to recover the original progressive source pickup the strong 3:2 cadence of the underlying film material, content Such as film. This source can be reconstructed from resulting in a poor display of the moving text. the field-based content using an inverse telecine process. In 0021. In accordance with the present invention, an adap this inverse telecine process, it is critical that the correct tive block-based per-pixel mechanism is provided that can cadence (e.g., 2:2, 3:2, 5:5, 6:4, 8:7, etc.) of the field-based turn off the inverse telecine process for certain portions of the content be identified so that the correct fields can be weaved screen and use a normal video-mode deinterlacer instead. In together to produce the original progressive source. this manner, the normal video-mode content would not US 2009/0067508 A1 Mar. 12, 2009 undergo the inverse telecine process, which can produce 0032. The sbdiff1 for each of the vertically-oriented sub objectionable display of the video-mode content. blocks and the sbdiff2 values for each of the horizontally 0022. One of the difficulties of per-pixel correction is the oriented sub-blocks are compared to a threshold to determine determination of which regions contain video-mode content. if per-pixel correction should be enabled for that particular In the present invention, it is recognized that the differences block. If any of the sbdiff1 or sbdiff2 values exceed the between the repeat fields can be used to determine the areas threshold, then a flag rf motion(bx,by) is set for that block on the screen that are suspected to contain video-mode con indicating the presence of significant repeat field motion. tent. 0033. As would be appreciated, the specific number of 0023. In the example of a 3:2 cadence, such as that illus vertically-oriented and horizontally-oriented sub-blocks cho trated in FIG. 1, the repeat field occurs when the same field is Sen can be implementation dependent. Also, the same number utilized twice. This happens during the '3' part of the 3:2 of sub-blocks need not be used. If that is the case, different cadence. In the example of FIG. 1, the repeat fields occur in thresholds may be used in the analysis vertical and horizontal the top fields (TFs) of Frame 2 and the bottom fields (BFs) of analysis. Frame 4. 0034. In one embodiment, a histogram of values of sbdiff1 0024. In the present invention, the detection of those andsbdiff2 are created.