(12) United States Patent (10) Patent No.: US 6,542,196 B1 Watkins (45) Date of Patent: Apr
Total Page：16
File Type：pdf, Size：1020Kb
USOO6542.196B1 (12) United States Patent (10) Patent No.: US 6,542,196 B1 Watkins (45) Date of Patent: Apr. 1, 2003 (54) ADAPTIVE FIELD PARING SYSTEM FOR 6,269,484 B1 7/2001 Simsic et al. ............... 348/448 DE-INTERLACING 6,348,949 B1 * 2/2002 McVeigh .................... 348/448 (75) Inventor: Daniel Watkins, Saratoga, CA (US) * cited by examiner (73) Assignee: LSI Logic Corporation, Milpitas, CA (US) Primaryrimary ExaminerExaminer-Sherrie CC HsiSa (*) Notice: Subject to any disclaimer, the term of this (74) Attorney, Agent, or Firm-Christopher P. Maiorana, patent is extended or adjusted under 35 PC U.S.C. 154(b) by 0 days. (57) ABSTRACT (21) Appl. No.: 09/435,184 A method for de-interlacing a decoded Video Stream com (22) Filed: Nov. 5, 1999 prising the Steps of (A) defining a sampling period, (B) 7 9 Sampling the decoded Video Stream during the Sampling (51) Int. Cl.' .................................................. H04N 7/01 period to define one or more parameters, (C) adjusting a (52) U.S. Cl. ........................................ 348/448; 348/452 threshold and a level of the decoded video stream used in (58) Field of Search ................................. 348/448, 452, processing, in response to the one or more parameters, (D) 348/441; H04N 7/01 filtering the decoded Video Stream using a filter tool Selected (56) References Cited from a plurality of filters, in response to the one or more parameterS. U.S. PATENT DOCUMENTS 6,118,488 A * 9/2000 Huang ........................ 348/448 20 Claims, 5 Drawing Sheets ASC Monitor Interlaced-60 fields/sec 1920x1080 - 16:9 704 x 480 - 16:9 704 x 480 - 4:3 (TV today) 640x480 - 4:3 Progressive-60, 30.24 frames/sec 1920x1080 - 16:9 (No. 60) 1280x720 - 16:9 704 x 480 - 169 704 x 480 - 4:3 (Computer today 60 Format framesisec) Conversion 640x480 - 4:3 SVGA Connector O 1394 f21 f2 f11 1 - 2- - 1. OO 2- 3 f2 f 102 24 (user) options (e.g., Block, MB, Slice, Picture) 104 122 Calibration - pixel match threshold - level of match - select new pixel generation method f12, 480 P - pixel match type (column, row, etc) 126 U.S. Patent Apr. 1, 2003 Sheet 1 of 5 US 6,542,196 B1 10-Na Composite 300 HL of R DVD 720 x 480 i NTSC/PAL S-VideO 4OOHL of R leadter 55, 5.6O1 Encoder RGB 47sHLof R 60 fields/Sec YUV OF Y 14 1 6bpixel Composite 60 fields/sec NTSC/PAL lated EnCOder OO up to 720 16 pixels/line 28 Progressive up to 640 Monitor pixels/line max resolution available 2O to support PC monitor SVGA Connector 3O SVGA Controller Progressive Line Doubling Monitor (No de-interlace) 48O 60 frames/Sec line frame 1280 x 1024 max 18 DRAM Square pixels 720 x 480i (60 fields/sec) converted to 720 x 480p (60 frames/sec) (Conventional) FIG.1 U.S. Patent Apr. 1, 2003 Sheet 2 of 5 US 6,542,196 B1 52 50 54 Composite DeCOCler NTSC/PAL EnCOder (Conventional) FIG.2 Horizontal 6O 64 Spacial Resolution Vertical Display Controller ResolutionSpacial a Vertical filter to 2X for SF 720 x 576/25 *352 X 288/25 4-tap luma 352 x 240/30 2-tap chroma 66%, SF Also, LB, .75LB, .5LB filtering 6O fields/Sec frame OR is pixel area Horiz DeCim. Filter * 2 pixels averaged to 1 pixel Reg 274.6 Horiz D.F. Enable CCR 6O1 Horiz Filter 8-tap to 720 pixels/line Horiz pan & scan to 1/8 pixel luma & chroma * Reg 277 scale Reg 276.1 Horiz F. Enable * Reg 278 Main Reads/line from FS Host Controller parses MPEG2 seq & picture header for: Ver Res, Horiz Res, pict/se, Aspect Ratio, Prog/Inter, (Sed) (Sed) (Seq) (Seq) (Seq) (Pict) (Conventional) FIG.3 U.S. Patent Apr. 1, 2003 Sheet 3 of 5 US 6,542,196 B1 Comp 656/6O1 NTSC S-Video 27MHZ EnCOder 352 X 240 lumaAll e 96.pixel4:2:2 RGB 12b/pixel X240 x 240 66 fields/sec Progressive frame is usually SIF, so first 240 lines go to each field. comp 300 HLR Odd lines even lines top field bottom field S-Video 400 HR RGB 476 HR 656/6O1 27MHz 720 x 480 field 1 field 2 4:2:2 16b/pixel 12b/pixel x 240 x 240 60 fields/Sec (Conventional) FIG.4 ATSC Monitor Interlaced-60 fields/sec 1920 x 1080 - 16:9 704 x 480 - 16:9 704 x 480 - 4:3 (TV today) 640 x 480 - 4:3 Progressive-60, 30,24 frames/sec 1920 x 1080 - 16:9 (No. 60) 1280 x 720 - 16:9 704 x 480 - 16:9 704 x 480 - 4:3 (Computer ATSC today 60 Format frames/sec) Conversion 640 x 480 - 4:3 SVGA Connector O 1394 FIG.5 U.S. Patent Apr. 1, 2003 Sheet 4 of 5 US 6,542,196 B1 f21 f12 f11 1OO - e2 - 31 - 1. f2 f1 124 match G <threshold (user) options (e.g., Block, MB, Slice, Picture) New pixel generation 122 Calibration - pixel match threshold - level of match - select new pixel generation method f12, 480 P - pixel match type (column, row, etc) 126 FIG.6 2OO 2O2BOCk o Example is to default to MB pixel thresholds = 204 200 and MB level non-field blending. o Selection of sections to be non-field blending based On MSE > threshold can be user defined - to be Block, MB, Slice, or Picture boundary MB Slice o User can Select threshold as Well Picture FIG.7 U.S. Patent Apr. 1, 2003 Sheet 5 of 5 US 6,542,196 B1 field 21 f12 f11 1 - 2- 1 - If no motion between f11 & f12, P12 = f12 & f11 blended. 3- I3 - If motion between f11 & f12, within Block, MB, slice pixels: P122 - . 1 f11 1 - 1 f113 - 6 f12 2 - . 1 f21 1 - . 1 f21 3 P123 - 3 f11 3-3 f12 2 - 2 f12 14 - 2 f21 3 P12 1080 480 i 2 3 51 - .752 4. 5 *2 - 53 6 7 53 - 254 8 9 1 O 11 2 55 - 756 13 14 15 16 5*I7 - 258 17 18 19 2O 21 69 - 75*10 22 O 23 1078 - 75*479 - 25*48O 1 O79 = 480 1080 = 480 o is line e Only upsample to match display capabilities o Software loads coefficient into interpolator engine FIG.9 US 6,542,196 B1 1 2 ADAPTIVE FIELD PARING SYSTEM FOR Sive frame; (ii) choosing either a first field or a second, DE-INTERLACING double the number of lines, and using the combination as a progressive frame; (iii) Vertical filtering nearby lines to create a missing line; (iv) vertical temporal filtering (this is FIELD OF THE INVENTION (iii) plus temporal filtering from adjacent fields); (V) adap tive motion compensation (i.e., using the current field com The present invention relates to de-interlacing Systems pared to the previous first or Second fields on a pixel by pixel generally and, more particularly, to a System for enabling basis); and (vi) traditional adaptive field pairing (i.e., if no adaptive field pairing based on predetermined, user defined, motion-field merge, if motion-vertical temporal filtering of and/or auto-calibrated de-interlacing parameters. entire frame). BACKGROUND OF THE INVENTION The disadvantages with conventional de-interlacing meth ods (i) is if there is movement between the fields, jagged De-interlacing is necessary to display interlaced Source edges may result; (ii) is use of only one-half the vertical material on a progressive-only display. Also, de-interlacing information available, if 30 frames/sec, or if 60 frames/sec, can remove or reduce interlacing artifacts. Most televisions 15 flicker can occur Since there are fill lines, (iii, iv, V) is lack are interlaced for historic and bandwidth Saving reasons, of use of field merge, and (vi) is visible Switching between sending fields every 60th of a second, where two fields make types, especially around the motion threshold. up a frame. Most computer monitors are progressive, Send ing frames every 60th of a Second, depending on the SUMMARY OF THE INVENTION particular refresh rate implemented. One aspect of the present invention concerns a method for Referring to FIG. 1, an example of a conventional de-interlacing a decoded Video Stream comprising the Steps de-interlacing System is shown. The System 10 generally of (A) defining a sampling period, (B) sampling the decoded comprises a Source decoder 12, an encoder 14, an encoder Video Stream during the Sampling period to define one or 16, a circuit 18. The circuit 18 may present signals to an more parameters, (C) adjusting a threshold and a level of the SVGA connector 20. The SVGA connector 20 is connected 25 decoded Video stream used in processing, in response to the to a progressive monitor 22 that can display 60 frames per one or more parameters, (D) filtering the decoded video Second. The encoder 14 presents either a composite Signal, Stream using a filter tool Selected from a plurality of filters, an S-Video Signal or an RGB signal. The composite, S-Video in response to the one or more parameters. or RGB signal is presented to an interlaced monitor 24. The encoder 16 presents either a composite, an S-Video or an Another aspect of the present invention concerns a RGB signal to an interlaced monitor 26. Additionally, the method for de-interlacing a decoded Video Stream having a RGB signal is presented to a progressive monitor 28. The plurality of frames comprising the steps of (A) comparing a circuit 18 includes a line doubler 30 and a RGB conversion first one of the plurality of frames with a next one of the circuit 32.