IMAGE ) I TEXTURE Tmn PICIJURE 128 I MAPS ‘/ J 56/ U.S
Total Page:16
File Type:pdf, Size:1020Kb
US006538658B1 (12) United States Patent (10) Patent N0.: US 6,538,658 B1 Herrera (45) Date of Patent: Mar. 25, 2003 (54) METHODS AND APPARATUS FOR (58) Field of Search ............................... .. 345/582, 589, PROCESSING DVD VIDEO 345/583, 600, 441, 385 (75) Inventor: Alex John Herrera, Burlingame, CA (56) References Cited (Us) US. PATENT DOCUMENTS (73) Assigneei Koninklijke Philips Electronics N-V-> 5,870,097 A * 2/1999 Snyder et al. ............ .. 345/426 E1ndh0ven(NL) 6,333,743 B1 * 12/2001 Gossett etal. ............ .. 345/582 ( * ) Notice: Subject to any disclaimer, the term of this * Cited by examiner patent is extended or adjusted under 35 U‘SC' 154(k)) by 73 days‘ Primary Examzner—Mark Zimmerman Assistant Examiner—Mano Padmanabhan (21) Appl. No.: 09/677,823 (57) ABSTRACT (22) Filed: Sep. 30, 2000 A 3D graphics accelerator is modi?ed to support MPEG-2 video decoding in a computer system con?gured to playback Related US. Application Data a DVD data stream. The methods and apparatus modify the 3D graphics accelerator to conduct motion compensation (62) Division of application NO- 08/963,931, ?led 0n NOV- 4, and/or YUV 4:2:0 to YUV 4:2:2 conversion. Sub-code 1997’ now Pat‘ NO‘ 672087350‘ blending can also be further supported by the 3D graphics (51) Int. c1.7 ................................................ .. G09G 5/00 accelerator (52) US. Cl. ..................... .. 345/582; 345/589; 345/503; 345/600 22 Claims, 8 Drawing Sheets ON SCREEN PORTION i OFF SCREEN PORTION ' \ 1I —3D 1126 m I TEXTURE I i M APS w12421 PICTURE FOR I i I > MPEG-2 'I 3O. A |[IIAOITIIIQEIIINSATION IMAGE ) I TEXTURE Tmn PICIJURE 128 I MAPS ‘/ j 56/ U.S. Patent Mar. 25,2003 Sheet 1 of 8 US 6,538,658 B1 10 DVD DATA STREAM / 13 nvn STREAM DEMULTIPLEX } 12 17 15% I K DVD VLD SUB-PICTURE DECODE IQUANT (OSD) _,._T IDCT MOTION I8 COMPENSATION YUV 412:0 TO 4:212 "-30 14 CONVERSION . I ALPHA BLENOING $32 YUV TO ROB 34 CONVERSION ‘f IMAGE SCALING $36 \ I EIG.I U.S. Patent Mar. 25,2003 Sheet 2 of 8 US 6,538,658 B1 \_ RROOESSOR 40 42 E-AM / 46“ CHIPSET DRAM "48 52 PCI BUS 58 \ ISA BUS 50) I / I 54”’ GRAPHICS DISPLAY STORAGE SOUND DEVICE 60f 62f 56*\ BUFFER FIG. 2a PRIOR ART 42\ PROOESSOR 40' / 46“ CHIPSET DRAM "48 52 j P C I BUS 58 \ ISA BUS 50 I / I 54f” GRAPHICSQ DISPLAY STORAGE K 64 SOUND DEVICE I 62} | I 56*\ ROEEER FIG. 2b PRIOR ART U.S. Patent Mar. 25,2003 Sheet 3 of 8 US 6,538,658 B1 DVD PROCESS PROCESSOR BURDEN HARDWARE COST SYSTEM PARSING / VLD 20% HIGH IDCT/IOUANT 12% MODERATE MOTION COMPENSATION 30% LOW YUV 432:0 CONVERSION 25% LOW RGB CONVERSION 0% EXISTING SUB-PICTURE BLEND N/A LOW AC-S DECODE 13% MODERATE FIG.3 U.S. Patent Mar. 25,2003 Sheet 4 of 8 US 6,538,658 B1 PCI / 50 T BUS GHAPHICSACCELERATOR l SYSTEM INTERFACE 99 58 + 90f / / —> DAC > DISPLAY GE’RERES i T 596A f K98 i E ROO : i : OONvERTER : 94f MEMORYCONTROLLER 9'5 + i N FRAME 3D 56MODEL BUFFERLIGHTING VIEW POINT 202~ OATA DATA DATA \ EOLL/ >06 / 200 GEOMETRY $208 (SS/TV) LIGHTING ~21O MAP TO VIEW PORT @212 (W) TRIANGLE RASTERIZE ~216 U.S. Patent Mar. 25,2003 Sheet 5 of8 US 6,538,658 B1 (FROM SYSTEM I/F) COMMANDS 100x + COMMANO INTERFACE I ¢ /104 J92 CONTROL SET-UP ‘ REGISTER ENGINE ‘_ K 106 3D 102 l / GRAPHICS RASTERIZER <—~ ENGINE I + 6 (TO/FROMMEMORY - CONTROLLER) FROM SET-UP ENGINE + SCAN CONVERTER I—-> TEXTUERBIEGIYINAEPPING / I112 <— 108 “DJ INTERPOLATORS + f106 114% RASTER OPERATIONS 1158 H. 115R 4 + CONF/IFIMmIMDS YOFFSET COMMANO imi» P'XEh)Pé|%K'NG H I/FOF VOFFSET REGISTER ——> \ 116 V (MEMORY FIG. 7 CONTROLLER) U.S. Patent Mar. 25,2003 Sheet 6 6f 8 US 6,538,658 B1 PROCESSOR 45 \F CHIP SET DRAM PCI BUS (AGP) ISA BUS / I 50 I [52 WW2 SOUND STORAGE MODIFIED DEVICE GRAPHICS DISPLAY ACCELERATOR FRAME N 56 BUFFER FIG.8 O N m on Tll m N E m SIII WWn O4' 4DH 1N4| H2.I.2 a PDIE 66LEw mN J¢m %2 W6 N0) %0 _I.I _UMHM MM Mm. v 4 DUDI8S n.WMMOR%WW WWW 6% _AIn W N 3_|A...3_TA 8 will} 56/ FIG.9 U.S. Patent Mar. 25,2003 Sheet 7 of8 US 6,538,658 B1 Y3 Y2 Y1 Y0 REGISTER3 HEGISTERZ REG|STER1 REGISTERO 140d J 1406H \140b \1403 Y2 Y0 }150a FIG. 10a U3 U2 U1 U0 REGISTEH3 REGISTERZ REG|STER1 REGISTERO J / \ 140d 1400 v 140,) \140a u }150b V3 V2 V1 V0 REGISTER3 REGISTERQ REGISTER1 REGISTERO I f’ \ \ 140d 1400 140D ' 1403 v }150 FIG. 10c U.S. Patent Mar. 25,2003 Sheet 8 of8 US 6,538,658 B1 FROM TEXTURE MAPPING ENGINE | + FROM l M M f v 1 COAIQIETAFIIIIQFLYER v W v EXISTING 8-BITSIGNED ROP AOOER 115a 115R 130 [I14 FROM OONTROL MUX 132 REGISTER V TO PIXEL PACKING LOGIC 116 FROM RASTER OPERATIONS I / {8 LEL l140dH LEL 1140C/ LE 1140b2 LEL lM?aK CONTROLFROM __, REGISTER3 F, REGISTER2 F REGISTER1 F REGISTERO REGISTER ~ /8 1’8 A’8 4 /’8 Y V 132 V Y T0 MEMORY CONTROLLER FIG. 12 US 6,538,658 B1 1 2 METHODS AND APPARATUS FOR tend to be too costly for the mainstream market and/or lack PROCESSING DVD VIDEO the necessary performance to perform adequately. To achieve its goals of quality, storage and data bit-rate, CROSS REFERENCE TO RELATED the DVD video standard leverages several existing audio APPLICATIONS and video compression and transmission standards, includ This is a divisional of application Ser. No. 08/963,931, ing MPEG-2 video and both AC-3 and MPEG-2 audio. By ?led Nov. 4, 1997, now US. Pat. No. 6,208,350. Way of example, FIG. 1 depicts a typical DVD processing pipeline in Which a DVD data stream is received, for TECHNICAL FIELD example, from a DVD-ROM drive and/or from a remote 10 device, and converted into a decoded and decompressed The present invention relates to computers, and more digital video signal and corresponding digital audio signal particularly to methods and apparatus for processing a (s). Digital Versatile Disk (DVD) data stream using a computer. A DVD data stream consists of sequential data packets, each of Which typically includes various system BACKGROUND ART 15 information, video information and audio information. The The emergence of DVD (Digital Versatile Disk) technol DVD video decode pipeline 10 depicted in FIG. 1 has been ogy presents a tremendous market groWth opportunity for broken doWn into three high-level processing stages, namely the personal computer (PC). It also presents a signi?cant a system stream parsing stage 12, a video processing stage technical challenge to the highly cost-competitive PC 14, and an audio processing stage 16. Additional information market, namely providing a cost effective PC architecture 20 regarding these processing stages and others, and the DVD that provides the digital video performance and quality that and MPEG-2 standards are provided in the DVD the user demands While also remaining ?exible enough to speci?cation, entitled DVD Speci?cation, Version 1.0, support a range of other PC applications. August 1996, and in the MPEG-2 video speci?cation ISO/ IEC 13818-1, 2, 3 is available from ISO/IEC Copyright As knoWn, DVD technology presents a signi?cant leap 25 forWard for today’s multimedia PC environment. In addition Of?ce Case Postale 56, CH 1211, Geneve 20, SWitZerland, to providing backward compatibility to CD-ROM, current each of Which are incorporated herein, in their entirety and DVDs provide a storage capacity of betWeen 4.7 GB and 17 for all purposes, by reference. GB, Which is at least about 8 times the storage capacity of In system stream parsing stage 12, the incoming DVD a typical CD. To support this increased storage capacity, 30 data stream is split or demultiplexed and/or descrambled, for DVD devices, such as DVD-ROM drives, typically provide example using CSS decryption techniques, into three inde bandWidths in excess of 10 Mb/s. By combining DVD pendent streams: a MPEG-2 video stream 15, a MPEG-2 (or technologies With video compression technologies, such as AC-3) audio stream 17, and a sub-picture stream 13. By Way MPEG-2 video compression techniques, and audio compres of example, in certain embodiments, the MPEG-2 video stream 15 can have a bit-rate as high as approximately 9 Mb sion technologies, such as MPEG-2 and AC-3 audio 35 techniques, a PC can deliver better-than-broadcast quality per second, and the audio stream 17 (MPEG-2 or AC-3) can television (TV) to a video display device and an audio have a bit-rate as high as approximately 384 Kb per second. reproduction device. The sub-picture stream 13 tends to have a relatively loWer DVD also presents an avenue for PC technology to bit-rate, and includes sub-picture information that can be incorporated into the ?nal digital video signal as on-screen migrate to various neW market segments. DVD is being 40 embraced not only by the PC industry, but also by the displays ( OSDs), such as menus or closed captioning data. entertainment and consumer electronics industries. As such, The MPEG-2 video stream 15 and sub-picture stream 13 are many PC manufacturers and softWare developers consider then provided to video processing stage 14 for additional DVD to represent the next step in turning desktop PCs into processing.