US 20120013798A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2012/0013798 A1 Arora et al. (43) Pub. Date: Jan. 19, 2012
(54) METHOD AND SYSTEM FOR ACHIEVING (52) US. Cl...... 348/445; 348/E07.003 BETTER PICTURE QUALITY IN VARIOUS ZOOM MODES (57) ABSTRACT (76) Inventors: Gaurav Arora, Northborough, MA (US); Adil Jagmag, Hollis, NH A method and system are provided in Which a video image may be scaled from a ?rst to a second video format. The (Us) scaling may be a non-uniform scaling such as an anamorphic (21) Appl. No.: 13/013,307 scaling. When panning associated With the scaled video image is detected, one or more end portions of a current frame (22) Filed: Jan. 25, 2011 of the scaled video image may be adjusted, the adjustment being based on one or more frames of the scaled video image Related US. Application Data that are previous to the current frame. The adjustment may result from combining information from the corresponding (60) Provisional application No. 61/364,628, ?led on Jul. end portion of previous frames With the information of the 15, 2010. current frame. One or more end portions that are opposite to the ones adjusted may also be adjusted based on one or more Publication Classi?cation frames of the scaled video image that are subsequent to the (51) Int. Cl. current frame. The panning detected may be horizontal, ver H04N 7/01 (2006.01) tical, or a combination thereof.
pillarbox 4:3 530a /
520 53Gb pillarbox Patent Application Publication Jan. 19, 2012 Sheet 1 0f 14 US 2012/0013798 A1
Server
IN /
, ‘ I f 132 1 i ------‘__"--_
Cable/Satellite .
122 110 111 V / f 134 V142
120 m K / 136 C) |:|
Fig. 1 Patent Application Publication Jan. 19, 2012 Sheet 2 0f 14 US 2012/0013798 A1
Digital Television System-On-Chip E Audio ‘ reproduction Audio 7 module module E Cab|e/ Tuning Interface M Core Tv/ —> module : module procgslsor Video Satellite m E Video mgog e > display module — ' module M m Other devices 8:228 —> and/or peripherals
Host processor Memory module module 240 E
Fig. 2 Patent Application Publication Jan. 19, 2012 Sheet 3 0f 14 US 2012/0013798 A1
320
Fig. 3A
340
Fig. 3B Patent Application Publication Jan. 19, 2012 Sheet 4 0f 14 US 2012/0013798 A1
A] Ietterbox
420
16:9
Ietterbox K 430a Fig. 4 Patent Application Publication Jan. 19, 2012 Sheet 5 0f 14 US 2012/0013798 A1
pillarbox 4:3 530a / 520 530b pillarbox
Fig. 5 Patent Application Publication Jan. 19, 2012 Sheet 6 0f 14 US 2012/0013798 A1
Top end _A_ 1 v. \.\ \__ 4.3. 600
wk- ‘ "-_ \\ Height "'~~.,, 610 -\.___\ 4/ _~-.\ \ 16:9 _ \ \
\ Bottom end
" ‘ ‘ Width ‘ ‘
16:9 left} \ 4:3 left 4:3 right} \16;9 right end end end end Fig. 6 Patent Application Publication Jan. 19, 2012 Sheet 7 0f 14 US 2012/0013798 A1
Frame (k-2) 760
Frame (k-1) 700 \ i 720 2% Current frame (k)
:> Frame (k+1) PANNING 770 DIRECTION Frame (k+2) Fig. 7A Patent Application Publication Jan. 19, 2012 Sheet 8 0f 14 US 2012/0013798 A1
Frame (k+2) 770
Frame (k+1) 70)?
Current frame (k)
Frame (k-1) PANNING 760 DIRECTION Frame (k-2) Fig. 7B Patent Application Publication Jan. 19, 2012 Sheet 9 0f 14 US 2012/0013798 A1
870 Frame (k+2) ‘J 800 810 l 820 Frame (k+1) N ) 27’
\ Frame (k-1) Current frame (k) 830 860 840 PANNING F rame( k-2 ) DIRECTION
Fig. 8A Patent Application Publication Jan. 19, 2012 Sheet 10 0f 14 US 2012/0013798 A1
860 Frame (k-2) ‘J 800 820 810 Frame (k-1)
Frame (k+1) Current frame (k) 830 870 840 PANNING F rame( k+2 ) DIRECTION
Fig. 8B Patent Application Publication Jan. 19, 2012 Sheet 11 0f 14 US 2012/0013798 A1
Frame (k-2) 760
Frame (k-1) 900
Current frame (k)
Frame (k+1) PANNING 770 DIRECTION k» Frame (k+2) Fig. 9 Patent Application Publication Jan. 19, 2012 Sheet 12 0f 14 US 2012/0013798 A1
10000
Scaling a video image from a first video format to a second video format
Detecting panning in the scaled video image
Adjusting, upon detection of the panning, one or more end portions of a current frame based on one or more previous frames
Adjusting one or more opposite end portions of the current frame based on one or more subsequent frames
Fig. 10 Patent Application Publication Jan. 19, 2012 Sheet 13 0f 14 US 2012/0013798 A1
1110 Frame (k, (DN) / Frame (k, (D1) Frame (k, CD1) / 11008 I
Current frame (k, (DO) u 1150b
Fig. 11 Augmented current frame (k) Patent Application Publication Jan. 19, 2012 Sheet 14 0f 14 US 2012/0013798 A1
1200
Digitally zooming a video image
Selecting one or more frames that correspond to a current frame of the zoomed video image, wherein the one or more frames have a different viewing angle
Combining information from the current frame and the selected frames to generate an augmented current frame of the zoomed video image
Fig. 12 US 2012/0013798 A1 Jan. 19, 2012
METHOD AND SYSTEM FOR ACHIEVING [0012] FIG. 4 is a diagram illustrating an exemplary con BETTER PICTURE QUALITY IN VARIOUS version of a 16: 9 aspect ratio video image to a 4:3 aspect ratio ZOOM MODES video image, in connection With an embodiment of the inven tion. CROSS-REFERENCE TO RELATED [0013] FIG. 5 is a diagram illustrating an exemplary con APPLICATIONS/INCORPORATION BY version of a 4:3 aspect ratio video image to a 16: 9 aspect ratio REFERENCE video image, in connection With an embodiment of the inven tion. [0001] This application claims priority to and makes refer [0014] FIG. 6 is a diagram illustrating a non-uniform hori ence to US. Provisional Patent Application Ser. No. 61/364, Zontal scaling of a 4:3 aspect ratio video image to a 16:9 628 ?led on Jul. 15, 2010. aspect ratio video image, in accordance With an embodiment [0002] The above stated application is hereby incorporated of the invention. herein by reference in its entirety. [0015] FIGS. 7A and 7B are each a diagram illustrating reduction of a jarring effect on horiZontal panning content by FIELD OF THE INVENTION utiliZing previous and/or subsequent frames, in accordance With embodiments of the invention. [0003] Certain embodiments of the invention relate to pro [0016] FIGS. 8A and 8B are each a diagram illustrating cessing of video signals. More speci?cally, certain embodi reduction of a jarring effect on vertical panning content by ments of the invention relate to a method and system for utiliZing previous and/or subsequent frames, in accordance achieving better picture quality in various Zoom modes. With embodiments of the invention. [0017] FIG. 9 is a diagram illustrating reduction of a jarring BACKGROUND OF THE INVENTION effect on a right-doWn panning content by utiliZing previous and/or subsequent frames, in accordance With an embodi [0004] Televisions typically support a range of vieW ment of the invention. modes, including letterboxing and/or pillarboxing, Zooms [0018] FIG. 10 is a How diagram illustrating exemplary that employ clipping of a source, and Zooms that employ steps for reducing a jarring effect on panning content, in scaling of the image provided by the video source Without accordance With an embodiment of the invention. preserving the original aspect ratio. In some instances, a [0019] FIG. 11 is a diagram illustrating augmentation of a television can support a combination of the above-described digitally Zoomed video image based on frames having a dif modes. Such vieW modes can have an effect on image quality, ferent vieWing angle, in accordance With an embodiment of particularly on the smoothness and/or sharpness of the scaled the invention. or Zoomed video image. [0020] FIG. 12 is a How diagram illustrating exemplary [0005] Further limitations and disadvantages of conven steps for augmenting a Zoomed video image, in accordance tional and traditional approaches Will become apparent to one With an embodiment of the invention. of skill in the art, through comparison of such systems With the present invention as set forth in the remainder of the DETAILED DESCRIPTION OF THE INVENTION present application With reference to the draWings. [0021] Certain embodiments of the invention can be found in a method and system for achieving better picture quality in BRIEF SUMMARY OF THE INVENTION various Zoom modes. Various embodiments of the invention provide for a video processor that may scale a video image [0006] A system and/ or method for achieving better picture from a ?rst video format to a second video format, detecting quality in various Zoom modes, as set forth more completely panning associated With the scaled video image, and adjust in the claims. ing, When the panning is detected, one or more endportions of [0007] Various advantages, aspects and novel features of a current frame of the scaled video image. The ?rst video the present invention, as Well as details of an illustrated format may be a 4:3 aspect ratio video format and the second embodiment thereof, Will be more fully understood from the video format may be a 16:9 aspect ratio video format, for folloWing description and draWings. example. Other video formats, hoWever, may also be utiliZed. The scaling of the video image may comprise non-uniform BRIEF DESCRIPTION OF SEVERAL VIEWS OF scaling, such as an anamorphic scaling, for example. The THE DRAWINGS scaling need not be limited to full screen scaling, for example, but may also be utiliZed in instances Where the scaling [0008] FIG. 1 is a block diagram of an exemplary system involves less than a full screen. Moreover, the video processor for delivering multiple video signals to a display unit, in may be operable to detect panning that is horiZontal, vertical, accordance With an embodiment of the invention. or a combination thereof. In this regard, the video processor [0009] FIG. 2 is a block diagram illustrating an exemplary may adjust one or more end portions of the current frame system for processing video image data and audio data in a according to the panning direction detected. display unit, in accordance With an embodiment of the inven [0022] The adjustment of the end portion of the current tion. frame of the scaled video image may be based on one or more [0010] FIG. 3A is diagram illustrating a 4:3 standard aspect frames of the scaled video image that are previous to the ratio video format, in connection With an embodiment of the current frame. The adjustment of the end portion of the cur invention. rent frame may comprise combining information of the end [0011] FIG. 3B is a diagram illustrating a 16:9 high-de? portion of the current frame With information of a corre nition aspect ratio video format, in connection With an sponding end portion of the one or more frames that are embodiment of the invention. previous to the current frame. The opposite end portion of the US 2012/0013798 A1 Jan. 19, 2012
current frame may be adjustedbased on one or more frames of in the same video image, for example When tickers are being the scaled video image that are subsequent to the current displayed, may be handled in a similar manner by detecting frame. The adjustment of the opposite end portion of the the panning regions and augmenting the matching regions current frame may comprise combining information of the Within the current frame. opposite end portion of the current frame With information of [0026] In another embodiment of the invention, zoomed a corresponding opposite end portion of the one or more images can be improved for certain sources, such as a Blu-ray frames that are subsequent to the current frame. Disc (BD) players, for example, by utilizing additional angles [0023] The panning that is to be detected may be a substan of the same video content that may have been captured during tially horizontal panning. In such instances, the end portion of ?lming, encoded, and stored. Such an enhancement mode the current frame may be associated With a vertical end of the may be performed by the television or other like display current frame, and the opposite end portion of the current device, and/or by the video player. For example, the video frame may be associated With the other vertical end of the processing engine carrying out the zooming operation may current frame. The panning that is to be detected may also be have access to various angles of a particular frame of a video substantially vertical panning. In such instances, the end por image and may utilize the additional information comprised tion of the current frame may be associated With a horizontal in those other frames to augment or modify the current frame end of the current frame, and the opposite end portion of the to achieve better quality. current frame may be associated With the opposite horizontal [0027] FIG. 1 is a block diagram of an exemplary system end of the current frame. The panning that is to be detected for delivering multiple video signals to a display unit, in may also be a combination of a horizontal panning and a accordance With an embodiment of the invention. Referring vertical panning. For example, the panning may be in a right to FIG. 1, there is shoWn a display unit 100, a set-top-box 110, doWn direction, a right-up direction, a left-doWn direction, or a DVR 120, and a netWork interface device 130. Also shoWn a left-up direction, Wherein the angle associated With the in FIG. 1 are a netWork 140 and a server 150. panning direction may be vary from frame to frame. [0028] The display unit 100 may comprise suitable logic, [0024] In another embodiment of the invention, a method circuitry, code, and/ or interfaces that may be operable to and/ or a system may be provided in Which a video image may receive video signals from one or more sources and to process be digitally zoomed. The digital zooming of the video image the received video signals. In this regard, the display unit 100 may comprise anamorphic scaling, for example. For a current may be operable to process the video image data and/or the frame of the digitally zoomed video image, one or more audio data video comprised Within such video signals. When frames that correspond to the current frame may be selected, the video image data and the audio data are combined in some Wherein each of the one or more frames is associated With an manner Within the video signal, the display unit 100 may be angle of vieW that is different from the angle of vieW of the operable to receive the video signal and separate the video current frame. Information for each selected frame may be image data from the audio data. Once separated, the display combined With information for the current frame to generate unit 100 may process the video image data and may display an augmented current frame of the digitally zoomed video the video images associated With the processed video image image. The combining of information may comprise interpo data. Moreover, the display unit 100 may process the audio lating the information of the current frame, interpolating the data and may reproduce the audio or sound associated With information of each selected frame, and blending the inter the processed audio data. polated information of the current frame and the interpolated [0029] When the video image data and the audio data are information of each selected frame. separate Within the video signal, such as When carried by [0025] The above-described operations may be utilized to separate signals Within the video signal, for example, the improve or enhance the image quality, particularly the display unit 100 need not separate the video image data from smoothness and/or sharpness of scaled or zoomed video the audio data. For example, the video signal may include one images. For example, anamorphic scaling may be typically or more image signals that comprise the video image data. In used in some zoom modes to provide non-uniform scaling, such an instance, the display unit 100 may be operable to such scaling generally being, but not limited to, horizontal or process the video image data in the image signals to display substantially horizontal scaling. In some instances, hoWever, the video images associated With the processed video image the scaling, Whether uniform or non-uniform, may comprise data. The video signal may also include one or more audio vertical scaling, or a combination of vertical and horizontal signals that comprise the audio data. In such an instance, the scaling. In anamorphic scaling, the video content in the center display unit 100 may be operable to process the audio data in of the screen may be minimally stretched While the video the audio signals to reproduce the audio or sound associated content at the edges of the screen may be stretched someWhat With the processed audio data. more to compensate. This approach may result in a jarring [0030] The display unit 100 may comprise a visual display effect that may be noticeable during panning of the video or screen 102 that may be operable to display the video image on the screen. To reduce or eliminate this jarring effect, images associated With the video image data processed by the a panning motion may be detected and one or more frames display unit 100. The screen 102 may be based on a display may be utilized to augment the current frame. This detection technology such as cathode ray tubes (CRTs), liquid crystal and augmentation may be utilized to reduce the jarring effect displays (LCDs), plasma display panels (PDPs), thin ?lm on one of the edges. For example, the left edge of the video transistor LCDs (TFT-LCDs), plasma, light emitting diode image on the screen may be improved if the panning motion (LED), Organic LED (OLED), or other ?atscreen display is from left to right or the right edge of the video image may technology, for example. The screen 102 may support one or be improved if the panning motion is from right to left. The more aspect ratios When displaying video images such, but other edge may also be augmented by using buffered frames not limited to, a 4:3 standard aspect ratio and a 16:9 Wide from future or subsequent frames to the current frame. More screen aspect ratio, for example. For the standard aspect ratio, complicated panning, such as When multiple pannings occur the screen 102 may support a Width of 1024 pixels and a US 2012/0013798 A1 Jan. 19, 2012
height of 768 pixels, or a proportionally equivalent pixel [0035] The display unit 100 may receive video signals com count. For the Widescreen aspect ratio, the screen 102 may prising video image data and/ or audio data from one or more support a Width of 1024 pixels and a height of 576 pixels, or sources. For example, the display unit 100 may receive video a proportionally equivalent pixel count. The display unit 100 signals from traditional radio frequency broadcasts and/or may comprise one or more speakers (not shoWn) and/or may may generate video signals from signals received through be communicatively coupled to one or more speakers (not traditional radio frequency broadcasts. In another example, shoWn), Wherein the speakers may be utilized to reproduce the display unit 100 may receive video signals from other the audio or sound associated With the audio data processed sources such as the set-top-box 110, the DVR 120, and/ or the by the display unit 100. netWork interface device 130. Each of the set-top-box 110, [0031] The display unit 100 may be operable to support the DVR 120, and/or the netWork interface device 130 may digital Zooming or scaling of the video images. For example, provide one or more video signals to the display unit 100. When the received video images are suitable for a 4:3 standard When a single device provides multiple video signals to the aspect ratio but the display unit 100 supports a 16:9 Wide display unit 100, the various video signals provided may be screen aspect ratio, the video image may be scaled to match based on different formats, standards, and/or protocols, for the aspect ratio supported by the display unit 100. Similarly, example. In this regard, the video signals received by the When the received video images are suitable for a 16:9 Wide display unit 100 may be associated With different sources screen aspect ratio but the display unit 100 supports a 4:3 When provided by different devices and/or services, and/or standard aspect ratio, the video image may be scaled to match When based on different formats, standards, and/ or protocols. the aspect ratio supported by the display unit 100. [0036] As described above, the display unit 100 may [0032] The display unit 100 may be operable to receive receive video signals comprising video content such as video content, such as video content comprising video images, that image data and/ or audio data. In this regard, the display unit may be me formatted in one of multiple different types of 100 may comprise one or more processing devices (not aspect ratios. For example, the display unit 100 may receive shoWn) that may be operable to process the video image data video content in 4:3 standard aspect ratio, video content in a and/or the audio data received by the display unit 100. For 16:9 Widescreen aspect ratio, movie content in an 1.85:1 or example, a processing device in the display unit 100 may 2.39:1 aspect ratio, and/or camera content in 1.5:1 aspect process the video image data comprised Within a video signal ratio. The display unit 100 may be operable to display the such that the video images associated With the video image received content in one or more aspect ratios, Which may data may be displayed. Similarly, the same processing device, comprise a 4:3 standard aspect ratio, a 16:9 Widescreen aspect or another processing device in the display unit 100, may ratio, and a 21 :9 aspect ratio, for example. Because the con process the audio data comprised Within the video signal such tent may be received in any one of several aspect ratios and the that the audio or sound associated With the audio data may be display unit 100 may support any one of several aspect ratios reproduced. The processing device in the display unit 100 for displaying the content received, conversions betWeen may be operable to improve or enhance the image quality of aspect ratios through scaling and/or digital Zooming may be scaled or digitally Zoomed video images. Exemplary embodi necessary. In this regard, the conversions need not be limited ments of such processing devices are described beloW With to scaling or Zooming to full screen, such conversions may respect to FIG. 2. also involve scaling or Zooming to different proportions of the [0037] The set-top-box 110 may comprise suitable logic, screen based on the user and/ or the application. circuitry, code, and/or interfaces that may be operable to [0033] The display unit 100 may be operable to provide receive signals from a cable or satellite operator that provides digital Zooming and scaling enhancement operations. For television services and/or other type of programming ser example, the display unit 100 may be operable to detect vices. The set-top-box 110 may be operable to process the panning in a current frame of a scaled video image and to signals received from the operator to generate one or more augment or enhance the current frame based on one or more video signals that may be communicated to the display unit previous frames and/or one or more future or subsequent 100. In this regard, the set-top-box 110 may receive signals frames that correspond to the current frame. Moreover, the from the cable operator or from a satellite antenna (not display unit 100 may be operable to augment or enhance a shoWn) via a link 111 and may communicate the video signals current frame of a digitally Zoomed video image based on to the display unit 100 via a link 112. The links 111 and 112 other frames that correspond to the current frame but Were may comprise, for example, suitable connectors, coaxial taken, during ?lming, at different angles from an angle of the cables, Wires, and/ or optical ?bers that enable Wired commu current frame. The frames comprising content associated nication to and/or from the set-top-box 110. In an embodi With different angles from the angle of the current frame may ment of the invention, at least a portion of the link 111 and/ or be received by the display unit 100 from the set-top-box 110, at least a portion of the link 112 may comprise a Wireless the DVR 120, the netWork interface device 130, and/or the communication link. server 150 through the netWork 140, for example. [0038] The DVR 120 may comprise suitable logic, cir [0034] While the display unit 100 may typically be a tele cuitry, code, and/or interfaces that may be operable to digi vision, the invention need not be so limited. For example, the tally record and/or play back video content. For example, the display unit 100 may be a monitor, a handheld device, a DVR 120 may digitally record and/or play back video image portable device, a stationary device, or other like device that data and/or audio data. The DVR 120 may support recording is capable of receiving video signals from one or more and/or play back operations in one or more formats that may sources, and processing and/or handling the video content include, but need not be limited to, a compact disc (CD) associated With the received video signals. When the display format, a digital video disc (DVD) format, and a Blu-ray Disc unit 100 is a television, the display unit 100 may support (BD) format, for example. The DVR 120 may utiliZe a multiple technical standards such as digital television (DTV) memory medium, such as a disk drive, a universal serial bus and high-de?nition television (HDTV), for example. (U SB) ?ash drive, a non-volatile memory card (e.g., secure US 2012/0013798 A1 Jan. 19, 2012
digital (SD) memory card), and/ or other type of digital stor modem, Wireless cable modem), a router (e.g., Wireless age medium in Which to digitally record and/ or from Which to router), and a sWitch (e.g., netWork sWitch, local area netWork play back video image data and/ or audio data. The DVR 120 (LAN) sWitch). may also be operable to augment or enhance a current frame [0044] The netWork interface device 130 may be utiliZed to of a digitally Zoomed video image based on other frames that provide IPTV services and/or other netWork-based video correspond to the current frame but Were taken, during ?lm content delivery services to one or more of the display unit ing, at different angles from an angle of the current frame. The 100, the set-top-box 110, and the DVR 120 via the links 132, frames comprising content associated With different angles 134, and 136, respectively. The netWork interface device 130 from the angle of the current frame may be received by the may provide video signals to the display unit 100 in connec DVR 120 from those frames stored in a memory medium tion With the IPTV services and/or the netWork-based video utiliZed in connection With the DVR 120, and/or from the content delivery services. Moreover, the netWork interface server 150 through the netWork 140. device 130 may provide signals to the set-top-box 110 and/or to the DVR 120 that may be utiliZed by those devices to [0039] In some embodiments of the invention, the DVR generate video signals that may be communicated to the 120 may be a portable device or an application for a personal display unit 100 for processing. The netWork interface device computer that enables capturing, storing, and/or playing back 130 may be communicatively coupled to the netWork 140 via video image data and/or audio data. When in a play back a link 142, Which may support Wired and/or Wireless commu mode of operation, the DVR 120 may generate one or more nication betWeen the netWork interface device 130 and the video signals that may be communicated to the display unit netWork 140. 100 via a link 122. The link 112 may comprise, for example, [0045] The server 150 may comprise suitable logic, cir suitable connectors, coaxial cables, Wires, and/ or optical cuitry, code, and/or interfaces that may be operable to provide ?bers that enable Wired communication betWeen the DVR video content through IPTV services and/or other netWork 120 and the display unit 100. In an embodiment of the inven based video delivery services. The server 150 may also pro tion, at least a portion of the link 122 may comprise a Wireless vide, via the netWork interface device 130, data or informa communication link. tion, other than video content, to the display unit 100, the [0040] In an embodiment of the invention, some or all of the set-top-box 110, and/or the DVR 120. For example, the server functions or operations supported by the DVR 120 may be 150 may provide pro?le information, such as operating implemented in the set-top-box 110. For example, the set-top parameters, that may be utiliZed to con?gure one or more processing devices in the display unit 100. The server 150 box 110 may receive one or more signals from the cable or may be communicatively coupled to the netWork 140 via a satellite operator and may digitally record video content asso link 144, Which may support Wired and/or Wireless commu ciated With the received signals. The set-top-box 110 may nication betWeen the server 150 and the netWork 140. The also play back the digitally recorded video content to generate server 150 may comprise video content having multiple video signals that are communicated to the display unit 100. related concurrent frames, Wherein each of those related con [0041] In another embodiment of the invention, some or all current frames has information associated With a different of the functions or operations supported by the DVR 120 and angle of vieW. The related concurrent frames may result from, some or all of the functions or operations supported by the for example, ?lming or recording video content associated set-top-box 110 may be implemented in the display unit 100. With a same scene from different angles of vieW. The server That is, the display unit 100 may receive video signals from 150 may be utiliZed to provide or send the related concurrent the cable or satellite operator, or may generate video signals frames to the digital display 110 and/or the DVR 120 to from signals received from the cable or satellite operator. process the related concurrent frames in connection With Moreover, the display unit 100 may digitally record video augmenting or enhancing the image quality in a digitally content associated With the received signals. In this regard, Zoomed video image. the display unit 100 may play back the digitally recorded [0046] While a single server 150 is shoWn in FIG. 1, the video content, display the video images associated With the invention need not be so limited. For example, multiple serv video content, and/or reproduce the audio or sound associated ers may be utiliZed for the delivery of video content to the With the video content. display unit 100, the set-top-box 110, and/or the DVR 120 via [0042] The netWork interface device 130 may comprise the netWork interface device 130. In another example, one or suitable logic, circuitry, code, and/or interfaces that may be more servers may be utiliZed for the delivery of data or infor operable to communicatively couple one or more devices to mation other than video content to the display unit 100, the the netWork 140. The netWork 140 may be the Internet or set-top-box 110, and/or the DVR 120 via the netWork inter other Wide area netWork (WAN), for example. The netWork face device 130. interface device 130 may be communicatively coupled to one [0047] Although not shoWn in FIG. 1, the display unit 100 or more of the display unit 100, the set-top-box 110, and the may Wirelessly communicate With the netWork 140 by utiliZ DVR 120 via links 132, 134, and 136, respectively. Each of ing a Wireless protocol such as the WorldWide interoperability the links 132, 134, and 136 may support Wired and/ or Wireless for microWave access (WiMAX) communication protocol, communication betWeen the netWork interface device 130 for example. In this manner, IPTV services, other netWork and the display unit 100, the set-top-box 110, and the DVR based video content delivery services, and/or data or infor 120. mation other than video content may be provided to the dis [0043] In an embodiment of the invention, the netWork play unit 100 via a Wireless link 146. interface device 130 may be a residential gateWay that may [0048] FIG. 2 is a block diagram illustrating an exemplary comprise suitable hardWare and/ or softWare to provide some system for processing video image data and audio data in a or all of the functions and/or operations of one or more of a display unit, in accordance With an embodiment of the inven modem (e.g., digital subscribed line (DSL) modem, cable tion. Referring to FIG. 2, there is shoWn a digital television US 2012/0013798 A1 Jan. 19, 2012
system-on-chip (DTV 80C) 200, avideo display module 220, but need not be limited to, motion detection, edge detection, an audio reproduction module 230, a host processor module and adaptive temporal ?lter that are utiliZed to reduce random 240, and a memory module 250. noise. [0049] The DTV 80C 200 may comprise suitable logic, [0056] The letterbox detection operation supported by the circuitry, code, and/or interfaces that may be operable to DTV 80C 200 may comprise aspect ratio detection, black line receive and process one or more video signals that comprise detection, black column detection. In this regard, the letter video content. Examples of video signals that may be box detection operation may support letterbox format detec received and processed by the DTV 80C 200 include, but tion, pillarbox format detection, and postage-stamp format need not be limited to, a CVBS signal, an S-video signal, an detection. When a video image has an ambiguous format, HDMI signal, a component signal, a PC signal, an SIF signal, Whether because the video image is mostly black or has and an RGB signal. The video source signals may be received excessive noise, the letterbox detection operation may con from a tuning module 210 and/or from one or more audio/ sider or treat such a video image as being letterbox formatted. visual (A/V) sources. The video signals received by the DTV The letterbox detection operation need not change the for 80C 200 may include image signals that comprise video matting of the video images automatically, but may do so image data and/or audio signals that comprise audio data. based on different usage models and/or user input. [0050] The processing of a video signal by the DTV 80C [0057] The video capture operations supported by the DTV 200 may comprise various operations such as display control 80C 200 may comprise receiving video image data from one operations, scaling operations, picture enhancement opera or more modules Within the DTV 80C 200, formatting the tions, digital noise reduction operations, analog noise reduc video image data and sending the video image data to tion operations, letterbox detection operations, video capture memory, such as a Dynamic Random Access Memory and feeding operations, and/or video bypass and routing (DRAM) external to the DTV 80C 200. Exemplary format operations. The DTV 80C 200 need not be so limited and ting of the video image data may comprise doWn-sampling other operations associated processing a video signal may rounding and/or truncation. The video feeding operations also be performed. supported by the DTV 80C 200 may comprise receiving [0051] The display control operations supported by the video image data from memory external to the DTV 80C 200, DTV 80C 200 may comprise con?guring DTV 80C 200 to formatting the video image data (e.g., up-sampling), and support multiple display output formats. In this regard, the sending the video image data to one or more modules Within data transfer in the DTV 80C 200 may be controlled utiliZing the DTV 80C 200 for processing. a self-regulating data How control mechanism. [0058] The video display module 220 may comprise suit [0052] The scaling operations supported by the DTV 80C able logic, circuitry, code, and/ or interfaces that may be oper 200 may comprise tWo-dimensional scaling, including stan able to receive one or more signals comprising processed dard de?nition (SD) scaling, high-de?nition (HD) scaling, video image data from the DTV 80C 200 and to display the and/or non-linear horiZontal scaling With multiple scaling video images associated With the processed video image data regions in Which the side regions may utiliZe a higher-order received. In this regard, the video display module 220 may difference equation for the scale factor. The DTV 80C 200 correspond to a screen such as the screen 102 of the display may also support video image cropping. The scaling opera unit 100 described above With respect to FIG. 1. The audio tions may utiliZe separate luma and chroma coe?icients, for reproduction module 230 may comprise suitable logic, cir example. cuitry, code, and/ or interfaces that may be operable to receive [0053] The picture enhancement operations supported by one or more signals from the DTV 80C 200 comprising DTV 80C 200 may comprise adjustments to the color space, processed audio data and to reproduce the audio or sound sharpness, and brightness of the video images to improve associated With the processed audio data received. In this image quality. Such improvements in image quality may be regard, the audio reproduction module 230 may correspond to utiliZed in connection With various functions that may one or more speakers of the display unit 100 and/or to one or include, but need not be limited to, auto-?esh, green boost, more speakers communicatively coupled to the display unit soft saturate luma, black stretch adjustment, histogram equal 100. iZation, blue shift, and sharpness improvement. The picture [0059] The host processor module 240 may comprise suit enhancement operations may also enable 3D color manage able logic, circuitry, code, and/ or interfaces that may be oper ment adjustments over various regions of a video image based able to control and/or con?gure the operation of the DTV 80C on luma-chroma or hue-saturation coordinates, for example. 200. For example, the host processor module 240 may be Within each of these regions, both luma and chroma adjust utiliZed to provide user-based instructions and/or other ments may be possible. instructions to the DTV 80C 200. The instructions may [0054] The digital noise reduction (DNR) operations sup include mode selections that enable the DTV 80C 200 to ported by the DTV 80C 200 may comprise adaptive block improve and/or enhance image quality of scaled or digitally noise reduction and adaptive mosquito noise reduction. In Zoomed video images. The memory module 250 may com some embodiments of the invention, the digital noise reduc prise may comprise suitable logic, circuitry, code, and/or tion operations may be applied before scaling or de-interlac interfaces that may be operable to store information associ ing operations. The digital noise reduction operations may be ated With the operation of the DTV 80C 200. For example, the applied to video image data in various formats, such as MPEG memory module 250 may store intermediate values associ or Advanced Video Coding (AVC) formats, for example, and ated With the processing of video image data and/or audio in various resolutions, including SD and HD, for example. data by the DTV 80C 200. Moreover, the memory module [0055] The analog noise reduction (ANR) operations sup 250 may be utiliZed to stored information associated With ported by DTV 80C 200 may comprise reduction of random Which of the video signals received by the DTV 80C 200 is noise that may be result from the external video source. For active and/or is locked-in Within the DTV 80C 200. As example, the analog noise reduction operations may include, described above, the memory module 250 may be utiliZed to