US010154285B2 (12 ) United States Patent ( 10) Patent No. : US 10 , 154, 285 B2 Xu et al. ( 45 ) Date of Patent : Dec . 11 , 2018 (54 ) VIDEO CODING SYSTEM WITH SEARCH ( 56 ) References Cited RANGE AND METHOD OF OPERATION THEREOF U . S . PATENT DOCUMENTS 8 ,494 ,042 B2 7 /2013 Park et al. (71 ) Applicant: SONY CORPORATION , Tokyo ( JP ) 2011/ 0261882 A1 10 / 2011 Zheng et al. 2012 /0287995 A1 11 / 2012 Budagavi ( 72 ) Inventors : Jun Xu , Cupertino , CA (US ) ; Ali 2013 / 0114697 Al 5 /2013 Siddaramanna et al. Tabatabai, Cupertino , CA (US ) ; Ohji 2013 /0177082 AL 7 /2013 Sugio et al . Nakagami, Tokyo ( JP ) 2013 / 0301719 AL 11 / 2013 Sasai et al. 2013 / 0336394 A1 12 / 2013 Tu et al. 2014 / 0044171 Al 2 / 2014 Takehara et al . (73 ) Assignee : SONY CORPORATION , Tokyo ( JP ) 2014 /0334542 Al 11/ 2014 Lee et al. ( * ) Notice : Subject to any disclaimer , the term of this ( Continued ) patent is extended or adjusted under 35 U . S . C . 154 (b ) by 0 days . OTHER PUBLICATIONS Flynn , et al. , “ High Efficiency Video Coding (HEVC ) Range (21 ) Appl. No. : 15 /952 ,986 Extensions text specification : Draft 4 ” , JCTVC -N1005 v3 , Joint Collaborative Team on Video Coding ( JCT -VC ) of ITU - T SG16 WP ( 22 ) Filed : Apr. 13 , 2018 3 and ISO /IEC JTC 1/ SC 29 /WG 11 , vol . 3 , Aug . 8 , 2013 , 322 (65 ) Prior Publication Data pages . US 2018 /0234699 A1 Aug. 16 , 2018 ( Continued ) Related U .S . Application Data Primary Examiner - James M Pontius (63 ) Continuation of application No . 14 / 339, 324 , filed on (74 ) Attorney , Agent, or Firm — Chip Law Group Jul. 23 , 2014 , now Pat. No. 10 , 009 ,629 . (60 ) Provisional application No. 61/ 889 ,832 , filed on Oct. (57 ) ABSTRACT 11 , 2013 . A video coding system , and a method of operation thereof, ( 51) Int. Ci. includes : a source input module for receiving a frame from H04N 19 /593 ( 2014 . 01 ) a video source ; and a picture process module , coupled to the H04N 19 / 57 ( 2014 . 01 ) source input module , for generating a reference coding unit H04N 19 / 436 ( 2014 .01 ) in the frame; for generating an intra copy motion vector HO4N 19 / 70 ( 2014 .01 ) pointing to the reference coding unit within a search range , ( 52 ) U . S . CI. wherein the search range does not include an upper coding CPC ...... H04N 19 /593 ( 2014 . 11 ) ; H04N 19 /57 tree unit of the frame; for generating a current coding unit (2014 .11 ) ; H04N 19/ 436 ( 2014 .11 ) ; H04N based on the intra copy motion vector; and for generating a 19 /70 (2014 . 11 ) video bitstream based on the current coding unit for a video (58 ) Field of Classification Search decoder to receive and decode for displaying on a device . CPC ...... HO4N 19 /593 See application file for complete search history . 8 Claims, 9 Drawing Sheets
803 902 802
2W
. commemo 24 > 906
W YMIA
INVALID 804 RANGE US 10 ,154 ,285 B2 Page 2 ( 56 ) References Cited U . S . PATENT DOCUMENTS 2015 / 0049813 A1 * 2/ 2015 Tabatabai ...... H04N 19 /513 375 / 240 . 16 2015 /0103914 A14 /2015 Xu et al . OTHER PUBLICATIONS Saxena , et al ., “ HEVC Range Extensions Core Experiment 3 (RCE3 ) : Intra Prediction techniques” , JCTVC -N1123 v3 , Joint Collaborative ream on Video Coding ( JCTVC ) of ITU - T SG 16 WP 3 and ISO / IEC JTC 1 /SC 29 /WG 11, vol. 3 , Aug . 8 , 2013 , pp . 1 - 6 . Xu , et al . , “ On intra block copying in RExt , JCTVC -Oxxxx ” , Input Document to JCT- VC , Joint Collaborative Team on Video Coding ( JCT- VC ) of ITU - T SG 16 WP 3 and ISO / IEC JTC 1/ SC 297WG 11 , 15th Meeting , Oct . 2013 , pp . 1 - 8 . Non - Final Office Action for U . S . Appl . No . 14 / 339, 324 , dated Apr. 6 , 2017 , 14 pages. Final Office Action for U . S . Appl . No. 14 / 339 ,324 , dated Oct . 19 , 2017, 10 pages. Advisory Action for U . S . Appl . No. 14 /339 ,324 , dated Dec . 28 , 2017 , 3 pages . Notice of Allowance for U . S . Appl. No. 14 /339 , 324 , dated Mar. 1 , 2018 , 8 pages . * cited by examiner U . S . Patent Dec . 11, 2018 Sheet 1 of 9 US 10, 154 ,285 B2
kkkkka ?
* **
* ** aw +?t?
** r 4 DISPLAY PROC -1&?
===* * * DECODER FIG.1
ww.
h
w
?
106» away -02 -~109 - ENCODER
f8? put
100- uxwwwwwwwwwwwwwws U . S . Patent Dec. 11, 2018 Sheet 2 of 9 US 10 , 154 ,285 B2
WWWWWWWWWWWWWW 202 214
*
*
*
S WWWWWWWWWWWWWW 202 212
+
+ 2.FIG 110 WWWWWWWWWWWW ps202 www VIDEOBITSTREAM 210 0000OOOOO RRRR# w wwwwwwwwwwwwwwwwwww 202 www 122
MOMO
O
COLOC
* U . S . Patent Dec . 11, 2018 Sheet 3 of 9 ? US 10 , 154 ,285 B2
302
304 )9LX9L (
( 32X32 )
#hey WWW.KVKEKENNE?VEASTENTERNMENTENNE 12 CARFRAMAARMAMAHARAHAMPANYTHANANANAHHNSTANARAHAMATTANNERATHANHAMAHANNAHAMAHAMATSHARENANAKAMENTANANAYAMAMMINMAHANNAHAMAHA 14
FIG . 3
??????? writ YAMAHA 40 ???? ? ARRA??? FTWWWWWW Nickenrism the AAAAAAN ? ? ? MANHAMANHAMAN ? TEAMWEATH. TELATA? FIG . 4 U . S . Patent Dec . 11 , 2018 Sheet 4 of 9 US 10 , 154, 285 B2
S05 506 0404508 08
? arends???yuA ? ???? ? 1 evernatreture ?
?
? ? ???
?
*
? pagnoppnnnnn ressoniconter? 302 -
- ???? - ???? NANA ??? ???? ???? ??? KMP mber ???? ?????? vers ver … ??????ws-scrips?????? ?????????e Ara? nantsnamecase eranspanes mm speacupunny* manasanma n ?… … dsM +rra??bus .Senergranspartness . t arvanvaringapanoness . 4musionary .organemap??????wspaneserve ??e enary …… ariance AMAMA ?????? orgpranspaneutream eranspanessaneservember s sers AranspaneneraA Andry41% n Austers????????????wrare????nanspanesersand .auty seasterenar . Awarenchancen- Aliendman ???nawa . an ???????aAsus4plustranswersonvermarump?? tainis?? …… ? iframeriananmainarrancess nameanasharsensen … …… neven… f arenophysiano? ??? SainASSESAAAAA???reaserversonemann eneserver ???
?????????????????? FIG . 5 CO2 606 NX ?? ??????????????? ??? ?ou…Bo?| Do??on? no?on? ?? FIG . 6 U . S . Patent Dec. 11, 2018 Sheet 5 of 9 US 10 , 154, 285 B2
VIDEO unnammeBITSTREAM 110
MELUMAT
am X ...... ENCODER MODULE 704 MMM CODING 724 1401RomRRANONOOSAR wwwwww www AMVUMUUALMUR KA w OKXXXX son TIQ ITIQ 714 W 712
*
U* We
godersidor FIG.7 googatoTADALA INTRA-PRD pasaranno w wwwww mommy WAKODOVA
718(KKKKK googooooooooooooowwwwwwwwwwwwwwww. LOOPFILTER ww WODOW 723 722 w SOXURADO M.CPRED www M OOOOOOOOOOOOONOWIONOODOOOnpowoduwowowowano
WWWWWWWWWWooooooooooo DPB 720 o0o0o0oXoXDADD
*
Oon 102 VIDEO SRC 108 U . S . Patent Dec . 11, 2018 Sheet 6 of 9 US 10 , 154 ,285 B2
302 802
mework W WW COOwn M + * + * +
RO > 304 Xoooooooooowwwwwww 808
L804
Wwwwwwwx + + FIG . 8
808 902 802 * * * *
W
* OddogDUODHDUKuwwuuuuuwwwww 2H wwwm van 906
wwwwww
806 INVALID 804 RANGE FIG . 9 U . S . Patent Dec. 11, 2018 Sheet 7 of 9 US 10 , 154 ,285 B2
CURRENTCU POSSIBLEREFERENCE AREA CTB(64PIXINEX.) REFERENCEDCU
+
+
+
+
+
+
+ WAKAWA3.
+ www + +
+
+ wwwwww www Powed + 1004 1010 rem -1016 : 808 804
Xxxwwwx wowowe ith FIG.10 Ocuac B
y2008 OOOO WWWWWWWWWWWWWWWWWWWWW AsunnotALARMALARA WWW 902
CO , N www WIN 1008EMON4 K * *** ARMAAX TOPO * WwwWwWWWWWWWWWW OWILL X * www.MYCREAWww www WWWwwwww UMAHodogo 1008
XXX w P 302- 806 1012 1014 U . S . Patent Dec . 11, 2018 Sheet 8 of 9 US 10 , 154 ,285 B2
INTRA BLK CP PROC 802
SRC INP MOD 1102
wwwwwwwwwwwwwwwwwww
PIC PROC MOD 1104 UNIT SIZE 1106
WWWWWWWWWWWWWWWWWWWW
WWWWWWWWWWWWWW WIDTH 1108
* WWWWWWW MAGNITUDE 1110
. wwwWwwWwwWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww.WWWWWWWWWWWWWWWWWWWWWW HEIGHT 1112
W WWWWWWWWWWWWWWWWWWWW FIG . 11 U . S . Patent Dec . 11, 2018 Sheet 9 of 9 US 10 , 154 ,285 B2
1200 -
RECEIVING A FRAME 1202
GENERATING A REFERENCE CODING UNIT 1204
w wwwwwwwwwwwwwwwwwwwwwwwwwwwwww GENERATING AN INTRA COPY MOTION VECTOR 1206
GENERATING A CURRENT CODING UNIT 1208
WWWWWWWWWWWWWWWWWWWWWW 7777777777777777777
GENERATING A VIDEO BITSTREAM 1210
Wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww w wwwww w w w FIG . 12 US 10 , 154 , 285 B2
VIDEO CODING SYSTEM WITH SEARCH petitive pressures , adds an even greater urgency to the RANGE AND METHOD OF OPERATION critical necessity for finding answers to these problems. THEREOF Solutions to these problems have been long sought but prior developments have not taught or suggested any solu CROSS REFERENCE TO RELATED 5 tions and , thus, solutions to these problems have long eluded APPLICATIONS those skilled in the art . The present application is a continuation application of DISCLOSURE OF THE INVENTION U . S . patent application Ser. No . 14 / 339 ,324 , filed on Jul. 23 , 2014 , which claims the benefit of U . S . Provisional Patent 10 The present invention provides a method of operation of Ser. No. 61/ 889 ,832 filed on Oct . 11, 2013 . Each of the a video coding system including : receiving a frame from a above - referenced applications is hereby incorporated herein video source ; generating a reference coding unit in the by reference in its entirety. frame; generating an intra copy motion vector pointing to The present application contains subject matter related to a concurrently filed U . S . Patent Application by Jun Xu, Ali 15 the reference coding unit within a search range, wherein the Tabatabai and Ohji Nakagami entitled “ VIDEO CODING search range does not include an upper coding tree unit of SYSTEM WITH INTRA PREDICTION MECHANISM the frame; generating a current coding unit based on the intra AND METHOD OF OPERATION THEREOF” . The related copy motion vector ; and generating a video bitstream based application is assigned to Sony Corporation and is identified on the current coding unit for a video decoder to receive and by U . S . patent application No. 14 / 339, 309. The subject 2020 decode for displaying on a device. matter thereof is incorporated herein by reference thereto . The present invention provides a video coding system , including: a source inputmodule for receiving a frame from TECHNICAL FIELD a video source ; and a picture process module , coupled to the source input module , for generating a reference coding unit The present invention relates generally to video systems, 25 in the frame; for generating an intra copy motion vector and more particularly to a system for video coding with intra pointing to the reference coding unit within a search range , prediction . wherein the search range does not include an upper coding tree unit of the frame; for generating a current coding unit BACKGROUND ART based on the intra copy motion vector , and for generating a 30 video bitstream based on the current coding unit for a video The deployment of high quality video to smart phones , decoder to receive and decode for displaying on a device . high definition televisions , automotive information systems, Certain embodiments of the invention have other aspects and other video devices with screens has grown tremen - in addition to or in place of those mentioned above . The dously in recent years . The wide variety of information aspects will become apparent to those skilled in the art from devices supporting video content requires multiple types of 35 a reading of the following detailed description when taken video content to be provided to devices with different size , with reference to the accompanying drawings. quality , and connectivity capabilities . Video has evolved from two dimensional single view BRIEF DESCRIPTION OF THE DRAWINGS video to multiview video with high -resolution three -dimen sional imagery . In order to make the transfer of video more 40 FIG . 1 is a block diagram of a video coding system in an efficient, different video coding and compression schemes embodiment of the present invention . have tried to get the best picture from the least amount of FIG . 2 is an example of the video bitstream . data . The Moving Pictures Experts Group (MPEG ) devel FIG . 3 is an example of a coding tree unit . oped standards to allow good video quality based on a FIG . 4 is an example of prediction units . standardized data sequence and algorithm . The H . 264 45 FIG . 5 is an example of grouping coding tree units . (MPEG4 Part 10 )/ Advanced Video Coding design was an FIG . 6 is an example of a color space in the video coding improvement in coding efficiency typically by a factor of system of FIG . 1 . two over the prior MPEG - 2 format . The quality of the video FIG . 7 is an exemplary block diagram of the video is dependent upon the manipulation and compression of the encoder. data in the video . The video can be modified to accommo- 50 FIG . 8 is an example of an intra block copy process of the date the varying bandwidths used to send the video to the video coding system of FIG . 1 . display devices with different resolutions and feature sets . FIG . 9 is an example of a search range for the intra block However, distributing larger, higher quality video , or more copy process . complex video functionality requires additional bandwidth FIG . 10 is an example of the reference coding unit. and improved video compression . 55 FIG . 11 is a flow diagram of the intra block copy process Thus, a need still remains for a video coding system that of FIG . 8 . can deliver good picture quality and features across a wide FIG . 12 is a flow chart of a method of operation of a video range of device with different sizes , resolutions , and con - coding system in a further embodiment of the present nectivity . In view of the increasing demand for providing invention . video on the growing spectrum of intelligent devices , it is 60 increasingly critical that answers be found to these prob BEST MODE FOR CARRYING OUT THE lems. In view of the ever - increasing commercial competitive INVENTION pressures, along with growing consumer expectations and the diminishing opportunities for meaningful product dif The following embodiments are described in sufficient ferentiation in the marketplace , it is critical that answers be 65 detail to enable those skilled in the art to make and use the found for these problems. Additionally , the need to save invention . It is to be understood that other embodiments costs , improve efficiencies and performance , and meet com - would be evident based on the present disclosure, and that US 10 , 154 , 285 B2 process or mechanical changes may bemade without depart In an illustrative example , the video bitstream 110 can be ing from the scope of the present invention . a serial bitstream sent from the video encoder 102 to the In the following description , numerous specific details are video decoder 104 . In another illustrative example , the video given to provide a thorough understanding of the invention . bitstream 110 can be a data file stored on a storage device However, it will be apparent that the invention may be 5 and retrieved for use by the video decoder 104 . practiced without these specific details . In order to avoid The video encoder 102 can receive the video source 108 obscuring the present invention , some well -known circuits, for a scene in a variety of ways . For example , the video system configurations , and process steps are not disclosed in source 108 representing objects in the real -world can be detail . captured with a video camera , multiple cameras, generated Likewise , the drawings showing embodiments of the 10 with a computer , provided as a file , or a combination thereof. system are semi- diagrammatic and not to scale and , particu - The video source 108 can include a variety of video larly , some of the dimensions are for the clarity of presen - features . For example , the video source 108 can include tation and are shown greatly exaggerated in the drawing single view video , multiview video , stereoscopic video , or a FIGs. Where multiple embodiments are disclosed and combination thereof. described , having some features in common , for clarity and 15 The video encoder 102 can encode the video source 108 ease of illustration , description , and comprehension thereof, using a video syntax 114 to generate the video bitstream 110 . similar and like features one to another will ordinarily be The video syntax 114 is defined as a set of information described with like reference numerals . elements that describe a coding system for encoding and The term “ module ” referred to herein can include soft - decoding the video source 108 . The video bitstream 110 is ware , hardware , or a combination thereof in the present 20 compliant with the video syntax 114 , such as High -Effi invention in accordance with the context in which the term ciency Video Coding / H . 265 , and can include a HEVC video is used . For example , the software can be machine code , bitstream , an Ultra High Definition video bitstream , or a firmware , embedded code , and application software . Also combination thereof. The video bitstream 110 can include for example , the hardware can be circuitry , processor, com - the video syntax 114 . puter, integrated circuit , integrated circuit cores, a micro - 25 The video bitstream 110 can include information repre electromechanical system (MEMS ) , passive devices, envi- senting the imagery of the video source 108 and the asso ronmental sensors including temperature sensors, or a ciated control information related to the encoding of the combination thereof. video source 108 . For example , the video bitstream 110 can The term “ syntax ” means the set of elements describing a include an occurrence of the video syntax 114 having a data structure . The term “ block ” referred to herein means a 30 representation of the video source 108 . group of picture elements , pixels , or smallest addressable The video encoder 102 can encode the video source 108 elements in a display device . to form a video layer 122 . The video layer 122 is a Referring now to FIG . 1 , therein is shown a block diagram representation of the video source 108 . For example , the of a video coding system 100 in an embodiment of the video layer 122 can include the video source 108 at a present invention . The video coding system 100 can encode 35 different resolution , quality , bit rate , frame rate , or a com and decode video information . A video encoder 102 can bination thereof . The video layer 122 can be a lower receive a video source 108 and send a video bitstream 110 resolution representation of the video source 108 . In another to a video decoder 104 for decoding and display on a display example , the video layer 122 can be a high efficiency video interface 120 . coding (HEVC ) representation of the video source 108 . In The video encoder 102 can receive and encode the video 40 yet another example , the video layer 122 can be a represen source 108 . The video encoder 102 is a unit for encoding the tation of the video source 108 configured for a smart phone video source 108 into a different form . The video source 108 display. is defined as a digital representation of a scene of objects . The video coding system 100 can include the video Encoding is defined as computationally modifying the decoder 104 for decoding the video bitstream 110 . The video video source 108 to a different form . For example , encoding 45 decoder 104 is defined as a unit for receiving the video can compress the video source 108 into the video bitstream bitstream 110 and modifying the video bitstream 110 to form 110 to reduce the amount of data needed to transmit the a video stream 112 . video bitstream 110 . The video decoder 104 can decode the video bitstream In another example , the video source 108 can be encoded 110 to form the video stream 112 using the video syntax 114 . by being compressed , visually enhanced , separated into one 50 Decoding is defined as computationally modifying the video or more views, changed in resolution , changed in aspect bitstream 110 to form the video stream 112 . For example , ratio , or a combination thereof. In another illustrative decoding can decompress the video bitstream 110 to form example , the video source 108 can be encoded according to the video stream 112 formatted for displaying on the display the High - Efficiency Video Coding (HEVC ) / H . 265 standard . the display interface 120 . In yet another illustrative example , the video source 108 can 55 The video stream 112 is defined as a computationally be further encoded to increase spatial scalability . modified version of the video source 108 . For example , the The video source 108 can include frames 109 . The frames video stream 112 can include a modified occurrence of the 109 are individual images that form the video source 108 . video source 108 with different resolution . The video stream For example , the video source 108 can be the digital output 112 can include cropped decoded pictures from the video of one or more digital video cameras taking 24 of the frames 60 source 108 . 109 per second . The video decoder 104 can form the video stream 112 in The video encoder 102 can encode the video source 108 a variety of ways . For example , the video decoder 104 can to form the video bitstream 110 . The video bitstream 110 is form the video stream 112 from the video layer 122 . In defined a sequence of bits representing information associ- another example , the video decoder 104 can form the video ated with the video source 108 . For example , the video 65 stream 112 from the video layer 122 . bitstream 110 can be a bit sequence representing a compres In a further example , the video stream 112 can have a sion of the video source 108 . different aspect ratio , a different frame rate , different stereo US 10 , 154 , 285 B2 scopic views, different view order , or a combination thereof The video source 108 of FIG . 1 can include the frames than the video source 108 . The video stream 112 can have 109 of FIG . 1 . Each of the frames 109 can be split into the different visual properties including different color param - coding tree unit 302 of equal size. eters , color planes, contrast , hue , or a combination thereof . The coding tree unit 302 can be subdivided into coding The video coding system 100 can include a display 5 units 304 using a quadtree structure . The quadtree structure processor 118 . The display processor 118 can receive the is a tree data structure in which each internal mode has video stream 112 from the video decoder 104 for display on exactly four children . The quadtree structure can partition a the display interface 120 . The display interface 120 is a unit two dimensional space by recursively subdividing the space that can present a visual representation of the video stream into four quadrants . 112 . 10 For example , the display interface 120 can include a smart 10 The frames 109 of the video source 108 can be subdivided phone display , a digital projector, a DVD player display , or into the coding units 304 . The coding units 304 are square a combination thereof. Although the video coding system regions that make up one of the frames 109 of the video 100 shows the video decoder 104 , the display processor 118 , source 108 . and the display interface 120 as individual units , it is 15 The coding units 304 can be a variety of sizes . For understood that the video decoder 104 can include the example , the coding units 304 can be up to 64x64 pixels in display processor 118 and the display interface 120 . size . Each of the coding units 304 can be recursively The video encoder 102 can send the video bitstream 110 subdivided into fourmore of the coding units 304 . In another to the video decoder 104 in a variety ofways . For example , example , the coding units 304 can include the coding units the video encoder 102 can send the video bitstream 110 to 20 304 having 64x64 pixels, 32x32 pixels , 16x16 pixels, or 8x8 the video decoder 104 over a communication path 106 . In pixels . another example , the video encoder 102 can send the video Referring now to FIG . 4 , therein is shown an example of bitstream 110 as a data file on a storage device . The video prediction units 402 . The prediction units 402 are regions decoder 104 can access the data file to receive the video within the coding units 304 of FIG . 3 . The contents of the bitstream 110 . 25 prediction units 402 can be calculated based on the content The communication path 106 can be a variety ofnetworks of other adjacent regions of pixels . suitable for data transfer. For example , the communication Each of the prediction units 402 can be calculated in a path 106 can include wireless communication , wired com - variety of ways . For example , the prediction units 402 can munication , optical , infrared , or the combination thereof. be calculated using intra -prediction or inter - prediction . Satellite communication , cellular communication , terrestrial 30 The prediction units 402 calculated using intra -predic communication , Bluetooth , Infrared Data Association stan - tions can include content based on neighboring regions . For dard ( IrDA ), wireless fidelity (WiFi ) , and worldwide example , the content of the prediction units 402 can be interoperability for microwave access ( WiMAX ) are calculated using an average value , by fitting a plan surface examples of wireless communication that can be included in to one of the prediction units 402 , direction prediction the communication path 106 . Ethernet, digital subscriber 35 extrapolated from neighboring regions, or a combination line (DSL ) , fiber to the home (FTTH ) , digital television , and thereof . plain old telephone service (POTS ) are examples of wired The prediction units 402 calculated using inter - predic communication that can be included in the communication tions can include content based on image data from the path 106 . frames 109 of FIG . 1 that are nearby. For example , the The video coding system 100 can employ a variety of 40 content of the prediction units 402 can include content video coding syntax structures . For example , the video calculated using previous frames or later frames , content coding system 100 can encode and decode video informa- based on motion compensated predictions , average values tion using High Efficiency Video Coding/ H .265 (HEVC ), from multiple frames, or a combination thereof. scalable extensions for HEVC (SHVC ), or other video The prediction units 402 can be formed by partitioning coding syntax structures . 45 one of the coding units 304 in one of eight partition modes . The video encoder 102 and the video decoder 104 can be The coding units 304 can include one , two, or four of the implemented in a variety of ways . For example , the video prediction units 402 . The prediction units 402 can be rect encoder 102 and the video decoder 104 can be implemented angular or square . using hardware , software, or a combination thereof. For F or example , the prediction units 402 can be represented example , the video encoder 102 can be implemented with 50 by mnemonics 2 Nx2 N , 2 NxN , Nx2 N , NxN , 2 NxnU , 2 custom circuitry, a digital signal processor, microprocessor, NxnD , nLx2 N , and nRx2 N . Uppercase “ N ” can represent or a combination thereof. In another example , the video half the length of one of the coding units 304. Lowercase “ n ” decoder 104 can be implemented with custom circuitry , a can represent one quarter of the length of one of the coding digital signal processor, microprocessor, or a combination units 304 . Uppercases “ R ” and “ L ” can represent right or left thereof. 55 respectively . Uppercases “ U ” and “ D ” can represent up and Referring now to FIG . 2 , therein is shown an example of down respectively. the video bitstream 110 . The video bitstream 110 includes an Referring now to FIG . 5 , therein is shown an example of encoded occurrence of the video source 108 of FIG . 1 and grouping coding tree units 302. The coding tree units 302 can be decoded to form the video stream 112 of FIG . 1 for can be grouped into slices 502 having slice segments 504 . display on the display interface 120 of FIG . 1 . The video 60 The slices 502 are sequences of one or more of the slice bitstream 110 can include the video layer 122 based on the segments 504 . The slices 502 start with one of independent video source 108 . The video bitstream 110 can include one slice segments 505 and include all subsequent dependent of the frames 109 of FIG . 1 of the video layer 122 followed slice segments 507 that precede the next one of the inde by a parameter set 202 associated with the video source 108 . pendent slice segments 505 within the same access unit . Referring now to FIG . 3 , therein is shown an example of 65 The coding tree units 302 can be partitioned into the slices a coding tree unit 302 . The coding tree unit 302 is a basic 502 having the slice segments 504 . The slice segments 504 unit of video coding . are sequences of one or more of the coding tree units 302 . US 10 , 154 , 285 B2 A division of the slices 502 into the coding tree units 302 is Referring now to FIG . 7 , therein is shown an exemplary a partitioning . One of the slices 502 can include one or more block diagram of the video encoder 102 . The video encoder of the coding tree units 302 . 102 can form the video layer 122 of FIG . 1 based on the The coding tree units 302 can be divided into two or more video source 108 . of the slices 502 . A first slice 506 can include a first 5 The video encoder 102 can receive the video source 108 . independent slice segment 508 and two of dependent slice The video encoder 102 can encode the video source 108 to segments 504 . The slices 502 can include data structures that form the video bitstream 110 . can be decoded independently from other slices 502 of the The video coding system 100 of FIG . 1 can include the same picture, in terms of compression methods including video decoder 104 of FIG . 1 for decoding the video bit entropy coding, signal prediction , and residual signal recon - stream 110 provided by the video encoder 102 . The video struction . decoder 104 can have a complementary structure to the Each of the slices 502 can be either an entire picture or a video encoder 102 for forming the video stream 112 of FIG . region of a picture . One of the purposes of the slices 502 is 1 based on the video layer 122 . It is understood that the re - synchronization in an event of data losses . In a case of video decoder 104 can include similar modules to the video packetized transmission , a maximum number of payload bits encoder 102 . within each of the slices 502 can be restricted . A number of The video encoder 102 can include an encoder module the coding tree units 302 in each of the slices 502 can be 704 . The encoder module 704 can be implemented in a varied to minimize a packetization overhead while keeping variety ofways . For example , the encoder module 704 can a size of each packet within this bound . 20 be a HEVC /Advanced Video coding (AVC ) encoder . One of the frames 109 of FIG . 1 can be divided into tiles The encoder module 704 can receive the video source 108 510. The tiles 510 are rectangular portions of the coding tree and form the video layer 122 . The video source 108 can be units 302 . The tiles 510 represent an integer number of the at the original resolution or can be downsampled to reduce coding tree units 302 . The tiles 510 can include one of the the resolution or quality . coding tree units 302 included in one of the slices 502 . 25 The encoder module 704 can include a transformation and The tiles 510 allow a picture to be divided up into a grid quantization module 712 for performing transformation of rectangular regions that can independently be decoded or operations , scaling operations , quantization operations, or a encoded . A purpose of the tiles 510 can allow for parallel combination thereof. The transformation and quantization processing . The tiles 510 can be independently decoded and module 712 can receive the video source 108 and interme can even allow for random access to specific regions of a su diate video content and pass additional intermediate video picture in a video stream . The slices 502 can be decoded content to an entropy coding module 724 for forming the independently from each other with a purpose of the tiles video bitstream 110 . 510 being re - synchronization in case of data loss in the video The intermediate video content is partially processed stream . 25 video information used by the encoder module 704 . The A purpose of the tiles 510 can increase a capability for intermediate video content can include portions of frames, parallel processing rather than provide error resilience . The motion elements , regions, color maps, tables , or a combi tiles 510 can include independently decodable regions of a nation thereof. picture that are encoded with shared header information . The encoder module 704 can include an inverse transfor Therefore , the tiles 510 can additionally be used for a 40 mation and inverse quantization module 714 . The inverse purpose of random access to local regions of video pictures. transformation and inverse quantization module 714 can A configuration of the tiles 510 of a picture can include perform inverse transformation and inverse quantization segmenting the picture into rectangular regions with operations on the intermediate video content received from approximately equal numbers of the coding tree units 302 in the transformation and quantization module 712 . each of the tiles 510 . 45 The encoder module 704 can include an intra - picture All or a number of the coding tree units 302 in one of the prediction module 716 . The intra -picture prediction module slices 502 can belong to the one of the tiles 510 . All or a 716 can calculate portions of the intermediate video content number of the coding tree units 302 in one of the tiles 510 based on adjacent regions within one of the frames 109 of can belong to the same one of the tiles 510 . All or a number FIG . 1 . The intra -picture prediction module 716 can receive of the coding tree units 302 in one of the slice segments 504 50 intermediateintermediate video contercontent from the inverse transformation can belong to one of the tiles 510 . All or a number of the and inverse quantization module 714 . The encoder module 704 can include a loop filter module coding tree units 302 in one of the tiles 510 can belong to 718 for processing the intermediate video content based on one of the slice segments 504 . loop levels with the encoder module 704 . The loop filter Referring now to FIG . 6 , therein is shown an example of 55 module 718 can process and send the intermediate video a color space 602 in the video coding system 100 of FIG . 1 . content to a digital picture buffer module 720 . The loop filter The color space 602 describes a mechanism for representing module 718 can process reconstructed samples or portions color elements in a picture . of the video layer 122 before writing into the digital picture Each of the frames 109 of FIG . 1 of the video source 108 buffer module 720 . The loop filter module 718 can improve of FIG . 1 and the video stream 112 of FIG . 1 can include one 60 the reconstructed picture quality for better temporal predic or more sample arrays 604 . The sample arrays 604 can t ion for future pictures . represent pixels having color schemes. The sample arrays The encoder module 704 can include the digital picture 604 can include monochrome luma pixels 606 only . The buffer module 720 . The digital picture buffer module 720 sample arrays 604 can include the monochrome luma pixels can include memory storage for holding intermediate video 606 and two chroma pixels 608 . For example , the chroma 65 content . The digital picture buffer module 720 can receive pixels 608 can include YUV pixels , red - green - blue pixels the intermediate video content from the loop filter module (RGB ), or arrays representing other color systems. 718 and buffer the information for future loop iterations . The US 10 , 154 , 285 B2 10 digital picture buffer module 720 can send the intermediate Referring now to FIG . 9 , therein is shown an example of video content to a motion compensation prediction module a search range 902 for the intra block copy process 802 . FIG . 722 . 9 depicts redundancy in coding of the intra copy motion The encoder module 704 can include the motion com - vector 808 . pensation prediction module 722 . The motion compensation 5 For example , a motion vector of the intra block copying prediction module 722 calculate motion compensation and prediction mode is coded using a motion vector difference motion vector information based on multiple frames from (MVD ) coding scheme directly . Because of a causality of the video source 108 and intermediate video content. intra block copying , motion vector values cannot be arbi The encoder module 704 can selectively loop the output trary in the search range 902 . For example , the current of the intra - picture prediction module 716 or the motion 10 coding unit 804 cannot copy the reference coding unit 806 , compensation prediction module 722 back to the transfor - which overlaps with the current coding unit 804 . Thus , there mation and quantization module 712 using a mode selector are invalid motion vectors 904 as shown in FIG . 9 . 723 . The mode selector 723 can select the output of the The invalid motion vectors 904 lead to the redundancy in intra -picture prediction module 716 or the motion compen motion vector (MV ) coding of the intra block copying sation prediction module 722 for sending to the transforma - 15 prediction mode . To remove the redundancy , the solutions tion and quantization module 712 . The selection of which are proposed in the embodiments of the present invention , module to select is based on the content of the video source which will subsequently be described in more details . 108 . FIG . 9 depicts the invalid motion vectors 904 pointing The encoder module 704 can include the entropy coding from the current coding unit 804 when the reference coding module 724 . The entropy coding module 724 can encode the 20 unit 806 is within a restricted region 906 . The restricted residual portions of the video source 108 to form a portion region is a region having an invalid range of pixels of a of the video layer 122 . The entropy coding module 724 can picture , within which the reference coding unit 806 cannot output the video bitstream 110 . exist in order to prevent the problem with the redundancy . It has been found the encoding the video source 108 with For illustration purposes , the restricted region 906 is shown the video encoder 102 to form the video layer 122 to form 25 having a width of 2 W and a height of 2 H , although it is the video bitstream 110 increases the level of video com - understood that the restricted region 906 can have any pression and increases operation flexibility . Providing the widths and heights , where W and H are a width and a height, video layer 122 in the video bitstream 110 allows the respectively , of a number of pixels in a horizontal direction formation of the video stream 112 at different resolutions at and a vertical direction , respectively . a lower bandwidth by partitions the compressed video 30 The intra copy motion vector 808 is shown as a valid information . motion vector since the intra copy motion vector 808 is It has been found that the video encoder 102 having the pointing from the current coding unit 804 to the reference encoder module 704 can increase performance and flexibil - coding unit 806 . The reference coding unit 806 is outside of ity . By encoding the video layer 122 , the video coding and not within the restricted region 906 . The current coding system 100 can provide different resolutions and image sizes 35 unit 804 can be in the restricted region 906 . to support different video display systems. Referring now to FIG . 10 , therein is shown an example of Referring now to FIG . 8 , therein is shown an example of the reference coding unit 806 . FIG . 10 depicts a diagram that an intra block copy process 802 of the video coding system shows how the current coding unit 804 references the 100 of FIG . 1 . The intra block copy process 802 is a method reference coding unit 806 out of a possible reference area or of estimating a current coding unit 804 by copying a content 40 the search range 902 . of a reference coding unit 806 . An arrow from the current coding unit 804 to the refer The intra block copy process 802 is different from an intra ence coding unit 806 is an intra block vector, a motion block copying prediction mode such that the intra block vector, or the intra copy motion vector 808 . The intra copy copy process 802 provides solutions for restricting a range motion vector 808 can be projected to a vertical direction of an intra copy motion vector 808 , which is not specified in 45 and get a vertical component 1002 of the intra copy motion the intra block copying prediction mode. The intra block vector 808 and similarly projected to a horizontal direction copying prediction mode may be considered in extension and get a horizontal component 1004 of the intra copy works focusing on screen contents or any other extension motion vector 808 . works of HEVC . The current coding unit 804 can be in a coding tree block The scope of the embodiments of the present invention 50 (CTB ) or one of the coding tree units 302 . Each of the can be broadened such that it can cover the extension works. coding tree units 302 can include any number of pixels in for For example , the extension works can be based on , extended the width and the height. For example , each of the coding from , and not in a version of the High -Efficiency Video tree units 302 can include 64 pixels by 64 pixels . Coding (HEVC ) including version 1 . The example shows the possible reference area limited to The current coding unit 804 is one of the coding units 304 , 55 be one CTB height vertically and one CTB horizontally to where the content is copied from another one of the coding the left of the current coding unit 804 , as the search range units 304 from within the same coding tree unit 302 or from 902 restricted by the intra block copy process 802 of FIG . 8 another of the coding tree units 302 . The current coding unit of the embodiments of the present invention . In this case , the 804 is generated based on the restriction of the range of the reference coding unit 806 is within one of the coding tree intra copy motion vector 808 according to the intra block 60 units 302 immediately to the left of one of the coding tree copy process 802 . units 302 , to which the current coding unit 804 belongs. The current coding unit 804 can include the intra copy. The search range 902 can include a verticalmotion range motion vector 808 representing a path from an upper left 1006 , which limits a search for the intra copy motion vector corner of the reference coding unit 806 to an upper left 808 in a vertical direction from the current coding unit 804 corner of the current coding unit 804 . The reference coding 65 in one of the frames 109 of FIG . 1 . The vertical motion range unit 806 is within the range of the intra copy motion vector 1006 is limited so that the vertical motion range 1006 does 808 as restricted for the intra block copy process 802 . not include any of upper coding tree units 1008 , which are US 10 , 154 , 285 B2 12 the coding tree units 302 that are immediately above a 806 , which can represent any of the coding units 304 of FIG . current coding tree unit 1010 . The current coding tree unit 3 having sizes in a number of pixels smaller than a size in 1010 is one of the coding tree units 302 to which the current a number of pixels of the left coding tree unit 1018 . The coding unit 804 belongs . current coding unit 804 can represent any of the coding units The upper coding tree units 1008 are within an upper 5 304 having sizes in a number of pixels smaller than a size in coding unit row 1012 directly abutting a current coding unit a number of pixels of the current coding tree unit 1010 . row 1014 , which includes a sequence or line with a number The left coding tree unit 1018 , the current coding tree unit of the coding tree units 302 , one of which includes the 1010 , the upper coding tree units 1008 , or a combination current coding unit 804 . None of the coding tree units 302 thereof can include any number of the coding units 304 . The are located directly in between or intervening the upper 10 left coding tree unit 1018 , the current coding tree unit 1010 , coding unit row 1012 and the current coding unit row 1014 . the upper coding tree units 1008 , or a combination thereof The upper coding unit row 1012 and the current coding unit can include the same number of the coding units 304 . A row 1014 do not have any intervening coding tree units in number of the upper coding tree units 1008 in the upper between the upper coding unit row 1012 and the current coding unit row 1012 of FIG . 10 can be equal to a number coding unit row 1014 . 15 of the coding tree units 302 of FIG . 3 in the current coding The search range 902 can include a horizontal motion unit row 1014 of FIG . 10 . range 1016 , which limits a search for the intra copy motion For example , the search range 902 can be applied for the vector 808 in a horizontal direction from the current coding intra block copying prediction mode in HEVC . Also for unit 804 in one of the frames 109. The horizontal motion example , the intra block copying ( IntraBC ) prediction mode range 1016 is limited so that only a left coding tree unit 1018 20 was used as additional intra coding mode. A large range can and the current coding tree unit 1010 are allowed to be used be set for a motion vector of the IntraBC . The intra block to search for the reference coding unit 806 . The left coding copying prediction mode increases the complexity of the tree unit 1018 and the current coding tree unit 1010 are IntraBC by referencing more reference area . abutting each other such that none of the coding tree units The intra block copying ( IntraBC ) prediction mode may 302 is located directly in between or intervening the left 25 be adopted in HEVC . The IntraBC increases the complexity coding tree unit 1018 and the current coding tree unit 1010 . by requiring more memory for previous reconstructed Referring now to FIG . 11 , therein is shown a flow diagram samples for motion estimation in an encoder and motion of the intra block copy process 802 of FIG . 8 . The intra block compensation in a decoder. copy process 802 includes a motion vector range or the A problem exists in a BvIntra range of the intra block search range 902 of FIG . 9 of the intra copy motion vector 30 copying prediction mode . The problem relates to a large 808 of FIG . 8 . The intra block copy process 802 can be search area required for intra prediction using the IntraBC . implemented in the intra - picture prediction module 716 of For example , the BvIntra range is specified as follows. FIG . 7 . A variable of BvIntra [ xO ] [ y0 ] [ compIdx ] specifies a vector The video coding system 100 of FIG . 1 can include a used for the intra block copying prediction mode . A value of source input module 1102 for receiving the frames 109 of 35 BvIntra?x01 yol shall be in a range of 0 to 128 , inclusive . FIG . 1 from the video source 108 of FIG . 1 . The video Array indices x0 , yo specify a location (x0 , yo ) of a top - left coding system 100 can include the video stream 112 of FIG . luma sample of a considered prediction block relative to a 1 and the video bitstream 110 of FIG . 1 , which can then be top - left luma sample of a picture . A horizontal block vector processed by other modules in the video encoder 102 of FIG . component is assigned compldx = 0 , and a vertical block 1 and the video decoder 104 of FIG . 1 , respectively . 40 vector component is assigned compidx = 1 . The value of The video coding system 100 can include a picture BvIntra [xO ] [ y0 ] takes 0 to 128 , which covers the large process module 1104 for processing a picture or one of the search area , especially upper coding tree unit (CTU ) line frames 109 at a time . The picture process module 1104 pixels . processes the picture by encoding video data or decoding If refList is equal to 0 , MvdLO [ xO ][ y0 ][ compidx ] is set coded data of the picture or the frames 109 using the intra 45 equal to 1Mvd [ compidx ] for compldx = 0 . . . 1 . Otherwise , block copy process 802 . The picture process module 1104 if refList is equal to 1 , MvdL1[ x0 ] [y0 ][ compldx ] is set equal can be coupled to the source input module 1102 . to 1Mvd [ compIdx ] for compidx = 0 . . . 1. Otherwise if The picture process module 1104 can process the frames refList is equal to 2 , BvIntra [x0 ][ y0 ][ compidx ] is set equal 109 by generating the reference coding unit 806 of FIG . 8 . to 1Mvd?compldx ) for compldx = 0 . . . 1 . The picture process module 1104 can generate the intra copy 50 It is asserted thatupper CTU line pixels can be referred by motion vector 808 pointing to the reference coding unit 806 the IntraBC according to a current restriction of the intra within the search range 902 , wherein the search range 902 block copying prediction mode . From an implementation does not include any of the upper coding tree units 1008 of point of view , it is a great concern since it implies forcing to FIG . 10 , and the search range 902 includes only the left run an in - loop filter process frame by frame. coding tree unit 1018 of FIG . 10 , the current coding tree unit 55 For CTU -based in - loop filtering architectures, the upper 1010 of FIG . 10 , or a combination thereof. CTU line pixels are stored in a decoded picture buffer The picture process module 1104 can generate the current (DPB ) , which is usually located on dynamic random - access coding unit 804 of FIG . 8 based on the intra copy motion memory (DRAM ) , after the in - loop filtering is processed . vector 808 . The picture process module 1104 can generate Intermediate pixels like before the in -loop filtering are not the video bitstream 110 based on the intra copy motion 60 available for the current CTU . If the intermediate pixels in vector 808 . The video bitstream 110 can then be sent through the upper CTU line are required by the IntraBC , a significant the communication path 106 of FIG . 1 to the video decoder DRAM bandwidth increases to store and load the interme 104 to receive and decode to generate the video stream 112 diate pixels is inevitable . Alternatively , expensive cache for displaying on a device , such as the display interface 120 memory is necessary for storage . of FIG . 1 . 65 On the other hand , a BvIntra search range or the search The picture process module 1104 can generate the intra range 902 as proposed by the intra block copy process 802 copy motion vector 808 to point to the reference coding unit is restricted or constrained not to access the upper CTU line US 10 , 154 , 285 B2 13 14 pixels in the upper coding tree units 1008 . An IntraBC It is proposed in the embodiments to clarify a block vector performance can be measured under the constraint . for intra prediction (BvIntra ) range restriction , especially for Thus, it is proposed by the embodiments to clarify or the vertical component 1002 of FIG . 10 . The BvIntra range change the restriction in the text as follows to align a restriction applies to the restriction of the search range 902 reference or test software . The change is to emphasize the 5 of the intra copy motion vector 808 according to the intra constraint not to use the upper CTU line pixels . block copy process 802 . It is also proposed to modify a MV The value of BvIntra [x0 ] [yo ] [ 0 ] can be in the range of coding of the IntraBC of the intra block copying prediction - (2 * CtbSizeY ) to (CtbSizeY - nCbS ). The value of BvIntra mode . [ XO ] [ y0 ] [ 1 ] can be in the range of - ( y0 % CtbSizeY ) to The invalid motion vectors 904 of FIG . 9 lead to the ( CtbSize Y - nCbS ) . 10 redundancy in motion vector (MV ) coding of the intra block BvIntra [x0 ] [y0 ][ 0 ] is a horizontal component of an intra copying prediction mode. To remove the redundancy, the block vector, BvIntra [x0 ][ y0 ][ 1 ] is a vertical component of solutions previously mentioned are proposed in the embodi an intra block vector. CtbSizeY is a height of a coding tree ments of the present invention . block . nCbs is a size of a coding block . YO is a vertical A first solution is described as follows. As demonstrated component of a top left sample location . % is a remainder 15 in FIG . 9 , absolute values of the horizontal component 1004 , operator. denoted as MVX , and the vertical component 1002 , denoted The reference pixels can be available for any BvIntra as MVy, of the intra copy motion vector 808 in the intra value , which satisfies the above restriction . For the horizon - block copy process 802 cannot be both less than a unit size tal component 1004 of FIG . 4 , it is recommended to restrict 1106 of the current coding unit 804 . The current coding unit further based on a discussion in terms of coding efficiency . 20 804 can represent the current coding unit 804 . In order to align BvIntra coding improvement proposal in In the other words , if the horizontal component 1004 is FIG . 9 , following is suggested since BvIntra is an MVD less than a width 1108, denoted as W , of the current coding value. The specification of the intra block copy process 802 unit 804 a magnitude 1110 , denoted as |MVyl , of the vertical is described as follows. A bitstream conformance for an component 1002 has to be larger or greater than a height input bitstream or the video bitstream 110 that a recon - 25 1112 , denoted as H , of the current coding unit 804 . The structed vector for the intra block copying prediction mode magnitude 1110 can be reduced to save bits in coding the can satisfy the following restriction in Equations 1 - 2 . values. bvIntra [0 ] in the range of - ( 2 * CtbSizeY) to ( Ctb At the video encoder 102 side, before the intra copy Size Y - nCbS) . (Eq . 1 ) motion vector 808 is encoded ( i . e . , MVx and MVy ), the bvIntra [ 1 ] in the range of - ( yTbCmp % CtbSizeY) to 30 following in Equation 3 can apply . (CtbSizeY -NCbS ) . (Eq . 2 ) If abs( MVx ) < W .MVy + = H , where (Eq . 3 ) bvIntra [ 0 ] is a horizontal component of an intra block vector . bvIntra [1 ] is a vertical component of an intra block " abs (MVx )” is an absolute value of the horizontal com vector. yTbCmp is a height of a tree block . es35 ponentP 1004 , " < ” is less than , and “ MVy + = H ” is a new value The embodiments of the present invention propose the of the vertical component 1002 is assigned to a sum of a solutions to set reasonable range limits for restricting the current value of the vertical component 1002 and the height search range 902 of the intra copy motion vector 808 . The 1112 of the current coding unit 804 . embodiments save or do without a large line buffer. As such , At the video decoder 104 side , after the intra copy motion to reduce cost and complexity for implementation , the 40 vector 808 is parsed from the video bitstream 110 , the embodiments of the present invention provide the solutions following in Equation 4 can apply . for restricting the motion vector range for the IntraBC The solutions provide the intra copy motion vector 808 If abs( MVx ) < W .MVy - = H , where (Eq . 4 ) having the vertical motion range 1006 of FIG . 10 that is " abs (MVx ) ” is an absolute value of the horizontal com restricted to not cover any of the upper coding tree units 45 ponent 1004 , “ < ” is less than , and “ MVy - = H ” is a new value 1008 . The solutions also provide the horizontalmotion range of the vertical component 1002 assigned to a difference of a 1016 of FIG . 10 , which includes only the left coding tree current value of the vertical component 1002 and the height unit 1018 and the current coding tree unit 1010 . The 1112 of the current coding unit 804 . solutions provide a horizontal motion restriction that can be A specification of the intra block copy process 802 is loosen based on a trade -off between complexity and coding 50 described below . Inputs to this process can include a sample efficiency . location , a transform block size , a block copying vector, and The intra block copy process 802 is a new process that can a colour component. The sample location , denoted as ( xTb employ a whole block of one of the coding tree units 302 , Cmp , yTbCmp ) , can specify a top -left sample of a current not neighboring pixels of the current coding unit 804 ,within transform block or the current coding unit 804 , relative to a the same picture of the same frame of one of the frames 109 55 top left sample of a current picture or one of the frames 109 of FIG . 1 . This is different from the intra block copying currently processed. The transform block size , denoted as prediction mode or any other prediction modes that employ nTbS , is a variable or information specifying a block size of only neighboring pixels but the intra block copy process 802 the current coding unit 804 . entirely uses all of pixels or picture elements in both the left The block copying vector, denoted as bvIntra , is a variable coding tree unit 1018 and the current coding tree unit 1010 60 or information associated with a motion vector of the current for the search range 902 . coding unit 804 to the reference coding unit 806 . The block The intra block copy process 802 is studied from an copying vector can represent the intra copy motion vector implementation point of view in this contribution of the 808 . The colour component, denoted as cIdx , is a variable or embodiments of the present invention . For clean -up and information specifying colors of the current coding unit 804 . bug - fixes purposes of the intra block copying prediction 65 Outputs of this process can include predicted samples, mode , several modifications are proposed by the embodi- denoted as predSamples [ x ] [ y ] , with x , y = 0 . . . nTbS - 1 . In ments . addition to the description above, the first solution includes US 10 , 154 , 285 B2 15 16 proposed changes, which will subsequently be described The block copying vector, denoted as bvIntra , is a variable below . For example , the proposed changes can be introduced or information associated with a motion vector of the current as follows. coding unit 804 to the reference coding unit 806 . The block A variable, denoted as by , representing a block vector or copying vector can represent the intra copy motion vector the intra copy motion vector 808 for prediction in full - 5 808 . The colour component, denoted as cIdx , is a variable or sample units can be derived using Equations 5 - 6 as follows. information specifying colors of the current coding unit 804 . Outputs of this process can include the predicted samples , bv [0 ] = bvIntra [0 ] > > ( (( cldx = = 0 ) ? 1 :SubWidthC ) - 1 ) (Eq . 5 ) denoted as predSamples [ x ][ y ], with x , y = 0 . . . nTbS - 1 . In addition to the description above , the second solution bv [ 1 ] = ( abs (bvIntra [0 ] ) < nTbs ?bvIntra [ 1 ] - nTbs: bvIntra 10 includes proposed changes , which will subsequently be [1 ] ) > > (( ( c ) dx = = 0) ?1 : SubHeightC )- 1) (Eq . 6) described below . For example , the proposed changes can be bvIntra [ 0 ] is a horizontal component of an intra block introduced as follows. vector. bvIntra [ 1 ] is a vertical component of an intra block The variable by representing the block vector or the intra vector. 0 and 1 are indices for horizontal and vertical copy motion vector 808 for prediction in full - sample units components . cIdx is an index for a color component. Sub - 15 can be derived using Equations 10 - 11 as follows. WidthC and SubHeightC are a width and a height of a chroma component of the same coding block . bv [0 ]= ( abs( bvIntra [1 ] )