USOO89651 80B2

(12) United States Patent (10) Patent No.: US 8,965,180 B2 Knight et al. (45) Date of Patent: *Feb. 24, 2015

(54) SYSTEMS AND METHODS FOR 21/4884 (2013.01); H04N 2 1/84 (2013.01); CONVERTING INTERACTIVE MULTIMEDIA H04L 65/602 (2013.01); G1 I B2220/2562 CONTENT AUTHORED FOR DISTRIBUTION (2013.01) VIAA PHYSICAL MEDIUM FOR USPC ...... 386/282 ELECTRONIC DISTRIBUTION (58) Field of Classification Search USPC ...... 386/278, 279, 280, 281, 282,283, 284, (75) Inventors: Anthony David Knight, San Jose, CA 386/285, 290 (US); Ian Michael Lewis, Oxfordshire See application file for complete search history. (GB); Andrew Maurice Devitt, London (GB) (56) References Cited (73) Assignee: Rovi Guides, Inc., Santa Clara, CA (US) U.S. PATENT DOCUMENTS 4,838,843. A 6, 1989 Westhoff (*) Notice: Subject to any disclaimer, the term of this 5,313,881 A 5/1994 Morgan patent is extended or adjusted under 35 U.S.C. 154(b) by 66 days. (Continued) This patent is Subject to a terminal dis FOREIGN PATENT DOCUMENTS claimer. EP O865.362 B1 T 2003 (21) Appl. No.: 13/182,376 JP 2001344828 12/2001 (Continued) (22) Filed: Jul. 13, 2011 OTHER PUBLICATIONS (65) Prior Publication Data Apple Inc., "iTunes Extra iTunes LP Development: Template How US 2012/OO 14674 A1 Jan. 19, 2012 To v1.1”. Jan. 26, 2010, 58 pgs. (Continued) Related U.S. Application Data Primary Examiner — Tat Chio (60) Provisional application No. 61/364,001, filed on Jul. (74) Attorney, Agent, or Firm — Ropes & Gray LLP 13, 2010. (57) ABSTRACT (51) Int. Cl. Systems and methods for converting interactive multimedia H04N5/93 (2006.01) content authored for distribution via a physical medium for GIB 27/034 (2006.01) electronic distribution are disclosed. One embodiment of the GIB 27/32 (2006.01) invention includes building an object model of interactive H4N2L/2343 (2011.01) multimedia content authored for distribution via a physical H4N2L/488 (2011.01) medium using a content authoring system, automatically authoring a user interface based upon the object model using (Continued) the content authoring system, and packing the transcoded (52) U.S. Cl. multimedia content into at least one container file. CPC ...... GIIB 27/034 (2013.01); GIIB 27/329 (2013.01); H04N 21/234,354 (2013.01); H04N 23 Claims, 12 Drawing Sheets

6 O N.

Content Authoring System Uss 16 Computer US 8,965,180 B2 Page 2

(51) Int. Cl. JP 2006212834 8, 2006 H4N2L/84 (2011.01) KR 102007OO76748 7/2007 WO WO-2006054987 5, 2006 H04L 29/06 (2006.01) WO WO-2007059664 5/2007 WO 2008108966 A1 9, 2008 (56) References Cited WO 20120094.85 A1 1/2012 U.S. PATENT DOCUMENTS OTHER PUBLICATIONS 5,316,464 5, 1994 Lexell International Search Report and Written Opinion for Application No. 5,320,219 6, 1994 Ward PCT/US2011/043923, International Filing Date Jul. 13, 2011, Search 5,375,515 12, 1994 Morgan 5.435.246 7, 1995 Edman Completed Sep. 15, 2011, Mailed Sep. 29, 2011, 21 pgs. 5,504,688 4, 1996 Letourneau “Any DVD Converter, Dec. 30, 2009, Retrieved on Aug. 25, 2011, 5,742,569 4, 1998 Yamamoto et al...... 369/30.18 Retrieved from:http://web.archive.org/web/2009 1230041557/http:// 5,787,802 8, 1998 McNab www.any-video-converter.com/products/for dvd/. 5.991,399 11, 1999 Graunke et al. “How to rip DVDs in Windows/Mac using Handbrake', Oct. 3, 2008, 6,302,176 10, 2001 Chen Retrieved Aug. 30, 2011, Retrieved from http://my-guides.net/en/ 6,310,601 10, 2001 Moore et al...... 345,660 content/view/11 1/26/. 6,453459 9, 2002 Brodersen et al...... 717/100 “Screenshot Any DVD Converter, Dec. 30, 2009, Retrieved on 6,496,802 12, 2002 van Zoest et al. Aug. 25, 2011, http://web.archive.org/web/2009 1230070300/http:// 6,585,021 T/2003 Clark et al. any-video-converter.com/products for dvd/screenshot.php. 6,799,621 10, 2004 Flynn et al. 7,257,732 8, 2007 Zarnke et al. Hickson, Ian et al., “HTML5—A vocabulary and associated APIs for 7.340,481 3, 2008 Baer et al. HTML and XHTML, Mar. 4, 2010, Retrieved Mar. 4, 2010, http:// 2003/00284.51 2, 2003 Ananian www.w3.org/TR/2010/WD-html5-20100301/Overview.html, 709 2004/00399.34 2, 2004 Land et al...... T13/200 pgs. Relevant pages: pp. 21-26 (paragraph 2.1), pp. 62-70 (paragraph 2004/0267742 12, 2004 Poison et al. 3.1), pp. 78-84 (paragraph 3.2.5), pp. 108-115 (paragraph 4.3), pp. 2005, 010832O 5/2005 Lord et al. 162-217 (paragraph 4.8), pp. 303-312 (paragraph 4.11.3-paragraph 2005, 0169606 8, 2005 Yoo et al...... 386,95 4.11.5). 2005/0262149 11/2005 Jung et al...... TO7 104.1 Knight, Tony, "Metadata & the Supply Chain'. Mar. 24, 2011, 2006, O161584 T/2006 Kawakami Retrieved on Aug. 24, 2011, http://www.mediatech.net/fileadmin/ 2006, O165381 T/2006 Eckleder et al. templates/association/pdfenewsLas Vegas 2011/Rovi Slides 2007/0105253 5/2007 Hendriks et al. (MediaTech2011.pdf. 2007/O112826 5/2007 Laksono ...... 707/102 2007/O150548 6, 2007 Nakagawa Lawson, Bruce, "Accessible HTML5 Video with JavaScripted cap 2007/0192352 8, 2007 Levy tions', Jan. 13, 2010, Retrieved Aug. 26, 2011, http://dev.opera.com/ 2007/0256141 11/2007 Nakano et al. articles/view/accessible-htmlS-video-with-javascripted-captions/. 2008/0216106 9, 2008 Maxwell et al...... 725, 1 Pieters, Simon, “Everything you need to know about HTML5 video 2008/0313680 12, 2008 Suzanne et al. and audio', Mar. 3, 2010, Retrieved Aug. 26, 2011, http://my, opera. 2009. O156181 6, 2009 Athsani et al. com/core/blog/2010/03/03/everything-you-need-to-know-about 2009,0257336 10, 2009 Knight html5-video-and-audio-2. 2009,0259684 10, 2009 Knight Pilgrim, Mark, “Video on the Web”, Nov. 16, 2009, Retrieved on Aug. 2010.0185729 T/2010 Lord et al. 26, 2011, http://web.archive.org/web/20091116135139/http:// 2011 OO13888 1, 2011 Sasaki et al...... 386.353 diveintohtml5.org/video.html. 2011 OO60741 3, 2011 Heller et al. 2011 OO60742 3, 2011 Heller et al. International Application Serial No. PCT/US2008/013744. Interna 2011 OO60991 3, 2011 Grant et al. tional Search Report, dated Mar. 13, 2009. 2011/006 1002 3, 2011 Bethune et al...... 715,744 The Kaleidescape System, The Ultimate Entertainment Experience 2012fOO 14663 1, 2012 Knight et al. Brochure, printed from www.kaleidescape.com on Apr. 22, 2008 (9 2012fOO 14674 1, 2012 Knight et al. pages). International Application Serial No. PCT/US2009/002142. Interna FOREIGN PATENT DOCUMENTS tional Search Report, dated Nov. 25, 2009. European Application Serial No. EP 09729772.5, Extended Search JP 2004.004245 1, 2004 Report, dated May 10, 2013. JP 2004.199590 T 2004 JP 2005-028729 2, 2005 * cited by examiner U.S. Patent Feb. 24, 2015 Sheet 1 of 12 US 8,965,180 B2

0$ U.S. Patent Feb. 24, 2015 Sheet 2 of 12 US 8,965,180 B2

( 3: e...

Build object model of u-1 interactive multimedia content

24 Automatically author S. S. user interface using object model

26 Transcode/transrate u-1 audio and/or video U.S. Patent Feb. 24, 2015 Sheet 3 of 12 US 8,965,180 B2

40 42 N 44 DVDVideo

46

/ 48 AUDIOS WDEO TS 56 58

WWG 60 WOO SFO WDEOS, BUp 50 WDEOIS. WOB 62 WS 64. WTSO. O. FO 52 66 ~x. WIS O. O.WOB WTS011.WOB

66 WTSO 9.VOB

66 WTS 54

WTS WTS 99 O. FO

FIG. 3 U.S. Patent Feb. 24, 2015 Sheet 4 of 12 US 8,965,180 B2

?& Start )

. . . . . 22' Build object model of u-1 DVD

s CSS 24' pagesGenerate using HTML5 object u-1 model

26' Transcode/transrate u-1 audio and/or video

Convert subtites

Pack into container------s: file u-"

? assassiggists:Complete )

FIG. 4 U.S. Patent Feb. 24, 2015 Sheet 5 of 12 US 8,965,180 B2

U.S. Patent Feb. 24, 2015 Sheet 6 of 12 US 8,965,180 B2

U.S. Patent Feb. 24, 2015 Sheet 7 of 12 US 8,965,180 B2

120

121

122

123

124

FIG. 7 U.S. Patent Feb. 24, 2015 Sheet 8 of 12 US 8,965,180 B2

130 132

ROOt OO Root Page 136 138 134 / 148 150 Scene Selection Document 2 DOCument 3

Scene Chapter) (Chapter 142

142

JavaScript Scripts Scripts Scripts 144

144

Media Containers 146 Audio/Video/ Audio/Video/ Subtitles Subtitles 146

FIG. 8 U.S. Patent Feb. 24, 2015 Sheet 9 of 12 US 8,965,180 B2

160

162

838; xx-xx-x8 8-88: 8:8;&8:8:::8:

188

190 164 3:838:

166

168

182

FIG. 9 U.S. Patent Feb. 24, 2015 Sheet 10 of 12 US 8,965,180 B2

200

208

21 O

214

212

re: esssssss

FIG 10 U.S. Patent Feb. 24, 2015 Sheet 11 of 12 US 8,965,180 B2

ZZZ 8ZZZOZ U.S. Patent Feb. 24, 2015 Sheet 12 of 12 US 8,965,180 B2

US 8,965, 180 B2 1. 2 SYSTEMS AND METHODS FOR rendering engine formats content for display. The