USOO7207006B1 (12) United States Patent (10) Patent No.: US 7,207,006 B1 Feig et al. (45) Date of Patent: Apr. 17, 2007 (54) RUN-TIME HYPERVIDEO HYPERLINK FOREIGN PATENT DOCUMENTS INDICATOR OPTIONS IN HYPERVIDEO PLAYERS EP O 483 576 5, 1992 (75) Inventors: Ephraim Feig, San Diego, CA (US); (Continued) Jeane Shu-Chun Chen, San Diego, CA OTHER PUBLICATIONS SSY sy Beijing (CN); Dong Dimitrova et al., Visual Associations in DejaVideo, 1998, pp. 1-11.* le, Be11ng (Continued) (73) Assignee: International Business Machines Primary Examiner Weilun Lo C orporation,tion, Armonk,OnK, NY (US(US) Assistanty Examiner Truc T. Chuong (*) Notice: Subject to any disclaimer, the term of this (74) Attorney, Agent, or Firm Ohlandt, Greenley, Ruggiero patent is extended or adjusted under 35 & Perle, L.L.P.; Daniel P. Morris, Esq. U.S.C. 154(b)(b) by 420 davs.ayS (57) ABSTRACT (21) Appl. No.: 09/654,205 A hypervideo player for playing hypervideos containing 1-1. both video and hypervideo hyperlinks provides user select (22)22) FileFiled: Sep.ep. 1,1, 2000 able run-time options for the form of hypervideo hyperlink (51) Int. Cl. emphasis region display attributes displayed at the time of GIB 27/00 (2006.01) viewing. The hypervideo player may reside on a host (52) U.S. Cl. ....................... 715/723, 715,724; 715,726 System. The hypervideo player integrates video file(s) and (58) Field of Classification Search s 3 45/589 hypervideo hyperlink data file(s) to form a hypervideo. The 34.5/619, 716, 719, 720 723.764.810 821 824. hypervideo player decodes a video file, encodes the decoded 3 45 '83 5 85 6: 71 5 501 1. 513. 539.85 4. video file with a corresponding hypervideo hyperlink data s s 715,723 724 726 file at key frames of the video file to form a hypervideo, See application file for complete search history. displays the hypervideo on a display device and provides the user, at the time of viewing, with at least one user selectable (56) References Cited option for the form of hypervideo hyperlink emphasis region display attributes. The hypervideo player preferably U.S. PATENT DOCUMENTS employs interpolation between key frames to determine the 4,808,984. A * 2/1989 Trueblood et al. .......... 345,214 display position of the hypervideo hyperlink emphasis 5,819,092 A * 10/1998 Ferguson et al. ........... 717/113 region(s) in non-key frames of the hypervideo. The use of 5,918,012 A * 6/1999 Astiz et al. ................. 345/744 key frame encoding and interpolation to determine the 5,966,121 A * 10/1999 Hubbell et al. ............. 345,726 display position between key frames, enable the hypervideo 5,987.509 A 11/1999 Portuesi hyperlink emphasis region(s) to be displayed at all desired 6,006,265 A * 12/1999 Rangan et al. .............. TO9,226 locations of the hypervideo even though the hypervideo 6,088,707 A * 7/2000 Bates et al. ................. 715,513 hyperlink data is encoded only at key frames. (Continued) 12 Claims, 9 Drawing Sheets Hot Video Maker - Untitlehwf CEX ite Editit View insert Run Help t OC:\Cosoblonco\Cosoblonca, Ovi Hot Video File-C:\CosobloncoVunk2.hvi X Duration: 687 45.70 501-1 Current Postition: 343 f 22.79 C:\Casablanco\Cosablancoy Go to Frome 53 Online Video's URL Object Bergmon-X C:\movies\bergmon.htm 575 rt, GOOO1: 9: 0231,0164) 525 20024 (0048,0004)- 0251,0164)-N-5 Bogord-> c:\movies\bogord - 0, 00135; (0049,0052)-(O112,0176) - 00171: (0077.0030)-(O140,0154) -200218. (OO95,0000)-(0215,0178) - 00268: (C1000030)-(01950165) C:\movies\berman.htm f C:\movies\bogard 527 C:\movies\bergman.htm US 7,207,006 B1 Page 2 U.S. PATENT DOCUMENTS Chen et al., Video and Audio: Organization and Retrieval in the WWW, 1995, pp. 1-17.* 6,154,771 A * 1 1/2000 Rangan et al. .............. 345,660 6,175,840 B1* 1/2001 Chen et al. .... ... 345,803 Mark R. Brown. Using Netscape 2, Que Corp, Special Edition, and 6,204.842 B1* 3/2001 Fujii .......... ... 715,717 p. 167.* 6,585,776 B1* 7/2003 Bates et al 715,513 NEC's Video Hypertext System, Newsbytes News Network, Jul. 31. 7,000,242 B1* 2/2006 Haber ..... 715,719 1995, 1 pg. “HyperCafe: Narrative and Aesthetic Properties of Hypervideo.” FOREIGN PATENT DOCUMENTS (N. Hawhney et al., Hypertext 96: Seventh ACM Conference on EP O 840 241 5, 1998 Hypertext, Mar. 20, 1996, 18 pp. EP O 982 947 3, 2000 “RealVideo Technical White Paper.” Progressive Networks, Inc., 8 WO WO 98.44435 10, 1998 pp., Publication Date Unknown. OTHER PUBLICATIONS “V-Active 1.0 Beta 3, Time Limit Demo.” V-Active Home Page, AndNetVer, 2 pp., Publication Date Unknown. Mitsubishi Electric America, Inc., Authoring with Hyperlinked Video, White Paper, 1998, pp. 1-13.* * cited by examiner U.S. Patent Apr. 17, 2007 Sheet 1 of 9 US 7,207,006 B1 - 'N MEMORY o, 112 103 CPU 108 SATC STORAGE DEVICE GRAPHICS 104 ADAPTER 107 INPUT 105 DEVICE DISPLAY DEVICE 109 COMM LINK 110 SYSTEM BUS FIG. 1 U.S. Patent Apr. 17, 2007 Sheet 2 of 9 US 7,207,006 B1 15 FIG. 2 \ 10 20 30 35 40 HEADER DATA(1) DATA(2) DATA() o DATA(N) ENCODED DATA() 50 60 70 80 (A) MPEG FORMATTED VIDEO FILE (B) MPEG FORMATTED DATA FILE U.S. Patent Apr. 17, 2007 Sheet 3 of 9 US 7,207,006 B1 (A) STRUCTURE FOR ENCIODED HYPERLINK DATA FILE (B) STRUCTURE FOR OBJECT OB() (C) STRUCTURE FOR IDENTIFIERSL(k) U.S. Patent Apr. 17, 2007 Sheet 4 of 9 US 7,207,006 B1 ! 077 U.S. Patent Apr. 17, 2007 Sheet 5 Of 9 US 7,207,006 B1 1. 1000 U.S. Patent Apr. 17, 2007 Sheet 6 of 9 US 7,207,006 B1 --480 - - - - - - 415 420 DEFINEHYPERVIDEO HYPERLINKEMPHASIS RECON 425 ATTACH OBJECT 445 460 U.S. Patent US 7,207,006 B1 L U.S. Patent Apr. 17, 2007 Sheet 8 of 9 US 7,207,006 B1 U.S. Patent Apr. 17, 2007 Sheet 9 Of 9 US 7,207,006 B1 700 740 DISPLAY DEVICE 730 DISPLAY PROCESSOR HYPERWIDEO 710 USER INTERFACE FIG. 9 US 7,207,006 B1 1. 2 RUN-TIME HYPERVIDEO HYPERLINK creators of the hypervideo. The display location and the INDICATOR OPTIONS IN HYPERVIDEO form of hypervideo emphasis displayed are fixed (i.e., PLAYERS static). Similar to a hypertext hyperlink in a hypertext document, BACKGROUND OF THE INVENTION a hypervideo hyperlink in a hypervideo is often indicated by a hypervideo hyperlink emphasis region. The display 1. Field of the Invention attributes of the hypervideo hyperlink emphasis region The present invention relates to video players and editors delineate the hypervideo hyperlink from the surrounding and, in particular, to a hypervideo system and method of Video, thereby providing a visual indicator of those portions playing and creating hypervideos. 10 of the hypervideo having hypervideo hyperlinks embedded 2. Description of the Related Art therein. The Internet and its associated World Wide Web (Web) The hypervideo hyperlink emphasis region may be dis are well known. The Internet and the Web are distributed played as a visually distinctive border or background color networks of computers, including servers and clients. Also that delineates the region wherein one or more hypervideo well known are the techniques for navigating the Web via 15 hyperlinks are located. The information linked via hyperlink computers employing graphical user interfaces (GUI). The to a segment of video in a hypervideo typically contains more common techniques include the processes of “point information related to the images displayed in or near a and click” and "click and drag to select, activate and hypervideo hyperlink emphasis region. The linked content implement actions via GUIs. Instead of typing commands to may include information in the form of text, audio, video, specify actions or instructions, a user, via a GUI, typically two- or three-dimensional images or a combination thereof. executes a point and click maneuver or other techniques to HyperCafe is an experimental hypermedia prototype, activate the command/instruction represented by an icon. developed to illustrate a general hypervideo system. This Hypertext formatted documents and hyperlinks are also program places the user in a virtual cafe, which is composed known from viewing hypertext documents on the Web. primarily of digital video clips of actors involved in fictional Hypertext formatted documents contain hyperlinks to other 25 conversations in the cafe. HyperCafe allows the user to documents and files. Hyperlinks specify the name and follow different conversations, and offers dynamic opportu location of documents and files using Uniform Resource nities of interaction via temporal, spatio-temporal and tex Locators (URLs). URL is a standard for specifying an object tual links to present alternative narratives. HyperCafe is on the Internet. It specifies an access method and location for discussed in an article entitled: “HyperCafe: Narrative and files. Since a URL specifies the location of files, URLs are 30 Aesthetic Properties of Hypervideo.” (N. Sawhney et al., commonly referred to as the address for the files linked via Hypertext 96: Seventh ACM Conference on Hypertext, Mar. hyperlinks. The linked document(s) and file(s) may be 20, 1996. located locally or, more typically, remotely on the Internet. V-Active is an authoring tool for the creation of interac Selection of a hyperlink typically downloads document(s) tive movies. V-Active is part of MediaBuilder by Veon and/or image(s) specified by the associated URL for local 35 Technologies. It uses the HyperVideo technology to identify viewing at the user's display.