(12) United States Patent (10) Patent No.: US 7.793,205 B2 Errico Et Al
Total Page:16
File Type:pdf, Size:1020Kb
US007793205 B2 (12) United States Patent (10) Patent No.: US 7.793,205 B2 Errico et al. (45) Date of Patent: Sep. 7, 2010 (54) SYNCHRONIZATION OF VIDEO AND DATA 4,298,884. A 1 1/1981 Reneau 4.321,635 A 3/1982 Tsuyuguchi (75) Inventors: James Errico, Portland, OR (US); 4,324.402 A 4, 1982 Klose Baoxin Li, Vancouver, WA (US) 4,520.404 A 5, 1985 Von Kohorn s s 4,729,044. A 3/1988 Kiesel (73) Assignee: Sharp Laboratories of America, Inc., 4.937,685 A 6, 1990 Barker et al. Camas, WA (US) 5,012,334 A 4, 1991 Etra s 5,027,400 A 6/1991 Baji et al. 5,101,364 A 3, 1992 D rt et al. (*) Notice: Subject to any disclaimer, the term of this 5,109,482 A 4, 1992 SR a patent is extended or adjusted under 35 5,148,154 A 9/1992 MacKay et al. U.S.C. 154(b) by 1460 days. 5,200,825 A 4/1993 Perine 5,222,924 A 6/1993 Shin et al. (21) Appl. No.: 11/177,867 5,223,924. A 6/1993 Strubbe 5,241,671 A 8, 1993 Reed et al. (22) Filed: Jul. 8, 2005 5,270,922 A * 12/1993 Higgins ....................... 705/37 (65) Prior Publication Data (Continued) US 2005/0271269 A1 Dec. 8, 2005 FOREIGN PATENT DOCUMENTS Related U.S. Application Data EP O 854 645 7, 1998 (62) Division of application No. 10/155,269, filed on May (Continued) 22, 2002. OTHER PUBLICATIONS (60) Royal application No. 60/365,915, filed on Mar. Kimber, Don, et al., “Fly About: Spatially Indexed Panoramic Video'. s Multimedia 01: Proceedings of the Ninth ACM International Con (51) Int. Cl. ference on Multimedia, Oct. 2001, pp. 339-347.* G06F 7700 (2006.01) (Continued) G06F 3/00 (2006.01) Primary Examiner Laurie Riesr (52) U.S. Cl. ........ grgrrr. 715/201: 715/730 (74) Attorney, Agent, or Firm—Chernoff, Vilhauer, (58) Field of Classification Search ................. 715/203, McClung & Stenzel 715/201, 204, 719, 720, 721, 722, 723, 730, 715/731 (57) ABSTRACT See application file for complete search history. (56) References Cited A system including a video stream and a data stream. The system synchronizes the data stream to different portions of U.S. PATENT DOCUMENTS the video stream. 4,183,056 A 1, 1980 Evans et al. 4,253,108 A 2/1981 Engel 16 Claims, 17 Drawing Sheets iSEZ.skip 2 Sports Ticker Events/SyncCues t t f DetectedPlay Events/SyncCues US 7,793.205 B2 Page 2 U.S. PATENT DOCUMENTS 5,875,107 2, 1999 Nagai et al. 5,875,108 2, 1999 Hoffberg et al. 5,288,069 2, 1994 Matsumoto 5,877,821 3, 1999 Newlin et al. D348,251 6, 1994 Hendricks 5,878,222 3, 1999 Harrison 5,333,091 T. 1994 Iggulden et al. 5,892,536 4, 1999 Logan et al. 5,339,393 8, 1994 Duffy et al. 5,900,867 5, 1999 Schindler et al. D354,059 1, 1995 Hendricks 5,901,246 5, 1999 Hoffberg et al. 5,381,477 1, 1995 Beyers, II et al. 5,903.454 5, 1999 Hoffberg et al. 5,404,316 4, 1995 Klingler et al. 5,907,324 5, 1999 Larson et al. 5,410,344 4, 1995 Graves et al. 5,913,013 6, 1999 Abecassis 5,424,770 6, 1995 Schmelzer et al. 5,913,030 6, 1999 Lotspiech et al. 5.434,678 7, 1995 Abecassis 5,920,300 7, 1999 Yamazaki et al. 5.444499 8, 1995 Saitoh 5,920,360 7, 1999 Coleman, Jr. 5,452,016 9, 1995 Ohara et al. 5,920,477 7, 1999 Hoffberg et al. 5,459,830 10, 1995 Ohba et al. 5,923,365 7, 1999 Tamir et al. 5.483.278 1, 1996 Strubbe et al. 5,926,624 7, 1999 Katz et al. D368,263 3, 1996 Hendricks 5,945.988 8, 1999 Williams et al. 5,521,841 5, 1996 Arman et al. 5,956,026 9, 1999 Ratakonda 5,550.965 8, 1996 Gabbe et al. 5,956,037 9, 1999 Osawa et al. 5,559,549 9, 1996 Hendricks et al. 5,958,006 9, 1999 Eggleston et al. 5,589,945 12, 1996 Abecassis 5,959,681 9, 1999 Cho 5,600,364 2, 1997 Hendricks et al. 5,959,697 9, 1999 Coleman, Jr. 5,600,573 2, 1997 Hendricks et al. 5,969,755 10, 1999 Courtney 5,600,781 2, 1997 Root et al. 5,973,683 10, 1999 Cragun et al. 5,610,653 3, 1997 Abecassis 5,977.964 11, 1999 Williams et al. 5,634,849 6, 1997 Abecassis 5,986,690 11, 1999 Hendricks 5,635,982 6, 1997 Zhang et al. 5,986,692 11, 1999 Logan et al. 5,635,989 6, 1997 Rothmuller 5,987,211 11, 1999 Abecassis D381,991 8, 1997 Hendricks 5.990,927 11, 1999 Hendricks et al. 5,654,769 8, 1997 Ohara et al. 5.990,980 11, 1999 Golin 5,659,350 8, 1997 Hendricks et al. 5,995,094 11, 1999 Eggen et al. 5,664.046 9, 1997 Abecassis 5,995,095 11, 1999 Ratakonda 5,664,227 9, 1997 Mauldin et al. 6,002,833 12, 1999 Abecassis 5,675,752 10, 1997 Scott et al. 6,005,565 12, 1999 Legall et al. 5,682,195 10, 1997 Hendricks et al. 6,005,597 12, 1999 Barrett et al. 5,682,460 10, 1997 Hyziak et al. 6,006,265 12, 1999 Rangan et al. 5,684,918 11, 1997 Abecassis 6,011,895 1, 2000 Abecassis 5,694,163 12, 1997 Harrison 6,014, 183 1, 2000 Hoang 5,696,869 12, 1997 Abecassis 6,020,883 2, 2000 Herz et al. 5,696,965 12, 1997 Dedrick 6,021419 2, 2000 Clarke et al. ................ TO8,300 5,710,884 1, 1998 Dedrick 6,029,195 2, 2000 Herz 5,717,814 2, 1998 Abecassis 6,038,367 3, 2000 Abecassis 5,717,879 2, 1998 Moran et al. 6,041,323 3, 2000 Kubota 5,717,923 2, 1998 Dedrick 6,049,821 4, 2000 Theriault et al. 5,724.472 3, 1998 Abecassis 6,052,554 4, 2000 Hendricks et al. 5,727, 129 3, 1998 Barrett et al. 6,055.018 4, 2000 Swan 5,732,216 3, 1998 Logan et al. 6,055,569 4, 2000 O'Brien et al. 5,734.853 3, 1998 Hendricks et al. 6,060, 167 5/2000 Morgan et al. 5,751,953 5, 1998 Shiels et al. 6,064,385 5/2000 Sturgeon et al. 5,758,257 5, 1998 Herz et al. 6,064449 5/2000 White et al. 5,758,259 5, 1998 Lawler 6,067,401 5/2000 Abecassis 5,761,881 6, 1998 Wall 6,070,167 5/2000 Qian et al. 5,764,916 6, 1998 Busey et al. 6,072,934 6, 2000 Abecassis 5,774,357 6, 1998 Hoffberg et al. 6,076,166 6, 2000 Moshfeghi et al. 5,774,666 6, 1998 Portuesi 6,078,917 6, 2000 Paulsen, Jr. et al. 5,778, 108 7, 1998 Coleman, Jr. 6,078,928 6, 2000 Schnase et al. 5,781,188 7, 1998 Amiot et al. 6,081,278 6, 2000 Chen 5,794.210 8, 1998 Goldhaber et al. 6,081,750 6, 2000 Hoffberg et al. 5,797,001 8, 1998 Augenbraun et al. 6,088,455 T/2000 Logan et al. 5,798,785 8, 1998 Hendricks et al. 6,088,722 T/2000 Herz et al. 5,805,733 9, 1998 Wang et al. 6,091,886 T/2000 Abecassis 5,809,426 9, 1998 Radojevic et al. RE36,801 8, 2000 Logan et al. 5,821,945 10, 1998 Yeo et al. 6,100,941 8, 2000 Dimitrova et al. 5,822,537 10, 1998 Katseffet al. 6,115,709 9, 2000 Gilmour et al. 5,828.809 10, 1998 Chang et al. 6,122,657 9, 2000 Hoffman, Jr. et al. 5,828,839 10, 1998 Moncreiff 6,128,624 10, 2000 Papierniak et al. 5,835,087 11, 1998 Herz et al. 6,133,909 10, 2000 Schein et al. D402,310 12, 1998 Hendricks 6,137,486 10, 2000 Yoshida et al. 5,848,396 12, 1998 Gerace 6,141,041 10, 2000 Carlbom et al. 5,857, 190 1, 1999 Brown 6,141,060 10, 2000 Honey et al. 5,861,881 1, 1999 Freeman et al. 6,144,375 11, 2000 Jain et al. 5,867,226 2, 1999 Wehmeyer et al. 6,151,444 11, 2000 Abecassis 5,867,386 2, 1999 Hoffberg et al. D435,561 S 12, 2000 Pettigrew etal. US 7,793.205 B2 Page 3 6,157,377 A 12/2000 Shah-Nazaroffet al. 6,553,178 B2 4/2003 Abecassis 6, 160,989 A 12/2000 Hendricks et al. 6,556,767 B2 4/2003 Okayama et al. 6,161,142 A 12/2000 Wolfe et al. 6,571,279 B1 5/2003 Herz et al. 6,163,316 A 12/2000 Killian 6,578,075 B1 6/2003 Nieminen et al. 6,163,779 A 12/2000 Mantha et al. 6,581,207 B1 6/2003 Sumita et al. 6,169,542 B1 1/2001 Hooks et al. 6,587,127 B1 7/2003 Leeke et al. 6,177,931 B1 1/2001 Alexander et al.