(12) United States Patent (10) Patent No.: US 9,124,910 B2 Kellicker (45) Date of Patent: Sep
Total Page:16
File Type:pdf, Size:1020Kb
USOO9124910B2 (12) United States Patent (10) Patent No.: US 9,124,910 B2 Kellicker (45) Date of Patent: Sep. 1, 2015 (54) SYSTEMS AND METHODS OF PROCESSING USPC ........................... 725/87, 91, 40, 32: 348/468 CLOSED CAPTIONING FOR VIDEO ON See application file for complete search history. DEMAND CONTENT (71) Applicant: Wowza Media Systems, LLC, (56) References Cited Evergreen, CO (US) U.S. PATENT DOCUMENTS (72) Inventor: Scott Kellicker, Worthington, OH (US) (73) Assignee: WOWZA MEDIA SYSTEMS, LLC, 5,347,365 A 9/1994 Harigai et al. Golden, CO (US) 5,572,260 A 11/1996 Onishi et al. (Continued) (*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 FOREIGN PATENT DOCUMENTS U.S.C. 154(b) by 0 days. (21) Appl. No.: 14/225,674 WO 2009052118 A3 4/2009 (22) Filed: Mar. 26, 2014 OTHER PUBLICATIONS (65) Prior Publication Data "Captions: Embed Closed Captions for Web, Mobile, and OTT', Zencoder, Retrieved on Oct. 4, 2012, Retrieved from <<http:// US 2014/O2O8373 A1 Jul. 24, 2014 Zencoder.com/captions/index.html>>, Brightcove Inc., 3 pages. Related U.S. Application Data (Continued) (63) Continuation of application No. 13/889,979, filed on May 8, 2013, now Pat. No. 8,732,775, which is a continuation of application No. 13/652.272, filed on Primary Examiner — James R Sheleheda Oct. 15, 2012, now Pat. No. 8,695,048. (74) Attorney, Agent, or Firm — Toler Law Group, PC (51) Int. Cl. H04N 7/10 (2006.01) (57) ABSTRACT H)4N 7/173 (2011.01) A method includes receiving closed captioning data at a com H04N II/00 (2006.01) puting device. The closed captioning data is associated with a H4N2L/235 (2011.01) Video on demand asset and is represented in a first format. The H04N 7/88 (2006.01) method also includes, during a single video on demand (Continued) streaming session, converting the closed captioning data from (52) U.S. Cl. the first format to a platform-independent format and convert CPC ......... H04N 21/2358 (2013.01); H04N 7/0882 ing the closed captioning data from the platform-independent (2013.01); H04N 21/2355 (2013.01); H04N format to a second format. The method further includes trans 21/47202 (2013.01); H04N21/4884 (2013.01) mitting, during the single video on demand streaming ses (58) Field of Classification Search Sion, the closed captioning data in the second format to a CPC ............ H04N 21/235; H04N 21/2355; H04N destination device. 21/2358; H04N 21/488; H04N 21/4884; H04N 21/4888; H04N 7/08; H04N 7/087; H04N 7/088; H04N 7/822; H04N 7/0885 20 Claims, 4 Drawing Sheets 400 receive, from a destination device, a request for closed captioning data (e.g. in a first language) associated with a -402 stream of a wideo on demand asset, where the stream is associated with a particular outbound streaming protocol identify a source of the requested closed captioning data (e.g., / 404 based on the first language) receive the closed captioning data from the identified source in a 408 first format Convert the closed captioning data from the first format to a platform-independentformat and from the platform-independent / 408 format to a second format that is compatible with the particular outbound streaming protocol Transmit the closed captioning data in the second format via the / 410 stream -ul-or-o- Receive a request to switch the closed captioning data from the 42 first language to a second language ---...Ye Transmit second closed captioning data that is associated with the second language and that is in the second format via the 44 stream without interupting the stream US 9,124,910 B2 Page 2 (51) Int. C. 2011/0083144 A1* 4/2011 Bocharov et al. ............... 725/32 2011/O128443 A1* 6, 2011 Blanchard et al. ............ 348/468 H4N2L/472 (2011.01) 2011/O1491.53 A1 6, 2011 Nam et al. H4N2L/488 (2011.01) 2011/0164.673 A1* 7, 2011 Shaffer .................... 375,240.01 2011/0302417 A1 12/2011 Whillock et al. (56) References Cited 2012/0023255 A1 1/2012 Edelman et al. 2012/0066235 A1 3/2012 Itakura .......................... 707/751 U.S. PATENT DOCUMENTS 2012/0102158 A1* 4, 2012 Ma et al. TO9,219 2012/014.3606 A1* 6, 2012 Pham ............................ TO4/235 ::::::::ck m E 2012/01765402012,0240. A1A 9.20127/2012 PhilipseLabrozzi et at al. 7.054,804 B2 * 5/2006 Gonzales et al. ................. TO4/8 2012/0301 111 A1* 11, 2012 Cordova . 386.245 7,272.658 B1 9, 2007 Edelman et al. 2012/0316860 All 12/2012 Reitan 7.587,500 B1 9, 2009 Edelman et al. 2013/0300929 A1* 11/2013 Hines . 348/468 796.1878 B2 6, 2011 Whillocket al. 2014/00289 12 A1 1/2014 Lenzi et al. ................... 348/468 8,051.287 B2 11/2011 Shetty et al. OTHER PUBLICATIONS 8,065.426 B2 11/2011 Edelman et al. 8,205,076 B1 6/2012 Shetty et al. "Closed Captioning of Internet Protocol-Delivered Video Program 58. R 6583 S. al ming: Implementation of the Twenty-First Century Communications 8.285867 B1 10/2012 Edelman et al. and Video Accessibility Act of 2010”. Federal Register, vol. 77. No. 2002fO154891 A1 10, 2002 Kimura et al. 151, Aug. 6, 2012, pp. 46632-46633. 2004/0047589 A1 3f2004 Kim ................................ 386/46 “FCC Releases Internet Protocol Captioning Rules', National Asso 2005.0075857 A1* 4, 2005 Elcock et al. ..................... TO4/2 ciation of the Deaf, Retrieved from <http://www.nad.org/news/ 2006.0109378 A1 5/2006 Yang et al. 2012/1/fcc-releases-internet-protocol-captioning-rules >>, National 2007/0022435 A1 1/2007 Kwon ............................. 725/38 Association of the Deaf, Silver Spring, MD, 3 pages. 2007/0027844 A1 ck 2/2007 Toub et al. “Real Time Messaging Protocol'. Wikipedia, Retrieved from 2008/01298.64SE. A1N. S.6/2008 E.Stone et al. "...O.E. cols.httpen.wikipedia.org Retrieved on Oct 11, WikiRealTime 2012, 10 pages. Messaging Proto 2009/0022247 A1 1/2009 Kim et al. ..................... 375/321 RTMP Specification License'. Adobe Systems Incorporated, 2009/0083462 A1* 3/2009 Song et al. 710,105 Retrieved from <<http://www.adobe.com/devnet/rtmp/>, Apr. 20090310O21 A1* 12, 2009 Kondo et al. 348,564 2009, 70 pages. 2010/0106482 A1* 4/2010 Hardacker et al. ................ TO4/3 U.S. Appl. No. 13/652,272, filed Oct. 15, 2012, 21 pages. 2010, 0141834 A1 6, 2010 Cuttner U.S. Appl. No. 13/889,979, filed May 8, 2013, 21 pages. 2010/0225808 A1* 9, 2010 Mears ........................... 348/468 2010/0265397 A1 10, 2010 Dasher et al. * cited by examiner U.S. Patent Sep. 1, 2015 Sheet 2 of 4 US 9,124,910 B2 2OO N co Data in Platform-independent Format s - 20 NO. 1 Text "JOHN: He should be here any minute." Start Time 0:19:20,000 End Time O:19:22:OOO Language eng Location 50 4OOD Font Proportional Sans Serif Size 2 Style ----- - BG Color Black NFG Color White -L Passed-through 220 No. 2 Text "KNOCKING ON THE DOOR” Start Time O:19:21.7OO End Time O:19:23:700 Language eng Location <30, 300> Font Proportional Sans Serif Size 2 Style Italics BG Color Black F.G Color White Passed-through FIG. 2 U.S. Patent Sep. 1, 2015 Sheet 3 of 4 US 9,124,910 B2 Receive closed captioning data at a computing device, where the closed captioning data is associated with a video on demand 302 asset and wherein the closed captioning data is represented in a first format Convert the closed captioning data from the first format to a 304 platform-independent format Convert the closed captioning data from the platform- 306 independent format to a second format Transmit the closed captioning data in the second format to a 308 destination device FIG 3 U.S. Patent Sep. 1, 2015 Sheet 4 of 4 US 9,124,910 B2 400 y Receive, from a destination device, a request for closed Captioning data (e.g., in a first language) associated with a 402 stream of a video on demand asset, where the stream is associated with a particular outbound streaming protocol ldentify a source of the requested closed captioning data (e.g., 404 based on the first language) Receive the closed captioning data from the identified source in a 406 first format Convert the closed captioning data from the first format to a platform-independent format and from the platform-independent 408 format to a second format that is compatible with the particular outbound streaming protocol Transmit the closed captioning data in the second format via the 410 stream Receive a request to switch the closed captioning data from the 412 first language to a second language Transmit second closed captioning data that is associated with the second language and that is in the Second format via the 414 stream without interrupting the stream F.G. 4 US 9,124,910 B2 1. 2 SYSTEMIS AND METHODS OF PROCESSING devices request closed captions at the same time, multiple CLOSED CAPTIONING FOR VIDEO ON closed caption streams may be generated on-the-fly from the DEMAND CONTENT platform-independent data. For example, platform-indepen dent captioning data may be used to generate consumer elec CROSS-REFERENCE TO RELATED tronics association (CEA)-608 captions that are embedded APPLICATIONS into a hypertext transfer protocol (HTTP) live streaming (HLS) stream, action message format (AMF) on TextData The present application is a continuation of and claims events included in a HTTP dynamic streaming (HDS) stream, priority to U.S.