(12) United States Patent (10) Patent No.: US 9,648,279 B2 Shen Et Al
Total Page:16
File Type:pdf, Size:1020Kb
US009648279B2 (12) United States Patent (10) Patent No.: US 9,648,279 B2 Shen et al. (45) Date of Patent: May 9, 2017 (54) METHOD AND SYSTEM FOR VIDEO (58) Field of Classification Search COMMUNICATION CPC ... G09G 5/14: G09G 2370/00; G06F 3/0481; G06F 3/0482; G06F 3/04842; G06F (75) Inventors: Francis Shen, Concord (CA); Paulo 3/04845; G06F 17/30899-17/30905; Francisco, Concord (CA); David Sayson, Vancouver (CA); Stephane G06F 3/04817: G06F 3/0484; G06F Angelot, Frisco, TX (US); Keith 17/30867; G06F 8/34; G06F 9/443; G06F Huthmacher, Wexford, PA (US); Lloyd 3/0488; G06F 3/04886; G06F 2203/0483; Hucke, Wexford, PA (US) G06F 2203/04803; H04N 21/4858; H04N 21/485; H04N 7/15; H04N 19/136; H04N (73) Assignee: Mitel Networks Corporation, Ottawa, 7/17; H04L 12/1813 Ontario (CA) USPC ...... 715/753 758, 764, 792, 863; 348/1403, 348714.08 (*) Notice: Subject to any disclaimer, the term of this See application file for complete search history. patent is extended or adjusted under 35 U.S.C. 154(b) by 447 days. (56) References Cited (21) Appl. No.: 13/156.220 U.S. PATENT DOCUMENTS 5,233,687 A * 8/1993 Henderson et al. .......... T15,804 (22) Filed: Jun. 8, 2011 5,594,859 A 1/1997 Palmer et al. (65) Prior Publication Data (Continued) US 2012/OO62688 A1 Mar. 15, 2012 FOREIGN PATENT DOCUMENTS Related U.S. Application Data EP 21898.89 A1 5, 2010 (60) Provisional application No. 61/352.695, filed on Jun. WO WO 2008/OO31216 A1 3, 2008 8, 2010. Primary Examiner — Nicholas Ulrich (51) Int. Cl. (57) ABSTRACT HO)4N 7/15 (2006.01) An apparatus and a non-transitory machine readable H04N 9/36 (2014.01) medium for facilitating a video communication session G06F 3/0488 (2013.01) between correspondents. Each correspondent is associated G06F 9/44 (2006.01) with the apparatus having a graphical user interface (GUI). H04L 12/18 (2006.01) Video corresponding to at least one of the correspondents is (Continued) displayed in a first partition, the video having characteristics. (52) U.S. C. A plurality of applications executing concurrently during the CPC ........... H04N 7/15 (2013.01); G06F 3/04886 Video communication session are displayed in a second (2013.01); G06F 9/4443 (2013.01); H04L partition. GUI objects corresponding to the video commu 12/18 (2013.01); H04N 19/136 (2014.11); nication session are displayed in a third partition. The G06F 3/04842 (2013.01); G06F 2203/04803 second partition is dynamically resized to a size that depends (2013.01); G06O 10/107 (2013.01); H04L on the characteristics of the video. 12/1827 (2013.01); (Continued) 16 Claims, 33 Drawing Sheets 2 sa. 80 82 30 US 9,648,279 B2 Page 2 (51) Int. Cl. 8,533,611 B2 * 9/2013 Katis ................... HO4L 12, 1827 GO6F 3/0484 (2013.01) 370,352 G06O IO/IO (2012.01) 2001/0033296 A1* 10, 2001 Fullerton .......... GO6F 17/30017 HO4N 7/14 2006.O1 715,730 HO4L 29/06 30: 8: 2004/0001091 A1 1/2004 Kressin ............... HO4L 12, 1822 715/753 HO4L 29/08 (2006.01) 2004/0165710 A1 8/2004 Delhoyo et al. (52) U.S. Cl. 2006/0107303 A1 5.2006 Erhart et al. CPC .......... H04L 65/4038 (2013.01); H04L 67/36 2006/0129935 A1 6/2006 Deinlein et al. .............. 71.5/733 2006/0236247 A1 10, 2006 Morita et al. (2013.01); H04N 7/147 (2013.01) 2007/013.6685 A1 6/2007 Bhatla et al. ................. T15,800 2007/0250788 A1* 10/2007 Rigolet ... 715,788 (56) References Cited 2008/009.4369 A1 4/2008 Ganatra et al. ... 345,173 20090037826 A1 2/2009 Bennetts .................. HO4N 7/15 U.S. PATENT DOCUMENTS 715/753 ck 2009.0049385 A1* 2, 2009 Blinnikka et al. 715,719 6,329,984 B1 12/2001 Boss et al. ... 715,723 2009 OO63972 A1* 3, 2009 Ma .......................... G06F 3/048 6,456,305 B1 9/2002 Qureshi et al. T15,800 715,716 6,496.201 B1* 12/2002 Baldwin .................. ". 2009/0083637 A1 3/2009 Skakkebaek et al. 7,379,704 B2* 5/2008 Parker et al. ................. 434/350 2009/0228808 A1*ck 9, 2009 MacDonald ........... Goog 9. 2322 R.ck 3. NY l al. "...R. 2010, 0037151 A1 2/2010 Ackerman et al. ........... 715/753 7.568.67 B2 * 7, 2009 Van Dok et al. 15,789 2010, OO73454 A1 3/2010 Lovhaugen et al. 7707632 B2 * 9, 2010 Anzelde et al. 71.5/273 2010.0192O72 A1* T/2010 Spataro et al. 715/753 7,865,834 B1* 1/2011 van Oseal. 715/756 2011/00224.50 A1 1/2011 Meredith ..................... TO5,144 8,201,096 B2 * 6/2012 Robert et al. ... ... 715,767 2011 011587.6 A1* 5, 2011 Khot ........................ HO4N 7/15 8,253,695 B2 * 8/2012 Ganatra et al. ... 345,173 348, 14.09 8,302,026 B2 * 10/2012 Wang et al. ... 715,788 2011 0145753 A1* 6, 2011 Prakash ................ G06F 3/0481 8.405,706 B2 * 3/2013 Zhang et al. ... 348,1416 715.783 8,429,540 B1 * 4/2013 Yankovich et al. .......... 715/751 8,522,142 B2 * 8/2013 Bhatla et al. ................. 71.5/719 * cited by examiner U.S. Patent May 9, 2017 Sheet 1 of 33 US 9,648,279 B2 s ZZ ?aun61+ U.S. Patent May 9, 2017 Sheet 2 of 33 US 9,648,279 B2 U.S. Patent May 9, 2017 Sheet 3 of 33 US 9,648,279 B2 aaa U.S. Patent May 9, 2017 Sheet 4 of 33 US 9,648,279 B2 72 Video Window Easton S 77 Figure 4 82 80 72 fa: s ** * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * } * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * Video Window Figure 5 82 80 U.S. Patent May 9, 2017 Sheet 5 Of 33 US 9,648,279 B2 3 38: Figure 6 : Sixes: Figure 7 s U.S. Patent May 9, 2017 Sheet 6 of 33 US 9,648,279 B2 Appiastian Selection r:& Applicatier Selection * & R}ining Apps Faget Page 2 Page 3 Rinning Apis kx Page-4 Figure 8 U.S. Patent May 9, 2017 Sheet 7 Of 33 US 9,648,279 B2 | &&aesse U.S. Patent May 9, 2017 Sheet 8 of 33 US 9,648,279 B2 ?3,3384,3? sionuoo §§§§§§§§ U.S. Patent US 9,648,279 B2 U.S. Patent US 9,648,279 B2 **** U.S. Patent US 9,648,279 B2 U.S. Patent May 9, 2017 Sheet 12 of 33 US 9,648,279 B2 U.S. Patent May 9, 2017 Sheet 13 of 33 US 9,648,279 B2 Figure 5a 82 U.S. Patent May 9, 2017 Sheet 14 of 33 US 9,648,279 B2 Figure 18 U.S. Patent May 9, 2017 Sheet 15 Of 33 US 9,648,279 B2 Figure 17 77 Figure 18 85 77 U.S. Patent May 9, 2017 Sheet 16 of 33 US 9,648,279 B2 Figure 19 Figure 2) 85 U.S. Patent May 9, 2017 Sheet 17 Of 33 US 9,648,279 B2 72 88b 88a E88ssefirg assis SSSXX8Ex Essees cers Figure 2 38c 88 72 BBb sees attis Sk V *: 88b. Essengests esses: 88: s: a. 3xes Figure 22 88: U.S. Patent May 9, 2017 Sheet 18 of 33 US 9,648,279 B2 iseeing 8aising Caesa Saxons 8:8 E. Sess U.S. Patent May 9, 2017 Sheet 19 Of 33 US 9,648,279 B2 s 70 i. : Figure 26 77 U.S. Patent May 9, 2017 Sheet 20 of 33 US 9,648,279 B2 94. 88 96. 88c --88 Figure 27 88: 77 Figure 28 88c 77 U.S. Patent May 9, 2017 Sheet 21 of 33 US 9,648,279 B2 Figure 29 Figure 30 U.S. Patent May 9, 2017 Sheet 22 of 33 US 9,648,279 B2 88. Figure 3. Figures: U.S. Patent May 9, 2017 Sheet 23 of 33 US 9,648,279 B2 Seiseig SSS 8skatiya seekeelesses Figure 33 Figure 34 77 U.S. Patent May 9, 2017 Sheet 24 of 33 US 9,648,279 B2 86 Singineering .90 oneeae as 74 Figure 35 100 92 Figure 36a OO U.S. Patent May 9, 2017 Sheet 25 Of 33 US 9,648,279 B2 Figure 36b 92 Figure 36c U.S. Patent May 9, 2017 Sheet 26 of 33 US 9,648,279 B2 Figure 36d Figure 36e U.S. Patent May 9, 2017 Sheet 27 Of 33 US 9,648,279 B2 120 88 22 124 : contacts 8 8. Fian A. Figure 37a ... O 8 contacts & 118 s feat xxxxx. 14 Figure 37b U.S. Patent May 9, 2017 Sheet 28 of 33 US 9,648,279 B2 20 88 122 124 s: directory 8 axe. a & contacts : favorites &France sects enes E. & first seas M asses 3. W 1 14 Figure 37d U.S. Patent May 9, 2017 Sheet 29 Of 33 US 9,648,279 B2 120 125 : certaets Figure 37e 120 Fassassess & Fiat ar six geolois: Figure 37f U.S. Patent May 9, 2017 Sheet 30 Of 33 US 9,648,279 B2 124 120 3 tirectory 122 8 favorites 86 Rategorge:Ssia Figure 37g 2 25 ... 26 124 . 122 86 S tissassesses Figure 38 U.S. Patent May 9, 2017 Sheet 31 of 33 US 9,648,279 B2 20 Riseratepissiosa Seriestsys esseE. : Air. GriffinW SmithE. ice informaticsax 8 : Senio Saivasa Eirgi'see: 32 victoria Aye ASSA ric 252 Fenway trive Siallyie, PA 22822 Ts: 84-123-3555 Yassissation Yax .a.