US008001261B2

(12) United States Patent (10) Patent N0.: US 8,001,261 B2 Katis et al. (45) Date of Patent: Aug. 16, 2011

(54) TELECOMMUNICATION AND MULTIMEDIA (56) References Cited MANAGEMENT METHOD AND APPARATUS U.S. PATENT DOCUMENTS 4,807,224 A 2/1989 Naron et al. (75) Inventors: Thomas E. Katis, Jackson, WY (US); 5,117,422 A 5/1992 Hauptschein et al. James T. Panttaja, Healdsburg, CA 5,283,818 A 2/1994 Klausner et a1. (US); Mary G. Panttaj a, Healdsburg, 5,375,018 A 12/1994 Klausner et a1. CA (US); Matthew J. Ranney, Oakland, (Continued) CA (US) FOREIGN PATENT DOCUMENTS EP 1202531 A 5/2002 (73) Assignee: VoXer IP LLC, San Francisco, CA (US) (Continued) Notice: Subject to any disclaimer, the term of this OTHER PUBLICATIONS patent is extended or adjusted under 35 WikiPediaiThe Free Encyclopedia, “Eudora (email client),” http:// U.S.C. 154(b) by 500 days. en.wikipedia.org/wiki/Eudorai(e-mailiclient), Downloaded on Aug. 20, 2009, 3 pages. (21) Appl. N0.: 12/197,146 (Continued)

Filed: Aug. 22, 2008 Primary Examiner * Lashonda T Jacobs (22) (74) Attorney, Agent, or Firm * Beyer Law Group LLP

(65) Prior Publication Data (57) ABSTRACT US 2009/0103528 A1 Apr. 23, 2009 An apparatus for improving the ability of a recipient to review time-sensitive media upon receipt when network conditions are poor. The apparatus includes a media ascertaining ele Related U.S. Application Data ment con?gured to ascertain if media to be sent from a send ing node to a receiving node is time-sensitive. A bandwidth (63) Continuation-in-part of application No. 12/028,400, ascertaining ascertains if there is suf?cient ?led on Feb. 8, 2008. bandwidth for transmitting a full bit rate representation of the media at a ?rst bit rate and at a ?rst packetiZation interval. If (60) Provisional application No. 60/999,619, ?led on Oct. the bandwidth is suf?cient, a transmitter transmits the full bit 19, 2007. rate representation of the media. If the bandwidth is insu?i cient, then the transmitter generates and transmits a reduced bit rate representation of the media. The reduced bit rate (51) Int. Cl. representation is generated by performing one or more of the G06F 15/16 (2006.01) following (i) using fewer bits per unit time of media when packetiZing the media relative to the full bit rate representa (52) U.S. Cl...... 709/231; 709/203; 709/223; 709/224; tion; (ii) increasing the packetiZation interval for the packets 370/395.64; 725/25 used to transmit the reduced bit rate representation; and (iii) (58) Field of Classi?cation Search ...... 709/231, adjusting the rate of transmission of the packets used to pack 709/203, 217, 219, 223, 224; 370/395.64, etiZed the reduced bit rate representation of the media. 370/395.65; 725/25 See application ?le for complete search history. 43 Claims, 33 Drawing Sheets

s4. 00M FARE MABR amen MAKE AND A181? 54, 54; lME-SENSITWE v PAwEnzE USING ESSAGES m usw 1BR US 8,001,261 B2 Page2

U.S. PATENT DOCUMENTS 2003/0099198 A1 5/2003 Kiremidjian etal. 2003/0126162 A1 7/2003 Yohe etal. 513901236 A “995 Klausner 6‘ 311 2003/0186722 A1 10/2003 Weiner 514871167 A V1996 Dlnallo ‘M11 2003/0233371 A1 12/2003 Abhyankar etal. 21283152 2 $8882 2004/0017905 A1 1/2004 Warrieretal. 5,692,213 A 11/1997 Goldberg etal. 588288882288 2} 8588: g?i?ltjtlal' 5173710115734 963 A M9983/1998 Luk‘icsFitz erald etal. 2004/0090959 A1 5/2004 crngnrtaetal.- - ' 5,768,527 A 11 6/1998 Zhu etal...... 709/231 58888888888 2} 8888: 8112533 2 188888 etal' 2004/0192353 A1 9/2004 Mason etal. 5,970,122 A 1111999 L1P<1111e111~ 588283532321 18/5332‘ 3112821111 610371932 A 3/2000 Fe1n1e!b 2004/0252679 A1 12/2004 Williarnsetal. 610921120 A 7/2000 Swamma?lan etal' 2004/0255148 A1 12/2004 Monteiro etal. 611041757 A 8/2000 Rhe‘? 2004/0258220 A1 12/2004 Levine etal. ggggég E1 5588} geslmonel 2005/0021819 A1 1/2005 Kilkki 612561669 B1 M001 2005/0025308 A1 2/2005 Tischeretal. 612621994 Bl wool Dirsche Cu at 2111' 2005/0030932 A1 2/2005 Kellyetal. 613781035 Bl 4/2002 Par etal‘ 2005/0037706 A1 2/2005 settle 614801783 B1 “0002 M TY 2005/0053033 A1 3/2005 Kelly etal. 1 1 Yr 2005/0055644 A1 3/2005 Stockton etal. 615071586 B1 V2003 5111111111111 2005/0102358 A1 5/2005 Goldetal. 615641261 B1 5/2003 Gudlonsson ‘M11 2005/0123045 A1 6/2005 Hannukselaetal. 615771599 B1 6/2003 Guptaetal' 2005/0135333 A1 6/2005 Rojas 615801694 B1 6/2003 Baker 2005/0135476 A111 6/2005 Gentric etal...... 375/240.1 616711732 B1 12/2003 Weln.“ . 2005/0144247 A1 6/2005 Christensen etal. 617171925 B1 ‘V2004 Leppls‘mletal' 2005/0157708 A1 7/2005 Chun etal. 617211703 B2 ‘V2004 Jackson etal' 2005/0160345 A1 7/2005 Walsh etal. 218881222 5% 18%88: %Y‘C1lr‘?{la1~ l 2005/0165911 A1 7/2005 Honu'lleretal. 618071578 B2 10/2004 Sim; e‘ztajl' 2005/0202807 A1 9/2005 Ayyasarnyetal. 1 1 1 2005/0207487 A1 9/2005 Monroe 618291473 B2 12/2004 Rama“ et 311 2005/0215228 A1 9/2005 Fostick etal. 212231822 5; 1%88‘5‘ ?lly“ 311 2005/0220137 A1 10/2005 Prigentetal. 618731597 131* 30005 Kine“ 370/235 2005/0259682 A1 11/2005 Yosefetal. 1 1 .g 111111111111111111111111111 11 2005/0288101A1 12/2005 Locktonetal. 2185i‘: 3} $88? 886111.“ 2006/0007943 A1 1/2006 Fellnran 619701926 B1 “0005 Nggllllm et a1 2006/0026294 A111 2/2006 Virdietal...... 709/232 1 1 1 2006/0039363 A111 2/2006 Gummalla etal...... 370/352 218831388 5; 185882 EYE“ “1311 2006/0045038 A1 3/2006 Kay etal. 619961624 B1 200% Leecryoetgt'al 2006/0059267 A1 3/2006 cugietal. 710021913 B2 200% Huangyet a1 1 2006/0059342 A1 3/2006 Medvlnsky etal. 7103910407,020,093 B211B1 3/200682006 Burgsirivara etal...... 370/252 2006/011499058828888882 A1112} 6/200688888 Pak ...... 375/240.03 818381853 5; 28882 yth 2006/0146822 A1 7/2006 Kolakowski etal. 7,068,619 B211 6/2006 Balachandran etal...... 370/328 58828188888 2} 88888 ifltc’lbsetal' 7111044 B2 9/2006 Lee Oet 31' 1 1 . 2006/0212582 A1 9/2006 Gupta etal. 5% 8185882 ?l?éllyedam 2006/0212592 A1 9/2006 Gupta etal. 711711491 B1 V2007 ofTogl‘znjtyal 2006/0224748 A1 10/2006 Gupta etal. 1 1 . 1 2006/0244588 A1 11/2006 Hannah etal. 711871941 B2 3/2007 Slegel 2006/0245367 A1 11/2006 Jefferyetal. E5 2588; 8*“? ‘M11 l 2006/0253599 A1 11/2006 Monteiro etal. 712361738 B2 60007 $2311?“ eta' 2006/0268750 A1 11/2006 Weiner 1 1 2006/0274698 A1 12/2006 Twitchell 81532182? 5% 15588; if” ‘M11 2006/0276714 A1 12/2006 Holt etal. 713051438 B2 12/2007 chfi‘ztensen et a1 2006/0282544 A1 12/2006 Monteiro etal. 1 1 . 1 2006/0288391 A1 12/2006 Puthiyedath 31351249‘: 5% 18588; 51.111“) 6‘ 3111 2006/0294259 A1 12/2006 Mate? etal. 713491871 B2 3/2008 L?ilfgilél 2007/0001869 A1 1/2007 Hunzinger 1 1 . 1 2007/0076754 A111 4/2007 Krlshnaswamy ...... 370/468 713821881 B2 6/2008 Uusltalo 6‘ 311 2007/0133405 A111 6/2007 Bowra etal...... 370/230 92%;?) 5% 385883 511ml ‘?t 311 l 2007/0180032 A1 8/2007 Pearson 716171337 B1 110009 133011253331 2007/0182819 A1 8/2007 Monroe 1 1 1 2007/0206592 A1 9/2007 Itakura etal. 313531245‘; 5% 1428583)? groy et 311 31 2007/0207785 A1 9/2007 Chatterjee etal. 200l/b0251377 A1 90001 1 2007/0263653 A1 11/2007 Hassanetal. 2002/0078439 A1 6/2002 Yamagaetal 2007/0294717 A111 12/2007 H111 etal...... 725/25 2002/0128029 A1 9/2002 Nishikawa etal. Zoos/0000979 A1 V2008 P918“ 2002/0150094 A1 10/2002 Cheng etal' 2008/0002621 A1 1/2008 Glnzburg etal. 2002/0154745 A1 10/2002 shtivelnran Zoos/0002691 A1 V2008 Q‘et.a1'

2002/0184368 A1 12/2002 Wang 2008/0091838 A1 4/2008 Miceli etal. 2003/0027566 A1 2/2003 Weiner 2008/0134054 A1 6/2008 Clarketal. 2003/002g632 A1 2/2003 Davis 2008/0192661 A1 55/2008 Hamamoto etal. 2003/0072370 A1 4/2003 Girod et a1, 2009/0028188 A111 1/2009 Boic etal...... 370/474 2003/0083870 A111 5/2003 Lee etal...... 704/229 2009/0063698 A1 3/2009 Xu etal. 2003/0095594 A1 5/2003 Laksono etal. 2009/0103433 A1 4/2009 Katisetal. US 8,001,261 B2 Page 3

2009/0103475 A1 4/2009 Katis et al. Liaw, Kim Poh, “Pairingo launches its IM Software for Android 2009/0103521 A1 4/2009 Katis et al. Phones,” Slashphone.com, Mar. 24, 2009, http://www.slashphone. 2009/0103522 A1 4/2009 Katis et al. com/palringo-launches-its-im-software-for-android-phones 2009/0103523 A1 4/2009 Katis et al. 245111, Downloaded on Aug. 13, 2009, 8 pages. 2009/0103527 A1 4/2009 Katis et al. 2009/0103529 A1 4/2009 Katis et al. WikiPediaiThe Free Encyclopedia, “Palringo” http://en.wikipedia. 2009/0103549 A1 4/2009 Katis et al. org/wiki/Palringo, Downloaded on Aug. 13, 2009, 1 page. 2009/0103560 A1 4/2009 Katis et al. “Dircproxy,” http://home.pcisys.net/~tbc/hacks/dircproxyhtm, 2009/0104915 A1 4/2009 Katis et al. Downloaded on Sep. 26, 2008, 1 page. 2009/0106617 A1 4/2009 Katis et al. Apple Inc., “iPhone User ’s Guide,” http://manuals.info.apple.com/ 2009/0175425 A1 7/2009 Lee eniUS/iPhoneiUseriGuide.pdf, Downloaded on Oct. 3, 2008, 154 2009/0268808 A1* 10/2009 Li et al...... 375/240.02 2011/0001642 A1 1/2011 Yu et a1. pages. Brandxnet, “Using Talk,” http://www.brandX.net/support/ FOREIGN PATENT DOCUMENTS usingtelnet/talk.shtml, Downloaded on Sep. 19, 2008, 2 pages. W0 W0 03/073642 9/2003 Businesswire.com “LignUp 4.0 Delivers Industry's Most Compre W0 WO 2006/114673 11/2006 hensive Suite of Communications Web Services,” http://www. W0 WO 2007/026320 3/2007 businesswire .com/portal/ site/ goo gle/ indeX.j sp?ndmViewId:newsi view&newsId:20070430005498&newsLang:en, Downloaded on OTHER PUBLICATIONS Nov. 21, 2008, 10 pages. “Eudora,” Answers.com, http://www.answers.com/topic/eudora-e Calore, Michael, “Spin Vox Moves Into VoIP, Brings Voice-to-Text to mail-client, Downloaded on Aug. 20, 2009, 4 pages. Users,” MonkeyiBites, http://blog.wired.com/monkeybites/ “The Eudora Open Messaging Advantage,” Qualcomm, 1997, Part 2007/08/spinvoX-moves-i.htrnl, Downloaded on Oct. 3, 2008, 4 pages. No. 100-50030-1, 23 pages. Cardei et al., “MAC Layer QoS Support for Wireless Networks of “AsperaiNext Generation File TransportiBroadcasting & Enter Unmanned Air Vehicles,” Proceedings of the 37th Hawaii Interna tainment Media,” Asperasoft.com, http://www.asperasoft.com/en/ tional Conference on System Sciencesi2004, Jan. 5-8, 2004 pp. 9 industries/di gitalimediail 0/BroadcastiEntertainmentiMediai PP 5, Downloaded on Sep. 22, 2009, 2 pages. Charny, Ben, “Nextel pushes new ‘push to talk’ features,” URL: “AsperaiNext Generation File Transportifasp TM transfer times,” http://news.Zdnet.com/2100-9584i22-134945.html, Mar 18, 2004, Asperasoft.com, http://www.asperasoft.com/en/technology/faspi 3 pages. transferitimesi14/faspitransferitimesi14, Downloaded on Sep. Chen et al., “An Adaptive Multimedia Transmission Protocol for 22, 2009, 1 page. Distributed Multimedia Applications,” Proceedings of the 5th Inter “AsperaiNext Generation File Transportithe fasp solution,” national Workshop on Multimedia Network Systems and Applica Asperasoft.com, http://www.asperasoft.com/en/technology/faspi tions (MNSA ’2003), in conjunction with the 23rd International solutioni3/theifaspisolutioni3, Downloaded on Sep. 22, 2009, 3 Conference on Distributed Computing Systems (ICDCS-2003), 6 pages. pages. “AsperaiNext Generation File TransportiThe shortcomings of Dannen, Chris, “Technology: The Skype Mobile Phone Will Blow TCP ?le transfer,” Asperasoft.com, http://www.asperasoft.com/en/ Your Mind,” Dec. 18, 2007, URL: http://www.fastcompany.com/ technology/shortcomings, 1of iTCPi2/theishortcomingsiof blog/chris-dannen/lab/technology-skype-mobile-phone-will-blow your-mind, 2 pages. TCPi?leitransferi2, Downloaded on Sep. 22, 2009, 2 pages. Erwu et al., “Packet-late indication based (PLIB): adaptive jitter “AsperaiNext Generation File Transportifasp technology over bujfer,” ACM International Conference Proceeding Series; vol. 58, view” Asperasoft.com, http://www.asperasoft.com/en/technology/ Proceedings of the winter international symposium on Information faspioverviewil/faspitechnologyioverviewi1, Downloaded on and communication technologies, Cancun, Mexico, SESSION: Per Sep. 22, 2009, 2 pages. formance, reliability, and quality of service, pp. 1-5 Year of Publica “Asperafasp TM High Speed Transport-A Critical Technology Com tion: 2004. parison,” White Paper, Asperasoft. com, http://www. asperasoft.com/ FAQS.org, “RFC1 644*T/TCPiT CP Extensions for Transactions en/technology/whiteipapersi13/asperaifaspihighispeeditrans Functional S,” http://www.faqs.org/rfcs/rfc1644.html, Downloaded porti13, Downloaded on Sep. 22, 2009, 11 pages. on Sep. 19, 2008, 26 pages. “Palringo Brings First Push-to-Talk Application to the iPhone,” FluidVoice “Overview of FluidVoice,” http://viral.media.mit.edu/ RedOrbit.com, http://www.redorbit.com/news/technology/ wiki/tiki-indeX.php?page:FluidVoice, Downloaded on Sep. 16, 1 52 5 54 5/palringoibring si?rstipu shtotalkiapplicationitoi 2008, 2 pages. theiiphone/indexhtml, Downloaded on Aug. 13, 2009, 2 pages. GrandCentral.com, “Call Record,” http://www.grandcentral.com/ Palringoi Features, Palringo .com, http://www.palringo.com/en/gb/ howitworks/callirecord, Downloaded on Sep. 26, 2008, 1 page. features/, Downloaded on Aug. 13, 2009, 1 page. GrandCentral.com, “One Voicemail Box,” http://www.grandcentral. Moren, Dan, “Palringo Brings Picture Messaging to Iphone,” http:// com/home/oneivoicemail, Downloaded on Sep. 26, 2008, 1 page. www.pcworld.com/aIticle/149108/palringoibringsipictureimes GrandCentral.com, “So Many Features, You Won ’t Believe it,” http:// sagingitoiiphonehtml, Downloaded on Aug. 13, 2009, 3 pages. www.grandcentral.com/support/howitworks/, Downloaded on Sep. Paul, Ryan, “Gmail gets integration,” Arstechnica.com, 26, 2008, 1 page. http://arstechnica.com/old/content/2006/02/6l28.ars , Downloaded GrandCentral.com, “Voicemail forwarding,” http://www. on Aug. 20, 2009, 1 page. grandcentral.com/howitworks/voicemailiforwarding, Downloaded Sherman, Chris, “Google Integrates Chat with Gmail,” Search on Sep. 26, 2008, 1 page. Engine Watch, http://searchenginewatch.com/3583121, Feb. 7, Henshall, Stuart, “HotRecorderiRecord Skype Calls,” Skype Jour 2006, Downloaded on Aug. 20, 2009, 2 pages. nal, URL: http://skypejournal.com/blog/archives/2005/03/ “About Gmail,” http://mail.google.com/mail/help/chat.html, Down hotrecorderirecphp, Mar. 25, 2005, 11 pages. loaded on Aug. 20, 2009, 3 pages. IRCHelp.org, “An IRC Tutorial,” http://www.irchelp.org/irchelp/ WikiPediaiThe Free Encyclopedia, “Google Talk,” http://en. irctutorial.html, Downloaded on Sep. 26, 2008, 14 pages. wikipedia.org/wiki/GoogleiTalk, Downloaded on Aug. 20, 2009, 8 Kadoinkcom, “Get a Widget,” http://www.kadoink.com/indeX. pages. cfm?action:getWidgets, Downloaded on Sep. 19, 2008, 3 pages. AZuri, Calvin, “Palringo Gold Launched on BlackBerry Krishnan et al., “EVRC-Wideband: The New 3GPP2 Wideband Smartphone”, Apr. 20, 2009, http://ivr.tmcnet.com/topics/ivr Vocoder Standard,” IEEE International Conference on Acoustics, voiceXml/aIticles/54573-palringo-gold-launched-blackberry Speech and Processing, 2007. ICASSP 2007, Publication smartphone.htm, Downloaded on Aug. 13, 2009, 3 pages. Date: Apr. 15-20, 2007, vol. 2, on pp. II-333-II-336, Honolulu, HI. US 8,001,261 B2 Page 4

Layton, Julia, “How Slingbox Works,” Jan. 4, 2006, HowStuflVVorks. VOIP-News.com, “Company Pro?le, LignUp,” http://www.voip com, http://electronics.howstuffworks.com/slingboX.htm, 9 pages. news.com/vendors/lignup/, Downloaded on Dec. 5, 2008, 6 pages. LignUp.com, “LignUp Communications Applications Server,” WikiBooks, “Internet Technologies/IRC,” http://en.wikibooks.org/ http://www.lignup.com/platform/indexhtml, Downloaded on Sep. wiki/InternetiTechnologies/IRC, Downloaded on Sep. 19, 2008, 4 19,2008, 1 page. pages. Network Dictionary, “Instant Message (Ill/I) Technology Overview,” WikiPediaiThe Free Encyclopedia, “E-mail,” http://en.wikipedia. http://www.networkdictionary.com/networking/im.php, Down org/wiki/E-mail, Downloaded on Sep. 19, 2008, 8 pages. loaded on Sep. 16, 2008, 2 pages. WikiPediaiThe Free Encyclopedia, “Internet Relay Chat,” http:// Nikotalkiecom, “NikotalkieiHome,” http://www.nikotalkie.com/, en.wikipedia.org/wiki/InternetiRelayiChat, Downloaded on Oct. Downloaded on Sep. 19, 2008, 2 pages. 3,2008, 11 pages. Nikotel.com, “Click-Pop-Talk WebStart Phone,” http://www.nikotel. WikiPediaiThe Free Encyclopedia, “Spinvox,” http://en.wikipedia. com/nikotel-click-pop-talk-j ava-phone.html, Downloaded on Sep. org/wiki/SpinvoX, Downloaded on Sep. 26, 2008, 1 page. 19,2008, 1 page. WikiPediaiThe Free Encyclopedia, “TiVo”, http://en.wikipedia. Notaras, George, “dircproxy IRC Proxy,” http://www.g-loaded.eu/ org/wiki/TiVo, Downloaded on Sep. 16, 2008, 6 pages. 2007/02/01/dircproXy-irc-proXy/, Downloaded on Sep. 26, 2008, 4 YavuZ et al., “VoIP over cdma2000 IxEV-DO Revision A,” IEEE pages. Communications Magazine, Feb. 2006, pp. 88-95. Pash, Adam, “Consolidate Your Phones with GrandCentral,” http:// HotRecorder.com, “Features,” http://www.hotrecorder.com/musici techgroup.groups.voX.com/library/post/ features.asp, downloaded on Sep. 26, 2008, 1 page. 6a00cd978d0ef7f9cc00e398b8ff7a0002.htrnl, Downloaded on Sep. HotRecorder.com, “Help,” http://www.hotrecorder.com/musici 19, 2008, 5 pages. help.asp, downloaded on Sep. 26, 2008, 3 pages. Patel, Nilay, “Apple patent reveals data-to-voice translation system HotRecorder.com, “FAQs,” http://www.hotrecorder.com/musici for cellphones,” Jul. 28th 2007, URL: http://www.engadget.com/ support.asp, downloaded on Sep. 26, 2008, 1 page. 2007/07/28/apple-patent-reveals-data-to-voice-translation-system WikiPediaiThe Free Encyclopedia, “Skype,” http://en.wikipedia. for-cellph/, 5 pages. org/wiki/Skype, Downloaded on Sep. 26, 2008, 7 pages. Piecuch et al., “A Selective Retransmission Protocol for Multimedia WikiPediaiThe Free Encyclopedia, “Skype Protocol,” http://en. on the Internet,” In Proceedings of SPIE Multimedia Systems and wikipedia.org/wiki/Skype, Downloaded on Sep. 26, 2008, 4 pages. Applications, Nov. 2000, Boston MA, USA, 12 pages. Jabber.org, “Main page,” http://wwwjabberorg/Web/mainipage, Qiao et al., “SCTP Performance Issue on Path Delay Dijj’erential,” Sep. 2, 2008, downloaded on Sep. 26, 2008, 1 page. Lecture Notes in Computer Science, Springer Berlin / IIeidelberg Jabber.org, “FAQ,” http://www.jabber.org/web/faq, Sep. 4, 2008, ISSN 0302-9743 (Print) 1611-3349 (Online) vol. 4517/2007, Wired/ downloaded on Sep. 26, 2008 , 2 pages. Wireless Internet Communications, pp. 43-54 Sunday, Jun. 24, 2007. Apple Inc., “iPhone: About I/isual Voicemail,” http://www.support. Ramo et al., “On comparing speech quality of various narrow- and apple.com/kb/HT 1486, Downloaded on Sep. 26, 2008, 3 pages. wideband speech codecs,” Proceedings of the Eighth International J abberorg, “Products // Jabber XCP //Benqits,” http://www.j abber. Symposium on Signal Processing and Its Applications, 2005. Publi com/CE/JabberXCPBene?ts, downloaded on Sep. 26, 2008, 1 page. cation Date: Aug. 28-31, 2005, vol. 2, On pp. 603-606. J abber.org, “Products //Jabber Clients,” http://www.j abber.com/CE/ Rey et al., “I-D ACTION'draft-ietf-avt-rtp-retransmission-09.txt,” JabberClients, downloaded on Sep. 26, 2008, 1 page. Aug. 5, 2003, http://osdir.com/ml/ietf.avt/2003-08/msg00003.html, Jabber.org, “Products // JabberNow” http://www.jabber.com/CE/ Downloaded on Sep. 19, 2008, 2 pages. JabberNow, downloaded on Sep. 26, 2008, 1 page. Ribbit.com, “Amphibian,” http://www.ribbit.com/everyday/, Down KillerStartupscom, “Kadoink com-Mobilizing your Socializing,” loaded on Sep. 26, 2008, 1 page. http://www.killerstartups.com/Web20/kadoink-com-mobliZing Ribbit.com, “Enhanced I/isual Voicemail,” http://www.ribbit.com/ your-socializing, Downloaded on Sep. 26, 2008, 3 pages. everyday/tourienhancedivisualivoicemail.php, Downloaded on CNETNews.com, “Kadoink’s phonecast lines o?cially open for Sep. 26, 2008, 2 pages. texting,” http://news.cnetcom/8301-17939i109-9829877-2.html, Ribbit.com, “What is Ribbit? Features,” http://www.ribbit.com/plat downloaded on Sep. 26, 2008, 1 page. form/featuresphp, Downloaded on Sep. 26, 2008, 1 page. BusinessWire.com, “Lign Up 4.0 Delivers Industry ’s Most Compre Ribbit.com, “What is Ribbit? Overview,” http://www.ribbit.com/ hensive Suite of Communications Web Services,” Apr. 30, 2007, platform/indeXphp, Downloaded on Sep. 26, 2008, 1 page. http://www.businesswire.com/portal/site/google/ Ribbit.com, “What is Ribbit? Voice Architecture,” http://www.ribbit. ?ndmViewId:newsiview&ne wsId:20070430005498& com/platform/architecture.php, Downloaded on Sep. 26, 2008, 2 newsLang:en, Downloaded on Sep. 26, 2008, 6 pages. pages. VOIP-News.com, “Company Pro?leiLignUp,” http://www.voip Saito et al., “IP Packet Loss Compensation Scheme with Bicast and news.com/vendors/lignup/, Downloaded on Oct. 3, 2008, 6 pages. Forwarding for Handover in Mobile Communications,” 2006 IEEE JustAnotheriPhoneBlog.com, “NikotalkieiJust Talk, Don 't Type,” 17th International Symposium on Personal, Indoor and Mobile Radio http://justanotheriphoneblog.com/wordpress/2007/ 10/ 13/ Communications, Sep. 2006, pp. 1-5, Helsinki. nikotalkie-just-talk-dont-type/, Downloaded on Sep. 26, 2008, 10 Skype.com, “Making calls isjust the start,” URL: http://www.skype. pages. com/features/, Downloaded on Sep. 16, 2008, 2 pages. WikiPediaiThe Free Encyclopedia, “Push To Talk” http://en. SpinvoX.com, “HomePage,” http://www.spinvoX.com/, Downloaded wikipedia.org/wiki/Pushitoitalk, Downloaded on Sep. 26, 2008, 3 on Sep. 26, 2008, 3 pages. pages. SpinvoX.com, “How Does it Work?,” http://www.spinvoX.com/howi WikiPediaiThe Free Encyclopedia, “Slingbox” http://en.wikipedia. itiworkshtml, Downloaded on Sep. 19, 2008, 2 pages. org/wiki/SlingboX, Downloaded on Sep. 26, 2008, 4 pages. Swissvoice.net, “PSTN,” http://www.swissvoice.net/ww/htmiww/ About.com, “Linux / Unix Command.‘ talk,”http://linux.about.com/ 08itechnology/contentipstn.htrnl, Downloaded on Sep. 19, 2008, 3 od/commands/l/blcmdllitalkhtm, Downloaded on Sep. 26, 2008, pages. 2 pages. TektroniX, “VOIP Technology Overview; Protocols, Convergence, Fall, Kevin, “A Delay-TolerantNetworkArchitecture for Challenged Testing,” http://www.tektronics.com/voip, May 12, 2006. Internets,” Feb. 2003, http://www.dtnrg.org/docs/papers/IRB-TR The Jabber Extensible Communications PlatformTM, “Products // 03-003.pdf, 15 pages. Jabber XCP,” URL: http://wwwjabber.com/Ce/JabberXCR Down Chuah et al., “Store-and-Forward Performance in a DTN,” Vehicular loaded on Sep. 16,2008, 2 pages. Technology Conference, 2006. VTC 2006-Spring. IEEE 63"", Publi ThunkDifferentcom, “YouMail vs. Google Grandcentral Voice Mail cation Date: May 7-10, 2006, vol. 1, On pp. 187-191. Service,” http://thunkdifferent.com/2007/ 10/ 1 l/youmail-vs-google Krishnan, et al., “The SPINDLE Disruption-Tolerant Networking grandcentral-voice-mail-service/, Downloaded on Oct. 3, 2008, 6 System,” Military Communications Conference, 2007. MILCOM pages. 2007. IEEE Volume , Issue , Oct. 29-31, 2007 pp. 1-7. US 8,001,261 B2 Page 5

WikiPediaiThe Free Encyclopedia, “Wsual Voicemail” http://en. Cerf et al., “A Protocol for Packet Network Intercommunication,” Wikipedia.org/Wiki/Visualivoicemail, downloaded on Sep. 26, Communications, IEEE Transactions on, vol. 22, Issue 5, May 1974 2008, 1 page. pp. 637-648. Amir et al., “An Overlay Architecture for High Quality VoIP International Search Report from PCT/US2008/078469, dated Apr. Streamsf’, IEEE Transactions on Multimedia, Publication Date: Dec. 16, 2009. 2006, vol. 8, Issue:6, On pp. 1250-1262. Written Opinion from PCT/U S2008/ 078469, dated Apr. 16, 2009. Rothermel et al., “An Adaptive Stream Synchronization Protocol,” International Search Report from PCT/US2008/078472, dated Apr. Lecture Notes in Computer Science; vol. 1018, Proceedings of the 9, 2009. 5th International Workshop on Network and Operating System Sup Written Opinion from PCT/U S2008/ 078472, dated Apr. 9, 2009. port for Digital Audio and Video, pp. 178-189, Year of Publication: Of?ce Action from EPApplication 088413406, mailed Sep. 8,2009. 1995. Of?ce Action from U.S. Appl. No. 12/192,401 mailed May 31, 2011. Baset et al., “An Analysis of the Skype Peer-to-Peer Internet Tele Of?ce Action from U.S. Appl. No. 12/197, 148 mailed May 31, 2011. phony Protocol,” INFOCOM 2006. 25th IEEE International Confer ence on Computer Communications. Proceedings (2006), pp. 1-11. * cited by examiner US. Patent Aug. 16, 2011 Sheet 1 0133 US 8,001,261 B2

m5 @2

or

g :2 562% m8g 11 mm? #2,

N2

m8 5 US. Patent Aug. 16, 2011 Sheet 2 0133 US 8,001,261 B2

MCMS/SaS Message Module 2i SaS Services Module 20b Messaging and Signaling Services Module m

% .QE3

8%25£22%a: g322$.5222262250£88 822%2025SN Q822$329G235 822%22922882g 26:%236238mg a2252@5805259:59am mg255

US. Patent Aug. 16, 2011 Sheet 5 0133 US 8,001,261 B2

type sub-type length payload

95 FIG. 4A

95 A F \ Ethernet lP UDP type sub-type length payload 4' FIG. 4B

96 95 A f \ MACEthernet srC ProtocolOptions portUDP src NTIedLa. git; Length MeTgage sTtgpnep. seqlugnce P’! . d MACdst lP, IPA, lPB port dst ll’ ll’ l g‘ FIG. 4C

97

Sub Len th Message Time Sequence Media Type 9 ID Stamp. lD Payload

4 FIG. 4D US. Patent Aug. 16, 2011 Sheet 6 0f 33 US 8,001,261 B2

Inte et Provider C Internet Provider B -A

\ HTTP VP over IP #1 / Server \ HTTP over IP VP over IP #2 l VP over IP #3 HTTP over IP 100 VP over IP #4 /\/ l VP over IP #5 l VP over IP #6 HTTP over IP 13 VP over IP #7 9 Sh#red lP Netwc rk HTTP 1.2 Internet Provider A Client Client

FIG. 5 US. Patent Aug. 16, 2011 Sheet 7 0133 US 8,001,261 B2

16

104

VP 1 Circuit Type VP 2 Network VP3 VP4 VP5

Client

FIG. 6 US. Patent Aug. 16, 2011 Sheet 8 0133 US 8,001,261 B2

mm? 622% E26mm? $228 62%mm: .OEh $225 62%<8 622% E26

n _ _

m3

4 226N8 mmmmozmm .OEmm $25?m: n8925 llllllllllllllllllllllll ______n _ _ _ _ _ n m _ _ _ _ n m m _ $5358 ozmm

Egwzéc2 llllllllllllllllllllllll E265 US. Patent Aug. 16, 2011 Sheet 10 0133 US 8,001,261 B2

User Creates Media ”\/1301 l 1302 Encode Media w l 4203 Create Indexed Media Payloads

I 132 Store In PIMB 30 ’\/

130

FIG. 8B US. Patent Aug. 16, 2011 Sheet 11 0133 US 8,001,261 B2

1341 Indexed Media Written into PIMB ‘For Transmissio

MCMS. Prioritize Which Payload 1342 COnV?r5at'On —’ Should be Transmitted “J Attributes l Packet Optimization 1343 Using PQM m/ (Figures 9A-9C) 1' 1344 Retrieve Payload from PIMB /\/ l 1345 Create Vox Packets ’\/ l 1346 Transmit ’\/

FIG. 8C US. Patent Aug. 16, 2011 Sheet 12 0133 US 8,001,261 B2

Receive \/0x Packets over Network 18 361 l 136 Convert Packets to Indexed Media Payloads '\/ 3 1 Store in PIMB 30 £64

Run DQM (F|gures. 9D-9F) w1365

FIG. 8D US. Patent Aug. 16, 2011 Sheet 13 0133 US 8,001,261 B2 | Start '

MTSD Read Priority lnfermlation 1401 from MCMS Application 20

Retrieve Corresponding Payloads $02 from PIMB 30

" 1403 Perform PLC Interpolation IV

V 1404 Mix Message Streams ’\/

1405 Render Media ’\/

" 1406 Generate Sound/Video w

[ Done ' FIG. 8E US. Patent Aug. 16, 2011 Sheet 14 0133 US 8,001,261 B2

PIMB WRITER Net Receive From Previous Node on Network (Fig. 8D)

p|MB 91 Archive 98a

PIMB READER Transmit to Next Node on Network (Fig. 8C)

133 FIG. 8F US. Patent Aug. 16, 2011 Sheet 15 0133 US 8,001,261 B2

—> M ONITOR NETWORK INTERFACE Jr RECEIVE REPORTS FROM RECEIVER J, OBSERVE THROUGHPUT

OBSERVE PACKET LOSS

OBSERVE JITTER 1' CAL CU LATE M ABR

FIG. 9A