Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page1 of 13
1 QUINN EMANUEL URQUHART & SULLIVAN, LLP Sean Pak (Cal. Bar No. 219032) 2 [email protected] Amy H. Candido (Cal. Bar No. 237829) 3 [email protected] Matthew S. Warren (Cal. Bar No. 230565) 4 [email protected] 50 California Street, 22nd Floor 5 San Francisco, California 94111 (415) 875-6600 6 (415) 875-6700 (facsimile)
7 Attorneys for Plaintiff GOOGLE INC.
8 UNITED STATES DISTRICT COURT
9 NORTHERN DISTRICT OF CALIFORNIA
10 11 GOOGLE INC., CASE NO. 3:13-cv-5933
12 Plaintiff, COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT 13 v. OF U.S. PATENT NOS. 5,838,551; 6,037,937; 6,128,298; 6,333,973; 6,463,131; 14 ROCKSTAR CONSORTIUM US LP and 6,765,591; AND 6,937,572 MOBILESTAR TECHNOLOGIES LLC, 15 DEMAND FOR JURY TRIAL Defendants. 16
17
18 Plaintiff Google Inc. (“Google”) seeks a declaration that Google does not directly or 19 indirectly infringe United States Patent Nos. 5,838,551, 6,037,937, 6,128,298, 6,333,973, 20 6,463,131, 6,765,591, and 6,937,572, as follows: 21 22 23 24 25 26 27 28
01980.00011/5659994.7
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page2 of 13
1 NATURE OF THE ACTION 2 1. This is an action for a declaratory judgment of non-infringement arising under the
3 patent laws of the United States, Title 35 of the United States Code. Google requests this relief 4 because Defendants Rockstar Consortium US LP and MobileStar Technologies LLC (collectively,
5 “Rockstar”) have filed seven lawsuits claiming that Google’s customers infringe some or all of 6 United States Patent Nos. 5,838,551, 6,037,937, 6,128,298, 6,333,973, 6,463,131, 6,765,591, and
7 6,937,572 (the “patents in suit”) by making, using, selling, offering for sale, importing, exporting, 8 supplying, or distributing “certain mobile communication devices having a version (or an adaption
9 thereof) of [the] Android operating system” developed by Google. Rockstar’s litigation campaign
10 has placed a cloud on Google’s Android platform; threatened Google’s business and relationships 11 with its customers and partners, as well as its sales of Nexus-branded Android devices; and created 12 a justiciable controversy between Google and Rockstar.
13 THE PARTIES 14 2. Plaintiff Google Inc. (“Google”) is a corporation organized and existing under the 15 laws of the state of Delaware, with its principal place of business at 1600 Amphitheatre Parkway, 16 Mountain View, California, 94043. Google’s mission is to organize the world’s information and 17 make it universally accessible and useful. As part of that mission, Google produces Android, an 18 open-source mobile platform that has been adopted by original equipment manufacturers 19 (“OEMs”) worldwide. 20 3. Defendant Rockstar Consortium US LP (“Rockstar Consortium”) is a limited 21 partnership organized and existing under the laws of the state of Delaware. Rockstar Consortium 22 claims that its principal place of business is at Legacy Town Center 1, 7160 North Dallas 23 Parkway, Suite No. 250, Plano, Texas, 75024, but the substantial majority of its employees, 24 including senior management, are based in Ontario, Canada. Rockstar Consortium is admittedly a 25 “patent licensing business” that produces no products, and instead exists solely to assert its 26 patents. ( http://www.ip-rockstar.com/about .) 27 4. Defendant MobileStar Technologies LLC (“MobileStar”) is a limited liability 28 corporation organized and existing under the laws of the state of Delaware, and also claims that its
01980.00011/5659994.7 - 2 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page3 of 13
1 principal place of business is at Legacy Town Center 1, 7160 North Dallas Parkway, 2 Suite No. 250, Plano, Texas, 75024. MobileStar claims to be a subsidiary of Rockstar.
3 MobileStar was formed for litigation one day before Rockstar filed its lawsuits against Google’s 4 customers.
5 JURISDICTIONAL STATEMENT 6 5. This action arises under the Declaratory Judgment Act, 28 U.S.C. § 2201, and
7 under the patent laws of the United States, 35 U.S.C. §§ 1-390. 8 6. This Court has subject matter jurisdiction over this action under 28 U.S.C. §§ 1331,
9 1338(a), and 2201(a).
10 7. This Court has personal jurisdiction over Rockstar. Among other things, Rockstar 11 has continuous and systematic business contacts with California. As Rockstar executives have 12 explained to the media, once Rockstar identifies commercially successful products, it approaches 13 the companies behind those products in person and through other means to seek licenses to 14 Rockstar’s patents. Rockstar conducts this business extensively throughout California, including 15 through personnel located in the San Francisco Bay Area. Rockstar’s CEO has publicly stated that 16 Facebook (based in Menlo Park) and LinkedIn (based in Mountain View) infringe Rockstar’s 17 patents. (http://www.wired.com/wiredenterprise/2013/11/veschi/ .) In fact, Rockstar’s CEO has 18 stated that it would be difficult to imagine that any tech companies—legions of which call 19 California home—do not infringe Rockstar’s patents. On information and belief, Rockstar’s 20 licensing and enforcement efforts in California have generated substantial revenues. 21 8. On information and belief, Rockstar’s shareholders direct and participate in 22 Rockstar’s licensing and enforcement efforts against companies in California. For example, Apple 23 Inc. (“Apple”) is a large shareholder in closely-held Rockstar, and maintains a seat on Rockstar’s 24 board of directors. Rockstar’s CEO has publicly stated that Rockstar maintains regular contact 25 with its shareholders. Apple’s headquarters are in Cupertino, California. 26 9. In addition, this Court has personal jurisdiction over Rockstar for another reason: 27 Rockstar has purposefully directed into California its enforcement activities regarding the patents 28 in suit. As part of this enforcement campaign, Rockstar contacted and met with a series of
01980.00011/5659994.7 - 3 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page4 of 13
1 California-based companies, accusing their devices that use Google’s Android platform. On 2 information and belief, Rockstar contacted and met with these California-based companies in
3 order to discourage them from continuing to use Google’s Android platform in their devices, and 4 to interfere with Google’s business relationships.
5 10. Venue is proper in this District under 28 U.S.C. §§ 1391(b), (c), because a 6 substantial part of the events giving rise to Google’s claim occurred in this district, and because
7 Rockstar Consortium and MobileStar are subject to personal jurisdiction here. 8 11. An immediate, real, and justiciable controversy exists between Google and
9 Rockstar as to whether Google is infringing or has infringed United States Patent Nos. 5,838,551
10 (the “’551 patent”), 6,037,937 (the “’937 patent”), 6,128,298 (the “’298 patent”), 6,333,973 (the 11 “’973 patent”), 6,463,131 (the “’131 patent”), 6,765,591 (the “’591 patent”), and 6,937,572 (the 12 “’572 patent”).
13 INTRADISTRICT ASSIGNMENT 14 12. For purposes of intradistrict assignment under Civil Local Rules 3-2(c) and 3-5(b), 15 this Intellectual Property Action will be assigned on a district-wide basis.
16 ROCKSTAR’S HISTORY AND BUSINESS 17 13. In June 2011, five of the world’s largest technology companies—including Google 18 competitors Apple, Research In Motion, and Microsoft—joined forces to obtain a portfolio of 19 patents auctioned during the bankruptcy of Nortel Networks. Bankrolled by these companies, a 20 manufactured entity called “Rockstar Bidco” placed the winning bid of $4.5 billion. According to 21 Apple’s June 2011 Form 10-Q filed with the Securities and Exchange Commission, Apple 22 contributed “approximately $2.6 billion” of that sum. 23 14. Following its acquisition of Nortel’s portfolio, Rockstar Bidco transferred 24 ownership of thousands of patents to its owners, whom it calls the “founding licensees.” Rockstar 25 Bidco transferred ownership of over 1,000 patents to Apple alone. On information and belief, 26 Rockstar Bidco was then reorganized into Rockstar Consortium. 27 15. Rockstar produces no products and practices no patents. Instead, Rockstar employs 28 a staff of engineers in Ontario, Canada, who examine other companies’ successful products to find
01980.00011/5659994.7 - 4 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page5 of 13
1 anything that Rockstar might use to demand and extract licenses to its patents under threat of 2 litigation.
3 16. Public reports confirm that in the first two months following its purchase of 4 Nortel’s portfolio, Rockstar sought licenses from as many as 100 companies. On information and
5 belief, Rockstar has since sought licenses from many additional companies.
6 ROCKSTAR’S CAMPAIGN AGAINST ANDROID 7 17. Among the myriad companies ensnared in Rockstar’s patent dragnet are customers 8 and partners of Google who use the Android platform in their devices, including ASUS, HTC,
9 Huawei, LG, Pantech, Samsung, and ZTE.
10 18. On October 31, 2013, Rockstar brought patent infringement actions against ASUS, 11 HTC, Huawei, LG, Pantech, Samsung, and ZTE in the Marshall Division of the United States 12 District Court for the Eastern District of Texas. Rockstar Consortium US LP v. ASUSTek 13 Computer, Inc. , No. 2:13-cv-894; Rockstar Consortium US LP v. HTC Corp. , No. 2:13-cv-895; 14 Rockstar Consortium US LP v. Huawei Investment & Holding Co., No. 2:13-cv-896; Rockstar 15 Consortium US LP v. LG Electronics Inc. , No. 2:13-cv-898; Rockstar Consortium US LP v. 16 Pantech Co., No. 2:13-cv-899; Rockstar Consortium US LP v. Samsung Electronics Co., 17 No. 2:13-cv-900; and Rockstar Consortium US LP v. ZTE Corp. , No. 2:13-cv-901 (collectively, 18 the “Android OEM Actions” against the “Android OEM Defendants”). 19 19. In the Android OEM Actions, Rockstar alleges that each Android OEM Defendant 20 infringes some or all of the ’551, ’937, ’298, ’973, ’131, ’591, and ’572 patents by making, using, 21 selling, offering for sale, importing, exporting, supplying, or distributing “certain mobile 22 communication devices having a version (or an adaption thereof) of [the] Android operating 23 system” developed by Google. 24 20. In the Android OEM Actions, Rockstar accuses Android features including 25 “Mobile Hotspot functionality” which is “designed to route data packets between wireless devices 26 tethered to the Mobile Hotspot to nodes on a public network such as the Internet,” allegedly 27 infringing the ’298 patent; “VPN management functionality,” allegedly infringing the ’591 patent; 28 “Messaging and Notification functionality,” allegedly infringing the ’131 patent; a “navigable
01980.00011/5659994.7 - 5 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page6 of 13
1 graphical user interface (‘navigable GUI’) that permits a user to manipulate and control the 2 contents of the display to maximize the use of display real estate,” allegedly infringing the ’937
3 patent; “integrated notification message center,” allegedly infringing the ’973 patent; and 4 “Location Services functionality,” allegedly infringing the ’572 patent.
5 21. Rockstar further accuses devices incorporating Android of infringing the ’551 6 patent by “includ[ing] at least one electronic package comprising a component that is located
7 between an EMI shield and a ground member for performing shielding operations” where “[t]he 8 EMI shield is incorporated into the electronic package, which is then mounted to a circuit board”
9 in the accused devices.
10 22. As Rockstar’s complaints admit, in the Android OEM Actions Rockstar has 11 asserted its patents only against “certain mobile communication devices having a version (or an 12 adaption thereof) of [the] Android operating system” developed by Google—although each of the 13 Android OEM Defendants also makes other products that do not use Google’s Android platform. 14 Rockstar has further asserted patent infringement by the Nexus 7, a device offered for sale by 15 Google and built by ASUS, one of the Android OEM Defendants. 16 23. On information and belief, Rockstar intends the Android OEM Actions to harm 17 Google’s Android platform and disrupt Google’s relationships with the Android OEM Defendants. 18 This is an open secret: industry media immediately observed that in filing the Android OEM 19 Actions, Rockstar “launch[ed] an all-out patent attack on Google and Android.” 20 (http://arstechnica.com/tech-policy/2013/10/patent-war-goes-nuclear-microsoft-apple-owned- 21 rockstar-sues-google/ .) 22 24. For all these reasons, an actual controversy exists between Google and Rockstar 23 regarding the alleged infringement of any claim of the ’551, ’937, ’298, ’973, ’131, ’591, and 24 ’572 patents.
25 GOOGLE DOES NOT INFRINGE THE PATENTS IN SUIT 26 25. Neither any version of Google’s Android platform nor any of the Nexus 5, 27 Nexus 7, or Nexus 10 devices sold by Google directly or indirectly infringe any claim of the ’551, 28 ’937, ’298, ’973, ’131, ’591, and ’572 patents.
01980.00011/5659994.7 - 6 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page7 of 13
1 26. To the best of Google’s knowledge, no third party infringes any claim of the ’551, 2 ’937, ’298, ’973, ’131, ’591, or ’572 patents by using Nexus devices or Google’s Android
3 platform in other devices. Google has not caused, directed, requested, or facilitated any such 4 infringement, much less with specific intent to do so. Neither the Nexus devices nor Google’s
5 Android platform are designed for use in any combination which infringes any claim of the ’551, 6 ’937, ’298, ’973, ’131, ’591, or ’572 patents. To the contrary, each is a product with substantial
7 uses that do not infringe any claim of these patents.
8 FIRST COUNT
9 (Declaration of Non-Infringement of the ’551 Patent) 10 27. Google restates and incorporates by reference the allegations in paragraphs 1 11 through 26 of this Complaint as if fully set forth herein. 12 28. Rockstar Consortium claims to own all rights, title, and interest in United States 13 Patent No. 5,838,551 (the “’551 patent”). MobileStar claims to be the exclusive licensee of the 14 ’551 patent. A true and correct copy of the ’551 patent is attached hereto as Exhibit A. 15 29. In the Android OEM Actions, Rockstar accuses Android OEM defendants ASUS, 16 HTC, Huawei, LG, Pantech, and Samsung of infringing the ’551 patent in that each “makes, uses, 17 sells, offers for sale, imports, exports, supplies and/or distributes within the United States” devices 18 incorporating Google’s Android platform, which devices allegedly include “at least one electronic 19 package comprising a component that is located between an EMI shield and a ground member for 20 performing shielding operations” where “[t]he EMI shield is incorporated into the electronic 21 package, which is then mounted to a circuit board” in the accused devices. In its complaint 22 against ASUS, which manufactures the Nexus 7, Rockstar specifically accuses the Nexus 7, a 23 device offered for sale by Google. 24 30. A substantial, immediate, and real controversy therefore exists between Google and 25 Rockstar regarding whether the Android platform or any of these Nexus devices infringe or have 26 infringed the ’551 patent. A judicial declaration is necessary to determine the parties’ respective 27 rights regarding the ’551 patent. 28
01980.00011/5659994.7 - 7 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page8 of 13
1 31. Google seeks a judgment declaring that Google’s Android platform and the 2 Nexus 5, Nexus 7, and Nexus 10 devices do not directly or indirectly infringe any claim of the
3 ’551 patent.
4 SECOND COUNT
5 (Declaration of Non-Infringement of the ’937 Patent) 6 32. Google restates and incorporates by reference the allegations in paragraphs 1
7 through 31 of this Complaint as if fully set forth herein. 8 33. MobileStar claims to own all rights, title, and interest in United States Patent
9 No. 6,037,937 (the “’937 patent”). Rockstar Consortium claims no interest in the ’937 patent, yet
10 seeks a judgment of infringement against the Android OEM Defendants in the Android OEM 11 Actions. A true and correct copy of the ’937 patent is attached hereto as Exhibit B. 12 34. In the Android OEM Actions, Rockstar accuses Android OEM Defendants ASUS, 13 HTC, Huawei, LG, Pantech, Samsung, and ZTE of infringing the ’937 patent in that each “makes, 14 uses, sells, offers for sale, imports, exports, supplies and/or distributes within the United States” 15 devices incorporating a version of Google’s Android platform that supports a “navigable graphical 16 user interface (‘navigable GUI’) that permits a user to manipulate and control the contents of the 17 display to maximize the use of display real estate.” In its complaint against ASUS, which 18 manufactures the Nexus 7, Rockstar specifically accuses the Nexus 7, a device offered for sale by 19 Google. 20 35. The Nexus 5, Nexus 7, and Nexus 10 devices use Google’s Android platform. 21 36. A substantial, immediate, and real controversy therefore exists between Google and 22 Rockstar regarding whether the Android platform or any of these Nexus devices infringe or have 23 infringed the ’937 patent. A judicial declaration is necessary to determine the parties’ respective 24 rights regarding the ’937 patent. 25 37. Google seeks a judgment declaring that Google’s Android platform and the 26 Nexus 5, Nexus 7, and Nexus 10 devices do not directly or indirectly infringe any claim of the 27 ’937 patent. 28
01980.00011/5659994.7 - 8 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page9 of 13
1 THIRD COUNT 2 (Declaration of Non-Infringement of the ’298 Patent) 3 38. Google restates and incorporates by reference the allegations in paragraphs 1 4 through 37 of this Complaint as if fully set forth herein.
5 39. Rockstar Consortium claims to own all rights, title, and interest in United States 6 Patent No. 6,128,298 (the “’298 patent”). MobileStar claims to be the exclusive licensee of ’298
7 patent. A true and correct copy of the ’298 patent is attached hereto as Exhibit C. 8 40. In the Android OEM Actions, Rockstar accuses Android OEM Defendants ASUS,
9 HTC, Huawei, LG, Pantech, Samsung, and ZTE of infringing the ’298 patent in that each “makes,
10 uses, sells, offers for sale, imports, exports, supplies and/or distributes within the United States” 11 devices incorporating a version of Google’s Android platform that supports “Mobile Hotspot 12 functionality [which] is designed to route data packets between wireless devices tethered to the 13 Mobile Hotspot to nodes on a public network such as the Internet.” In its complaint against 14 ASUS, which manufactures the Nexus 7, Rockstar specifically accuses the Nexus 7, a device 15 offered for sale by Google. 16 41. The Nexus 5, Nexus 7, and Nexus 10 devices use Google’s Android platform. 17 42. A substantial, immediate, and real controversy therefore exists between Google and 18 Rockstar regarding whether the Android platform or any of these Nexus devices infringe or have 19 infringed the ’298 patent. A judicial declaration is necessary to determine the parties’ respective 20 rights regarding the ’298 patent. 21 43. Google seeks a judgment declaring that Google’s Android platform and the 22 Nexus 5, Nexus 7, and Nexus 10 devices do not directly or indirectly infringe any claim of the 23 ’298 patent.
24 FOURTH COUNT 25 (Declaration of Non-Infringement of the ’973 Patent) 26 44. Google restates and incorporates by reference the allegations in paragraphs 1 27 through 43 of this Complaint as if fully set forth herein. 28
01980.00011/5659994.7 - 9 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page10 of 13
1 45. MobileStar claims to own all rights, title, and interest in United States Patent 2 No. 6,333,973 (the “’973 patent”). Rockstar Consortium claims no interest in the ’973 patent, yet
3 seeks a judgment of infringement against the Android OEM Defendants in the Android OEM 4 Actions. A true and correct copy of the ’973 patent is attached hereto as Exhibit D.
5 46. In the Android OEM Actions, Rockstar accuses Android OEM Defendants ASUS, 6 HTC, Huawei, LG, Pantech, Samsung, and ZTE of infringing the ’973 patent in that each “makes,
7 uses, sells, offers for sale, imports, exports, supplies and/or distributes within the United States” 8 devices incorporating a version of Google’s Android platform that supports an “integrated
9 notification message center.” In its complaint against ASUS, which manufactures the Nexus 7,
10 Rockstar specifically accuses the Nexus 7, a device offered for sale by Google. 11 47. The Nexus 5, Nexus 7, and Nexus 10 devices use Google’s Android platform. 12 48. A substantial, immediate, and real controversy therefore exists between Google and 13 Rockstar regarding whether the Android platform or any of these Nexus devices infringe or have 14 infringed the ’973 patent. A judicial declaration is necessary to determine the parties’ respective 15 rights regarding the ’973 patent. 16 49. Google seeks a judgment declaring that Google’s Android platform and the 17 Nexus 5, Nexus 7, and Nexus 10 devices do not directly or indirectly infringe any claim of the 18 ’973 patent.
19 FIFTH COUNT 20 (Declaration of Non-Infringement of the ’131 Patent) 21 50. Google restates and incorporates by reference the allegations in paragraphs 1 22 through 49 of this Complaint as if fully set forth herein. 23 51. MobileStar claims to own all rights, title, and interest in United States Patent 24 No. 6,463,131 (the “’131 patent”). Rockstar Consortium claims no interest in the ’131 patent, yet 25 seeks a judgment of infringement against the Android OEM Defendants in the Android OEM 26 Actions. A true and correct copy of the ’131 patent is attached hereto as Exhibit E. 27 52. In the Android OEM Actions, Rockstar accuses Android OEM Defendants ASUS, 28 HTC, Huawei, LG, Pantech, Samsung, and ZTE of infringing the ’131 patent in that each “makes,
01980.00011/5659994.7 - 10 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page11 of 13
1 uses, sells, offers for sale, imports, exports, supplies and/or distributes within the United States” 2 devices incorporating a version of Google’s Android platform that supports “Messaging and
3 Notification functionality.” In its complaint against ASUS, which manufactures the Nexus 7, 4 Rockstar specifically accuses the Nexus 7, a device offered for sale by Google.
5 53. The Nexus 5, Nexus 7, and Nexus 10 devices use Google’s Android platform. 6 54. A substantial, immediate, and real controversy therefore exists between Google and
7 Rockstar regarding whether the Android platform or any of these Nexus devices infringe or have 8 infringed the ’131 patent. A judicial declaration is necessary to determine the parties’ respective
9 rights regarding the ’131 patent.
10 55. Google seeks a judgment declaring that Google’s Android platform and the 11 Nexus 5, Nexus 7, and Nexus 10 devices do not directly or indirectly infringe any claim of the 12 ’131 patent.
13 SIXTH COUNT 14 (Declaration of Non-Infringement of the ’591 Patent) 15 56. Google restates and incorporates by reference the allegations in paragraphs 1 16 through 55 of this Complaint as if fully set forth herein. 17 57. MobileStar claims to own all rights, title, and interest in United States Patent 18 No. 6,765,591 (the “’591 patent”). Rockstar Consortium claims no interest in the ’591 patent, yet 19 seeks a judgment of infringement against the Android OEM Defendants in the Android OEM 20 Actions. A true and correct copy of the ’591 patent is attached hereto as Exhibit F. 21 58. In the Android OEM Actions, Rockstar accuses Android OEM Defendants ASUS, 22 HTC, Huawei, LG, Pantech, Samsung, and ZTE of infringing the ’591 patent in that each “makes, 23 uses, sells, offers for sale, imports, exports, supplies and/or distributes within the United States” 24 devices incorporating a version of Google’s Android platform that supports “VPN management 25 functionality.” In its complaint against ASUS, which manufactures the Nexus 7, Rockstar 26 specifically accuses the Nexus 7, a device offered for sale by Google. 27 59. The Nexus 5, Nexus 7, and Nexus 10 devices use Google’s Android platform. 28
01980.00011/5659994.7 - 11 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page12 of 13
1 60. A substantial, immediate, and real controversy therefore exists between Google and 2 Rockstar regarding whether the Android platform or any of these Nexus devices infringe or have
3 infringed the ’591 patent. A judicial declaration is necessary to determine the parties’ respective 4 rights regarding the ’591 patent.
5 61. Google seeks a judgment declaring that Google’s Android platform and the 6 Nexus 5, Nexus 7, and Nexus 10 devices do not directly or indirectly infringe any claim of the
7 ’591 patent.
8 SEVENTH COUNT
9 (Declaration of Non-Infringement of the ’572 Patent) 10 62. Google restates and incorporates by reference the allegations in paragraphs 1 11 through 61 of this Complaint as if fully set forth herein. 12 63. Rockstar Consortium claims to own all rights, title, and interest in United States 13 Patent No. 6,937,572 (the “’572 patent”). MobileStar claims no interest in the ’572 patent, yet 14 seeks a judgment of infringement against the Android OEM Defendants in the Android OEM 15 Actions. A true and correct copy of the ’572 patent is attached hereto as Exhibit G. 16 64. In the Android OEM Actions, Rockstar accuses Android OEM Defendants ASUS, 17 HTC, Huawei, LG, Pantech, Samsung, and ZTE of infringing the ’572 patent in that each “makes, 18 uses, sells, offers for sale, imports, exports, supplies and/or distributes within the United States” 19 devices incorporating a version of Google’s Android platform that supports “Location Services 20 functionality.” In its complaint against ASUS, which manufactures the Nexus 7, Rockstar 21 specifically accuses the Nexus 7, a device offered for sale by Google. 22 65. The Nexus 5, Nexus 7, and Nexus 10 devices use Google’s Android platform. 23 66. A substantial, immediate, and real controversy therefore exists between Google and 24 Rockstar regarding whether the Android platform or any of these Nexus devices infringe or have 25 infringed the ’572 patent. A judicial declaration is necessary to determine the parties’ respective 26 rights regarding the ’572 patent. 27 28
01980.00011/5659994.7 - 12 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1 Filed12/23/13 Page13 of 13
1 67. Google seeks a judgment declaring that Google’s Android platform and the 2 Nexus 5, Nexus 7, and Nexus 10 devices do not directly or indirectly infringe any claim of the
3 ’572 patent.
4 PRAYER FOR RELIEF 5 WHEREFORE, Google prays for judgment and relief as follows: 6 A. Declaring that Google’s Android platform and the Nexus 5, Nexus 7, and Nexus 10
7 do not infringe any of the ’551, ’937, ’298, ’973, ’131, ’591, or ’572 patents; 8 B. Declaring that judgment be entered in favor of Google and against Rockstar
9 Consortium and MobileStar on each of Google’s claims;
10 C. Finding that this an exceptional case under 35 U.S.C. § 285; 11 D. Awarding Google its costs and attorneys’ fees in connection with this action; and 12 E. Such further and additional relief as the Court deems just and proper.
13 JURY DEMAND 14 Google demands a jury trial on all issues and claims so triable. 15 DATED: December 23, 2013 Respectfully submitted,
16 QUINN EMANUEL URQUHART & SULLIVAN, LLP
17 By /s Matthew S. Warren Matthew S. Warren 18 Attorneys for Google Inc.
19 20 21 22 23 24 25 26 27 28
01980.00011/5659994.7 - 13 -
COMPLAINT FOR DECLARATORY JUDGMENT OF NON-INFRINGEMENT Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page1 of 8
EXHIBIT A
Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page2 of 8
US005838551A United States Patent [19] [11] Patent Number: 5,838,551 Chan [45] Date of Patent: Nov. 17, 1998
[54] ELECTRONIC PACKAGE CARRYING AN 5,422,433 6/1995 Rivera et a1...... 174/35 GC ELECTRONIC COMPONENT AND 5,530,202 6/1996 Dais et a1...... 174/35 R ASSEMBLY OF MOTHER BOARD AND ELECTRONIC PACKAGE Primary Examiner—Leo P. Picard Assistant Examiner—Jayprakash N. Gandhi [75] Inventor: Yee-Ning Chan, Nepean, Canada Attorney, Agent, or Firm—R. J. Austin [73] Assignee: Northern Telecom Limited, Montreal, [57] ABSTRACT Canada Electronic package With an electronic component mounted upon a PCB or ceramic substrate by ?rst level interconnects [21] Appl. No.: 691,056 and housing second level interconnects on the other side of the PCB. The component is protected by an EMI shield [22] Filed: Aug. 1, 1996 Which is grounded to a ground plane of the PCB. Especially [51] Int. Cl.6 ...... H05K 9/00 signi?cant When there are a plurality of components pro [52] US. Cl...... 361/818; 361/760; 174/35 R; tected by the shield and When at least one of the components 174/35 GC; 257/699; 257/723; 257/728 is an integrated circuit component (I.C.C.). The package is [58] Field of Search ...... 361/760, 767, thus prebuilt With the EMI shield and Without a separate 361/818; 174/35 R, 35 GC, 357 S, 51; package required for each I.C.C., and is robust in construc 257/659, 660, 699, 723, 728, 738, 778; tion for shipping. The shield and ground plane provide a 437/221; 29/832, 840 Faraday cage Which is especially complete When the shield extends around edges of the PCB and onto its other side. The [56] References Cited package is ready for connection to a motherboard by use of the second level interconnects and process steps to place U.S. PATENT DOCUMENTS EMI shields individually onto mother boards are avoided.
5,355,016 10/1994 Swirbel et a1...... 174/35 GC X 5,400,949 3/1995 Hirvonen et a1...... 361/818 X 12 Claims, 2 Drawing Sheets Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page3 of 8
U.S. Patent Nov. 17,1998 Sheet 1 of2 5,838,551
10 2 24 18 14 1 [ 1(4 2i 26 28\l S 136 9%? A’ h? A61 28 @Q 32 3%) 20 FIG. 1 Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page4 of 8
U.S. Patent Nov. 17,1998 Sheet 2 of2 5,838,551
50 Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page5 of 8
5,838,551 1 2 ELECTRONIC PACKAGE CARRYING AN Which conventionally is individually packaged and provided ELECTRONIC COMPONENT AND With an EMI shield. In the inventive concept hoWever, When ASSEMBLY OF MOTHER BOARD AND an integrated circuit component is included, this does not ELECTRONIC PACKAGE require its oWn individual packaging in addition to the EMI shield. The shield provides protection of the integrated BACKGROUND OF THE INVENTION circuit component and hence procedures involved in pro viding shields When assembling prepackaged integrated 1. Field of the Invention circuit components, onto substrates are not required. The This invention relates to electronic packages. preparation of the inventive package thus simpli?es the ?nal 2. Related Prior Art 10 assembly process onto a larger substrate, and insofar as circuitry is included in the substrate of the package of the In the manufacture of electronic circuitry assemblies, printed circuit boards containing circuitry have electronic invention, circuitry of the larger substrate may be simpli?ed. components mounted thereon and EMI shielding is then The package is thus a completed unit With the integrated placed around certain sensitive components toWards circuit component protected against damage during storage or transportation to its assembly location onto a larger completion of the assemblies. Almost invariably, present day 15 assemblies include integrated circuit components (i.e. chips) substrate. Which need to be packaged to form electronic packages for The electronic package may include tWo or more elec storage and transportation purposes before incorporation tronic components, at least one of Which is an integrated into circuitry assemblies. The packaging process is an added circuit component, and all of these components are shielded expense to the cost of the chip. Methods of making assem by the EMI shield. blies also require additional electromagnetic interference The EMI shield preferably comprises a single metal sheet shields (EMI shields) to be placed around sensitive compo Which is formed as required into the shape of the shield. This nents after the components have been incorporated onto the manufacture from a single metal sheet may be by punching boards and this adds to the process steps required on the out a blank from the sheet and then bending the blank as boards. In addition, each shield needs to be connected 25 required to form the shield, care being taken to bring edges around its periphery to a solder trace on the board and this of Walls of the shield into close proximity thereby avoiding is connected to a ground member normally in the form of a any gaps Which could nullify the shielding effect. ground plane of the board construction. The solder trace Alternatively, the shield may be formed from a single metal adds to complication of board design. Thus, Where (as in sheet by a forming and stamping operation Which provides most electronic circuitry assemblies) integrated circuit com a top and side Walls to the shield With side Walls extending ponents are used, these particular components need to be integrally into one another. Also preferably, the shield prepackaged, stored and transported to the circuitry assem extends around and shields edges of the substrate so as to bly locations, assembled onto printed circuit boards, and face the second side of the substrate. It is also preferred that then provided With EMI shields. the shield is interconnected on the second side With the 35 ground member. When the ground member is situated Within SUMMARY OF THE INVENTION the substrate, the shield is connected by electrical pathWays extending through the substrate to the ground member, the The present invention provides an electronic package pathWays advantageously being soldered to the shield. This Which is of speci?c convenience in use and may simplify is conveniently done by spot soldering. Alternatively, rivets manufacture of electronic circuitry assemblies. make electrical contact betWeen the shield and the ground Accordingly, the invention provides an electronic package member. Where hoWever the ground member is provided comprising: a rigid planar dielectric substrate; an electronic upon either side of the substrate, then perforations must be component mounted upon a ?rst side of the substrate and provided in the ground member to provide insulating clear having terminals connected to a plurality of ?rst level ance betWeen the ground member and the ?rst or second terminal interconnects provided upon the ?rst side of the 45 level terminal interconnects as the case may be. board; a covering EMI shield extending over the electronic The invention also provides an assembly of a mother component and being electrically interconnected to a ground board and an electronic package incorporating a rigid planar member of the substrate; and a plurality of second level daughter board substrate, the package further comprising an interconnects mounted upon a second side of the substrate electronic component mounted upon a ?rst side of the and electrically interconnected through the substrate to the daughter board and having terminals connected to a plurality ?rst level interconnects. of ?rst level terminal interconnects provided upon the ?rst The substrate can be, for example, a printed circuit board side of the board, a covering EMI shield extending over the or a ceramic substrate. electronic component and being electrically interconnected The invention provides a package Which includes its oWn to a ground member of the daughter board; and a plurality individual EMI shield for the electronic components for 55 of second level interconnects mounted upon a second side of assembly by the second level interconnects onto a further the daughter board and electrically interconnecting through and larger substrate Which also carries its oWn circuitry. The the daughter board to the ?rst level interconnects, the second ground member preferably extends across substantially the level interconnects serving to mount the electronic package Whole area of the substrate and With this arrangement, a onto the mother board. complete Faraday cage is provided for the electronic The invention further includes a method of making an component, the Faraday cage comprising the ground mem electronic package comprising: mounting an electronic com ber and the EMI shield Which is electrically connected to it. ponent upon a rigid planar dielectric substrate With terminals Thus, in a package according to the invention, the rigid of the component connected to ?rst level terminal intercon substrate of the package provides a daughter board for nects located on a ?rst side of the substrate; and locating an incorporation onto a motherboard i.e. the larger substrate. 65 EMI shield upon the substrate so as to cover the electronic The invention has particular advantages When the elec component, and electrically connecting the shield to a tronic component comprises an integrated circuit component ground member of the substrate, the ?rst level terminal Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page6 of 8
5,838,551 3 4 interconnects being interconnected With second level inter combination With the ground plane to Which it is grounded connects located on a second side of the substrate. provides a Faraday cage for all electronic and electrical components and circuitry Within the cage. Hence, the elec BRIEF DESCRIPTION OF THE DRAWINGS tronic package 10 may be said to provide a “Faraday caged ball grid array” package. Embodiments of the invention Will noW be described, by The ?nished electronic package is pre-manufactured for Way of example, With reference to the accompanying later assembly onto a mother board. This pre-manufactured draWings, in Which: package 10 comprises its oWn EMI shield 22 for electronic FIG. 1 is a cross-sectional vieW through an electronic components of the package Which need EMI shielding so package according to a ?rst embodiment; 10 that subsequent shielding of these components after addition FIG. 2 is an isometric vieW of an EMI shield forming part to the mother board is avoided. In addition, the package of the package of FIG. 1; provides a structure Which may be handled With physical FIG. 3 is a vieW similar to FIG. 1 of the package mounted protection offered by the shield to the components during upon a mother board; storage, and for shipping purposes before being incorporated onto the mother board. Further, With the EMI shield con FIG. 4 is a vieW similar to FIG. 1 of an electronic package 15 according to a second embodiment; nected to the ground plane of the substrate 12, the pre-built structure is provided With its oWn Faraday cage as indicated FIG. 5 is an isometric vieW of the package of FIG. 4; above for protection of the electronic components beneath FIG. 6 is a cross-sectional vieW similar to FIG. 4 shoWing the shield, the Faraday cage provided on one side by the the manufacture of the package of the second embodiment shield 22 and on the other side by the plane 30 connected to during one manufacturing stage; and the shield by the electrical pathWays 32. FIG. 7 is a vieW similar to FIG. 4 With the package of the As shoWn by FIG. 3, the electronic package 10 is second embodiment mounted upon a mother board. assembled onto a mother board 34 by the second level interconnects being connected to circuitry on the mother DESCRIPTION OF THE PREFERRED boards and holding the package 10 in position. The package EMBODIMENTS 25 10, in this arrangement does, of course, provide only one of the structures carried upon the mother board Which also In a ?rst embodiment as shoWn in FIG. 1, an electronic includes other electronic components (not shoWn) and pos package 10 comprises a rigid planar dielectric substrate in sibly together With other electronic packages 38 basically the form of a printed circuit board 12. Carried upon an upper similar in construction to the device 10. surface of the board are a plurality of electronic components As may be seen therefore, and as indicated above, the comprising at least one (in this case three) integrated circuit assembly of the packages 10 and 38 onto the mother board component 14 and as shoWn, a capacitor or resistor 16. The 34 simpli?es the ?nal assembly process With the mother electronic components are provided on the upper surface of board in that the packages 10 and 36 have their Faraday the board With ?rst level interconnects 18 by Which the cages already provided thereby eliminating the necessity for terminals of the components are connected by circuit paths these to be added subsequently onto the mother board. This 35 in the board 12 With second level interconnects 20 on the is a distinct advantage for the ?nal manufacture of the total loWer surface of the board. Possibly the components 14 and 16 are also electrically interconnected together through the electronic structure. substrate 12. The second level interconnects 20 may be The EMI shield need not necessarily be attached to the solder balls or columns as required for connection to cir upper side of the board as shoWn in the ?rst embodiment. cuitry of a mother board as Will be described. The ?rst level For instance, as shoWn in a second embodiment from FIG. interconnects 18 may also be solder balls, but alternatively 4 onWards, and in Which parts similar to those described in are bond ?ngers for use in conventional Wire bonding the ?rst embodiment bear the same reference numerals, an techniques or for use in tape automated bonding electronic package 40 has an EMI shield 42 Which is of slightly different structure from that shoWn in the ?rst The electronic components are covered on the upper side embodiment. As shoWn in the second embodiment in FIGS. of the board by an EMI shield 22 Which extends across them. 45 4 and 5, the shield 42 has a top Wall 44 and depending side The shield 22 has a closed top 24 and doWnWardly depend Walls 46 Which have outWardly extending ?anges 48 similar ing side Walls 26 terminating in outWardly extending ?anges to the ?anges 28 of the ?rst embodiment. HoWever, in the 28. The structure of this shield is more clearly shoWn in FIG. second embodiment, the ?anges 48 extend outWardly 2. The shield may be formed from a single sheet of metal beyond edges of the board 12 and curve around the edges of Which is punched-out and then pressed into its desired shape. the board to terminate in ?ange edge regions 50 Which are In this case the side Walls 26 Would be slightly spaced apart disposed beneath and directly face the loWer surface of the by the pressing operation at the vertical corners of the board. These edge regions 50 are connected to the ground structure (this arrangement not being shoWn). In the plane by circuit paths 52 extending into the board. In the embodiment, the structure 22 is formed by a forming and structure of the second embodiment, the ?anges 48 in pressing operation from a ?at blank sheet of metal so that all 55 extending around edges of the board 12 provide EMI the side Walls 26 interconnect at the corners With each other protection for circuitry Within the board 12 itself and the as Well as With the top Wall 24. overlap betWeen the edge regions 50 of the ?anges 48 and The shield 22 is interconnected With a ground plane 30 edge regions of the ground plane 12 substantially complete extending substantially throughout the printed circuit board a closed Faraday cage around all of the electronic compo 12, this interconnection being provided possibly by rivets nents and the board circuitry. This is particularly the case but preferably by solder connections, at spaced intervals Where the ground plane lies toWards the loWer surface of the around the ?anges 28, to electrical pathWays 32 extending board. As shoWn by FIG. 5, the EMI shield 42 Which is into holes around the edges of the board 12 and connecting pressed, in this instance, from sheet metal has slight gaps 53 With the ground plane. betWeen edges of the doWnWardly extending Walls 46. These As Will be appreciated in the above structure, the second gaps hoWever are controlled so as to substantially eliminate level interconnects 20 form an array of solder balls and may 65 any EMI leakage betWeen the ?anges. FIG. 5 also illustrates be referred to in common terminology of the electronic the curved portions of the ?anges 48 extending around the industry as “ball grid array”. In addition, the shield 22 in board 12 to the undersurface of the board. The shield 42 is Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page7 of 8
5,838,551 5 6 preferably provided, as in the ?rst embodiment, With aper 7. A package according to claim 6 Wherein the shield is tures 54 disposed in appropriate locations for air ?oW electrically interconnected With the ground member through through the structure for removing heat from Within the the second side of the substrate. shield. The location of such apertures is a matter of choice 8. A package according to claim 7 Wherein the electrical With the proviso that the top surface 44 may require a large pathWays are connected to the ground member by soldering. unapertured space as shoWn by FIG. 5 in the event that it is 9. An assembly of a mother board and an electronic required to lift the package 40 by vacuum lifting techniques package incorporating a rigid planar daughter board, the for assembly purposes onto a mother board. package further comprising: FIG. 6 shoWs part of the process of assembling the EMI an electronic component mounted upon a ?rst side of the shield 42 onto the board 12 in the second embodiment. The daughter board and having terminals connected to a shield 42 is initially pressed from a planar sheet With plurality of ?rst level terminal interconnects provided opposite side Walls 46 diverging outWardly from each other upon the ?rst side of the board; as they extend from the top Wall 44. This provides a large a covering EMI shield extending over the electronic space betWeen the edge regions 50 of the ?anges 46 suf? component and being electrically interconnected to a cient to enable the shield to be disposed completely over the ground member of the daughter board; board 12 With the edge regions 50 passing doWn around the and a plurality of second level interconnects mounted board toWards the loWer side as shoWn by FIG. 6. Pressure upon a second side of the daughter board and electri is then applied in the direction of the arroWs in FIG. 6 to the cally interconnecting through the daughter board to the side Walls 46 to move opposing side Walls toWards each ?rst level interconnects, the second level interconnects other With the result that the end regions 50 of the side Walls mounting the electronic package onto the mother board pass beneath the printed circuit board 12 and into their ?nal 20 positions shoWn by FIG. 4. A soldering operation is then and electrically connecting the electronic component performed for connection of the edge regions 50 to the With circuitry in the mother board. ground plane as discussed above. 10. A method of making an electronic package compris As shoWn by FIG. 7, the package 40 may then be ing: assembled onto a mother board 52 together With other 25 mounting an electronic component upon a rigid planar electronic components (not shoWn) or other electronic pack dielectric substrate With terminals of the component ages 56 of similar construction to the package 40. Intercon connected to ?rst level terminal interconnects located nection With the circuitry of the mother board is again on a ?rst side of the substrate, the ?rst level terminal performed through the second level interconnects. The interconnects being interconnected With second level advantages of the package 40 of the second embodiment and interconnects located on a second side of the substrate; in its subsequent assembly onto the mother board are as and forming a Faraday cage around the electronic com described for the ?rst embodiment. ponent by locating an EMI shield upon the substrate so What is claimed is: as to cover the electronic component, and electrically 1. An electronic package comprising: interconnecting the shield to a ground member of the a rigid planar dielectric substrate carrying a ground mem 35 substrate, the around member extending across sub ber extending across substantially the Whole area stantially the While area Within the con?nes of the Within the con?nes of the edges of the substrate; edges of the substrate. a covering EMI shield extending over the electronic 11. A method according to claim 10 comprising locating component to locate the electronic component betWeen the shield upon the substrate With an edge region of the the EMI shield and the around member of the substrate, shield extending outWardly beyond each edge of the the EMI shield being electrically interconnected to the substrate, moving the edge regions of the shield inWardly so ground member of the substrate to form With the that the edge regions extend around the edges of the sub strate and face the second side of the substrate; and electri ground member, a Faraday cage around the electronic cally interconnecting the edge regions on the second side of component; the substrate With the ground member. and a plurality of second level interconnects mounted 45 12. A method of assembling an electronic package com upon a second side of the substrate and electrically prising a daughter board onto a mother board Wherein the interconnected through circuit paths in the substrate to package further comprises an electronic component the ?rst level interconnects. mounted upon a ?rst side of and having terminals connected 2. A package according to claim 1 Wherein the electronic to a plurality of ?rst level terminal interconnects located component comprises an integrated circuit component. upon the ?rst side of the daughter board; 3. Apackage according to claim 1 comprising tWo or more a covering EMI shield extending over the electronic electronic components mounted upon the ?rst side of the component and being electrically interconnected to a substrate and at least one of Which is an integrated circuit ground member of the daughter board; component and all of the components are commonly and a plurality of second level interconnects mounted on shielded by the EMI shield. 55 a second side of the daughter board and electrically 4. A package according to claim 3 Wherein tWo or more interconnecting through the daughter board to the ?rst of the electronic components are electrically interconnected by circuitry of the substrate. level interconnects; 5. Apackage according to claim 1 Wherein the EMI shield the method comprising disposing the package With the comprises a single formed sheet of electrically conductive second level interconnects in desired locations With material, the sheet formed With a plurality of spaced aper respect to electrical terminals on one surface of the tures for cooling air circulation. mother board and electrically interconnecting the sec 6. A package according to claim 1 Wherein the shield is ond level interconnects With the electrical terminals of provided by a formed sheet of electrically conductive mate the mother board. rial and Which extends around the shield edges of the substrate so as to face the second side of the substrate. Case5:13-cv-05933-PSG Document1-1 Filed12/23/13 Page8 of 8 UNITED sTATEs PATENT AND TRADEMARK OFFICE CERTIFICATE OF CORRECTION
PATENT NO. : 5,838,551 Page 1 of 1 APPLICATION NO. : 08/691056 DATED : November 17, 1998 INVENTOR(S) : Yee-ning Chan
It is certified that error appears in the above-identified patent and that said Letters Patent is hereby corrected as shown below:
Claim 1: Column 5, between Lines 37 and 38: - insert missing claim element as follows:
--an electronic component mounted upon a ?rst side of the substrate and having terminals connected to a plurality of ?rst level terminal interconnects provided upon the ?rst side of the board,-
Claim 1: Column 5, Line 40: - change the sixth Word “around” to “ground”
Claim 10: Column 6, Line 35: - change the third Word “around” to “ground” Column 6, Line 36: - change the third Word “While” to “Whole”
Signed and Sealed this Twenty-second Day of June, 2010
David J. Kappos Director of the United States Patent and Trademark Of?ce Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page1 of 19
EXHIBIT B
Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page2 of 19
US006037937A Ulllted States Patent [19] [11] Patent Number: 6,037,937 Beaton et al. [45] Date of Patent: *Mar. 14, 2000
[54] NAVIGATION TOOL FOR GRAPHICAL 5,745,716 4/1998 Tchao et al...... 345/350 USER INTERFACE 5,748,926 5/1998 Fukuda et al. .. . 345/358 X 5,760,773 6/1998 Berman et al. 345/347 [75] Inventors: Brian Finlay Beaton, Orleans; Colin g?ig?matsu 9t 91 - _ , , 1e ...... 223$? 25521212165555: Dale 5,809,267 9/1998 Moran et al...... 345/358 ’ ’ 5,812,134 9/1998 Pooser et al...... 345/356 [73] Assignee: Nortel Networks Corporation, CAX FOREIGN PATENT DOCUMENTS [ * ] Notice: This patent issued on a continued pros- 8 13; European 5“? - ecution application ?led under 37 CFR uropean a‘ " 1.53(d), and is subject to the tWenty year 0 684 543 11/1995 European Pat‘ Off’ ' patent term provisions of 35 U.S.C. OTHER PUBLICATIONS 154 a 2 . ( ) IBM Technical Disclosure Bulletin, “Scroll Control Box,” [21] AppL NO‘: 08/985,265 vol. 36, No. 4, Apr. 1993, pp. 399—403. - _ Primary Examiner—Raymond J. Bayerl [22] Flled' Dec‘ 4’ 1997 Assistant Examiner—Thomas Nguyen [51] Int. Cl.7 ...... G06F 3/14; G06F 3/02 Attorney, Agent, or Firm—Finnegan, Henderson, FaraboW, [52] US. Cl...... 345/339; 345/352; 345/347; Garrett & Dunner, L~L-P 345/341; 345/358 [57] ABSTRACT [58] Field of Search ...... 345/358, 352, 345/353, 341, 354, 350, 348, 347, 356 The system and method consistent With the present inven tion provides improved graphical navigation tool for elec [56l References Cited tronic devices. The graphical navigation tools may be used Us‘ PATENT DOCUMENTS to navigate through documents at any direction at varying speeds. The navigation tool is preferably transparent to 4,954,967 9/1990 Takahashi ...... 364/518 prevent obscuring the teXt of the underlying document. 5,297,253 3/1994 Meisel 395/348 Accordingly, the navigational tool does not take up addi 5a563a996 10/1996 Tchao 345/341 tional screen real estate. The GUI of the present invention 575707109 10/1996 Jens?“ 345/146 may be especially useful in portable electronic devices With 5,590,257 12/1996 Forcler ...... 707/530 Small dis 1a S 5,592,195 1/1997 Misono e161. 345/146 p y‘ 5,600,765 2/1997 Ando et al...... 345/326 X 5,745,116 4/1998 Pisutha-Armond ...... 345/358 24 Claims, 11 Drawing Sheets
MACROMEDI SEARCH] BRAIN | lNDU l l MACROMEDIA SHOCKWAVE
:EHAND Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page3 of 19
U.S. Patent Mar. 14,2000 Sheet 1 0f 11 6,037,937
FIG. 1
FIG. 2 Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page4 of 19
U.S. Patent Mar. 14, 2000 Sheet 2 0f 11 6,037,937
_:82a N-215m .%Davao63 22.5a3.“ _mJ 82-2128m L 05.33% GImm. Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page5 of 19 Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page6 of 19
U.S. Patent Mar. 14, 2000 Sheet 4 0f 11 6,037,937
MEMORY 440
STATIC RAM 442
FLASH ROM 444
TOUCH NAVIGATION DRAWING PROGRAM SCREEN PROGRAM PROGRAM 510 PROGRAM 530 540 520
FIG. 5 Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page7 of 19
U.S. Patent Mar. 14, 2000 Sheet 5 0f 11 6,037,937 (430 [460 (474
FEATURE ‘ ‘ ANALOG H SEQUECEHN PROCESSOR ‘ ' CONTROLLER PANEL
FIG. 6 06>4} FIG. 7A
ACTIVATION AREA
FIG. 7B Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page8 of 19
U.S. Patent Mar. 14, 2000 Sheet 6 0f 11 6,037,937
' MACROMEDI SIJIEARCH BRAIN INDU O MACROMEDIA SHOCKWAVE
FIG. 8 Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page9 of 19
U.S. Patent Mar. 14, 2000 Sheet 7 0f 11 6,037,937
WITHIN-PAGE GATION RCLE
"U m lT'l S 0111 PAG
_/E§€§E FIG. 98
ADDITIONAL CONTROLS FORWARD TO T DOC NT, Bil BAC K, HOME, .
IIHI
FIG. 9C Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page10 of 19
U.S. Patent Mar. 14, 2000 Sheet 8 0f 11 6,037,937 HDMEOMU __ION_ .QE3: EmFZwOwmw HM Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page11 of 19 U.S. Patent Mar. 14, 2000 Sheet 9 0f 11 6,037,937 VIEWING WINDOW DOES NOT MOVE (ACTIVATION AREA) VIEWING WINDOW MOVES SLOWLY VIEWING WINDOW MOVES QUICKLY FIG. 11A VIEWING WINDOW MOVES QUICKLY TO THE PREVIOUS PAGE NEXT PAGE .2 vIEWING WINDOW MOVES ICON ; SLOWLY TO THE PREVIOUS PAGE VIEWING WINDOW MOVES _{ SLOWLY TO THE NEXT PAGE PREVIOUS PAGE :“\ ICON vIEWING WINDOW MOVES QUICKLY TO THE NEXT PAGE FIG. 11B Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page12 of 19 U.S. Patent Mar. 14, 2000 Sheet 10 0f 11 6,037,937 TOUCH POINT DISTRIBUTION FIG. 12 1310 DETERMINE INDIVIDUAL POINTS OF CONTACT MADE BY OBJECT V 130 COMPUTE CENTROID OF DETERMINED POINTS OF CONTACT V 130 COMPUTE STANDARD DEVIATION OF CENTROID 1340 DETERMINE POINTER OF THE OBJECT MAKING CONTACT FIG. 13 Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page13 of 19 U.S. Patent Mar. 14,2000 Sheet 11 0f 11 6,037,937 PRE‘SSURE PEN TIME FIG. 14A PRESSURE A FINGER TlME FIG. 14B Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page14 of 19 6,037,937 1 2 NAVIGATION TOOL FOR GRAPHICAL tions in multiple layers, thus requiring a user to move deeply USER INTERFACE into the hierarchy before reaching the desired function. This is time consuming and renders the GUI cumbersome and RELATED APPLICATIONS ineffective. This application is related to US. patent application, Ser. Therefore, it is desirable to provide navigation tools that No. 08/985,264 (Atty. Docket No. 3884.0116-00), entitled alloW small-siZe devices While maximiZing the use of avail INTELLIGENT TOUCH DISPLAY; and US. patent able screen real estate. application, Ser. No. 08/985,561 (Atty. Docket No. It is also desirable to provide tools to navigate Within a 3884.0117-00), entitled CONTEXTUAL GESTURE document at any direction at varying speeds. 10 INTERFACE, both of Which are ?led concurrently hereWith, It is further desirable to provide navigation tools that can and both of Which are hereby incorporated by reference. be activated Without requiring speci?c electronic devices. In addition, it is further desirable to provide an improved BACKGROUND OF THE INVENTION GUI that simpli?es GUI by recogniZing various character The present invention relates generally to graphical user 15 istics of the touch input. interfaces (GUI), and more particularly to a navigation tool for graphical user interfaces. SUMMARY OF THE INVENTION Until relatively recently, softWare-based documents have Systems and methods consistent With the present inven been primarily vieWed and manipulated on desktop or laptop tion provide graphical control tools for ef?cient navigation computers With relatively large displays, typically 640-480 20 in display devices. pixels or larger. These displays are often large enough to Speci?cally, a method consistent With this invention of display a full page of standard siZe page or at least a controlling display of content information in a physical signi?cant portion of the page. Hence, on-screen graphical vieWing area comprises several steps. Initially, the system menus and controls displayed in WindoW of an application displays the content information in the physical vieWing 25 did not greatly reduce the display area for the underlying area. The system also displays a representation of a control document. Computers also have peripheral devices such as tool over the display of content information. Thereafter, the a keyboard or a mouse to control the display of content system receives a user input selecting the control tool, and information. Thus, vieWing and navigating around a single controls the display of content information according to the page or multi-page document have not posed much dif? user input. culty. 30 A system consistent for this invention for controlling Due to increasing focus on compactness of electronic display of content information in a physical vieWing area devices, hoWever, the displays especially in portable elec includes displaying means, receiving means, and controlling tronic devices are becoming smaller and smaller. Popular means. The displaying means displays the content informa electronic devices With a smaller display area include elec 35 tion in the physical vieWing area, and displays a represen tronic organiZers, PDA’s (personal digital assistants), and tation of a control tool over the display of content informa graphical display-based telephones. Also available today are tion. The receiving means receives a user input selecting the communicators that facilitate various types of communica control tool. Thereafter, the controlling means controls the tion such as voice, faxes, SMS (Short Messaging Services) display of the content information according to the user messages, e-mail, and Internet-related applications. These input. products can likeWise only contain a small display area. 40 To enable users to navigate around a full page of content BRIEF DESCRIPTION OF THE DRAWINGS information, these devices typically provide hard-keys for arroWs as shoWn in FIG. 1. The hard-keys, hoWever, not only The accompanying draWings, Which are incorporated in increase the siZe but also add to the cost of the devices. Also, and constitute a part of this speci?cation, illustrate the hard-keys generally provide limited options for direction of 45 invention and together With the description, serve to explain movement, e.g., vertical or horiZontal. They generally do not the principles of the invention. provide the freedom to move in any direction. In the draWings, Some displays of these devices also require a separate FIG. 1 shoWs conventional hard-key arroWs for naviga stylus having peripheral technology that requires transmis tion control; sion of electromagnetic pulses or light to the display. These FIG. 2 shoWs conventional on-screen graphical naviga devices often require additional controllers such as buttons tion tool; on the body or the tip of the stylus for activation. FIGS. 3A—3B are diagrams of an exemplary mobile Furthermore, these styli require a poWer source, either telephone consistent With the principles of the present inven through Wire or battery, and their compatibility is generally 55 tion; limited to a speci?c device. FIG. 4 is a block diagram shoWing the elements of the As shoWn in FIG. 2, other devices substitute hard-keys mobile telephone of FIG. 3A; With graphical on-screen arroWs or scroll bars that are FIG. 5 is a block diagram shoWing the components of the typically used in full-siZe computer displays. The on-screen memory of FIG. 4; scroll bars, hoWever, occupy valuable screen real estate and 60 compound the limitations of small displays. Similar to the FIG. 6 is a block diagram of touch screen functionalities; hard-keys, the on-screen arroWs also generally restrict the FIGS. 7A—7B shoW an exemplary inactive and active navigational movement to horiZontal or vertical direction. graphical navigation tool, respectively; In other forms of on-screen GUIs, e.g., pop-up menus, FIG. 8 is a sample screen shoWing an active navigation also take up valuable screen space, further reducing the 65 tool; available display area for content information. Additionally, FIGS. 9A—9C shoW exemplary features of the navigation on-screen pop-up menus typically provide available func tool; Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page15 of 19 6,037,937 3 4 FIGS. 10A—10C are sample screens showing the naviga nals and supporting GSM protocols. BOCK 425 supplies the tion tool performing various navigation functions; digital audio signals to VEGA 423 for digital-to-analog FIGS. 11A—11B shoW exemplary features of the naviga conversion. VEGA 423 applies the analog audio signals to tion tool relating to speed of navigation; audio transducers 427. Audio transducers 427 include FIG. 12 is a diagram illustrating a touch point distribution; speaker 428 and microphone 429 to facilitate audio com munication by the user. FIG. 13 is a ?owchart illustrating the process of deter mining the siZe of the object making contact With the Feature processor 430 provides GUI features and a Java vieWing area; and Virtual Machine (JVM). Feature processor 430 communi cates With BOCK 425 using high level messaging over an FIGS. 14A and 14B are graphs shoWing the touch char asynchronous (UART) data link. Feature processor 430 acteristics of a pen and a ?nger, respectively. contains additional system circuitry, such as a liquid crystal DESCRIPTION OF THE PREFERRED display (LCD) controller, timers, UART and bus interfaces, EMBODIMENT and real time clock and system clock generators (not shoWn). Reference Will noW be made in detail to the present 15 Memory 440 stores data and program code used by preferred embodiment of the invention, an example of Which feature processor 430. Memory 440 includes static RAM is illustrated in the accompanying draWings. Where 442 and ?ash ROM 444. Static RAM 442 is a volatile appropriate, the same reference numerals refer to the same memory that stores data and other information used by or similar elements. The appended claims de?ne the scope of feature processor 430. Flash ROM 444, on the other hand, the invention; the folloWing description does not limit that is a non-volatile memory that stores the program code scope. executed by feature processor 430. The graphical navigation tool of the present invention Sliding keypad 450 enables the user to dial a telephone may be implemented in a Wide range of electronic devices number, access remote databases, and manipulate the GUI mentioned above such as electronic organiZers, PDA’s, and features. Sliding keypad 450 preferably includes a mylar graphical display-based telephones. Although the need to 25 resistive key matrix that generates analog resistive voltage in maximiZe the use of screen real estate is most critical in response to actions by the user. Sliding keypad 450 prefer portable electronic devices With small displays, the present ably connects to main housing 210 (FIG. 3A) of mobile invention can also be implemented in full-siZe computers or telephone 310 through tWo mechanical “push pin”-type electronic devices. For purposes of illustration, hoWever, the contacts (FIG. 4). present invention Will be explained in detail in a mobile Analog controller 460 is preferably a Phillips UCB1100 telephone environment. device that acts as an interface betWeen feature processor Speci?cally, FIG. 3A shoWs a mobile telephone 310 and 430 and sliding keypad 450. Analog controller 460 converts FIG. 3B shoWs an exemplary Wireline telephone preferably the analog resistive voltage from sliding keypad 450 to having the graphical navigation tool consistent With the digital signals for presentation to feature processor 430. 35 present invention. Mobile telephone 310 includes main Display module 470 preferably includes a 160x320 pixel housing 210, antenna 320, keypad 330, and display 340. LCD 472 With an analog touch screen panel 474 and an FIG. 4 shoWs the hardWare elements in mobile telephone electroluminescent backlight. LCD 472 operates in conjunc 310 including antenna 410, communications module 420, tion With feature processor 430 to display the GUI features. feature processor 430, memory 440, sliding keypad 450, Analog controller 460 scans touch screen overlay 474 While analog controller 460, display module 470, battery pack 480, feature processor 430 refreshes LCD 472. and sWitching poWer supply 490. Battery pack 480 is preferably a single lithium-ion battery Antenna 410 transmits and receives radio frequency infor With active protection circuitry. SWitching poWer supply 490 mation for mobile telephone 310. Antenna 410 preferably ensures highly ef?cient use of the lithium-ion battery poWer comprises a planar inverted F antenna (PIFA)-type or a short 45 by converting the voltage of the lithium-ion battery into stub (2 to 4 cm) custom helix antenna. Antenna 410 com stable voltages used by the other hardWare elements of municates over a GSM (Global System for Mobile mobile telephone 310. Communications) sWitching fabric using a conventional FIG. 5 is a block diagram illustrating the components of voice B-channel, data B-channel, or GSM signaling channel memory 440. Static RAM 442 stores data and other infor connection. mation used by feature processor 430. Flash ROM 444 Communications module 420 connects to antenna 410 contains various programs including a program 510, a touch and provides the GSM radio, baseband, and audio function screen program 520, a navigation program 530, and a ality for mobile telephone 310. Communications module draWing program 540. Program 520, preferably Written in 420 includes GSM radio 421, VEGA 423, BOCK 425, and languages such as Java, C, or C++ for Macintosh, is a main audio transducers 427. 55 program overseeing the operation of mobile telephone 310. GSM radio 421 converts the radio frequency information Touch screen program 520 facilitates processing of touch to/from the antenna into analog baseband information for input on touch screen panel 474 using a typical touch input presentation to VEGA 423. VEGA 423 is preferably a Texas algorithm. Navigation program 530 handles navigation of Instruments VEGA device, containing analog-to-digital the content information display. DraWing program 540 is a (A/D)/digital-to-analog (D/A) conversion units 424. VEGA graphical draWing package. Programs 520, 530, and 540 423 converts the analog baseband information from GSM may be one of any commercially available packages or a radio 421 to digital information for presentation to BOCK user-de?ned feature program or macro. 425. The present invention provides various features through BOCK 425 is preferably a Texas Instruments BOCK tactile GUI. Initially, LCD 472 displays various GUI fea device containing a conventional ARM microprocessor and 65 tures. Referring to FIG. 6, a user touches touch screen panel a conventional LEAD DSP device. BOCK 425 performs 474 to provide user input, for example, to navigate around GSM baseband processing for generating digital audio sig a document or invoke a desired function. Analog controller Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page16 of 19 6,037,937 5 6 460 scans touch screen panel 474 and reads the correspond not display the respective previous or next page icons. This ing analog voltage of touch screen panel 474. Analog Would apply to one-page documents, or When the user is at controller 460 then converts the analog values into corre the beginning or end of a multi-page document. In one sponding digital values representing the Cartesian embodiment consistent With the present invention, a coordinates, Which are transmitted to feature processor 430 momentary touch of the next page icon causes navigation for processing. The resolution of the touch input depends on program 530 to jump to the next page While a continuous the ability of analog controller 460 to discern among mul touch on the next page icon causes navigation program 530 tiple levels of analog values, generally de?ned in bits. to continue scrolling through succeeding pages of the under FIGS. 7A—7B shoW an exemplary graphical navigation lying document. The previous page icon may embody simi tool preferably used to navigate around documents that are 10 lar characteristics. too large to vieW Within a single screen of a physical display The user may also control the speed of the navigation. As (hereinafter referred as “vieWing area”). The navigation tool shoWn in FIG. 11A, the speed of the navigation accelerates may be used to vieW any kind of document including faxes, as the user touch moves from the center of the circle toWard Web pages, or e-mail. In one embodiment consistent With the circumference of the circle, i.e., tip of the arroW. Hence, the present invention, an inactive navigation tool is dis 15 the vieWing WindoW moves sloWly When the user touches played and accessible to the user at all times (FIG. 7A). The the blunt end of the arroW located at the center of the circle user may activate the navigation tool by touching and While the speed accelerates as the user moves the ?nger holding the center of the navigation tool for a predetermined toWards the tip of the arroW. The speed of navigation, time period, for example, one to tWo seconds (FIG. 7B). An therefore, is determined by the distance of the touch relative activated navigation tool is preferably transparent to avoid to the center of the circle. LikeWise, similar principles apply hindering the display of content information in the vieWing to previous or next page/document icons Where a touch area as shoWn in FIG. 8. Alternatively, the navigation star closer to the outer edge of the previous or next page/ may change colors or other features of its appearance to document icons accelerates navigation through the docu indicate its active status. A solid line image, for example, ment as shoWn in FIG. 11B. may be used in greyscale displays that do not support 25 Although the exemplary transparent tool discussed above transparency. is for navigation, transparent control tools may be imple The present invention may be designed such that feature mented for a variety of functions. Atransparent tool may, for processor 430 ignores any touch input on the navigation tool example, be used for a Web broWser application Where the unless the navigation tool has been activated. Instead, the controls may be used for appropriate functions such as touch input may be interpreted as input to access control moving forWards or backWards through different Web pages buttons in the underlying document, Write on the underlying or returning to home page. One skilled in the art may easily document, or invoke other functions related to the underly vary the design or the functionality of the graphical navi ing document. This Will prevent against unintentional navi gation tools described above Without departing from the gation in the vieWing WindoW in case the user inadvertently scope of the present invention. 35 touches touch screen panel 474. In an alternative In an exemplary embodiment of a navigation tool embodiment, the present invention may accept stylus input described above, a ?nger touch invokes navigational func to access the underlying document While a ?nger or non tions based on the feature selected and the location of the electromagnetic touch on any part of the navigation tool user touch. Alternatively, other objects making contact With invokes the navigation function. touch screen panel 474 may invoke other tools or functions. Referring to FIGS. 9A—9C, once the navigation tool is Apointy stylus touch, for example, may invoke a menu With activated, the user may navigate through the document by cardinal points representing multiple line Widths, colors, or selecting the graphical arroWs, e.g., up, right, left, and doWn patterns. arroWs (FIG. 9A), or graphical page icons, e.g., previous or In another embodiment consistent With the present next page (FIG. 9B). One skilled in the art may vary the type 45 invention, tools or application programs may be stored in and number of graphical tools signi?cantly. For example, the ?ash ROM 444 to provide related interfaces to the user. The navigation tool may provide graphical representations for use of a ?nger may, for example, invoke tools or dialogues forWard, next document, back, or home functions (FIG. 9C). that are ?nger-touchable and large Whereas the use of a sharp FIGS. 10A—10C shoW exemplary screen displays While stylus may invoke a modi?ed GUI With smaller touch the user is touching the navigation tool. Upon touching the targets. In a yet another embodiment, in a document vieWing right arroW of the navigation tool, for example, the right application normally navigable by a ?nger touch, use of a arroW is highlighted and navigation program 530 moves the sharp stylus may automatically invoke a document annota display to the right (FIG. 10A). Similarly, touching the doWn tion application for marking up the underlying document. arroW moves the display doWn (FIG. 10B). Although the As described above, the touch-responsive GUI of the four arroWs are presented to guide the users, navigation 55 present invention are facilitated though various components program 530 supports navigational movement at any direc including touch screen panel 474, analog controller 460, and tion. If the user touches an area of the navigation tool feature processor 430. Speci?cally, analog controller 460 equidistant betWeen the up and right arroWs, for example, scans touch screen panel 474 to read the corresponding navigation program 530 Will move the display toWards the analog voltage of touch screen panel 474 activated by a user upper-right portion of the underlying document at a touch. Analog controller 460 then converts the analog values 45-degree angle. Touching the arroWs or any area in into a digital value representing the Cartesian coordinates, betWeen, moves the display in the selected direction until Which is transmitted to feature processor 430 for processing navigation program 530 reaches the edge of the page. according to the functionalities of the present invention. Touching the next page icon moves the vieWing WindoW When a user touches touch screen panel 474, program 510 to the next page of the underlying document (FIG. 10C). If 65 initiates touch screen program 520 to determine the pointer a particular document does not have a page corresponding to siZe of the object making contact With touch screen panel a previous or next page icon, navigation program 530 Will 474 based on a touch point distribution or pointer siZe of the Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page17 of 19 6,037,937 7 8 touch input. As shown in FIG. 12, touch screen program 520 quick drag to the right may invoke a draWing tool to draW can, for example, determine Whether the pointer size of the from the starting point to the ending point of the touch object is a ?nger or a sharp object. points. In a document vieWing application, the same touch FIG. 13 is a ?owchart illustrating the process of deter may invoke a navigation tool to move the vieW of the mining the siZe of the object making contact With the document in the direction of the ?nger drag. vieWing area. Touch point program 520 ?rst determines the All of the above functions and features described above individual points of contact made by the object (step 1310). focuses on providing intuitive GUIs and minimiZe the need It computes a centroid, or other average point, of the for users to memoriZe complicated, hierarchical menus or determined points of contact (step 1320). Touch program procedures. Additionally, the present invention maximiZe 520 then computes a standard deviation of the centroid as 10 available screen real estate While providing a Wide array of Well as the variance (step 1330), and determines the pointer GUI and tools. siZe based on the centroid and the standard deviation (step 1340). These computations are preferably performed on a It Will be apparent to those skilled in the art that various real-time basis to provide immediate system response to the modi?cations and variations can be made in the system of the present invention and in construction of this system touch input. In order to achieve optimum results and 15 accuracy, analog touch controller 460 preferably generates Without departing from the scope or spirit of the invention. 150 points per second or more. Touch program 520 may also Other embodiments of the invention Will be apparent to use the amount of pressure imposed on touch screen panel those skilled in the art from consideration of the speci?ca 474 as a function of time to determine the siZe of object. As tion and practice of the invention disclosed herein. The shoWn in FIG. 14A, for example, if the amount of pressure speci?cation and examples should be considered as exem increases or decreases sharply at a particular instant in time, plary only, With the true scope and spirit of the invention touch point program 520 may determine that the touch indicated by the folloWing claims. What is claimed is: corresponds to a pen. A ?nger touch, on the other hand, 1. A method of activating functions responsive to a user results in a gradual increase and decrease in pressure as input, comprising: illustrated by a smoother curve in FIG. 14B. 25 Program 510 can also be programmed to correlate certain providing a manipulable area portion in a physical vieW pointer siZe to certain objects and invoke corresponding ing area, said manipulable area portion having at least functions or tools. Such GUI provides a richer, yet simpli?ed one manipulation function associated thereWith; interaction betWeen the user and mobile telephone 310. If displaying a representation of a control tool overlaying program 510 determines that the pointer siZe of the object the manipulable area portion, said control tool having corresponds to the siZe of a ?nger, program 510 may initiate at least one control tool function associated thereWith; a navigation tool. If the pointer siZe corresponds to the siZe receiving a user input to the physical vieWing area cor of several ?ngers, program 510 may invoke a drag function responding to the manipulable area portion and the of the navigation tool. On the other hand, if program 510 representation of the control tool; determines that the pointer siZe of the object corresponds to 35 determining if the user input selects the control tool; and siZe of a sharp point or pen, program 510 may initiate a activating the at least one manipulation function When the draWing tool supported by draWing program 540. Similarly, user input does not select the control tool or permitting if program 510 determines that the pointer siZe of the object the at least one control tool function to be activated corresponds to siZe of a pencil eraser, program 510 may When the user input does select the control tool. initiate an erase function of the draWing tool. One skilled in 2. The method of claim 1, Wherein the at least one control the art may easily vary the functions or tools initiated by tool function includes a function of changing a display of program 510. Additionally, the functions or tools may be information in the manipulable area portion, the method commercial softWare packages, predetermined functions, or further including: user-de?ned macros. after at least one control tool function is permitted to be In addition to using the pointer siZe to determine the 45 activated, receiving a subsequent user input selecting a desired GUI, program 510 can also incorporate other char predetermined portion of the control tool; and acteristics of the user touch, e.g., gestures or movements, to activating the function of changing a display of informa simplify GUI and maximiZe screen real estate. A gesture tion in response to the subsequent user input. recogniZing interface extends the ability of the present 3. The method of claim 2, Wherein the function of invention to distinguish betWeen different siZed pointers to changing a display of information includes shifting infor track gestures and movement of user input based on vector mation in the manipulable area portion. direction and magnitude, all in the context of active user 4. The method of claim 3, Wherein the shifting includes application. This type of contextual gesture interface can scrolling. infer by context, the implement, and the gesture chosen by 5. The method of claim 3, Wherein the shifting includes the user What functions the user Wishes to invoke. 55 jumping. Accordingly, all these functions are available Without menus 6. The method of claim 2, Wherein the function of or scroll bars and do not require additional screen areas to changing a display of information includes control of the display the functions. speed of the change of the display of information based on Program 510 recogniZes other characteristics of the touch the subsequent user input. input including the context of the input, namely the task or 7. The method of claim 2, Wherein the changing includes sub-task applications running When the GUI is invoked. If a displaying a different one of a plurality of pages of infor user is in a document navigation application, for example, mation. program 510 interprets a quick drag to the right as a next 8. The method of claim 1, Wherein the displaying a page function. If the underlying task is an editing representation of the control tool includes displaying arroWs application, program 510 may interpret the same gesture as 65 indicating direction. a highlight function and highlight a portion of the document 9. The method of claim 1, Wherein the information touched by the user. Similarly, in graphics application, a displayed in the manipulable area portion includes a portion Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page18 of 19 6,037,937 9 10 of a document and wherein the at least one control tool means for activating the function of changing a display of function includes a function related to the document. information in response to the subsequent user input. 10. The method of claim 1, Wherein the displaying the 15. The apparatus of claim 14, Wherein the function of representation of the control tool includes displaying a changing a display of information includes shifting infor virtually transparent representation of the control tool. 11. The method of claim 1, Wherein the displaying the mation in the manipulable area portion. representation of the control tool includes displaying an 16. The apparatus of claim 15, Wherein the shifting opaque representation of the control tool. includes scrolling. 12. The method according to claim 1, Wherein the at least 17. The apparatus of claim 15, Wherein the shifting one manipulation function includes an editing function for a 10 includes jumping. document. 18. The apparatus of claim 14, Wherein the function of 13. An apparatus for activating functions responsive to a user input, comprising: changing a display of information includes control of the means for providing a manipulable area portion in a speed of the change of the display of information based on physical vieWing area, said manipulable area portion the subsequent user input. having at least one manipulation function associated 19. The apparatus of claim 14, Wherein the changing thereWith; includes displaying a different one of a plurality of pages of means for displaying a representation of a control tool information. overlaying the manipulable area portion, said control 20. The apparatus of claim 13, Wherein the means for tool having at least one control tool function associated displaying a representation of the control tool includes thereWith; displaying arroWs indicating direction. means for receiving a user input to the physical vieWing area corresponding to the manipulable area portion and 21. The apparatus of claim 13, Wherein the information the representation of the control tool; displayed in the manipulable area portion includes a portion means for determining if the user input selects the control of a document, and Wherein the at least one control tool tool; and 25 function includes a function related to the document. means for activating the at least one manipulation func 22. The apparatus of claim 13, Wherein the means for tion When the user input does not select the control tool displaying the representation of the control tool includes or permitting the at least one control tool function to be displaying a virtually transparent representation of the con activated When the user input does select the control trol tool. tool. 14. The apparatus of claim 13, Wherein the at least one 23. The apparatus of claim 13, Wherein the means for control tool function includes a function of changing a displaying the representation of the control tool includes display of information in the manipulable area portion, the displaying an opaque representation of the control tool. apparatus further including: 24. The apparatus according to claim 13, Wherein the at means for receiving a subsequent user input selecting a 35 least one manipulation function includes an editing function predetermined portion of the control tool, after at least for a document. one control tool function is permitted to be activated, and Case5:13-cv-05933-PSG Document1-2 Filed12/23/13 Page19 of 19 UNITED STATES PATENT AND TRADEMARK OFFICE CERTIFICATE OF CORRECTION PATENT NO. : 6,037,937 DATED = March 14, 2000 INVENTOR(S) : . Bnan Beaton, et 211. It is certified that error appears in the above-identified patent and that said Letters Patent is hereby corrected as shown below: Title page, col. 1, item [73], after "Assignee: Nortel Networks Corporation," "CAX" should be --CANADA--. Signed and Sealed this Nineteenth Day of December, 2000 Q. TODD DICKINSON Arresting O?‘icer Commissioner of Palenrs and Trademarks Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page1 of 13 EXHIBIT C Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page2 of 13 US006128298A United States Patent [19] [11] Patent Number: 6,128,298 W00tt0n et al. [45] Date of Patent: Oct. 3, 2000 [54] INTERNET PROTOCOL FILTER Carl—Mitchell, et al., “Building Internet Firewalls”, Unix Worla', Feb. 1992, pp. 93—103. [75] Inventors: Bruce Anthony Wootton, Raleigh, Chapman, “Network (In)Security Through IP Packet Filter NC; William G. Colvin, Milton, ing”, UNIX Security Symposium III Proceedings, Balti Canada more, MD, Sep. 14—16, 1992, pp. 63—76. [73] Assignee: Nortel Networks Corporation, Cheswick, “The Design of a Secure Internet Gateway”, Montreal, Canada USENIX Summer Conference, Anaheim, CA, Jul. 11—15, 1990, pp. 233—237. Ho, “Implementation of a Secure Gateway on Hughes [21] Appl. No.2 08/842,328 Aircraft’s Engineering Design Network”, 15”” Conference [22] Filed: Apr. 24, 1997 on Local Computer Networks, IEEE, Minneapolis, MN., Sep. 30—Oct. 3, 1990, pp. 180—182. Related US. Application Data Hoover, “Securing the Enterprise, Firewalls Can Keep You [60] Provisional application No. 60/015,945, Apr. 24, 1996. from Getting Burned”,Internet World, Feb. 1995 , pp. 39—47. [51] Int. C1.7 ...... H04L 12/56 Koblas, et al., “SOCKS”, UNIX Security Symposium III [52] US. Cl...... 370/392, 370/390, 370/401, Proceedings, Baltimore, MD, Sep. 14—16, 1992, pp. 77—83. 713/201 Lottor, “TCP Port Service Multiplexer (TCPMUX)”, Inter [58] Field Of Search ...... 370/351, 352, net rfc 1078 (1988), pp. 1,2. 370/355, 389, 390, 392, 393, 400, 401, Luotonen, et al., “World—Wide Web Proxies”, Computer 402, 409, 395/2006, 200.62, 200.68, 20072, Networks and ISDN Systems 27 (1994), pp. 147—154. 713/201 (List continued on neXt page.) [56] References Cited Primary Examiner—Ajit Patel U.S. PATENT DOCUMENTS Assistant Examiner—Bob A. Phunkulh Attorney, Agent, or Firm—Foley & Lardner 5,309,437 5/1994 Perlman et al...... 370/401 5,383,179 1/1995 Saini et al...... 370/393 [57] ABSTRACT 5,400,334 3/1995 Hayssen ...... 370/245 5,606,668 2/1997 Shwed. The IP ?lter, embodying the present invention, is a commu 5,623,601 4/1997 Vu. nications device designed to provide public network or 5,778,174 7/1998 Cain. Internet access to nodes of private networks, advantageously 5,781,550 7/1998 Templin et al...... 370/401 without requiring the private nodes on such networks to 5,793,763 8/1998 Mayes et al...... 370/389 5,826,014 10/1998 Coley et al. . register public Internet addresses. The IP ?lter presents a 5,835,726 11/1998 Shwed et al. . single IP address to the Internet and uses a plurality of IP ports to solve the problem of IP address conservation. It FOREIGN PATENT DOCUMENTS initiates sessions by assigning private side IP sessions to a unique port of the IP ?lter’s public address. The IP ?lter 0 465 201 1/1992 European Pat. Off. . effects a translation between a source port number for the OTHER PUBLICATIONS private network and a destination port number for the public network for communication therebetween. Bene?ts of the IP Axner, “Differing Approaches to Virtual LANs”, Business ?lter include private node security and conservation of Communications Review, Dec. 1993, pp. 42—45. Internet-registered addresses. Bryan, “Build a Firewall”, Byte, Apr. 1995, pp. 91—96. Bryan, “Firewalls for Sale”, Byte, Apr. 1995, pp. 99—104. 32 Claims, 2 Drawing Sheets /6 INTERNET PRIVATE PUBLIC N ETWORK NETWORK Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page3 of 13 6,128,298 Page 2 OTHER PUBLICATIONS Tolly, “Evaluating Port Switching Hubs—A reality check Marotta, et a1., “Internetworking Data Services”, 16th Con for virtual workgroups”, Data Communications, Jun. 1993, ference on Local Computer Networks, IEEE, Minneapolis, pp. 52—62. MN, Oct. 14—17, 1991, pp. 223—229. Treese, et al., “X Through the Firewall, and Other Applica PanZieri, et a1., “Interfacing UNIX to Data Communications tion Relays”, USENIX Summer 1993 Technical Conference, Networks”, IEEE Transactions on Software Engineering, vol. SE—11, Oct. 1985, pp. 1016—1032. Cincinnati, OH, Jun. 21—25, 1993, pp. 87—98. Schauer, et al., “An Internet Gatekeeper”, UNIX Security Cheswick and Bellovin, “Firewalls and Internet Security: Symposium III Proceedings, Baltimore, MD, Sep. 14—16, Repelling the Wily Hacker”, Addison—Wesley, 1994, pp. 1992, pp. 49—61. 34—36, 54—75. Schroeder, et al. “Autonet: A High Speed, Self—Con?guring Local Area Network Using Point—to—Point Links”, IEEE Comer, “Internetworking with TCP/IP”, Prentice—Hall, Inc., Journal on Selected Areas in Communications, vol. 9, No. 8, 1988, pp. 120—127, 137—141, 194, 195, 208—214, 346, 347. Oct. 1991, pp. 1318—1334. Shapiro, “Structure and Encapsulation in Distribution Sys McClimans, “Workarounds Ease the IP Address Shortage”, tems: The Proxy Principle”, The 6th International Confer Data Communications, section Software Views, vol 24, No. ence on Distributed Computing Systems, IEEE, Cambridge, 2, Feb. 23, 1995, (p. 33), pp. 3—5. MA, May 19—23, 1986, pp. 198—204. Snyder, “Choosing the Right Firewall to Defend Your Net Kostick, “Building a Linux Firewall”, Linux Journal, Apr. work” Network World, vol. 12, No. 10, Mar. 5, 1995, p. 1. 1996, pp. 49, 52, 53, 55, 57, 58, 61. Stephensen, “A Blueprint for Firewalls”, LAN Magazine, Egevang et al., “Internet Engineering Task Force, USA” Feb. 1995, pp. 63—70. XP2040992 pp. 1—8 (1994). Tam, et al. “CAPNET—An Approach to Ultra High Speed Networ ”, IEEE International Conference on Communica Stallings, “Internet Security Handbook” XP2040993 pp. tions, 1990, pp. 323.1.1—323.1.7. 27—37 (1995). Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page4 of 13 U.S. Patent 0a. 3, 2000 Sheet 1 of2 6,128,298 INTERNET PR IVATE NETWORK NETWORK FIG. I Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page5 of 13 U.S. Patent 0a. 3, 2000 Sheet 2 of2 6,128,298 /2 \ 40 \ ADDRESS usER A 42 TRANSLATION INTERFACE 33 '— lP HANDLER 34 '- ARP ETHERNET TABLE ‘\36 30 '- PACKET DRIVER PACKET DRIVER A 32 /0 /4 H.W. H.W. PRIVATE PUBLIC NETWORK NETWORK FIG. 2 Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page6 of 13 6,128,298 1 2 INTERNET PROTOCOL FILTER According to a third eXemplary aspect, the invention provides a method of operating a ?lter node for interfacing This application is based on provisional application ?rst and second data communications netWorks, comprising 60/015,945 ?led Apr. 26, 1996. the steps of: receiving from the ?rst netWork, a data packet having destination information, Which includes a destination BACKGROUND OF THE INVENTION address and a destination port, corresponding to a node in The present invention generally relates to internetWork the second netWork and having source information, Which ?reWalls and, in particular, to an internet protocol (IP) ?lter includes a source address and a source port, corresponding Whereby a private IP netWork domain is mapped to a single to a node in the ?rst netWork; maintaining the source IP address on the public Internet. 10 information taken from the data packet in correlation With a FireWalls are generally knoWn and characteriZed by com unique value representing a port of the ?lter node; replacing in the data packet the source address With an address of the puter servers Which function to couple nodes Within the domain of the private netWork to nodes in a public netWork ?lter node and the source port With the ?lter node port value; and sending to the second netWork the data packet having domain, such as the Internet. A de?ciency of the knoWn ?reWall products is the need for a unique public IP address 15 the replaced source information, Whereby that packet is routed according to its destination information to the corre for each concurrent session or interaction betWeen public and private nodes. sponding second netWork node. A ?reWall providing conservation of public IP addresses According to a fourth exemplary aspect, the invention Would be desirable. provides a ?lter node for interfacing ?rst and second data communications netWorks, comprising: means for receiving SUMMARY OF THE INVENTION from the ?rst netWork, a data packet having destination information, Which includes a destination address and a It is an object of the present invention to provide a neW destination port, corresponding to a node in the public and improved apparatus for communicatively coupling tWo netWork and having source information, Which includes a netWorks. 25 source address and a source port, corresponding to a node in The invention, therefore, according to a ?rst exemplary the ?rst netWork; means for maintaining the source infor aspect provides a method of interfacing private and public mation taken from the data packet in correlation With a data communications netWorks, through a ?lter node in unique value representing a port of the ?lter node; means for communication With both netWorks, the ?lter node having replacing in the data packet the source address With an an address knoWn in the public netWork, comprising the address of the ?lter node and the source port With the ?lter steps of: routing from nodes in the private netWork, to the node port value; and means for sending to the second ?lter node, data packets having destination information, netWork, the data packet having the replaced source Which includes a destination address and a destination port, information, Whereby that packet is routed according to its corresponding to nodes in the public netWork and having destination information to the corresponding second net source information, Which includes a source address and a 35 Work node. source port, of the respective private netWork nodes; for each data packet received from the private netWork, at the An IP ?lter, embodying the present invention, is a com munications device designed to provide public netWork or ?lter node, maintaining the source information taken from the data packet in correlation With a unique value represent Internet access to nodes of private netWorks, advantageously Without requiring the private nodes on such netWorks to ing a port of the ?lter node, and replacing in the data packet register public Internet addresses. The IP ?lter presents a the source address With the ?lter node address and the source single IP address to the Internet and uses a plurality of IP port With the ?lter node port value; and routing from the ports to solve the problem of IP address conservation. It ?lter node, in the public netWork, the data packets having the initiates sessions by assigning private side IP sessions to a replaced source information, according to the destination unique port of the IP ?lter’s public address Whereby up to information in each, to the corresponding public netWork 45 64,512 (=65,536 total —1,024 Well knoWn ports) concurrent nodes. sessions may be supported through the single IP address. According to a second exemplary aspect, the invention The IP ?lter effects a translation betWeen a source port provides a method of interfacing private and public data number for the private netWork and a destination port communications netWorks, through a ?lter node in commu number for the public netWork for communication therebe nication With both netWorks, comprising the steps of: (a) tWeen. Bene?ts of the IP ?lter include private node security receiving at the ?lter node, from the private netWork, a data and conservation of Internet-registered addresses. packet having an a destination address corresponding to a node in the public netWork and a source address correspond In a particular embodiment, the IP ?lter may support three ing to a node in the private netWork; (b) maintaining, by the data transport protocols over the internet protocol: transmis ?lter node, the source address taken from the data packet; (c) 55 sion control protocol (TCP), user datagram protocol (UDP) replacing, in the data packet, the source address With an and Internet control message protocol (ICMP). Packets of address of the ?lter node; (d) routing from the ?lter node, in other protocols may be ignored. the public netWork, the data packet having the replaced The TCP protocol prepends a TCP header to a data packet. source address, according to the destination address, to the The source port and destination port numbers are contained corresponding public netWork node; (e) Waiting for a return in this header. The Internet addresses of the source and packet from the public netWork, responsive to the data destination nodes are contained in the IP header. The IP packet having the replaced source information; replacing, address and port information extracted from each packet Will in the return packet, the destination address With the main be used to determine Where the IP ?lter should route this tained source address; and (g)routing from the ?lter node, in packet. the private netWork, the return packet having the replaced 65 The IP ?lter maintains a lookup table of information on destination address to the corresponding private netWork each TCP connection. This information includes the port node. from the private node, the private IP address, the assigned Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page7 of 13 6,128,298 3 4 port number of the destination node, and the port number of address packets. The relationship betWeen the tWo addresses the IP ?lter in the form of an index. When a packet is is dynamic; that is, a node With an IP address may change its received from the private network, the private address and Ethernet address. The information in the address table is port number are added to the table as a neW entry, if an entry obtained from the replies to the node’s broadcast of ARP corresponding to this packet is not found in the table and if packets. The source node broadcasts ARP packets to request the TCP header indicates that this is a neW connection the Ethernet address of the destination node, given the request. Then the source address and port number in the destination node’s IP address. If the destination node packet header are replaced With the IP ?lter’s IP address and receives the packet, it sends a reply packet With the port number, and the packet is transmitted to the Internet. requested information. When the IP ?lter receives a packet from the Internet, the 10 Though it does not maintain a true ARP table, the IP ?lter destination port number is used to index the lookup table. passes ARP packets in a manner similar to TCP and UDP When the corresponding table entry is found, the destination packet passing. When the IP ?lter receives an ARP packet address and port number are replaced With the private from a node on the private netWork destined for the public networks IP address and port number, and the packet is netWork, it replaces the source address information With the transmitted to the private netWork. If the received packet’s 15 ?lter’s address information. The private node’s IP address source port is different from the port recorded in the table, and the target IP address are placed in a lookup table. When and if the packet header information indicates that this the target node replies With its oWn Ethernet address, the packet is the ?rst response on the connection, then the destination address information is changed from that of the lookup table is updated With the port number assigned by the IP ?lter to that of the private node before transmitting the Internet node, if needed. When the IP ?lter detects an end of packet to the private node. The private node address infor transmission code in the packet, the lookup table entry is mation is obtained from the table. When an ARP packet is Zeroed. If the IP ?lter receives packets from the Internet that destined for the ?reWall, the ARP packet does not pass do not have entries in the lookup table corresponding to the through the IP ?lter but is restricted to communications IP ?lter port, it ignores the packets. betWeen the ?lter and the one side of the netWork. The UDP protocol is connectionless, as opposed to TCP, 25 Events and errors encountered by the IP ?lter may be a connection-oriented protocol. The UDP header contains no logged, for example, by Writing them into a text ?le. codes governing initial connection or end of transmission. The IP ?lter ideally Will process packets as fast as the The data of interest in the UDP header are the source port netWorks present them but When netWork traf?c is too heavy, and destination port. This information, along With the Inter the IP ?lter Will then buffer the packets in tWo queues, one net addresses contained in the IP header, are used to deter for the private netWork and one for the Internet. mine Where the IP ?lter should route this packet. TWo source and destination lookup tables may be utiliZed, The IP ?lter maintains a lookup table of information on one for TCP packets and the other for UDP packets. Each each UDP session. When the IP ?lter receives a UDP packet table is directly indexed by the IP ?lter port number assigned from the private netWork, it records the source address, the to the communication session. The table entries contain the 35 source port number, the destination port number, and the IP address of the private node, the source port of the private assigned IP ?lter port number as the index to the table. Then node, and the destination port of the Internet node. If there the private node address and port number in the packet is no connection on a certain IP ?lter port, then the corre header are replaced With the address and assigned port sponding entry in the table may be Zeroed. Packets arriving number of the IP ?lter. Then the packet is transmitted to the from both the private netWork and the Internet are processed Internet. using the same lookup table. This arrangement assumes that When the IP ?lter receives a UDP packet from the of the available IP ?lter communications ports some are Internet, it indexes the UDP lookup table and replaces the designated for UDP communication and some for TCP packet’s destination information, namely the IP ?lter address communication. and assigned port number, With the private address and port 45 number from the lookup table. The lookup table also main BRIEF DESCRIPTION OF THE DRAWINGS tains an interval indication for an expiration timer on data The invention Will be better understood from the folloW gram packets received as per standard UDP implementa ing description together With reference to the accompanying tions. If the IP ?lter receives packets from the Internet that draWings, in Which: do not have entries in the lookup table corresponding to the FIG. 1 is a schematic representing an internet protocol IP ?lter port, it ignores the packets. ?lter coupling a private netWork and a public netWork; and As ICMP packets do not contain port numbers of either FIG. 2 is a block diagram representing internal compo source or destination, any ICMP packets received from the nents of the ?lter. private netWork are processed one at a time, With buffering DETAILED DESCRIPTION of additional ICMP packets. The IP ?lter reads the private 55 address from the packet header and replaces it With the Referring to FIG. 1, shoWn for illustration of the present address of the IP ?lter. The packet is transmitted to the invention is a private netWork 10 communicatively coupled Internet, and the IP ?lter Waits for the response. When it through an internet protocol (IP) ?lter 12 to a public netWork receives the responding packet, the destination address in 14 Which may form part of a global data netWork, otherWise the packet header is changed from that of the IP ?lter to that referred to as the Internet 16. The private netWork 10 of the node on the private netWork. Then the IP ?lter represents a conventional data communications netWork, transmits the packet to the private netWork. such as a local area netWork (LAN), having a plurality of To successfully deliver packets over an IP protocol nodes 18 each being identi?ed by a unique IP address Within netWork, each node must maintain a table of other hosts’ IP the domain of the private netWork 10. The public netWork 14 addresses and their corresponding Ethernet addresses in an 65 and Internet 16 are representative of public domain data Ethernet based data communications netWork. The nodes communications netWorks also having a plurality of nodes actually use the IP addresses and the Ethernet addresses to 20 With corresponding IP addresses. Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page8 of 13 6,128,298 5 6 The IP ?lter 12 acts as a gateway through which data where frIP is the IP address of the IP ?lter 12 on the public packets are exchanged between the private network 10 and network 14, and frPort is the index into the translation table the public network 14, thereby providing Internet access to plus an offset value, for example, of 1024 to skip using well the nodes 18 of the private network 10. The IP ?lter 12 known ports. The frPort represents an arbitrary port. constitutes one of the private network nodes 18 and is the The internet node 20 will reply with a packet only such node to have a public IP address that is Internet registered, whereby the IP ?lter 12 essentially also consti tutes one of the public nodes 20 and its IP address is known (iIP, iPort—frIP, frPort) in the public domain. The IP addresses of the other private which will be received by the IP ?lter 12 and translated network nodes 18 are reserved for the private network 10, thereby to and not known or registered in the public Internet address domain. As is conventional, associated with the IP address of the IP ?lter 12 are a plurality of IP ports, speci?cally (iIP, iport—pIP, pPort) 65,536 in total of which 64,512 are not reserved for pre de?ned protocols and can be used for address translations. 15 In general, to translate from the private side, the values Communications between nodes 18 on the private net (protocol type, pIP, pPort, iIP, iport) must be located in the work 10 are unaffected by the presence of the IP ?lter 12, but translation table. This should be done with a hash table to access the public network 14 and particularly the nodes 20 lookup. therein, the private nodes 18 route all communications Translating from the public side can be a direct table requests through the IP ?lter 12. The IP ?lter 12 manages the lookup since frPort minus 1024 is the index into the table. communications between private nodes 18 and the Internet If (iIP, iport) in the packet does not match the corresponding nodes 20 by modifying header information of data packets entries in the table, then an unauthoriZed access is logged received from the private network 10 before transmitting and the packet dropped. each to the public network 14. The modi?cations cause the In translating packets, when a port is substituted in the communications between the private nodes 18 and the 25 TCP or UDP header, the checksum in both the TCP/UCP and public Internet nodes 20 to actually be between the IP ?lter IP header must be recalculated. When an IP address is 12 and the Internet nodes 20, which route all return com substituted in the IP header, the IP header checksum must be munications to the IP ?lter 12 which subsequently routes the recalculated. return data packets to the private nodes 18. Following are special considerations for different proto The IP ?lter 12 accepts no connection requests from the cols supported by the IP ?lter 12. public network 14. All communications between private In respect of TCP, when a SYN packet is received from nodes 18 and public nodes 20 are initiated by the private the private network 10, the IP ?lter 12 locates an unused nodes 18. The IP ?lter 12 is designed to support three data entry in the table and ?lls it in, setting the type to TCP and transport protocols over the internet protocol: TCP, UDP and state to SYN. Then the packet is forwarded by the general ICMP messages; packets of other protocols are rejected or 35 scheme above. If no free entries exist in the table, then the ignored. packet is dropped and the event is logged. If a SYN packet is received from the public network 14 Atranslation table is maintained by the IP ?lter 12 to map interface, it is treated as unauthoriZed and logged (except for address and ports for packets received from the private FTP special case described below). However, a SYN+ACK network 10 destined to the public network 14 and vise versa. packet is forwarded if the state of the translation table entry The translation table contains the following for each entry: is SYN. After forwarding such a packet the state set to OPEN. If a FIN packet is received by the IP ?lter 12 and if the private IP address (PIP) state in the translation table is not FIN, the state is set to FIN private port (pPort) 45 and the packet forwarded. If the state is FIN, then the packet internet (public) IP address (iIP) is forwarded and the translation table entry is deleted by internet (public) Port (iPort) timer setting it to 0. AFIN must be sent by each side to close a TCP session type/state connection. Ethernet address If a RST packet is received, then the translation table entry is deleted. The basic translation substitutes IP addresses and ports from Having regard now to the UDP protocol, when any UDP the private network side to the IP ?lter’s IP address and packet is received from the private network 10 side, the IP ports, thereby hiding all nodes 18 on the private network 10 ?lter 12 ?rst tries its standard lookup. If a translation table from the public network 14. entry is not found, an unused entry is set up and the state set Apacket originating on the private network side speci?es 55 to OPEN. If a free entry is not found in the table, then rather a source—destination of than dropping the packet, a random UDP in the table is overwritten. Since UDP is connectionless and consequently an unreliable transport, if a packet is received from the (pIP, pPort—iIP, iPort) public network 14 that would have needed the entry that was overwritten, that packet will be dropped and the node 18 on This de?nes a “socket” in which the endpoints of the the private side will need to retry. connection (source and destination) are de?ned by the IP With regard to FTP, an FTP client establishes a TCP addresses in the IP header and the ports in the TCP or UDP “control” connection with an FTP server on a particular port, header. for example, port 21. However, when data is to be The IP ?lter 12 will translate the above to 65 transmitted, the FTP server will open a TCP connection from its “data” port, for example, which is default 20, to a (frIP, frPort—iIP, iport) destination port speci?ed by the client. Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page9 of 13 6,128,298 7 8 To support this, packets sent by the private network 10 to drivers 30 and 32, an address resolution protocol (ARP) port 21 need to be analyzed for an FTP “port” command at table 34, an Ethernet address table 36, an IP handler 38, an the IP ?lter 12. If detected, then a neW entry in the table must address translation 40 and a user interface 42. The packet be set up With pPort set to the value in the FTP port drivers 30 and 32 control the Ethernet hardWare interfaces in command. The IP address and port number in the FTP order to communicate With, respectively, the private netWork command must be changed to the IP ?lter’s address and port 10 and the public netWork 14. The IP handler 38 provides a before forwarding the packet. The state is set to FTPDATA. router functionality for receiving and forWarding messages, When a SYN packet is received from the public netWork and maintains the ARP table 34 and the Ethernet table 36. 14, if a table entry exists and is in FTPDATA state, then the The address translation 40 effects translation betWeen source packet is forWarded and the state set to OPEN. 10 port numbers from the private netWork 10 and the destina For the ICMP protocol, if an ICMP packet is received tion port numbers on the public netWork side 14. The user from the private netWork 10 and if that packet is an echo interface 42 enables an operator, via a keyboard and display request (ping), then the IP ?lter 12 locates a neW entry in the terminal attached to the processing platform, to interface translation table. The sequence ?eld of the packet is stored With the IP ?lter 12. Functions keys are provided to con?g in pPort in the table and the table indeX is put in the sequence 15 ure the IP ?lter, vieW or copy log ?les, display status, etc. ?eld of the packet. The ICMP checksum is recalculated and The log ?le Will contain the connect time of TCP or UDP the standard IP header substitution is done. The type is set sessions, inbound and outbound traf?c statistics, and invalid to ICMP and state to PING and the timer set to 1 minute. access to the IP ?lter 12. To prevent the log ?le from If an echo reply (ping) is received from the public netWork groWing too large, this information Will be logged to a neW 14 interface, then the sequence ?eld is used as the indeX into ?le When the date changes. the table. If the state is PING, then pPort in the table is Routing of packets to and from the IP ?lter 12 is described substituted into the sequence ?eld of the packet, the ICMP in the folloWing in terms of a public interface, from the vieW checksum recalculated and the standard IP header substitu of the public netWork 14, and of a private interface, from the tion is done. The table entry is then deleted. vieW of the private netWork 10. If an echo request (ping) is received from the public 25 The public interface behaves as a host on the LAN netWork 14, then the IP ?lter 12 Will reply. This alloWs segment. To forWard a packet, it checks to see if the internet access to con?rm that the IP ?lter 12 is reachable destination IP is on the local LAN segment. If it is, it looks and running. up the IP address in its ARP table to ?nd the Ethernet If a Destination Unreachable packet is received from the address. If there is no entry in the ARP table, it must put the public netWork 14, then the header information contained is packet on a queue and send out an ARP request to get the eXtracted. If the protocol Was TCP or UDP, the (frIP, Ethernet address. Standard aging out of ARP table entries frPort—iIP, iport) of the originating packet can be deter needs to be done. If the IP destination is not on the LAN mined and the translation table entry located. segment, it Will forWard the packet to the con?gured default If the IP address eXtracted from the ICMP matches the router. ICMP Redirect messages sent by the default router address in the table, the IP ?lter 12 forWards the packet to the 35 Will be ignored. private netWork 10 using the standard scheme. The private interface effects the functionality of a router, All other ICMP packets received from either side are as it needs to be able to forWard packets to one or more dropped and logged. routers to communicate With the remote client stations. A Since most data communications protocols are based on large remote client netWork may access multiple router either the UDP or TCP protocols, these other protocols are machines. Conventional routing can result in large routing compatible With the IP ?lter 12 as long as they do not initiate tables because the routing entries become host addresses negotiations like FTP to have the server open a connection instead of subnet addresses. That is, if the netWork is set up back to the client. Examples of other compatible protocols so that a client may come in through either Router1 or include: Telnet; TFTP (Trivial File Transfer Protocol); DNS Router2, then no single router can be the router for the (Domain Name Services); and Web broWsers. 45 subnet that that client station is on. A conventional router Whenever a packet is transmitted in either direction, the that Would get routing tables via RIP from all routers on the timer ?eld of the translation table entry is set to the con?g private netWork Would end up With a large table of host ured timeout value (except ping). Each minute, the timer addresses for each remote client connected. This can affect ?eld of all active entries in the tables are decremented and performance in the search time necessary to ?nd the route, if they become 0, then the translation table entry is deleted. the memory required for large tables and the amount of RIP This Will clear out UDP and PING entries Which are no traffic on the LAN segment betWeen all these routers. longer in use and also TCP entries Which have had an To handle routing in this environment, the IP ?lter Will abnormal termination and did not send FIN from each side. maintain an Ethernet table. For every packet that is for It could be a security hole to leave an unused entry in the Warded from the private to public side, if a translation entry table for too long. A good timeout value to be con?gured 55 eXists, use its Ethernet indeX to compare With the Ethernet Would be just longer than the typical TCP keep alive. source address of the incoming packet. If they match, According to a particular embodiment, the private net nothing more needs to be done. OtherWise, the Ethernet Work 10 and the public netWork 14 are Ethernet based table is searched for the source Ethernet address, adding a LANs. The IP ?lter 12 may be implemented by a data neW Ethernet table entry if not found. The indeX to the processing platform Which is equipped With tWo conven Ethernet table is then saved in the translation table entry. tional Ethernet hardWare interfaces connected to netWorks Then When a packet is being translated from the public to 10 and 14, respectively, and Which is provisioned With private side, the Ethernet address can be retrieved directly appropriate softWare to implement the functionality of the IP from the indeX in the translation table. Thus packets Will be ?lter 12. routed to the router Which forWarded the packet to the IP Internal components of the IP ?lter 12 in terms of soft 65 ?lter. Ware eXecutable by the data processing platform are shoWn Those skilled in the art Will recogniZe that various modi in FIG. 2. The internal components include tWo packet ?cations and changes could be made to the invention With Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page10 of 13 6,128,298 9 10 out departing from the spirit and scope thereof. It should a destination port, corresponding to nodes in the public therefore be understood that the claims are not to be con netWork and having source information, Which includes sidered as being limited to the precise embodiments set forth a source address and a source port, of the respective above, in the absence of speci?c limitations directed to each private netWork nodes; embodiment. for each outgoing data packet received from the private What is claimed is: netWork, at the ?lter node, maintaining the source 1. A method of interfacing private and public data com information taken from the outgoing data packet in munications networks, through a ?lter node in communica correlation With a unique value representing a port of tion With both networks, the ?lter node having an address the ?lter node, and replacing in the outgoing data packet the source address With the ?lter node address knoWn in the public netWork, comprising the steps of: 10 and the source port With the ?lter node port value; routing from nodes in the private netWork, to the ?lter routing from the ?lter node, to nodes in the public node, outgoing data packets having destination netWork, the outgoing data packets having the replaced information, Which includes a destination address and source information, according to the destination infor a destination port, corresponding to nodes in the public mation in each, to the corresponding public netWork netWork and having source information, Which includes 15 nodes; a source address and a source port, of the respective routing from nodes in the public netWork, to the ?lter private netWork nodes; node, incoming data packets each having the address of for each outgoing data packet received from the private the ?lter node as the destination address; netWork, at the ?lter node, maintaining the source for each incoming data packet received from the public information taken from the outgoing data packet in netWork, at the ?lter node, correlating the destination correlation With a unique value representing a port of port of the destination information in the incoming data the ?lter node, and replacing in the outgoing data packet to particular source information being main packet the source address With the ?lter node address tained and replacing, in the incoming data packet, the and the source port With the ?lter node port value; and destination information With the particular source infor routing from the ?lter node, to nodes in the public 25 mation; netWork, the outgoing data packets having the replaced routing from the ?lter node, in the private netWork, the source information, according to the destination infor incoming data packets having the replaced destination mation in each, to the corresponding public netWork information to the corresponding private netWork nodes. nodes; 2. A method as claimed in claim 1, comprising the steps ignoring by the ?lter node any incoming data packet of: received from the public netWork, if the destination port of the destination information in that incoming routing from nodes in the public netWork, to the ?lter data packet can not be correlated to the maintained node, incoming data packets each having the address of source information, the ?lter node as the destination address; 35 Wherein maintaining the source information includes stor for each incoming data packet received from the public ing the source information from each outgoing data netWork, at the ?lter node, correlating the destination packet as an entry in a lookup table, and the ?lter node port of the destination information in the incoming data port value correlating to the source information con packet to particular source information being main stitutes an indeX into the table for that entry; tained and replacing, in the incoming data packet, the Wherein the incoming and outgoing data packets include destination information With the particular source infor packets in accordance With a transmission control pro mation; tocol (TCP) over an internet protocol (IP); and routing from the ?lter node, in the private netWork, the receiving at the ?lter node an outgoing TCP packet from incoming data packets having the replaced destination the private netWork; and if an entry corresponding to information to the corresponding private netWork 45 the outgoing TCP packet is not found in the lookup nodes. table and the outgoing TCP packet indicates that this is 3. Amethod as claimed in claim 2, comprising ignoring by a connection request, storing the source information the ?lter node any incoming data packet received from the together With the destination information from the public netWork, if the destination port of the destination outgoing TCP packet as a neW entry in the lookup table. information in that incoming data packet can not be corre 7. A method as claimed in claim 6, comprising receiving lated to the maintained source information. at the ?lter node an incoming TCP packet from the public 4. A method as claimed in claim 3, Wherein maintaining netWork; and if the source port in the received incoming TCP the source information includes storing the source informa packet is different from the destination port in a source tion from each outgoing data packet as an entry in a lookup information entry of the lookup table, indeXed by the des table, and the ?lter node port value correlating to the source 55 tination port in the outgoing TCP packet, and if the incoming information constitutes an indeX into the table for that entry. TCP packet indicates that this packet is a ?rst response to the 5. Amethod as claimed in claim 4, Wherein the incoming connection request, then updating by the ?lter node the and outgoing data packets include packets in accordance destination port in the table entry With the source port from With a transmission control protocol (TCP) over an internet the received incoming TCP packet. protocol (IP). 8. A method as claimed in claim 7, comprising receiving 6. A method of interfacing private and public data com at the ?lter node any incoming TCP packet having an end of munications netWorks, through a ?lter node in communica transmission code in the packet and Zeroing an entry in the tion With both netWorks, the ?lter node having an address lookup table corresponding to that received incomingTCP knoWn in the public netWork, comprising the steps of: packet. routine from nodes in the private netWork, to the ?lter 65 9. A method as claimed in claim 4, Wherein the data node, outgoing data packets having destination packets include packets in accordance With a user datagram information, Which includes a destination address and protocol (UDP) over an internet protocol (IP). Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page11 of 13 6,128,298 11 12 10. A method of interfacing private and public data (c) replacing, in the data packet, the source address with communications networks, through a ?lter node in commu an address of the ?lter node, wherein the source address nication with both networks, the ?lter node having an includes a port number of the node in the private address known in the public network, comprising the steps network and the address of the ?lter node includes a of: port number of the ?lter node; routing from nodes in the private network, to the ?lter (d) routing from the ?lter node, in the public network, the node, outgoing data packets having destination data packet having the replaced source address, accord information, which includes a destination address and ing to the destination address, to the corresponding a destination port, corresponding to nodes in the public public node network; network and having source information, which includes 10 (e) waiting for a return packet from the public network, a source address and a source port, of the respective responsive to the data packet having the replaced private network nodes; source information; for each outgoing data packet received from the private (f) replacing, in the return packet, the destination address network, at the ?lter node, maintaining the source with the maintained source address; and information taken from the outgoing data packet in 15 (g) routing from the ?lter node, in the private network, the correlation with a unique value representing a port of return packet having the replaced destination address to the ?lter node, and replacing in the outgoing data the corresponding private network node. packet the source address with the ?lter node address 12. A method as claimed in claim 11, comprising and the source port with the ?lter node port value; buffering, at the ?lter node, further data packets received routing from the ?lter node, to nodes in the public from the private network while waiting for the return packet, network, the outgoing data packets having the replaced and repeating steps (b) through (g) on an individual basis for source information, according to the destination infor the further packets, if any, that were buffered. mation in each, to the corresponding public network 13. A method as claimed in claim 12, wherein the data nodes; packets include packets in accordance with an internet 25 control message protocol (ICMP). routing from nodes in the public network, to the ?lter 14. A method of operating a ?lter node for interfacing ?rst node, incoming data packets each having the address of and second data communications networks, comprising the the ?lter node as the destination address; steps of: for each incoming data packet received from the public receiving from the ?rst network, an outgoing data packet network, at the ?lter node, correlating the destination having destination information, which includes a des port of the destination information in the incoming data tination address and a destination port, corresponding packet to particular source information being main to a node in the second network and having source tained and replacing, in the incoming data packet, the information, which includes a source address and a destination information with the particular source infor source port, corresponding to a node in the ?rst net mation; 35 work; routing from the ?lter node, in the private network, the maintaining the source information taken from the out incoming data packets having the replaced destination going data packet in correlation with a unique value information to the corresponding private network representing a port of the ?lter node; nodes: replacing in the outgoing data packet the source address ignoring by the ?lter node any incoming data packet with an address of the ?lter node and the source port received from the public network, if the destination with the ?lter node port value; and port of the destination information in that incoming sending to the second network the outgoing data packet data packet can not be correlated to the maintained having the replaced source information, whereby the source information, packet is routed according to its destination information 45 wherein maintaining the source information includes stor to the corresponding second network node. ing the source information from each outgoing data 15. A method as claimed in claim 14, further comprising packet as an entry in a lookup table, and the ?lter node the steps of: port value correlating to the source information con receiving from the second network, an incoming data stitutes an indeX into the table for that entry; packet having the address of the ?lter node as the wherein the data packets include packets in accordance destination address; with a user datagram protocol (UDP) over an internet correlating the destination port of the destination infor protocol (IP); and mation in the incoming data packet to particular source receiving at the ?lter node a UDP data packet from the information being maintained; private network, and adding the source information and 55 replacing, in the incoming data packet, the destination the destination information from the UDP packet information with the particular source information; together with an interval indication for an expiration sending to the ?rst network the incoming data packet timer as a new entry in the lookup table. having the replaced destination information, whereby 11. A method of interfacing private and public data that packet is routed according to its destination infor communications networks, through a ?lter node in commu mation to the corresponding ?rst network node. nication with both networks, comprising the steps of: 16. A method as claimed in claim 15, comprising ignoring (a) receiving at the ?lter node, from the private network, the incoming data packet received from the second network, a data packet having a destination address correspond if the destination port of the destination information in that ing to a node in the public network and a source address data packet can not be correlated to the maintained source corresponding to a node in the private network; 65 information. (b) maintaining, by the ?lter node, the source address 17. Amethod as claimed in claim 16, wherein maintaining taken from the data packet; the source information includes storing the source informa Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page12 of 13 6,128,298 13 14 tion from the outgoing data packet as an entry in a lookup then updating the destination port in the table entry With the table, and the ?lter node port value correlating to the source source port from that received incoming TCP packet. information constitutes an index into the table for that entry. 21. A method as claimed in claim 20, comprising receiv 18. A method as claimed in claim 17, Wherein the incom ing any incoming TCP packet having an end of transmission ing and outgoing data packets include packets in accordance code in the packet, and Zeroing an entry in the lookup table With a transmission control protocol (TCP) over an internet corresponding to that received incoming TCP packet. protocol (IP). 22. A method as claimed in claim 17, Wherein the out 19. A method of operating a ?lter node for interfacing ?rst going and incoming data packets include packets in accor and second data communications netWorks comprising the dance With a user datagram protocol (UDP) over an internet steps of: 10 protocol (IP). 23. A method of operating a ?lter node for interfacing ?rst receiving from the ?rst netWork, an outgoing data packet and second data communications netWorks, comprising the having destination information, Which includes a des steps of: tination address and a destination port, corresponding to a node in the second netWork and having source receiving from the ?rst netWork, an outgoing data packet information, Which includes a source address and a 15 having destination information, Which includes a des source port, corresponding to a node in the ?rst net tination address and a destination port, corresponding Work: to a node in the second netWork and having source information, Which includes a source address and a maintaining the source information taken from the out source port, corresponding to a node in the ?rst net going data packet in correlation With a unique value Work: representing a port of the ?lter node; maintaining the source information taken from the out replacing in the outgoing data packet the source address going data packet in correlation With a unique value With an address of the ?lter node and the source port representing a port of the ?lter node; With the ?lter node port value; replacing in the outgoing data packet the source address sending to the second netWork the outgoing data packet 25 With an address of the ?lter node and the source port having the replaced source information, Whereby that With the ?lter node port value; packet is routed according to its destination information sending to the second netWork the outgoing data packet to the corresponding second netWork node, having the replaced source information, Whereby that receiving from the second network, an incoming data packet is routed according to its destination information packet having the address of the ?lter node as the to the corresponding second netWork node; destination address: receiving from the second netWork, an incoming data correlating the destination port of the destination infor packet having the address of the ?lter node as the mation in the incoming data packet to particular source destination address; information being maintained; correlating the destination port of the destination infor replacing, in the incoming data packet, the destination 35 mation in the incoming data packet to particular source information With the particular source information; information being maintained; sending to the ?rst netWork the incoming data packet replacing, in the incoming data packet, the destination having the replaced destination information Whereby information With the particular source information; that packet is routed according to its destination infor sending to the ?rst netWork the incoming data packet mation to the corresponding ?rst netWork node; having the replaced destination information, Whereby ignoring the incoming data packet received from the that packet is routed according to its destination infor second netWork, if the destination port of the destina mation to the corresponding ?rst netWork node; and tion information in that data packet can not be corre ignoring the incoming data packet received from the lated to the maintained source information, 45 second netWork, if the destination port of the destina Wherein maintaining the source information includes stor tion information in that data packet can not be corre ing the source information from the outgoing data lated to the maintained source information, packet as an entry in a lookup table, and the ?lter node Wherein maintaining the source information includes stor port value correlating to the source information con ing the source information from the outgoing data stitutes an index into the table for that entry packet as an entry in a lookup table, and the ?lter node Wherein the incoming and outgoing data packets include port value correlating to the source information con packets in accordance With a transmission control pro stitutes an index into the table for that entry; tocol (TCP) over an internet protocol (IP): and Wherein the outgoing and incoming data packets include receiving an outgoing TCP packet from the ?rst netWork; packets in accordance With a user datagram protocol and if an entry corresponding to the outgoing TCP 55 (UDP) over an internet protocol (IP); and packet is not found in the lookup table and the outgoing receiving a UDP data packet from the ?rst netWork, and TCP packet indicates that this is a connection request, adding the source information and the destination infor storing the source information together With the desti mation from the UDP packet together With an interval nation information from the TCP packet as a neW entry indication for an expiration timer as a neW entry in the in the lookup table. a O lookup table. 20. A method as claimed in claim 19, comprising receiv 24. A method of operating a ?lter node for interfacing ?rst ing any incoming TCP packet from the second netWork; and and second data communications netWorks, comprising the if the source port in that received incoming TCP packet is steps of: different from the destination port in a source information (a) receiving from the ?rst netWork, a data packet having entry of the lookup table, indexed by the destination port in a destination address corresponding to a node in the the outgoing TCP packet, and if that incoming TCP packet second netWork and a source address corresponding to indicates that it is a ?rst response to the connection request, a node in the ?rst netWork; Case5:13-cv-05933-PSG Document1-3 Filed12/23/13 Page13 of 13 6,128,298 15 16 (b) maintaining the source address taken from the data means for replacing, in the data packet, the destination packet; information With the particular source information; and (c) replacing, in the data packet, the source address With means for sending to the ?rst netWork the data packet an address of the ?lter node, Wherein the source address having the replaced destination information, Whereby includes a source port number and the address of the that packet is routed according to its destination infor ?lter node includes a port number of the ?lter node; mation to the corresponding ?rst netWork node. (d) sending to the second netWork the data packet having 29. A?lter node as claimed in claim 28, comprising means the replaced source address, Whereby that packet is for ignoring a data packet received from the second netWork, routed to the corresponding second netWork node; if the destination port of the destination information in that (e) receiving a return packet from the second network, data packet can not be correlated to the maintained source responsive to the data packet having the replaced information. source information; 30. A ?lter node as claimed in claim 29, Wherein the (f) replacing, in the return packet, the destination address means for maintaining the source information includes With the maintained source address; and 15 means for storing the source information from the data (g) sending to the ?rst netWork the return packet having packet as an entry in a lookup table, and Wherein the ?lter the replaced destination address, Whereby that packet is node port value correlating to the source information con routed to the corresponding ?rst netWork node. stitutes an indeX into the table for that entry. 25. A method as claimed in claim 24, comprising buffer 31. A ?lter node for interfacing ?rst and second data ing further data packets received from the ?rst netWork communications netWorks, comprising: While Waiting for the return packet, and repeating steps (b) through (g) on an individual basis for the further packets, if (a) means for receiving from the ?rst netWork, a data any, that Were buffered. packet having a destination address corresponding to a 26. A method as claimed in claim 25, Wherein the data node in the second netWork; packets include packets in accordance With an internet 25 (b) means for maintaining the source address taken from control message protocol (ICMP). the data packet; 27. A ?lter node for interfacing ?rst and second data (c) means for replacing, in the data packet, the source communications netWorks, comprising: address With an address of the ?lter node, Wherein the means for receiving from the ?rst netWork, a data packet source address includes a source port number and the having destination information, Which includes a des address of the ?lter node includes a port number of the tination address and a destination port, corresponding ?lter node; to a node in the second netWork and having source (d) means for sending to the second netWork the data information, Which includes a source address and a source port, corresponding to a node in the ?rst net packet having the replaced source address, Whereby Work; 35 that packet is routed to the corresponding second netWork node; means for maintaining the source information taken from the data packet in correlation With a unique value (e) means for receiving a return packet from the second representing a port of the ?lter node; netWork, responsive to the data packet having the means for replacing in the data packet the source address replaced source information; With an address of the ?lter node and the source port (f) means for replacing, in the return packet, the destina With the ?lter node port value; and tion address With the maintained source address; and means for sending to the second netWork, the data packet (g) means for sending to the ?rst netWork the return having the replaced source information, Whereby that packet having the replaced destination address, packet is routed according to its destination information 45 Whereby that packet is routed to the corresponding the to the corresponding second netWork node. ?rst netWork node. 28. A ?lter node as claimed in claim 27, comprising: 32. A?lter node as claimed in claim 31, comprising means means for receiving from the second netWork, a data for buffering further data packets received from the ?rst packet having the address of the ?lter node as the netWork While Waiting for the return packet, and means for destination address; controlling means (b) through (g) on an individual basis for means for correlating the destination port of the destina processing the further packets, if any, that Were buffered. tion information in the data packet to particular source information being maintained; Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page1 of 27 EXHIBIT D Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page2 of 27 US006333973B1 (12) United States Patent (10) Patent N0.: US 6,333,973 B1 Smith et al. (45) Date of Patent: *Dec. 25, 2001 (54) INTEGRATED MESSAGE CENTER 5,742,905 * 4/1998 Pepe et al...... 455/461 5,794,142 * 8/1998 Vantilla et al...... 455/419 (75) Inventors: Colin Donald Smith, Ottawa; Brian 5,815,506 * 9/1998 Gokhale ------370/524 Finlay Beaton, Orleans, both of (CA) 5,842,141 * 11/1998 Vaihoja et al...... 455/574 (73) Assignee: Nortel Networks Limited (CA) (Llst Con?rmed on next page‘) FOREIGN PATENT DOCUMENTS (*) Notice: This patent issued on a continued pros ecution application ?led under 37 CFR 0 630 141 12/1994 (EP) 1.53(d), and is subject to the tWenty year 0 691 777 1/1996 (EP) - patent term provisions of 35 U.S.C. W0 96 15490 5/1996 (EP) ' 154(a)(2)_ 8268227 10/1996 (JP) . Subject to any disclaimer, the term of this OTHER PUBLICATIONS Pawnt is extended or adjusted under 35 Hattori et al., “A Multimedia Intelligent Message Commu U-S-C- 154(k)) by 0 days- nication System for Distributed Coordination Environ ments,” Electronics & Communications in Japan, Part (21) Appl. No.: 08/842,020 1—Communications, vol. 76, No. 1, Jan. 1, 1993, pp. 11—23. - _ “Nokia 9000 Communicator User’s Manual,” Nokia Cor (22) Flled' Apr‘ 23’ 1997 poration, 1996, pp. 1—1 through 16—1 (48 pages total). (51) Int. Cl.7 ...... H04M 1/64; H04M 11/00; H04M 3/42; H04Q 7/20 Primary Examiner—Allan Hoosain (52) US. Cl...... 379/8812; 379/67.1; 379/8811; (74) Attorney, Agent, or Firm—Finnegan, Henderson, 379/8822; 379/9308; 455/412; 455/413; FarabOW, Garrett & Dunner, L-L-P _ 455/466 (57) ABSTRACT (58) Field of Search ...... 379/8801, 88.11, 379/93.01, 93.08, 93.17, 100.01, 100.08, An integrated message center operates on telecommunica 88.22, 111, 112, 113, 211, 230, 246, 88.12, tions equipment, having a display and a processor, to con 114.06, 114.07, 88.23, 88.24; 455/445, solidate messages of different types for vieWing and manipu 517, 417, 459, 419, 433, 466, 422, 38-1, lation by a user. The telecommunications equipment 412, 413, 414; 370/347, 337, 349, 498, receives noti?cation messages corresponding to pending 524; 341/20—23 messages of different types and determines the message type of the pending messages. The integrated message center (56) References Clted associates a message type indicator With each of the received U'S' PATENT DOCUMENTS noti?cation messages based on the determined message type and displays on the display a portion of the received noti 5,228,029 * 7/1993 KotZin ...... 370/95.1 ?cation messages and the associated message type indicators 5,283,638 * 2/1994 Engberg et al------348/14 as entries in a single selectable list. The user can select one 5,327,486 * 7/1994 Woltf et al...... 379/96 of the pending messages for retrieval based on the entries in * 5103129; et al- - the single selectable list. In response to user selection, the , , y e- omson ...... ~ ~ - 5,568,540 * 10/1996 Greco etal...... 379/88 czgéeingitini‘lftsioghi sitllicfirpendmg 5,583,920 * 12/1996 Wheeler, Jr...... 379/88 g g p y " 5,608,786 * 3/1997 Gordon ...... 379/100 5,719,918 * 2/1998 Serbetciouglu et al...... 379/58 33 Claims, 16 Drawing Sheets @ 5200 5500 5600 f / TRAU 64 kb/s IWF T1 vglgvnéélt 5100 (519a 5300 / FAX MAIL 0.3 kb/s SMS TCP/IP SERVER “"5700 SEE'RAO'EE $5800 ‘9 @466 5400 BACKUP r5900 TCPIIP Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page3 of 27 US 6,333,973 B1 Page 2 US. PATENT DOCUMENTS 5,966,663 * 10/1999 Gleason ...... 455/466 5870 549 * 2/1999 B b H 395/200 36 6,055,424 * 4/2000 Tornqvist et a1. 455/414 , , 0 0, ...... * . 579037832 * 5/1999 Seppanen et a1‘ 455/414 6,205,139 3/2001 Volt ...... 370/389 5,905,959 * 5/1999 Foladare et a1. . 455/445 _ _ 5,911,485 * 6/1999 Rossman ...... 34/22 * cued by examlner Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page4 of 27 U.S. Patent D w u, m. m a m US 6,333,973 B1 wwoSmmwVEo>>Ez%A 8:v.QE uoEm/m $0595%wziotgw2mm CIDDEI DUDE! Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page5 of 27 U.S. Patent Dec. 25, 2001 Sheet 2 0f 16 US 6,333,973 B1 1100 ~2200 2100 N 8%, Q E] BRAD JOHNSON @ (613) 733-8024 HOLD HANG UP 499 ...... NOTE QUICK NAME PAD LNOTES LIST Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page6 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page7 of 27 U.S. Patent Dec- 25, 2001 Sheet 4 0f 16 US 6,333,973 B1 3440 4100 GUI MANAGER p“ 4200 USER APPLICATIONS PJ 4300 SERVICES CLASS "J 4400 JAVA ENVIRONMENT /~~/ RToS UTILITIES /~E/4500 DEVICE DRIVERS /~~/4600 FIG. 4 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page8 of 27 U.S. Patent Dec. 25,2001 Sheet 5 0f 16 US 6,333,973 B1 .GIm Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page9 of 27 U.S. Patent Dec. 25,2001 Sheet 6 6f 16 US 6,333,973 B1 ~V61OO 2400 A I BOBBY BONITO 1% 738-9157 ezoo/fiifff' 55]") 824-6721 % 824-5321 g1") 521—6704 & NOTEPAD OUICKNOTES FIG. 6 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page10 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page11 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page12 of 27 U.S. Patent Dec. 25,2001 Sheet 9 0f 16 US 6,333,973 B1 in?commmmBoQm .QEmm .3m_ :30 @ in?359gcomm mm;02 mPOZx050 wmPOZ04¢ “1mg65E21? wam U.S. Patent Dec. 25, 2001 Sheet 10 0f 16 US 6,333,973 B1 RECD 24/06/95 1éE'I4 I BRIAN BEATON 5]") (613) 238-6602 IFTA LK DISCARD QUIT RWN D PAUSE Fl" NOTE OUICK NAME LPAD NOTES LIST J FIG. 10 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page14 of 27 U.S. Patent Dec. 25,2001 Sheet 11 0f 16 US 6,333,973 B1 RECD 24/06/95 173217-14 CDG STUDIO FAX-j 765-6775 VIEW DISCARD QUIT FOEWARD TO: ‘_'_'b FAX OFFICE FAT? HOME FAX‘ OTHER —b FAX NAME —b FAX NUMBER NOTE OUICK NAME kPAD NOTES LIST ) FIG. 11 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page15 of 27 U.S. Patent Dec. 25, 2001 Sheet 12 0f 16 US 6,333,973 B1 RECD 24/06/95 1 COLIN SMITH er [email protected] 3((TALK DISCARD QUIT TO: ANDREW CONNELLY FROM: COLIN SMITH O RE: WEDNESDAY MORNINGS SALES MEETING THE WEDNESDAY MORNING SALES MEETING WILL BE HELD AT 9200 (6 NOTE OUICK NAME L PAD NOTES LIST J FIG. 12 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page16 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page17 of 27 U.S. Patent Dec. 25,2001 Sheet 14 0f 16 US 6,333,973 B1 PZmwmFOZ 02mm; Q2..UI w l :3002mm rm.5202,197: 02.GE 5.8;?6i mwiou?v) i.25%<6» % MMQO Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page18 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page19 of 27 U.S. Patent Dec. 25,2001 Sheet 16 0f 16 US 6,333,973 B1 mm“.QI Aw882128 %88.2.6.59 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page20 of 27 US 6,333,973 B1 1 2 INTEGRATED MESSAGE CENTER If the user then Wanted to vieW a received SMS message, hoWever, the user must return to the main menu to select RELATED APPLICATIONS “Received short messages.” In response, the internal pro This application is related to US. patent application, Ser. cessor launches the SMS application to display a list of No. 08/842,015, entitled MULTITASKING GRAPHICAL 5 received SMS messages from Which the user selects the USER INTERFACE; US. patent application, Ser. No. desired one. 08/841,485, entitled ELECTRONIC BUSINESS CARDS; Telephones of this type, hoWever, suffer from a number of US. patent application, Ser. No. 08/841,486, entitled draWbacks. First, they store in their internal memory all SCROLLING WITH AUTOMATIC COMPRESSION AND received messages, eXcept voice and e-mail messages Which EXPANSION; US. patent application, Ser. No. 08/842,019, 10 are stored at an external server. This Wastes precious entitled CLID WITH LOCATION ICON; US. patent memory space, and as a result, feWer messages can be application, Ser. No. 08/842,017, entitled CLID WITH locally stored. DRAG AND DROP CAPABILITY; and US. patent Additionally, message handling is cumbersome because application, Ser. No. 08/842,036, entitled ICONIZED the telephones are menu driven and contain separate appli NAME LIST, all of Which Were ?led concurrently hereWith, 15 cations for the different message types. To vieW different and all of Which are hereby incorporated by reference. types of messages, the user must folloW a series of menus BACKGROUND OF THE INVENTION that cause speci?c applications to be eXecuted. Therefore, a need eXists to integrate different types of This invention relates to the ?eld of message handling, messages from different types of equipment into one graphi 20 and more speci?cally to the ?eld of message presentation to cal location to notify the user of pending messages and their a user by Which messages of all types are consolidated and type, and to alloW the user to vieW and respond to the graphically displayed in a searchable list to alloW for easy messages by simple operation. graphical scanning, prioritiZing, editing, selection, vieWing, forWarding, playback, and response by the user. SUMMARY OF THE INVENTION Traditionally, a user could retrieve only voice messages 25 Systems and methods consistent With the present inven by calling and interacting With a voice mail service using tion address this need by providing an integrated message dual tone multi-frequency (DTMF) commands. Such center that graphically displays different types of received retrieval of messages, hoWever, required the user to dial the messages together to facilitate user vieWing and manipula voice mail service and listen to each message, or minimally tion of the messages Without having to folloW a series of the header of each message, that is, the name of the person 30 menus or launch separate applications. and the time received. This type of voice mail retrieval tended to be a sloW and tedious process. In accordance With the purpose of the invention as Additionally, the user needed to memoriZe the DTMF embodied and broadly described herein, an integrated mes number commands to control the voice mail service. Some sage center consistent With the principles of the present 35 invention operates on telecommunications equipment, hav times these commands Were different for the user’s home voice mail service and the user’s of?ce voice mail service. ing a display and a processor, to consolidate messages of For eXample, the user needed to remember that pressing “1” different types for vieWing and manipulation by a user. The With the office voice mail service, While pressing “6” With telecommunications equipment receives noti?cation mes the home voice mail service, meant “play the message.” sages corresponding to pending messages of different types 40 and determines the message type of the pending messages. More recently, telephones have been designed With the capability to directly receive, or doWnload, different types of The integrated message center associates a message type messages, such as faXes, e-mail, and Short Messaging Ser indicator With each of the received noti?cation messages vice (SMS) messages. One conventional mobile telephone based on the determined message type and displays on the display a portion of the received noti?cation messages and has a display, a keypad, and numerous hard keys, and uses 45 menus to enable a user to vieW different types of received the associated message type indicators as entries in a single selectable list. The user can select one of the pending messages. messages for retrieval based on the entries in the single When a message arrives, an internal processor detects the selectable list. In response to user selection, the integrated message type and stores the message in a folder dedicated to message center retrieves the selected pending message for the message type. If the telephone receives a faX, for 50 vieWing and manipulation by the user. eXample, the internal processor stores the far in a faX folder. When the user opens the cover to the display, the internal BRIEF DESCRIPTION OF THE DRAWINGS processor displays a note indicating the quantity and type of The accompanying draWings, Which are incorporated in messages received. For eXample, if tWo faXes and tWo SMS and constitute a part of this speci?cation, illustrate systems messages have been received, the note Will shoW “You have: 55 and methods consistent With this invention and, together 2 unread faXes and 2 unread short messages.” With the description, eXplain the objects, advantages and If the user Wants to vieW a received message, the user ?rst principles of the invention. In the draWings, goes to the main menu and selects the type of message to FIG. 1 is a diagram of a communications netWork con vieW. This causes the internal processor to launch a taining the integrated message center consistent With the message-type speci?c application to retrieve the message 60 from the message folder and display it for the user. For principles of the present invention; eXample, if the user Wants to read a received faX, the user FIG. 2 is a diagram of the user mobile telephone operating selects “Received faxes” from the main menu. In response, in the netWork of FIG. 1; the internal processor launches the faX application to display FIG. 3 is a block diagram of the elements included in the a list of received faXes. From the list, the user selects a 65 user mobile telephone of FIG. 2; particular faX to read. The far application then displays the FIG. 4 is a block diagram of the softWare components selected faX. stored in the ?ash ROM of FIG. 3; Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page21 of 27 US 6,333,973 B1 3 4 FIG. 5 is a block diagram of the elements included in the NetWork services provider 1200 stores many of the mes network services provider of FIG. 1; sages aWaiting retrieval by the user and noti?es the user of FIG. 6 is an example of an idle screen of the user mobile the pending messages. Subscriber mobile telephone 1100 telephone shoWn in FIG. 2; and caller equipment 1300 through 1700 communicate With FIGS. 7A and 7B are eXample displays of received netWork services provider 1200 over a communications messages; netWork, such as Global System for Mobile Communica tions (GSM) sWitching fabric 1800. FIG. 8A is an eXample display of a received SMS teXt While FIG. 1 shoWs caller equipment 1300 through 1700 message; directly connected to GSM sWitching fabric 1800, this is not FIG. 8B is an eXample display of a received electronic ink 10 typically the case. Telephone 1300, facsimile equipment message; 1500, computer 1600, and ADSI telephone 1700 normally FIGS. 9A and 9B are eXample displays of SMS teXt connect to GSM sWitching fabric 1800 via another type of messages With hypertext markup language code; netWork, such as a Public SWitched Telephone NetWork FIG. 10 is an eXample display in Which the user selects to (PSTN). listen to a voice mail message; 15 When a caller uses telephone 1300 to communicate With FIG. 11 is an eXample display in Which the user selects to the user, the caller dials the telephone number corresponding forWard a faX; to mobile telephone 1100. If the user does not ansWer the call FIG. 12 is an eXample display of a received e-mail for a predetermined number of rings, or upon direction of the message; user (to be described), the call routes to netWork services provider 1200 over GSM sWitching fabric 1800 by conven FIGS. 13A through 13D are eXample displays in Which tional mechanisms. NetWork services provider 1200 stores the user responds to an ink message by sending an SMS the message left by the caller as voice mail and sends a short message; message to mobile telephone 1100, notifying the user of the FIGS. 14A and 14B are eXample displays in Which the pending voice mail message. user responds to an ink message by establishing a voice call; 25 When the caller uses caller mobile telephone 1400 to and communicate With the user, the caller may either call the FIGS. 15A and 15B are eXample displays in Which the user, as described above With regard to telephone 1300, or user receives a voice call and an SMS message, respectively. may send the user a Short Messaging Service (SMS) mes sage. GSM netWorks typically include an SMS server that DETAILED DESCRIPTION OF THE provides the SMS service. The SMS service is an error-free, PREFERRED EMBODIMENTS guaranteed delivery transport mechanism by Which callers The folloWing detailed description of the invention refers can send short point-to-point messages, i.e., SMS messages, to the accompanying draWings that illustrate preferred through the GSM netWork, such as GSM sWitching fabric embodiments consistent With the principles of this inven 1800, in a GSM signaling channel, simultaneously With, or 35 tion. Other embodiments are possible and changes may be Without, a voice or data call. made to the embodiments Without departing from the spirit GSM protocol limits the length of the standard SMS teXt and scope of the invention. The folloWing detailed descrip message to a maXimum of 140 bytes. HoWever, GSM tion does not limit the invention. Instead, the scope of the protocol permits longer messages to be formed by concat invention is de?ned only by the appended claims. enating several messages together, transparent to the caller. The integrated message center consistent With the prin Because GSM protocol transparently performs this concat ciples of the present invention displays different types of enating of messages, the caller sees no restriction on mes received messages in a single display and permits manipu sage length. lation of the messages by a user, such that the user can vieW, If the caller chooses to send the user an SMS message, the discard, forWard, and respond to any type of message 45 caller inputs the message data, and selects a destination Without the need to launch different applications. corresponding to the user. GSM sWitching fabric 1800 I. System Architecture routes the message to an SMS server that services the area FIG. 1 is a diagram of a communications netWork con containing mobile telephone 1100, and the SMS server, in taining the integrated message center consistent With the turn, relays the message to the user. principles of the present invention. The integrated message When the caller uses facsimile equipment 1500 to send a center is a logical entity that resides in mobile telephone faX to the user, the caller dials the faX telephone number 1100 and operates in conjunction With netWork services corresponding to netWork services provider 1200. The caller provider 1200 to inform a user of incoming and pending sends the faX to netWork services provider 1200. NetWork messages, such as far mail, e-mail, voice mail, etc. The services provider 1200 stores the faX and then sends a short integrated message center also serves as a mechanism by 55 message to mobile telephone 1100, notifying the user of the Which the user can retrieve, manipulate, and reply to all pending faX. types of messages. User manipulation of the pending mes When the caller uses computer 1600 to send an e-mail sages might include the ability to vieW, prioritiZe, edit, message to the user, the caller enters the message into the playback, discard, and/or forWard messages. computer and af?Xes the user’s e-mail address. The user’s The user uses mobile telephone 1100 to vieW messages e-mail address directs the e-mail message to netWork ser from callers having different types of caller equipment, such vices provider 1200. NetWork services provider 1200 stores as ordinary telephone 1300, caller mobile telephone 1400 the e-mail message, and then sends a short message to Which is similar to user mobile telephone 1100, facsimile mobile telephone 1100, notifying the user of the pending equipment 1500, computer 1600, and Analog Display Ser e-mail message. vices Interface (ADSI) telephone 1700. The callers leave 65 When the caller uses ADSI telephone 1700 to communi different types of messages for the user, depending upon the cate With the user, the caller dials the telephone number type of caller equipment. corresponding to mobile telephone 1100, as described above Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page22 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page23 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page24 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page25 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page26 of 27 Case5:13-cv-05933-PSG Document1-4 Filed12/23/13 Page27 of 27 Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page1 of 11 EXHIBIT E Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page2 of 11 US006463131B1 (12> Ulllted States Patent (10) Patent N0.: US 6,463,131 B1 French-St. George et al. (45) Date of Patent: Oct. 8, 2002 (54) SYSTEM AND METHOD FOR NOTIFYING A 5,608,786 A 3/1997 Gordon ...... 379/100.01 USER OF AN INCOMING COMMUNICATION 5,633,916 A 5/1997 Goldhagen et al...... 379/88.13 EVENT 5,737,395 A 4/1998 Irribarren ...... 379/88.13 5,742,905 A * 4/1998 Pepe et al. 379/211.01 (75) Inventors: Marilyn French-St. George, Alcove; 5,751,791 A 5/1998 Chen 61 ‘IL - 379/88-13 A_ Mahan,AI Brisebois, Kanata, an of (CA) Laura 5,825,8545,822,404 A 10/1998 LarsonCave . . et. . . . al...... 379/88.13 5,832,221 A 11/1998 Jones ...... 379/88.13 (73) Assigneez Nortel Networks Limited (CA) 5,946,386 A * 8/1999 Rogers et al...... 379/265.09 5,987,100 A * 11/1999 Fortman et al...... 379/88.14 ( * ) Notice: Subject to any disclaimer, the term of this 6,061,570 A * 5/2000 Janow ...... 455/458 patent is extended or adjusted under 35 6,181,928 B1 * 1/2001 Moon ...... 379/88.12 U'S'C~ 154(k)) byo days~ 6,219,413 B1 * 4/2001 Burg ...... 379/215.01 (21) Appl. No.: 09/477,679 * Cited by examiner (22) Filed: Jan. 5, 2000 Primary Examiner—Fan Tsang Related US. Application Data Assistant Examiner—Ovidio Esalante (74) Attorney, Agent, or Firm—Finnegan, Henderson, (62) Division of application No. 08/996,034, ?led on Dec. 22, 1997’ now Pat‘ NO‘ 671227348‘ FaraboW, Garrett & Dunner, L.L.P. (51) Int. c1.7 ...... H04M 1/64 (57) ABSTRACT (52) US. Cl...... 379/88.23;337799/8§é1147; Asystem and method for providing multisensory Signaling capabilities enables a user to manage the receipt of incoming (58) Field of Search ...... 379/88.12, 88.13, communication events, after an initial noti?cation sequence, 379/88.14, 88.15, 88.17, 88.19, 88.22, 88.23, using multiple media options. Speci?cally, a remote device 88.25, 100.01, 100.08, 211.01, 211.02, noti?es a user of incoming communication events and offers 212.01, 207.16, 201.07 real-time coupling of the noti?cations With communication (56) References Cited management options. The message is delivered or otherwise processed according to the option selected. US. PATENT DOCUMENTS 5,327,486 A * 7/1994 Wolff et al...... 379/142.01 8 Claims, 3 Drawing Sheets 110 f 105 155 115 ’\.100 1j5 / I / 129., I / sERvER COMPUTER I __ _ MEMORY 140 w REGISTRATION /160 / SOFTWARE WEARABLE DEvICE 143 / SUBSCRIBER 165 TRANSDUCER 12@\ SEE l DATABASE ,_/ 1;11 I 142 E COMMUNICATION . RECEIVER/ K SOFTWARE % TRANSMITFER H PROCESSOR 13o COMMUNICATION 17° I K144 . DATABASE I/O MEMORY / PORT ~145 E III E / 150 E 175 180 / I / ELECTRONIC KIOSK MAII. SYSTEM 135 Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page3 of 11 Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page4 of 11 U.S. Patent Oct. 8,2002 Sheet 2 of3 US 6,463,131 B1 ALERT RECEIVING PARTY N200 OF COMMUNICATION EVENT 210 DOES THE PARTY WANT TO RESPOND? SELECT DEVICE FOR 220 DELIVERY OF SUBSEQUENT N INFORMING COMPONENT V ALLOW PARTY TO HEAR OR 230 SEE MORE INFORMATION ~ ABOUT COMMUNICATION EVENT 245 PRESENT COMMUNICATIONS ~24‘) SELECT MANAGEMENT OPTIONS TO COMMUNICATION PARTY IN SELECTED V MANAGEMENT OPTION MEDIA FORMAT FOR EXECUTION FIG. 2 Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page5 of 11 Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page6 of 11 US 6,463,131 B1 1 2 SYSTEM AND METHOD FOR NOTIFYING A then reply. Other disposition options (e.g., forWard, copy, USER OF AN INCOMING COMMUNICATION delete) can only be invoked after the user receives the EVENT communication. Currently, there are no products that alloW a user to intercept a communication during the noti?cation CROSS-REFERENCE TO RELATED sequence and re-route it to another device or person, or APPLICATION request the sender to alter the communication media. There are some third party service providers that integrate This is a division of application Ser. No. 08/996,034, ?led text-based and voice-based communications into a single Dec. 22,1997, the contents of Which are hereby incorporated “inbox” and then notify the subscriber of their presence. by reference (now US. Pat. No. 6,122,348 issued Sep. 19, 10 Often times the noti?cation is to a pager or a cell phone. In 2000). the latter case, media translation devices can recode a text ?le into speech. Although these services provide uni?ed BACKGROUND OF THE INVENTION noti?cation of all messages, they do not currently respond to the real-time voice calls, and often restrict access to infor The present invention relates generally to communication mation pertaining to the incoming communication to the management and more particularly, to a multisensory sig 15 device subscriber. naling structure that enables a user to manage the receipt of Therefore, it is desirable to provide a multisensory sig incoming communication events, after an initial noti?cation naling structure that is applicable to a variety of receiving sequence, using multiple media options. devices to alloW a user to manage incoming communication Recent advancements in communication technology have events. made push media channels a reality. These channels typi 20 It is also desirable to provide the user With a number of cally “push” information to a designated receiving device call management options that may be invoked in real-time. (e.g., pager) Without requiring a user to speci?cally request It is further desirable to structure noti?cations of incom the information. This, in conjunction With development of ing communication events. integrated text and voice at the desktop and in mobile In addition, it is desirable to couple real-time noti?cations devices, creates an environment Where users are increas 25 With communication management options. ingly demanding service strategies that alloW them to pri It is further desirable to route an incoming communication oritiZe competing demands on their attention. event to a receiving device or person of the receiver’s choice Not only do busy people need a Way of recogniZing the in real-time. context—the Who, What, When, and Why—of an incoming 30 It is also desirable to employ personal, Wearable commu noti?cation, they also need choices on hoW to respond to the nication devices for receiving incoming multimedia noti? request in real-time. For example, by structuring an alerting cations and information in a preselected format. or noti?cation sequence to provide more context about the Finally, it is desirable to alloW a user to intercept a nature of an interruption (i.e., the Who, What, When, and communication, during the noti?cation sequence and Why) and then integrating communication management 35 re-route it to another device or person, or request the sender options that are media independent, users may intercept and to alter the communication media. direct an incoming communication to a device or person of Additional desires, features and advantages of the inven their choosing. tion Will be set forth in the folloWing description, and Will On the service delivery side of the equation, service be apparent from description or may be learned by practic providers are looking for Ways of increasing their presence 40 ing the invention. to the end user. To facilitate this endeavor, there is a need for a noti?cation/signaling framework that enables service pro SUMMARY OF THE INVENTION viders to con?gure their commercial appearance to the Systems and methods consistent With the present inven customer and tailor communication management options to tion meet these desires by alloWing a user to manage the maximiZe service availability. For example, With such a 45 receipt of incoming communication events, after an initial frameWork, a sports broadcaster can notify its subscribers of noti?cation sequence, using multiple media options. a particular neWsWorthy event via a multimedia banner. If A system consistent With this invention for managing an the event is on video, the user can then select to receive the incoming communication event comprises means for noti broadcast at their desktop computer, or perhaps listen to the fying a user of the incoming communication event; means play-by-play via a personal audio device. 50 for providing a plurality of communication management Currently, real-time communication management options options to the user; means for receiving a selection of one of are limited (e.g., live voice calls can only be ignored or the communication management options; and means for ansWered). Calling Line Identi?cation (CLID) provides taking an action regarding the incoming communication some real-time information regarding the “Who” of the event consistent With the selected communication manage incoming-communication but more strictly re?ects the 55 ment option. source device rather than the user of the device. Display of A method consistent With this invention for managing an Second Call Waiting Identi?cation (DSCWID) provides incoming communication event comprises the steps of noti some real-time communication management by enabling fying a user of the incoming communication event; provid users to put a second call on hold While they ?nish the ?rst. ing a plurality of communication management options to the HoWever, the constraints of CLID limit this feature by 60 user; receiving a selection of one of the communication identifying the connection subscriber rather than the user. management options; and taking an action regarding the In the text domain, there is currently no possibility of incoming communication event consistent With the selected intercepting an e-mail on its Way to an in-box. Text mes communication management option. saging services direct data, such as e-mail, to a user’s inbox Both the foregoing general description and the folloWing and then notify the user of its arrival. If the user Wants to 65 detailed description are exemplary and explanatory and are vieW the e-mail or call the sender back, they must ?rst enter intended to provide further explanation of the invention as the mailbox, select the communication, open it, read it, and claimed. Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page7 of 11 US 6,463,131 B1 3 4 BRIEF DESCRIPTION OF THE DRAWINGS urgent return communication and thus, may choose not to The accompanying drawings, Which are incorporated in respond to any neW incoming communications. The user can communicate this information to server 115 When con?g and constitute a part of the speci?cation, illustrate presently preferred embodiments of the invention and, together With uring a call. Alternatively, system 100 can determine the preceding general description and the folloWing detailed Whether the call is a neW or return communication based on description, eXplain the principles of the invention. a prior communication betWeen the tWo parties. In this instance, the prior call information is stored in a memory of In the draWings: server 115 as a pro?le speci?c to the user or communication FIG. 1 illustrates a communications management system event. A communication event is any type of voice or data consistent With the present invention; 10 transfer betWeen tWo or more points. Thus, the communi FIG. 2 shoWs a ?oWchart of a communications manage cation event can be the transfer of video data or a voice ment method consistent With the present invention; and message. The user can de?ne the type of communication FIG. 3 shoWs a communications management options link used to transfer the selected information based on the diagram available to a user of the communications manage available communication netWork. For eXample, if the user ment system of FIG. 1. 15 Wishes to send a photograph, then the information Would be transferred over a data communication link such as an ATM DETAILED DESCRIPTION OF THE netWork. HoWever, to transfer voice information in real INVENTION time, the PSTN is the more appropriate selection. Reference Will noW be made in detail to the construction Based on the type of information transferred, the user can and operation of preferred embodiments consistent With the select communication management options for the receiving present invention that are illustrated in the accompanying party. For eXample, if the user Wishes to transfer a voice draWings. In those draWings, like elements and operations message to a receiving party concerning a relative’s Wed are designated With the same reference numbers. ding but also has a video of the Wedding, both a voice FIG. 1 illustrates a communications management system message option and a video option can be transferred to the 100 including a plurality of source devices 105, terminal 25 receiving party. Any data (e.g., video, text) or voice format devices 110, and at least one server 115 that controls the can be selected by the user as a communications manage transfer of information betWeen source devices 105 and ment option for the receiving party. This selection is only terminal devices 110. System 100, as illustrated in FIG. 1, limited by the format of the information for transfer. provides a framework for implementing communications Preferably, system 100 is capable of automatically choosing management functions consistent With the present invention. certain communication management options based on the Other components such as a public sWitched telephone type of information being transferred and information pre netWork (PSTN) or asynchronous transfer mode (ATM) viously provided by the user. netWork (not shoWn) are necessary to facilitate the transfer Finally, the user chooses a source device 105 for trans of information signals betWeen multiple source and desti ferring the voice or data information (e.g., facsimile, audio, nation points. These netWorks consist of a series of netWork 35 etc.). The communication device can be any device capable gateWays that mediate communications betWeen Wireline, of transferring information. One feature of the invention is Wireless, and computer netWorks. to signal the user (e.g., using a ringback function) When Source devices 105 include a variety of media devices system 100 noti?es the receiving party of the communica available to a user of system 100. These source devices may tion event. The signal may be sent back to the selected include a computer 120, telephone 125, faX machine 130, source device or a secondary device. For eXample, if the video device 135 or any other media source. The user or source device is a computer, the user can select to receive the caller may use one or more of the above devices to transfer ringback signal on a cellular telephone or pager by selecting information to one or more parties over system 100. this feature When con?guring a communication event trans fer With server 115. Preferably, system 100 can automati Before attempting to contact a party, the user selects the 45 information for transfer, de?nes Whether the call is a neW or cally choose the source device based on the type of infor return communication, chooses the type of communication mation transferred and information previously provided by link (i.e., voice or data), determines any additional receiver the user. communication management options, and selects a source Terminal devices 110 may include a Wearable device 140, device 105. Preferably, system 100 automatically performs computer 145, kiosk 150, or any other device capable of these functions based on the type of information being communicating voice/data signals to a receiving party. transferred and information previously provided by the user. These devices include a transceiver for bidirectional In this instance, the user only needs to provide the infor communication, and receive and transmit voice and/or teXt mation for transfer to system 100. data in real-time over a selected communication link. The type of information for transfer over system 100 can 55 Preferably, terminal device 110 is a personal Wearable be in any form such as a document or audio message. The device 140, such as SoundBeamTM manufactured by Nortel, format of the information dictates the source device to be that incorporates “Personal Space Audio” Where the audio used to transfer the information. For eXample, if the user signal is not broadcast to the entire surrounding environ chooses to relay the information verbally or using a prere ment. corded voice message, then telephone 125 Would be the Wearable device 140 includes a receiver/transmitter 141, preferred device. Nevertheless, the user may Wish to send a processor 142, transducer 143, memory 144, and input/ document or e-mail a ?le to one or more parties, Which output (I/O) port 146. Receiver/transmitter 141 receives and Would require a faX machine 130 or computer 120, respec transmits voice and data signals betWeen Wearable device tively. 140 and a remote device such as server 115. Receiver/ The user further has the option of de?ning Whether the 65 transmitter 141 alloWs Wearable device 140 to receive call is a neW or return communication. This feature is personal multimedia noti?cations at any time and anyWhere important since the receiving party may be expecting an over a Wireless communication link. Processor 142 can be Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page8 of 11 US 6,463,131 B1 5 6 any processor capable of controlling the operation of Wear Server 115 also establishes a user-centric relational data able device 140 by interfacing With components of the base. As communication relationships develop betWeen par device. For example, processor 142 processes incoming ties using system 100, categories for each registered user signals received through receiver/transmitter 142. Processor may be formed (e.g., home support services, of?ce, 142 then routes the signal to transducer 143 to output the recreational, family) and stored in subscriber database 165. signal in an audio, tactile, or visual format (e.g., beeping This high level categoriZation is encoded into the alerting sound, silent vibration, or text messaging), or memory 144 sequence of system 100, thus alloWing receivers to differ (e.g., random access memory) for storage. In addition, entiate betWeen “cold” incoming communications and those processor 142 can route the signal to I/O port 146 Which is from individuals or organiZations that have established a con?gured to interface With other terminal devices 110 such 10 relationship With the receiver. As described above, system as computer 145 or kiosk 150 to output the signal. These 100 facilitates the transfer of information from a user to a terminal devices 110 also include the components of Wear receiving party using various communication options and able device 140 to perform functions consistent With the media formats. The folloWing description provides the present invention as described herein. method for managing the communication events transferred Server 115 is a processor-based system that is customiZed 15 over system 100. to control the information transfer operation of system 100. Preferably, server 115 has high speed processing capability FIG. 2 is a ?oWchart illustrating a communication man in order to service a large number of users and includes a agement method consistent With the present invention. memory 155 that stores a variety of softWare and informa Speci?cally, the ?oWchart of FIG. 2 illustrates a signaling tion. Speci?cally, memory 155 stores registration softWare sequence received at terminal device 110 of the receiving 160, subscriber database 165, communication softWare 170, party. The signaling sequence includes an alerting compo and communication database 175. nent and informing component. Server 115 executes registration softWare 160 to register Before transferring information, system 100 alerts a system 100 devices. Registration softWare associates the selected receiving party of the incoming communication event (step 200). The alerting component is brief (typically registered devices With one or more subscribers. Server 115 25 stores information about the subscribers in subscriber data the duration of a single ring sequence of a traditional phone) base 165 and communicates With system 100 devices using and multisensory, consisting of tactile, auditory, and visual communication softWare 170. Communication softWare 170 components. System 100 bases the timing of the alerting includes softWare capable of transferring voice and data component on current telephony ring signaling. HoWever, in signals over any type of communication link. Server 115 system 100, only the ?rst “ring” sounds automatically With stores information (e.g., the communication event) for trans subsequent audio and visual output being mediated by the fer betWeen source devices 105 and terminal devices 110 in receiving party. communication database 175. The receiving party may choose to respond to or ignore Server 115 performs a number of automatic functions the alert signal based on the audio or visual information sent including user/device recognition, caller recognition, com 35 during the alerting component (step 210). Server 115 munication status, and communication management options. encodes categorical variables (e.g., urgency and synchro In addition, server 115 provides integrated electronic mail nous communication requests) via the tactile channel, and box functions for system 100 subscribers via electronic mail categorical or continuous variables (e.g., relationship cat system 180. Electronic mail system 180 can be any elec egory or name of caller) via the audio and visual channels. tronic mail system capable of storing voice, text, or video For example, server 115 can encode the distinction betWeen mail. an incoming message (Where the sender is not requesting Server 115 automatically supports user and device recog synchronous interaction), and an incoming request for dia nition. Preferably, all user devices are registered With the logue (e.g., a voice call, or video conference) in the tactile server using registration softWare 160. This registration channel. In addition, server 115 can transmit the relationship process is benign such that When a registered user commu 45 category (e.g., business, home, recreational) in the audio nicates With someone via a neW terminal device 110, the channel, While the caller name and topic is shoWn on a small device is automatically registered. This assumes that termi display during the alerting component of the signaling nal device 110 has a characteristic signature that de?nes sequence. such things as the media channels, the communication At the termination of the alerting component, the party protocols, and the bandWidth that it can support. If these may select a device for delivery of an associated incoming signatures are not de?ned or if a device is not supported by communication event (step 220). The party selects a device system 100, then server 115 automatically sWitches to a using a designated input function. For example, Wearable default setting that enables a standard signaling procedure device 140 may include a voice recognition response system (e.g., text messaging for pagers). Where the receiving party speaks a predetermined command Preferably, unregistered users can subscribe to server 115 55 into the device to make a selection. This selection may using terminal device 110. In this instance, server 115 ?rst include any terminal device registered With server 115. registers the neW subscriber using registration softWare 160 The selected device alloWs the party to see or hear more and then stores information about the subscriber in sub information about an incoming communication event (step scriber database 165. Subscriber information is stored in all 230). Based on its media format, the incoming communi formats speci?ed by the user and may include name, address cation event routes either to the audio channel or visual and one or more telephone numbers. These formats might channel of terminal device 110. If the party directs the include photos, videos, text, or audio introduction scripts communication event to a large display device, such as a that subscribers use via server 115 to con?gure appropriate computer, the user Will see detailed information about the header information appearing in the receiving party’s alert nature of the incoming communication. In this instance, the ing sequence. The header information, stored in subscriber 65 selected terminal device dictates the con?guration of audio database 165, alloWs the receiving party to hear or see the and visual channels for incoming communication event name of the calling party. output. For example, a user might be seated at their com Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page9 of 11 US 6,463,131 B1 7 8 puter When an incoming alert is detected. The computer Requesting the transmission later 340 prompts server 115 recognizes that the incoming communication is a return to save the message in communication database 175 for later video message. The tactile channel presents a distinct retrieval. Preferably, server 115 can mediate a later time to cadence that the user recogniZes as a message. The audio send the transmission. In this instance, server 115 initiates channel presents a signal that is recogniZed as a reply, While the later transmission at the mediated time. For eXample, the name of the caller is displayed in a small Wearable When the receiving party selects this communication man screen, together With a topic line (e.g., “video that you agement option, server 115 can request a more appropriate requested”). At this point, the user touches a predetermined time to send the communication event and initiate a subse button on the computer to select the computer or other quent transmission at that time. Alternatively, the receiving terminal device on Which to vieW further information regarding the incoming communication event. 10 party may dial into the server using a passWord or other security function to access and retrieve the message at a later If the selected device is not properly con?gured to receive time. the incoming communication event, system 100 informs the caller through the ringback sequence. For eXample, the Listen to voice message 350 alloWs a receiver to auto caller Would be noti?ed during the ringback sequence if the matically request that the caller leave a message rather than receiving party selected a communication device that Was 15 complete the requested synchronous dialogue. Server 115 not matched to the media con?gurations of the incoming informs the caller through the ringback sequence if the request. If the selected device con?guration is proper, server receiver selects this option. Once the voice message is 115 transmits further information about the communication recorded, server 115 then alerts the receiver of the recorded event to the selected computer, as used in this eXample. The voice message. receiving party then, for eXample, touches a predetermined ForWard communication event to third party 360 alloWs button on the computer, preferably located on a mouse, to the receiver to re-route the communication to other people or vieW the additional information on the computer display. devices. The other people may be part of a group registered The subsequent information may include a distribution list With system 100, such as a “business partners” category. In for the communication or return communication paths pre this eXample, the receiving party requests server 115 to route ferred by the caller for responding to the video message. If 25 the receiving party had decided to listen to the video the call to the predetermined “business partners” category so message, they could have responded to the initial alert by that everyone Within that registered group receives the touching a button associated With a personal audio device communication. The communication event may also be (e. g., Wearable device 140). At that point, server 115 informs forWarded to other devices including mail system 180. The the receiving party that a distribution list and return call mail system preferably includes electronic mail, video mail paths are available. or voice mail capabilities. System 100 presents one or more In addition to the subsequent information, server 115 of these mail options to the receiving party in the commu presents the receiving party With communication manage nications management options menu. System 100 also ment options (step 240). These options are described beloW alloWs the receiving party to request receipt of any replies to the forWarded message. With respect to FIG. 3. Server 115 then prompts the receiving 35 party to select a communication management option for Reject caller 370 alloWs the receiver to deny further execution (step 245). These communication management access from one or more callers. This feature is useful to options alloW the receiving party to control receipt (i.e., hoW prevent unWanted calls or messages from one or more and When) of the communication event. Upon executing the callers. The receiving party may modify the account at a selected option, system 100 completes the communication later time to permit subsequent communication With that functions available to the receiving party. caller. FIG. 3 is a diagram of communications management System 100 offers versatile communication management options 300 available to the receiving party in a menu techniques that provide a loW-intrusive solution to modem format. These options include ansWering or requesting trans personal communication needs. System 100 is not only a mission of the communications event 310, retrieving and 45 multisensory signaling structure that can be applied to a listening to a voice message 350, forWarding or “bouncing” variety of receiving devices, but also a tool for coupling the call to one or more parties 360, and rejecting the call 370. real-time noti?cations With communication management AnsWering or requesting transmission of the communi options. These communication management options alloW a cation event 310 includes the suboptions of requesting the party to control hoW, When and Where to receive incoming transmission noW 320, requesting a change of communica communications events. The party may receive these events tions media format 330, and requesting transmission later in a variety of media formats adding further versatility to the 340. Requesting the transmission noW 320 provides a real system. Moreover, users of system 100 may receive incom time coupling of the communication event (e.g., video ing communication events on any device capable of receiv message) With the terminal device selected by the receiving ing and transmitting voice or data signals. Thus, system 100 party. Requesting a change of communications media format 55 does not require “special” equipment to provide effective 330 alloWs the caller to select the communication event in an communication betWeen tWo or more parties. audio or visual format. The format used by the sender and While there has been illustrated and described What are at the capabilities of the terminal device may preclude changes present considered to be preferred embodiments and meth in media format. HoWever, audio and visual components ods of the present invention, those skilled in the art Will may be separated for the convenience of the receiving party. understand that various changes and modi?cations may be For eXample, a party may receive a personal multimedia made, and equivalents may be substituted for elements alert during a meeting indicating that a colleague Wants to thereof, Without departing from the true scope of the inven talk immediately. Since it is inconvenient to leave the tion. meeting, the party can take advantage of an ansWer option In addition, many modi?cations may be made to adapt a that alloWs for a request to change media. This request 65 particular element, technique, or implementation to the informs the sender that a teXt message should be sent since teachings of the present invention Without departing from it is inconvenient to talk right now. the scope of the invention. Therefore, this invention should Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page10 of 11 US 6,463,131 B1 10 not be limited to the particular embodiments and methods 4. The system of claim 2 Wherein the characteristic disclosed herein, but should include all embodiments falling includes a nonsynchronous communication and the selected Within the scope of the appended claims. noti?cation includes a nontactile alert. What is claimed is: 5. A method of notifying a user of an incoming commu 1. A system for notifying a user of an incoming commu 5 nication event, comprising: nication event, comprising: determining a characteristic of the communication event; means for determining a characteristic of the communi selecting a noti?cation based on the characteristic; cation event; sending the user the selected noti?cation; means for selecting a noti?cation based on the character 1O receiving a selection from the user indicating a format for istic; delivery of further information regarding the commu means for sending the user the selected noti?cation; nication event; and means for receiving a selection from the user indicating a alloWing the further information regarding the communi format for delivery of further information regarding the cation event to be sent to the user in the selected format. communication event; and 15 6. The method of claim 5 Wherein the selecting includes means for alloWing the further information regarding the a choice betWeen at least a tactile alert and a nontactile alert. communication event to be sent to the user in the 7. The method of claim 6 Wherein the characteristic selected format. includes synchronous communication and the selected noti 2. The system of claim 1 Wherein the means for selecting ?cation includes a tactile alert. includes a choice betWeen at least a tactile alert and a 8. The method of claim 6 Wherein the characteristic nontactile alert. includes a nonsynchronous communication and the selected 3. The system of claim 2 Wherein the characteristic noti?cation includes a nontactile alert. includes synchronous communication and the selected noti ?cation includes a tactile alert. Case5:13-cv-05933-PSG Document1-5 Filed12/23/13 Page11 of 11 UNITED STATES PATENT AND TRADEMARK OFFICE CERTIFICATE OF CORRECTION PATENT NO. : 6,463,131 B1 Page 1 of 1 DATED : October 8, 2002 INVENTOR(S) : Marilyn French-St. George et al. It is certified that error appears in the above-identi?ed patent and that said Letters Patent is hereby corrected as shown below: Column 9 Lines 14 and 16, after “further” insert -- notification Column 10 Lines 11 and 13, after “further” insert -- notification Signed and Sealed this Thirtieth Day of September, 2003 JAMES E. ROGAN Director ofthe United States Patent and Trademark O?‘i'ce Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page1 of 46 EXHIBIT F Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page2 of 46 US006765591B2 (12) United States Patent (10) Patent N0.: US 6,765,591 B2 Poisson et al. (45) Date of Patent: *Jul. 20, 2004 (54) MANAGING A VIRTUAL PRIVATE 5,926,463 A 7/1999 Ahearn et al. NETWORK 5,963,913 A 10/1999 Henneuse et al. 5,966,128 A 10/1999 Savage et al. (75) Inventors: Matthew W. Poisson, Manchester, NH 2 y‘flddalozfolet a1 _ . - , , 0 nson e a. Kmgston’ 5,987,513 A 11/1999 Prithviraj et al...... 709/223 ’ ' ’ 6,041,166 A 3/2000 Hart et 211. Manchester’ NH (Us) 6,041,347 A 3/2000 Harsham et al...... 709/220 _ _ _ 6,046,742 A * 4/2000 Chari ...... 345/734 (73) Asslgneei Nortel Networks Llmlted, 51- Laurent 6,061,334 A 5/2000 Berlovitch et al. 370/255 (CA) 6,075,776 A 6/2000 Tanimoto et al...... 370/254 (*) Notice: This patent issued on a continued pros- (L15t Continued on IleXt page) ecution application ?led under 37 CFR 1.53(d), and is subject to the twenty year FOREIGN PATENT DOCUMENTS patent term provisions of 35 U.S.C. EP 0 838 930 A2 4/1998 154(a)(2). W0 WO 97/50210 12/1997 OTHER PUBLICATIONS Subject to any disclaimer, the term of this patent is extended or adjusted under 35 Rooney, Sean, et al., “The Tempest: AFramework for Safe, U_S_C_ 154(k)) by 0 days_ Resource—Assured, Programmable Networks,” IEEE Com munications Magazine, Oct. 1998, pp. 42—53. . Kosit aiboon, Run ro', et al., “Customer Network Mana e (21) Appl. NO.. 09/285,424 P g 1 . . . g ment for B—ISDN/ATM Services,” Communications, 1993. (22) Filed: Apr. 2, 1999 ICC 1993 Geneva, Technical Program, Conference Record, , , , IEEE International Conference. (65) Pnor Pubhcatlon Data Con?guring and Maintaining Networks with Optivity NET US 2003/0030662 A1 Feb. 13, 2003 Con?gurator 2.0 Manual, Bay Networks, Oct. 1998. (51) Int Cl 7 G06F 3/00 New Oak Communications EXtranet Access Switch Admin (52) US. Cl...... 345/735; 345/734; 345/733; 15mm” S Gulde Manual’ Dec‘ 1997' 345/853 Primary Examiner—John Cabeca of Search ...... Assistant Examiner_l Edi! View iools X 0 Adminislralm©?49089?rrom Access Web Pages ServerSalup Double~click on a wizard to run it Roe One or more Recursively add, mudily, 0| delete passwords below selected item or iolder. Jane Tunnel Bulk Con?gure Extlinel Switches NOCZDOO Bulk Modily Exlranet FTP Data Rnnenl’Svmck Bulk Backup Extianel Switches VPN Repurl Wizard John Dd? John's Tunnel NOCZDDU RobenPSmack Switch NDC2000 RoberlPSmaak Scripts Saved Search Results Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page3 of 46 US 6,765,591 B2 Page 2 US. PATENT DOCUMENTS 6,243,815 B1 6/2001 Antur et a1. _ 6,256,739 B1 7/2001 Skopp et 211. 6,079,020 A * 6/2000 L111 ...... 713/201 6,259,448 B1 7/2001 McNally et aL ______u 345/733 6,085,238 A 7/2000 Yuasa et a1...... 709/223 6,272,537 B1 8/2001 Kekic et a1_ 7O9/223 6,085,243 A 7/2000 Fletcher 91 a1~ 709/224 6,282,175 B1 8/2001 Steele et a1...... 370/254 6,092,113 A * 7/2000 Maeshima ------709/230 6,286,050 B1 9/2001 Pullen et a1...... 709/229 6,092,200 A 7/2000 Muniyappa er 91- 6,304,909 B1 10/2001 Mullaly et 81. 6,115,736 A 9/2000 Devarakonda er a1------709/202 6,308,206 B1 10/2001 Singh ...... 709/223 6,148,337 A 11/2000 Estberg et a1...... 709/224 6,330,562 B1 12/2001 Boden et a1_ 6,188,691 B1 2/2001 Barkai et a1...... 370/390 6,369,840 B1 4/2002 Barnett et aL 6,205,488 B1 3/2001 Casey er a1------709/238 6,374,293 B1 4/2002 Dev et a1...... 709/220 6,209,031 B1 3/2001 Casey er 91- 6,374,296 B1 4/2002 Lim et a1...... 709/225 6,219,699 B1 4/2001 McCloghrie et a1...... 709/221 6,408,336 B1 6/2002 Schneider et a1_ 6,223,218 B1 4/2001 Iijima et a1...... 709/221 6,526,442 B1 2/2003 Stupek’ Jr_ et a1_ 6,226,751 B1 5/2001 Arrow et a1...... 713/201 6,233,618 B1 5/2001 Shannon * cited by examiner Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page4 of 46 U.S. Patent Jul. 20, 2004 Sheet 1 0f 36 US 6,765,591 B2 102 100b\ EXTRANET 4_ CONFIGURATION f?ab / REMOTE SWITCH iNFOHMATiON _\ i: USER __ PRNATE NETWORK VPN 7 MANAGER 116 115 EXT RANET q“ CONFlGURATION FIG. 1 100a/ SWITCH lNFORMATION PRIVATE NETWORK 100b\ EXTRANET SWiTCH 1 102 i / | | 106/ _ {120 | PRIVATE | NETWORK : 1 14 PUBLIC / : NETWDRK REMOTE EXTRANET USER 100a/ swnclH VPN MANAGER 110/7 PRIVATE NETWORK ‘ Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page5 of 46 U.S. Patent Jul. 20, 2004 Sheet 2 0f 36 US 6,765,591 B2 126 RECEIVE INFORMATION SPECIFYING 1 16 \ CONFIGURATION PARAMETERS FOR A \ SELECTION OF EXTRANET SWITCHES I 128 TRANSMIT DATA AND/0R INSTRUCTIONS \ CORRESPONDING To THE RECEIVED INFORMATION To THE SELECTED SWITCHES FIG. 3 ‘T 13OD\i I CONFIGURE SWITCH BASED ON 1303/ TRANSMITTED DATA AND/OR INSTRUCTIONS ‘T I008 EXT RANET SWITCH A 100D EXTRANET SWITCH B SWITCH FUNCTION SWTI'CH FUNCTION INSTRUCTIONS INSTRUCTIONS 1 32a \ AUTHENTICATION AUTHENTICATION 134a \ TUNNEL TUNNEL MANAGEMENT MANAGEMENT 1368 / PACKET FILTERING PACKET FILTERING Z Z 0 o /’ “ 138a /’ “ 138b 1308 / 1300 / SCRIPT INTERFACE SCRIPT INTERFACE A I SCRIPT TO BULK SCRIPT TO BULK I I 88 / CONFIGURE SWITCH ES CONFIGURE SWITCHES \I 1 8b II‘; I I WIT H 142/ ' CONFIGURATION INSTRUCTIONS 144 _/ GRAPHICAL USER INTERFACE 115 FIG. 4 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page6 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page7 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page8 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page9 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page10 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page11 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page12 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page13 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page14 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page15 of 46 U.S. Patent Jul. 20, 2004 Sheet 12 0f 36 US 6,765,591 B2 1 0% REMOTE ExTRANET 159D _ usER SWITCH / I swITcH VPN PUBLIC 'NFORMAT'ON __ MANAGER NETWORK ' PRIvATE E SWITCH 116 115 NETWORK INFORMATION ExTRANET 120a swITcR FIG. 14 PRIvATE NETWORK FIG. 15 EXTRANET swITGR A EXTRANET SWITCH G SWITCH FUNCTION SWITCH FUNCTION 100a\ INsTRucTIONs INsTRucTIONs n/100b AUTHENTICATION AUTHENTICATION TUNNEL TUNNEL MANAGEMENT MANAGEMENT PACKET FILTERING PAGKET FILTERING /" 138a / 13Gb 130a / 13Gb " / SCRIPT INTERFACE scRIPT INTERFACE A 1 150a 152D \ II / v SCRIPT scRIPT swITGR SWITCH / REOuEsTING REOuEsTING \ 152a ‘NFORMAHON INFORMATION 'NFORMAHON TNFORMATTON 15011 I T I I SWITCH 142/ CONFIGURATION INSTRUCTIONS 144 / GRAPHICALUSER INTERFACE m Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page16 of 46 U.S. Patent Jul. 20, 2004 Sheet 13 0f 36 US 6,765,591 B2 @228a???Eng51%? :SwmEm;£228 8.2%:onwmnew; E2am,“562$2.8m2228:82 btzumwtonmm000N002 2688BEES:82 m6.55 :2526>23; to?2% Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page17 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page18 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page19 of 46 U.S. Patent Jul. 20, 2004 Sheet 16 0f 36 US 6,765,591 B2 .Emm: Tell. 31mi QSowxuwEwnEBomU 5328525m225.;23:u 8882Too? 5:6.226N 3UN“ 5038.22321>E5 3685.5565:8525mm Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page20 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page21 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page22 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page23 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page24 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page25 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page26 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page27 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page28 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page29 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page30 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page31 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page32 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page33 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page34 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page35 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page36 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page37 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page38 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page39 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page40 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page41 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page42 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page43 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page44 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page45 of 46 Case5:13-cv-05933-PSG Document1-6 Filed12/23/13 Page46 of 46 Case5:13-cv-05933-PSG Document1-7 Filed12/23/13 Page1 of 7 EXHIBIT G Case5:13-cv-05933-PSG Document1-7 Filed12/23/13 Page2 of 7 US006937572B1 (12) United States Patent (10) Patent N0.: US 6,937,572 B1 Egan et al. (45) Date of Patent: Aug. 30, 2005 (54) CALL TRACE ON A PACKET SWITCHED 6,681,232 B1 * 1/2004 SistaniZadeh et al. 707/1041 NETWORK 6,721,184 B1 * 4/2004 Lehmeier et al...... 361/728 2002/0114274 A1* 8/2002 Sturges et al...... 370/229 (75) Inventors: Brian B. Egan ’ Ontario (CA)'’ Milos OTHER PUBLICATIONS Vodsedalek, Ontario (CA) Stevens, Richard; TCP/IP Illustrated, vol. 1; 1994; Addison 73 As's1gnee: N 0rte lN etwor ksL"dSlmlte , t. L aurent Wles ey, pp. 263265- , 97109*- . (CA) * cited. by eXammer. ( * ) Notice: Subject' to any disclaimer, the term of this Primary Examiner_DaVid Vincent Patent 15 extended or adlusted under 35 (74) Attorney, Agent, or Firm—MintZ Levin Cohn Ferris (21) Appl. NO.Z 09/751,796 (57) ABSTRACT (22) Flled: Dec‘ 29’ 2000 Acall trace feature for a network compatible device, such as (51) Int. Cl.7 ...... G01R 31/08 a Voice Over Internet Protocol device‘ The can trace infor' (52) U S C] 370/252 709/224 mation may include an Internet Protocol (IP) address, a ,' ' ' ' ' ' ' ' ' ' ' ' " ’ geographical location of the end-point device, a type or class (58) of the end-point device, a call route, a topology of the route, ’ _ ’ ’ _ ’ _ a domain name server of the IP address and route, a directory . number and name, a call back number, an advisement as to (56) References Clted Whether the IP address for the end-point device is mobile U.S. PATENT DOCUMENTS and an advisement as to What redirection may have occurred 6,144,336 A * 11/2000 Preston et al...... 342/35709 before the can Was Completed‘ 6,636,504 B1 * 10/2003 Albers et al...... 370/352 6,643,267 B1 * 11/2003 Karia et al...... 370/252 26 Claims, 1 Drawing Sheet /SET A \ ROUTER, CALL AND Case5:13-cv-05933-PSG Document1-7 Filed12/23/13 Page3 of 7 U.S. Patent Aug. 30, 2005 US 6,937,572 B1 QZ EQ> HZEAU Case5:13-cv-05933-PSG Document1-7 Filed12/23/13 Page4 of 7 US 6,937,572 B1 1 2 CALL TRACE ON A PACKET SWITCHED SUMMARY OF THE INVENTION NETWORK An aspect of the invention relates to providing call trace BACKGROUND OF THE INVENTION information about a caller’s end-point device that commu nicates on a packet switched network. The end-point device 1. Field of the Invention may be a voice over Internet Protocol (VoIP) device, which operates using voice that is packetiZed in accordance with The invention relates to providing call trace information Internet Protocol (IP) and transmitted over the Internet. on a packet switched network to users of various network The call trace information may include the following compatible devices, such as telephone sets, personal digital 10 about the end-point VoIP device: the IP address, the geo assistants, soft phones and the like. graphical location of the end-point device and the type or 2. Discussion of Related Art class of the end-point device. In addition, the call trace Support for end-to-end voice calls using the Internet as an information may provide the call route and the topology of alternative to traditional public switched telephone networks the route, the domain name server (DNS) of the IP address (PSTN) is well known. Unlike the PSTN, which is circuit 15 and route, the directory number and name and the call back number for the user. Further, the call trace information may switched, the Internet is packet-switched; communication on inform about whether the IP address for the end-point device the Internet is accomplished by transmitting and receiving is mobile and what redirection may have occurred before the packets of data. call was completed. In addition to data, each packet contains an address to In the case of a conference call, a further aspect of the ensure that it is routed correctly. The format of these packets invention is to provide a feature that enables call trace is de?ned by the Internet Protocol (IP). information about each one of the conferees to be delivered One type of allowable data is encoded, digitiZed voice. back to the originator of the conference call, whether the Voice over IP (VoIP) is encoded digitiZed voice that is conference is a voice, video or chat session. Even a circuit packetiZed in accordance with IP, and communicated over 25 switched time division multipleX (TDM) device may acti the Internet for telephone-like communication. vate this feature if it is connected to an end-point VoIP device through a gateway. Aservice provider can off-load branch-of?ce voice traf?c from the PSTN and route it across the company’s existing BRIEF DESCRIPTION OF THE DRAWING packet switched data intranet, thereby eliminating toll charges. In addition, interoffice faX traffic can be routed For a better understanding of the present invention, ref across a company’s data network or through an eXtranet, erence is made to the following description and accompa using eXisting faX machines, key systems, CentreXes, and nying drawings, while the scope of the invention is set forth PBXs, making the process of placing calls over the IP in the appended claims. network transparent to users. 35 The drawing is a schematic representation of a network Users of VoIP devices currently are not provided with call having network compatible devices. trace information. Such call trace information could be DETAILED DESCRIPTION OF THE useful in a variety of applications. INVENTION For instance, it would be useful for emergency E911 40 (electronic 911) service to help emergency personnel deter While the following description makes reference to pro mine critical information about an IP client in advance of viding call trace information to compatible VoIP devices, the rendering emergency service. Such call trace information call trace information may be provided to any packet would also be useful for tracking down and apprehending switched network device. prank callers who use VoIP. Even misbehaving IP clients 45 The drawing illustrates a communication network having could be identi?ed and reprimanded or shut down by net ?ve VoIP clients. The VoIP clients each include network work administrators that have access to such call trace compatible devices, such as voice communication devices, information. In addition, call trace information may serve as referred to as sets A, B, C, D & E. The sets may receive voice critical debugging information to help network servicing communications over a packet switched network, such as personnel determine network faults and the like. the Internet. The name and number information of the called party may The con?guration depicted in the drawing is illustrative be linked to address and geographic location information only; any number of communication devices may be about a called party. If geographic information about the employed and different types of networks may be con?gured called party of a VoIP call were known to the caller, the instead or in addition to that illustrated. For instance, the caller would then be in a position to know whether the call 55 user may have a plain old telephone service (POTS) tele is costly due to the geographic distance from the called party phone with an adjunct device that connects to a VoIP and whether the call to be placed is being received in a gateway that is in communication with the Internet or some different time Zone. If the caller is a retail merchant, geo other IP network. graphical information about the called party may be useful In the con?guration depicted in the drawing, set A talks to in deciding whether to ship certain products to certain set B through a local area network and a wide area geographical Zones. network A call server and a terminal proxy server It would be advantageous to provide call trace informa control sets A, B, C, D & E. Sets C, D & E may be in tion to users and/or administrators of network compatible conference with sets A & B or have separate calls going on devices. Such users and/or administrators would then be at the same time. informed about a caller’s end-point device in advance of 65 Sets D & E, which are wireless VoIP clients, communicate taking some action with respect to that caller or caller’s through a wireless VoIP base station with the Sets A, B or C. end-point device. Set C may be a computer telephony integration with a Case5:13-cv-05933-PSG Document1-7 Filed12/23/13 Page5 of 7 US 6,937,572 B1 3 4 monitor that displays a VoIP control panel. Set D may be a operating. Events in a trace chronology may be paired, Wireless LAN (802.11) Voice over IP phone With an integral forming event-pairs. An example of an event-pair includes text display capability. Set E may be a third generation the start and end times. Wireless digital phone With an integral text and video display Implementing the user interface to obtain this call trace capability. information from the IP-PBX call manager or gateWay is Where the adjunct device for a POTS telephone is being performed in the same manner implementing any other used instead of a VoIP device, the adjunct device Would be feature code activated IP-PBX feature. capable of handling the same type of information that the Most of the call trace information is con?gured at the time VoIP device handles. of registration for the VoIP device and stored in a variety of 10 locations or centraliZed directory and may be accessed using Auser may have a VoIP device or a TDM device (such as Local Directory Application Protocol (LDAP). As a VoIP one connected through a gateWay to a packet sWitched device registers With a packet sWitched netWork, it is network). The user of the packet sWitched netWork activates assigned an IP address, a domain name server (DMS) entry, the call trace information feature of the present invention. a directory number (DN), a name, and optionally a geo The activation may be by depressing a button, sliding a 15 graphic location that is assigned for static terminals (i.e., sWitch, or entering a feature code. Activation may also be those Which are at ?xed locations and not mobile), and automatic—either at startup, during the entire call, or peri terminal type (e.g., Wired, PC based, Wireless, etc.). DN, odically. If desired, the call trace feature may be remotely name and terminal type are stored in a call server data base activated With a sniffer softWare that is turned on in the (PBX), While data information such as IP address, DNS netWork. entry and other data parameters are stored in a data netWork Once activated, call trace information is provided at the server, such as a WINDOWS NT server. The terminal proxy user’s VoIP or TDM device. If desired, the call trace feature server may retrieve all this information at initial registration may be con?gured to present only selected pieces of infor of the VoIP device or the terminal proxy server may have mation. The presentation of the information may be in dynamic access to this information. graphic or numeric, textual or any combination thereof. 25 Once the user interface on the VoIP device has been Where the sniffer softWare is turned on, the sniffer softWare activated, a request signal is sent to the terminal proxy server monitors and reports this information to security or other for call trace information pertaining to an end-point device. authoriZed recipients. In response to the request signal, the terminal proxy server The call trace information may include the folloWing checks its oWn data base to retrieve the information pertain information about the connected end-point; the IP address, ing to call trace or dynamically retrieves it from the data the geographical location of the end-point device and the bases that represent administered data for that end-point type or class of the end-point device. In addition, the call device. trace information may provide the call route and the topol The terminal proxy server may supplement the retrieved ogy of the route, the domain name server (DNS) of the IP information by activating a dynamic IP trace against the address and route, the directory number and name and the 35 requested end-point device. The retrieved information is call back number for the user. Further, the call trace infor then returned to the VoIP device that requested the call trace mation may include Whether the IP address for the end-point information using an agreed upon protocol. device is mobile and What redirection may have occurred While the foregoing description and draWings represent before the call Was completed. the preferred embodiments of the present invention, it Will In the case of a conference call, the invention may 40 be understood that various changes and modi?cations may provide: a feature that enables the call trace information for be made Without departing from the spirit and scope of the each of the conferees to be delivered back to the originator present invention. of a conference call. Even a circuit sWitched time division What is claimed is: multiplex (TDM) device may activate this feature if it is 1. Apparatus that obtains call trace information, compris connected to a VoIP gateWay. 45 ing: An intelligent call log capability may be activated to log a netWork compatible device that is con?gured to com all of this call trace information for security or netWork municate over a packet sWitched netWork With an performance analysis. This capability may be triggered at end-point device, the netWork compatible device being the time the request for call trace information is received by con?gured to generate a request for call trace informa or acted upon by the terminal proxy server or at the time of tion that pertains to the end-point device and to receive receipt of the call trace information by the requesting device. the call trace information that Was requested and to dynamically display at least a portion of the call trace The implementation of this call trace feature uses ping information that Was received. and net trace tools and makes queries to an Internet Protocol 2. An apparatus as in claim 1, Wherein the call trace based Private Branch Exchange (IP-PBX) call manager or 55 information is selected from a group consisting of an Inter gateWay for information such as directory number (and net Protocol (IP) address, a geographical location of the name) to IP translation and for other parameters such as end-point device, a type or class of the end-point device, a geographical location, time, etc. The IP translation is a call route, a topology of the route, a domain name server of gatekeeper function to provide translation betWeen an IP the IP address and route, a directory number and name, a call address and a Name or Directory Number. It serves the same back number, an advisement as to Whether the IP address for type of function as a Domain Name Server (DNS). the end-point device is mobile and an advisement as to What Aping tool includes a routine that sends a packet onto the redirection may have occurred before the call Was com netWork and obtains a value of the average delay encoun pleted. tered by that packet in reaching the destination and return 3. An apparatus as in claim 1, Wherein the netWork ing. It also con?rms the status of the IP end-point. 65 compatible device is con?gured to originate a conference A netWork trace tool includes a routine that captures and call With a plurality of end points and to receive the call trace records events and states that occur While the netWork is information for each of the plurality of end-points. Case5:13-cv-05933-PSG Document1-7 Filed12/23/13 Page6 of 7 US 6,937,572 B1 5 6 4. An apparatus as in claim 3, wherein the network 18. An apparatus as in claim 17, wherein the call trace compatible device is a circuit switched time division mul information is selected from a group consisting of an Inter tipleX (TDM) compatible device. net Protocol (IP) address, a geographical location of the 5. An apparatus as in claim 1, wherein the network end-point device, a type or class of the end-point device, a compatible device is a circuit switched time division mul call route, a topology of the route, a domain name server of tipleX (TDM) compatible device. the IP address and route, a directory number and name, a call 6. An apparatus as in claim 1, wherein the network back number, an advisement as to whether the IP address for compatible device is a voice over Internet Protocol compat the end-point device is mobile and an advisement as to what ible device. redirection may have occurred before the call was com 7. An apparatus as in claim 1, further comprising at least 10 pleted. one data base containing the call trace information. 19. A method as in claim 18, further comprising logging 8. An apparatus as in claim 2, further comprising a call log the call trace information. that logs all the call trace information. 20. A method as in claim 18, further comprising storing 9. An apparatus that obtains call trace information, com the call trace information. prising: 15 21. A method as in claim 18, further comprising originat a network compatible device that is con?gured to com ing a conference call with a plurality of end-points and to municate over a packet switched network with an receive the call trace information for each of the plurality of end-point device, the network compatible device end-points. including means for generating a request for call trace 22. A method as in claim 21, wherein the network information about the end-point device, means for compatible device is a circuit switched time division mul receiving the call trace information that was requested tipleX (TDM) compatible device that accesses the packet and means for dynamically displaying at least a portion switched network through a gateway. of the call trace information that was received. 23. A method as in claim 18, wherein the network 10. An apparatus as in claim 9, wherein the call trace compatible device is a circuit switched time division mul information is selected from a group consisting of an Inter 25 tipleX (TDM) compatible device that accesses the packet net Protocol (IP) address, a geographical location of the switched network through a gateway. end-point device, a type or class of the end-point device, a 24. A method as in claim 18, wherein the network call route, a topology of the route, a domain name server of compatible device is a voice over Internet Protocol compat the IP address and route, a directory number and name, a call ible device. back number, an advisement as to whether the IP address for 25. An apparatus as in claim 1, further comprising: the end-point device is mobile and an advisement as to what a terminal proXy server, comprising software responsive redirection may have occurred before the call was com to a request to download call trace information and to pleted. transmit the downloaded call trace information to a 11. An apparatus as in claim 9, wherein the network network compatible device, the call trace information compatible device is con?gured to originate a conference 35 selected from a group consisting of an Internet Protocol call with a plurality of endpoints and to receive the call trace (IP) address, a geographical location of the end-point information for each of the plurality of end-points. device, a type or class of the end-point device, a call 12. An apparatus as in claim 10, wherein the network route, a topology of the route, a domain name server of compatible device is a circuit switched time division mul the IP address and route, a directory number and name, tipleX (TDM) compatible device. 40 a call back number, an advisement as to whether the IP 13. An apparatus as in claim 9, wherein the network address for the end-point device is mobile and an compatible device is a circuit switched time division mul advisement as to what redirection may have occurred tipleX (TDM) compatible device. before the call was completed. 14. An apparatus as in claim 9, wherein the network 26. An apparatus as in claim 1, further comprising: compatible device is a voice over Internet Protocol compat 45 a terminal proXy server, comprising software responsive ible device. to a request for call trace information to dynamically 15. An apparatus as in claim 9, further comprising means access and then transmit the call trace information to a for storing the call trace information. network compatible device, the call trace information 16. An apparatus as in claim 9, further comprising means selected from a group consisting of an Internet Protocol for logging the call trace information. (IP) address, a geographical location of the end-point 17. A method that obtains call trace information, com device, a type or class of the end-point device, a call prising: route, a topology of the route, a domain name server of communicating over a packet switched network between the IP address and route, a directory number and name, a network compatible device and an end-point device, a call back number, an advisement as to whether the IP generating a request for call trace information that 55 address for the end-point device is mobile and an pertains to the end-point device, subsequently receiving advisement as to what redirection may have occurred the call trace information that was requested, and before the call was completed. dynamically displaying at least a portion of the call trace information that was received. * * * * * Case5:13-cv-05933-PSG Document1-7 Filed12/23/13 Page7 of 7 UNITED STATES PATENT AND TRADEMARK OFFICE CERTIFICATE OF CORRECTION PATENT N0. : 6,937,572 B1 Page 1 of 1 APPLICATION NO. : 09/751796 DATED : August 30, 2005 INVENTOR(S) : Brian B. Egan and Milos Vodsedalek It is certified that error appears in the above-identi?ed patent and that said Letters Patent is hereby corrected as shown below: Claim 18, Column 6, line I: delete “An apparatus” insert --A method- Signed and Sealed this Eighteenth Day of September, 2012 David J. Kappos Director ofthe United States Patent and Trademark O?ice Case5:13-cv-05933-PSG Document1-8 Filed12/23/13 Page1 of 2 -6 5HY FDQGUHY &,9,/&29(56+((7 7KH-6FLYLOFRYHUVKHHWDQGWKHLQIRUPDWLRQFRQWDLQHGKHUHLQQHLWKHUUHSODFHQRUVXSSOHPHQWWKHILOLQJDQGVHUYLFHRISOHDGLQJVRURWKHUSDSHUVDVUHTXLUHGE\ODZH[FHSWDV SURYLGHGE\ORFDOUXOHVRIFRXUW7KLVIRUPDSSURYHGE\WKH-XGLFLDO&RQIHUHQFHRIWKH8QLWHG6WDWHVLQ6HSWHPEHU LVUHTXLUHGIRUWKHXVHRIWKH&OHUNRI&RXUWIRUWKH ¢ ¢ £ ¤ ¡ ¥ ¦ § ¨ ¥ £ © ¤ ¡ © ¤ ¤ ¢ ¥ ¢ © ¥ £ ¡ © ¦ SXUSRVHRILQLWLDWLQJWKHFLYLOGRFNHWVKHHW ¡ [ \ \ ] ^ _ ` a b c \ b o f e h g \ a o \ h f s r t u d x y e a ~ \ s ^ _ d f e h _ b j a \ ^ \ ] s _ o x x g i , D 3/$,17,))6 '()(1'$176 d e a f e g ^ e h e E &RXQW\RI5HVLGHQFHRI)LUVW/LVWHG3ODLQWLII &RXQW\RI5HVLGHQFHRI)LUVW/LVWHG'HIHQGDQW ¢ ¨ ¢ ¥ £ ¤ § ¡ £ ¤ ¥ £ ¨ ¡ ¢ ¡ £ ¤ § ¡ £ ¤ ¥ £ ¨ ¡ ¢ ¡ © ¤ 127( ,1/$1'&21'(01$7,21&$6(686(7+(/2&$7,212) 7+(75$&72)/$1',192/9(' £ $ % ! & ¤ ¥ ! ¤ " # $WWRUQH\V $WWRUQH\V e f f j _ k d c l e h h _ a m n o p c m q r s a a n t e a r _ ^ u h p r j e h f v d r ^ ^ s w e a m x x y i F g e ^ s | \ h a s e d f h _ _ f m } } a ~ ^ \ \ h m d e a h e a b s o b \ m g e ^ s | \ h a s e m z { z z { { ' ( ) © * ! + © , ' ( ) © * ! + $ ! - $ $ ,,%$6,62)-85,6',&7,21 ,,,&,7,=(16+,32)35,1&,3$/3$57,(6 ! . / - , ¨ © , © * ! + $ ! . $ - u 86*RYHUQPHQW u )HGHUDO4XHVWLRQ 37) '() 37) '() § ¡ ! / - ¤ ! - -, ! 3ODLQWLII &LWL]HQRI7KLV6WDWH u u ,QFRUSRUDWHG 3ULQFLSDO3ODFH u u RI%XVLQHVV,Q7KLV6WDWH u 86*RYHUQPHQW u 'LYHUVLW\ &LWL]HQRI$QRWKHU6WDWH u u ,QFRUSRUDWHG 3ULQFLSDO3ODFH u u ' - ¨ - 0 ! $ - £ - £ £ £ 'HIHQGDQW £ RI%XVLQHVV,Q$QRWKHU6WDWH &LWL]HQRU6XEMHFWRID u u )RUHLJQ1DWLRQ u u )RUHLJQ&RXQWU\ ' ( ) © * ! + © , ,91$785(2)68,7 &2175$&7 72576 )25)(,785(3(1$/7< %$1.5837&< 27+(567$787(6 u ,QVXUDQFH 3(5621$/,1-85< 3(5621$/,1-85< u 'UXJ5HODWHG6HL]XUH u $SSHDO86& u )DOVH&ODLPV$FW u 0DULQH u $LUSODQH u 3HUVRQDO,QMXU\ RI3URSHUW\86& u :LWKGUDZDO u 6WDWH5HDSSRUWLRQPHQW u 0LOOHU$FW u $LUSODQH3URGXFW 3URGXFW/LDELOLW\ u 2WKHU 86& u $QWLWUXVW u 1HJRWLDEOH,QVWUXPHQW /LDELOLW\ u +HDOWK&DUH u %DQNVDQG%DQNLQJ u 5HFRYHU\RI2YHUSD\PHQW u $VVDXOW/LEHO 3KDUPDFHXWLFDO 3523(57<5,*+76 u &RPPHUFH (QIRUFHPHQWRI-XGJPHQW 6ODQGHU 3HUVRQDO,QMXU\ u &RS\ULJKWV u 'HSRUWDWLRQ u 0HGLFDUH$FW u )HGHUDO(PSOR\HUV¶ 3URGXFW/LDELOLW\ u 3DWHQW u 5DFNHWHHU,QIOXHQFHGDQG u 5HFRYHU\RI'HIDXOWHG /LDELOLW\ u $VEHVWRV3HUVRQDO u 7UDGHPDUN &RUUXSW2UJDQL]DWLRQV 6WXGHQW/RDQV u 0DULQH ,QMXU\3URGXFW u &RQVXPHU&UHGLW ([FOXGHV9HWHUDQV u 0DULQH3URGXFW /LDELOLW\ /$%25 62&,$/6(&85,7< u &DEOH6DW79 u 5HFRYHU\RI2YHUSD\PHQW /LDELOLW\ 3(5621$/3523(57< u )DLU/DERU6WDQGDUGV u +,$ II u 6HFXULWLHV&RPPRGLWLHV RI9HWHUDQ¶V%HQHILWV u 0RWRU9HKLFOH u 2WKHU)UDXG $FW u %ODFN/XQJ ([FKDQJH u 6WRFNKROGHUV¶6XLWV u 0RWRU9HKLFOH u 7UXWKLQ/HQGLQJ u /DERU0DQDJHPHQW u ',:&',:: J u 2WKHU6WDWXWRU\ $FWLRQV u 2WKHU&RQWUDFW 3URGXFW/LDELOLW\ u 2WKHU3HUVRQDO 5HODWLRQV u 66,'7LWOH;9, u $JULFXOWXUDO$FWV u &RQWUDFW 3URGXFW/LDELOLW\ u 2WKHU3HUVRQDO 3URSHUW\'DPDJH u 5DLOZD\/DERU$FW u 56, J u (QYLURQPHQWDO0DWWHUV u )UDQFKLVH ,QMXU\ u 3URSHUW\'DPDJH u )DPLO\DQG0HGLFDO u )UHHGRPRI,QIRUPDWLRQ u 3HUVRQDO,QMXU\ 3URGXFW/LDELOLW\ /HDYH$FW $FW 0HGLFDO0DOSUDFWLFH u 2WKHU/DERU/LWLJDWLRQ u $UELWUDWLRQ 5($/3523(57< &,9,/5,*+76 35,621(53(7,7,216 u (PSOR\HH5HWLUHPHQW )('(5$/7$;68,76 u $GPLQLVWUDWLYH3URFHGXUH u /DQG&RQGHPQDWLRQ u 2WKHU&LYLO5LJKWV +DEHDV&RUSXV ,QFRPH6HFXULW\$FW u 7D[HV 863ODLQWLII $FW5HYLHZRU$SSHDORI u )RUHFORVXUH u 9RWLQJ u $OLHQ'HWDLQHH RU'HIHQGDQW $JHQF\'HFLVLRQ u 5HQW/HDVH (MHFWPHQW u (PSOR\PHQW u 0RWLRQVWR9DFDWH u ,56²7KLUG3DUW\ u &RQVWLWXWLRQDOLW\RI u 7RUWVWR/DQG u +RXVLQJ 6HQWHQFH 86& 6WDWH6WDWXWHV u 7RUW3URGXFW/LDELOLW\ $FFRPPRGDWLRQV u *HQHUDO u $OO2WKHU5HDO3URSHUW\ u $PHUZ'LVDELOLWLHV u 'HDWK3HQDOW\ ,00,*5$7,21 (PSOR\PHQW 2WKHU u 1DWXUDOL]DWLRQ$SSOLFDWLRQ u $PHUZ'LVDELOLWLHV u 0DQGDPXV 2WKHU u 2WKHU,PPLJUDWLRQ 2WKHU u &LYLO5LJKWV $FWLRQV u (GXFDWLRQ u 3 ULVRQ&RQGLWLRQ u &LYLO'HWDLQHH &RQGLWLRQVRI &RQILQHPHQW ' ( ) © * ! + © , 925,*,1 u 2ULJLQDO u 5HPRYHGIURP u 5HPDQGHGIURP u 5HLQVWDWHGRU u 7UDQVIHUUHGIURP u 0XOWLGLVWULFW ' $ , 3URFHHGLQJ 6WDWH&RXUW $SSHOODWH&RXUW 5HRSHQHG $QRWKHU'LVWULFW /LWLJDWLRQ 1 2 3 4 3 5 6 7 5 8 9 : ; 7 < = 7 6 5 7 3 4 > ? < 5 > 5 : 5 8 < : 4 ? 8 < < = 7 @ 8 ; < 7 5 A } u c d c g c } } m u c d c g c } { z &LWHWKH86&LYLO6WDWXWHXQGHUZKLFK\RXDUHILO LQJ 9,&$86(2)$&7,21 b f s \ a | \ h _ b ^ e h e f \ h r ~ ] t _ a f \ | \ a ` a | h s a ] _ t _ a f %ULHIGHVFULSWLRQRIFDXVH 9,,5(48(67(',1 u &+(&.,)7+,6,6$ &/$66$&7,21 '(0$1' &+(&.<(6RQO\LIGHPDQGHGLQFRPSODLQW &203/$,17 81'(558/()5&Y3 -85<'(0$1' u - " ' - ! B 9,,,5(/$7('&$6( 6 ¡ ,)$1< -8'*( '2&.(7180%(5 '$7( 6,*1$785(2)$77251(<2)5(&25' } } } ¡ { C D E F C G C H C I J K L K H H C M J N O J P Q R ST SU L EV E W X Y Z 3ODFHDQ³;´LQ2QH%R[2QO\ 6$1)5$1&,6&22$./$1' 6$1-26( (85(.$ -65HYHUVH 5HY Case5:13-cv-05933-PSG Document1-8 Filed12/23/13 Page2 of 2 ,16758&7,216)25$77251(<6&203/(7,1*&,9,/&29(56+((7)250-6 $XWKRULW\)RU&LYLO&RYHU6KHHW 7KH-6FLYLOFRYHUVKHHWDQGWKHLQIRUPDWLRQFRQWDLQHGKHUHLQQHLWKHUUHSODFHVQRUVXSSOHPHQWVWKHILOLQJVDQGVHUYLFHRISOHDGLQJRURWKHUSDSHUVDV UHTXLUHGE\ODZH[FHSWDVSURYLGHGE\ORFDOUXOHVRIFRXUW7KLVIRUPDSSURYHGE\WKH-XGLFLDO&RQIHUHQFHRIWKH8QLWHG6WDWHVLQ6HSWHPEHU LV UHTXLUHGIRUWKHXVHRIWKH&OHUNRI&RXUWIRUWKHSXUSRVHRILQLWLDWLQJWKHFLYLOGRFNHWVKHHW&RQVHTXHQWO\DFLYLOFRYHUVKHHWLVVXEPLWWHGWRWKH&OHUNRI &RXUWIRUHDFKFLYLOFRPSODLQWILOHG7KHDWWRUQH\ILOLQJDFDVHVKRXOGFRPSOHWHWKHIRUPDVIROORZV , D 3ODLQWLIIV'HIHQGDQWV (QWHUQDPHV ODVWILUVWPLGGOHLQLWLDO RISODLQWLIIDQGGHIHQGDQW,IWKHSODLQWLIIRUGHIHQGDQWLVDJRYHUQPHQWDJHQF\XVH RQO\WKHIXOOQDPHRUVWDQGDUGDEEUHYLDWLRQV,IWKHSODLQWLIIRUGHIHQGDQWLVDQRIILFLDOZLWKLQDJRYHUQPHQWDJHQF\LGHQWLI\ILUVWWKHDJHQF\DQG WKHQWKHRIILFLDOJLYLQJERWKQDPHDQGWLWOH E &RXQW\RI5HVLGHQFH )RUHDFKFLYLOFDVHILOHGH[FHSW86SODLQWLIIFDVHVHQWHUWKHQDPHRIWKHFRXQW\ZKHUHWKHILUVWOLVWHGSODLQWLIIUHVLGHVDWWKH WLPHRIILOLQJ,Q86SODLQWLIIFDVHVHQWHUWKHQDPHRIWKHFRXQW\LQZKLFKWKHILUVWOLVWHGGHIHQGDQWUHVLGHVDWWKHWLPHRIILOLQJ 127( ,QODQG FRQGHPQDWLRQFDVHVWKHFRXQW\RIUHVLGHQFHRIWKHGHIHQGDQWLVWKHORFDWLRQRIWKHWUDFWRIODQGLQYROYHG F $WWRUQH\V (QWHUWKHILUPQDPHDGGUHVVWHOHSKRQHQXPEHUDQGDWWRUQH\RIUHFRUG,IWKHUHDUHVHYHUDODWWRUQH\VOLVWWKHPRQDQDWWDFKPHQWQRWLQJ LQWKLVVHFWLRQ VHHDWWDFKPHQW ,, -XULVGLFWLRQ 7KHEDVLVRIMXULVGLFWLRQLVVHWIRUWKXQGHU5XOH D )5&Y3ZKLFKUHTXLUHVWKDWMXULVGLFWLRQVEHVKRZQLQSOHDGLQJV3ODFHDQ; LQRQHRIWKHER[HV,IWKHUHLVPRUHWKDQRQHEDVLVRIMXULVGLFWLRQSUHFHGHQFHLVJLYHQLQWKHRUGHUVKRZQEHORZ 8QLWHG6WDWHVSODLQWLII -XULVGLFWLRQEDVHGRQ86&DQG6XLWVE\DJHQFLHVDQGRIILFHUVRIWKH8QLWHG6WDWHVDUHLQFOXGHGKHUH 8QLWHG6WDWHVGHIHQGDQW :KHQWKHSODLQWLIILVVXLQJWKH8QLWHG6WDWHVLWVRIILFHUVRUDJHQFLHVSODFHDQ;LQWKLVER[ )HGHUDOTXHVWLRQ 7KLVUHIHUVWRVXLWVXQGHU86&ZKHUHMXULVGLFWLRQDULVHVXQGHUWKH&RQVWLWXWLRQRIWKH8QLWHG6WDWHVDQDPHQGPHQW WRWKH&RQVWLWXWLRQDQDFWRI&RQJUHVVRUDWUHDW\RIWKH8QLWHG6WDWHV,QFDVHVZKHUHWKH86LVDSDUW\WKH86SODLQWLIIRUGHIHQGDQWFRGHWDNHV SUHFHGHQFHDQGER[RUVKRXOGEHPDUNHG 'LYHUVLW\RIFLWL]HQVKLS 7KLVUHIHUVWRVXLWVXQGHU86&ZKHUHSDUWLHVDUHFLWL]HQVRIGLIIHUHQWVWDWHV:KHQ%R[LVFKHFNHGWKH FLWL]HQVKLSRIWKHGLIIHUHQWSDUWLHVPXVWEHFKHFNHG 6HH6HFWLRQ,,,EHORZ 127( IHGHUDOTXHVWLRQDFWLRQVWDNHSUHFHGHQFHRYHUGLYHUVLW\ FDVHV ,,, 5HVLGHQFH FLWL]HQVKLS RI3ULQFLSDO3DUWLHV7KLVVHFWLRQRIWKH-6LVWREHFRPSOHWHGLIGLYHUVLW\RIFLWL]HQVKLSZDVLQGLFDWHGDERYH0DUNWKLV VHFWLRQIRUHDFKSULQFLSDOSDUW\ ,9 1DWXUHRI6XLW 3ODFHDQ;LQWKHDSSURSULDWHER[,IWKHQDWXUHRIVXLWFDQQRWEHGHWHUPLQHGEHVXUHWKHFDXVHRIDFWLRQLQ6HFWLRQ9,EHORZLV VXIILFLHQWWRHQDEOHWKHGHSXW\FOHUNRUWKHVWDWLVWLFDOFOHUN V LQWKH$GPLQLVWUDWLYH2IILFHWRGHWHUPLQHWKHQDWXUHRIVXLW,IWKHFDXVHILWVPRUHWKDQ RQHQDWXUHRIVXLWVHOHFWWKHPRVWGHILQLWLYH 9 2ULJLQ 3ODFHDQ;LQRQHRIWKHVL[ER[HV 2ULJLQDO3URFHHGLQJV &DVHVZKLFKRULJLQDWHLQWKH8QLWHG6WDWHVGLVWULFWFRXUWV 5HPRYHGIURP6WDWH&RXUW 3URFHHGLQJVLQLWLDWHGLQVWDWHFRXUWVPD\EHUHPRYHGWRWKHGLVWULFWFRXUWVXQGHU7LWOH86&6HFWLRQ :KHQWKHSHWLWLRQIRUUHPRYDOLVJUDQWHGFKHFNWKLVER[ 5HPDQGHGIURP$SSHOODWH&RXUW &KHFNWKLVER[IRUFDVHVUHPDQGHGWRWKHGLVWULFWFRXUWIRUIXUWKHUDFWLRQ8VHWKHGDWHRIUHPDQGDVWKHILOLQJ GDWH 5HLQVWDWHGRU5HRSHQHG &KHFNWKLVER[IRUFDVHVUHLQVWDWHGRUUHRSHQHGLQWKHGLVWULFWFRXUW8VHWKHUHRSHQLQJGDWHDVWKHILOLQJGDWH 7UDQVIHUUHGIURP$QRWKHU'LVWULFW )RUFDVHVWUDQVIHUUHGXQGHU7LWOH86&6HFWLRQ D 'RQRWXVHWKLVIRUZLWKLQGLVWULFWWUDQVIHUVRU PXOWLGLVWULFWOLWLJDWLRQWUDQVIHUV 0XOWLGLVWULFW/LWLJDWLRQ &KHFNWKLVER[ZKHQDPXOWLGLVWULFWFDVHLVWUDQVIHUUHGLQWRWKHGLVWULFWXQGHUDXWKRULW\RI7LW OH86&6HFWLRQ :KHQWKLVER[LVFKHFNHGGRQRWFKHFN DERYH 9, &DXVHRI$FWLRQ 5HSRUWWKHFLYLOVWDWXWH GLUHFWO\UHODWHGWRWKHFDXVHRIDFWLRQDQGJLYHDEULHIGHVFULSWLRQRIWKHFDXVH 'RQRWFLWHMXULVGLFWLRQDO VWDWXWHVXQOHVVGLYHUVLW\ ([DPSOH 86&LYLO6WDWXWH 86&%ULHI'HVFULSWLRQ 8QDXWKRUL]HGUHFHSWLRQRIFDEOHVHUYLFH 9,, 5HTXHVWHGLQ&RPSODLQW &ODVV$FWLRQ3ODFHDQ;LQWKLVER[LI\RXDUHILOLQJDFODVVDFWLRQXQGHU5XOH)5&Y3 'HPDQG,QWKLVVSDFHHQWHUWKHDFWXDOGROODUDPRXQWEHLQJGHPDQGHGRULQGLFDWHRWKHUGHPDQGVXFKDVDSUHOLPLQDU\LQMXQFWLRQ -XU\'HPDQG&KHFNWKHDSSURSULDWHER[WRLQGLFDWHZKHWKHURUQRWDMXU\LVEHLQJGHPDQGHG 9,,, 5HODWHG&DVHV 7KLVVHFWLRQRIWKH-6LVXVHGWRUHIHUHQFHUHODWHGSHQGLQJFDVHVLIDQ\,IWKHUHDUHUHODWHGSHQGLQJFDVHVLQVHUWWKHGRFNHW QXPEHUVDQGWKHFRUUHVSRQGLQJMXGJHQDPHVIRUVXFKFDVHV 'DWHDQG$WWRUQH\6LJQDWXUH 'DWHDQGVLJQWKHFLYLOFRYHUVKHHW