USOO8638908B2 (12) United States Patent (10) Patent No.: US 8,638,908 B2 Leeds et al. (45) Date of Patent: *Jan. 28, 2014 (54) CONTEXTUAL CONVERSATION 379/142.04, 164, 179, 192, 252, PROCESSING IN TELECOMMUNICATION 379/372 374.02:455/567 APPLICATIONS See application file for complete search history. (75) Inventors: Richard Leeds, Bellevue, WA (US); (56) References Cited Elon Gasper, Bellevue, WA (US) U.S. PATENT DOCUMENTS (73) Assignee: Computer Products Introductions, 7,027,569 B2 4, 2006 Price Corp, Bellevue, WA (US) 7,127.238 B2 10/2006 Vandermeijden et al. 7,310,416 B1 12/2007 Henderson 2003/0026416 A1 2/2003 Fusco (*) Notice: Subject to any disclaimer, the term of this 2004, OO67751 A1 4/2004 Vandermeijden et al. patent is extended or adjusted under 35 2004/0235520 A1 11, 2004 Cadiz et al. U.S.C. 154(b) by 187 days. 2006,0003814 A1 1/2006 Moody et al. 2006/0111085 A1 5, 2006 Lee This patent is Subject to a terminal dis 2006/0148459 A1 7/2006 Wolfman et al. claimer. 2006/01995.75 A1 9, 2006 Moore et al. 2006/0215827 A1 9/2006 Pfleging et al. (21) Appl. No.: 13/305,686 2007/0117554 A1 5/2007 Arnos 2007/0264978 A1 1 1/2007 Stoops (22) Filed: Nov. 28, 2011 2009, O220067 A1 9, 2009 Leeds Primary Examiner – MD S Elahee (65) Prior Publication Data (74) Attorney, Agent, or Firm — LaRiviere, Grubman & US 2012/0134480 A1 May 31, 2012 Payne, LLP (57) ABSTRACT A method for generating a ring tone for a given caller based on Related U.S. Application Data a prior conversation with that caller. A portion of a conversa (63) Continuation-in-part of application No. 12/339,429, tion with a given caller is recorded and stored in memory as a filed on Dec. 19, 2008, now Pat. No. 8,068,604, and a ring tone. When a Subsequent call is received from the same continuation-in-part of application No. 12/039,596, caller, identified by caller ID, the ring tone is played, alerting filed on Feb. 28, 2008, now Pat. No. 8,553,852. the user to the incoming call as well as the context of their prior communication. In alternative embodiments of the (51) Int. C. invention, a prior textual or video conversation is used as the (2006.01) basis for a ring tone, and/or the ring tone is delivered by (52) U.S. C. other than audio means. The invention is capable of imple USPC .......... 379/76; 379/88.22; 379/164; 379/179; mentation in telecommunications systems such as cellular, 379/252: 379/373.01; 455/567 local exchange, and VOIP, and in combination with other (58) Field of Classification Search forms of internet-based telecommunication. USPC ............ 379/48, 72, 76, 88.16, 88.22, 100.06, 4 Claims, 24 Drawing Sheets 3. Y 3. ir coming Cai Caier NSecognizes PlayStandard Ringtone For Play Ringtone Basad. On 33 unrecognized Caller 335 Notification Setting 34 Record Conversation Sampie Seas Ringtore? sca eversaic Save Conversation Sample 38 Sample Set as Ringtone U.S. Patent Jan. 28, 2014 Sheet 1 of 24 US 8,638,908 B2 Terminal/Handset 110 Local Exchange Carrier, Cell or VOIP Platform 120 Local Exchange Carrier, Cell or VOIP Platform 140 Terminal/Handset 150 Figure 1 U.S. Patent Jan. 28, 2014 Sheet 2 of 24 US 8,638,908 B2 PSTN, PBX, LEC, cellular, Internet, etc. Interface. Caller ID & Ring detect apparatus, Call : placement apparatus : 230 Processor 250 Memory i Figure 2 U.S. Patent Jan. 28, 2014 Sheet 3 of 24 US 8,638,908 B2 300 Y 310 incoming Call No Caer D Yes Recognized? PlayStandard Ringtone For Play Ringtone Based On 330 Unrecognized Caller Notification Setting 340 Record Conversation Sample No Set as Yes Ringtone? 350 Discard Conversation Save Conversation Sample 360 Sample 365 Set as Ringtone Figure 3 U.S. Patent Jan. 28, 2014 Sheet 4 of 24 US 8,638,908 B2 400 410 Incoming Call No Caller D Yes Recognized? Play Standard Ringtone and Play Ringtone and/or Display 430 Display Standard Text for Text Based on Notification Unrecognized Caller Setting 440 Record Conversation Sample No Set as Display? Yes 450 Discard Conversation Convert Conversation 460 Sample 470 Sample to Text 480 Save and Set Text as Notification Text Figure 4 U.S. Patent Jan. 28, 2014 Sheet 5 of 24 US 8,638,908 B2 - Incoming Text or 510 Chat No Caller D Yes ecognized? Play Ringtone Based on 530 Play Standard Ringtone Notification Setting 540 Record Text or Chat No Set as Yes Ringtone? 550 Discard Conversation Convert Text to Audio 560 Sample 570 Speech 580 Save and Set Audio Speech as Ringtone Figure 5 U.S. Patent Jan. 28, 2014 Sheet 6 of 24 US 8,638,908 B2 600 60 incoming Call Caler D Yes Recognized? Play Ringtone Based on 630 Play Standard Ringtone Notification Setting Record Caller Memo 650 Set as Ringtone Figure 6 U.S. Patent Jan. 28, 2014 Sheet 7 of 24 US 8,638,908 B2 700 N Operating System (e.g., Linux) and file storage 710 Overall application shell for plug-ins (e.g., FireFox browser) Sound Flash-like AP A softphone plug Hander module module for in with user (e.g., SDL) (e.g., NetStream interface 730 760 Gnash) based 750 phone platform (e.g., Ribbit) 740 Netstream-style telecommunications internet (and phone platform, e.g., Ribbit, with 'digital switch' integration With PSTN Figure 7 U.S. Patent Jan. 28, 2014 Sheet 8 of 24 US 8,638,908 B2 800 N Operating System (e.g., Windows) with standard file storage, I/O, etc. Standard P.C. application, e.g., WXCommunicator 820 Module for SIP Module for User telecomm and other Interface features, I/O, e.g., SipXTapi e.g., wxWidgets 830 840 SIP-style telecommunications stream Internet, with SIP phone platform providers and PSTN gateways Figure 8 U.S. Patent US 8,638,908 B2 U.S. Patent Jan. 28, 2014 Sheet 10 of 24 US 8,638,908 B2 uesn U.S. Patent Jan. 28, 2014 Sheet 12 of 24 US 8,638,908 B2 0 $1], 0.11. U.S. Patent US 8,638,908 B2 U.S. Patent Jan. 28, 2014 Sheet 15 of 24 US 8,638,908 B2 Event Occurs 90 Phone Etc. cal GetAudioReminderfro mEvent or equivalent Get IP address Get corresponding Get Caller D from Private D or other indicator of originator designator Unknown person. Exit No indicating that and no is there more than 12 Yes 16rigination indicator have a ReminderRing to be used RR key ID (i.e., an associated to announce this event. person?) 192 Disambiguate andlor replace using mechanism specified s there a single reminde Get that rr filename by UI options! Ring set for that Key ID fg configuration files 196 this even? (Not shown: In all exit Resolve to 1 194 cases, besides returning an irr filename rr filename using designating the ls there more than 2 mechanism(s) specified by Ui ReminderRing to be used to announce this call, or options/configuration files an indication of its absence, ToneNapper may also return a separate rr filename as Did the UIU options the designation for a new configuration files indicate reminderRing file to be one should be Created formed, presumably from Exit the contents of this call, indicating and potentially used to that aCSOe rr filename subsequent calls for Known person, no other events.) reminderRing. Exit indicating that and no is an This applies to any kind ReminderRing to be used alternative of "call" event, not just to announce this event phone, Figure 15. ToneMapper response to telecommunications event U.S. Patent Jan. 28, 2014 Sheet 16 of 24 US 8,638,908 B2 2OO Terminal? Handset LOcal Exchange Carrier, Cell or VOIP Local platform, Exchange eC. 2OO Carrier, Cell Terminal? Handset platform, etc. 301 Control Program Controlling various Reminder Rings 2OO local Terminal? Exchange Local Handset Carrier, Cell Exchange or VOIP Carrier, Cell platform, or VOIP etc. platform, etc. 20O Terminal/ handset Figure 16 U.S. Patent Jan. 28, 2014 Sheet 17 of 24 US 8,638,908 B2 Controlled Controller NeedReminderRing to change Phone and/or other N 901 connection(s) - Detect call 900 Initiate Call from Controller Caller D Get Caller ID or or with equivalent equivalent identifier 906 Call- Connected -i.Controller table?in the S. Y-1 againError: andlor S. Connect to the call notehuman for No Specialse signa annunciation(without any "ring") 907 evaluation? detected? remediation Phone or other Connection(s) No Transmit special audio Yes 920 signal (e.g., answer the call with a short tone and "One moment Transmit identifying tone + encoded target caller please") 908 ID other identifier + new ReminderRing 925 Phone or other Connection(s) Digitize incoming audio No -95 N N ls dying, Conti tone present O?te 8S 3 Acknowledgementssignal present- Phone other N normal call Y orce Accept next audio Extract Caller D Note successful establishment of new segment as new or other ReminderRing on Controlled phone or other RingReminder identifier(s) for the system, so no repeat attempts to ReminderRing to Set ReminderRing be associated with as the new one for those target Pre- 930 indentifiers, Exit - Nok annunciation2970 consis,One Eas N TrainsSignal forto Pre-Niairn? acknowledgment annunciation2. No Figure 17 U.S. Patent Jan. 28, 2014 Sheet 19 of 24 US 8,638,908 B2 S^ & exes U.S. Patent Jan. 28, 2014 Sheet 22 of 24 US 8,638,908 B2 Figure 22 U.S.