(12) United States Patent (10) Patent No.: US 9,715,875 B2 Piernot Et Al
Total Page:16
File Type:pdf, Size:1020Kb
USOO971.5875B2 (12) United States Patent (10) Patent No.: US 9,715,875 B2 Piernot et al. (45) Date of Patent: Jul. 25, 2017 (54) REDUCING THE NEED FOR MANUAL (56) References Cited STARTAEND-PONTING AND TRIGGER PHRASES U.S. PATENT DOCUMENTS 1,559,320 A 10, 1925 Hirsh (71) Applicant: Apple Inc., Cupertino, CA (US) 2,180,522 A 11/1939 Henne (Continued) (72) Inventors: Philippe P. Piernot, Palo Alto, CA (US); Justin G. Binder, Oakland, CA FOREIGN PATENT DOCUMENTS (US) CA 2666438 C 6, 2013 (73) Assignee: Apple Inc., Cupertino, CA (US) CH 681573 A5 4f1993 (Continued) (*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 OTHER PUBLICATIONS U.S.C. 154(b) by 53 days. Extended European Search Report (includes Partial European Search Report and European Search Opinion) received for Euro (21) Appl. No.: 14/502,737 pean Patent Application No. 15169349.6, mailed on Jul. 28, 2015, 8 pages. (22) Filed: Sep. 30, 2014 (Continued) (65) Prior Publication Data Primary Examiner — Ibrahim Siddo (74) Attorney, Agent, or Firm — Morrison & Foerster US 2015/0348548 A1 Dec. 3, 2015 LLP (57) ABSTRACT Systems and processes for selectively processing and Related U.S. Application Data responding to a spoken user input are provided. In one (60) Provisional application No. 62/005,760, filed on May example, audio input containing a spoken user input can be 30, 2014. received at a user device. The spoken user input can be identified from the audio input by identifying start and (51) Int. C. end-points of the spoken user input. It can be determined GIOL I5/22 (2006.01) whether or not the spoken user input was intended for a virtual assistant based on contextual information. The deter GIOL I5/26 (2006.01) mination can be made using a rule-based system or a (Continued) probabilistic system. If it is determined that the spoken user (52) U.S. C. input was intended for the virtual assistant, the spoken user CPC .............. G10L 15/22 (2013.01); G10L 15/26 input can be processed and an appropriate response can be (2013.01); H04 W4/025 (2013.01); generated. If it is instead determined that the spoken user (Continued) input was not intended for the virtual assistant, the spoken (58) Field of Classification Search user input can be ignored and/or no response can be gener CPC ....................................................... G1OL 15/22 ated. See application file for complete search history. 8 Claims, 5 Drawing Sheets Process 400 Monitor The Audio input For A Spoken 402 Receive AStart-pointldentifier User input - Spoken User input entified 404 Receive An Audio input deterine Whethe Of Not The Wirtual Assistant Should respond To The Spoken user Input Based On 406 ldentify An Initial Spoken User input Contextuallnformation From The Audio input Respond? 408 Generate AresponseToThe First Spoken User input Generate AResponseToThe Spoken User input US 9,715,875 B2 Page 2 (51) Int. C. 4,790,028 12, 1988 Ramage GOL 7/00 4,797,930 1, 1989 Goudie (2013.01) 4,802,223 1, 1989 Lin et al. H0474/02 (2009.01) 4,803,729 2, 1989 Baker GIOL 15/18 (2013.01) 4,807,752 2, 1989 Chodorow (52) U.S. C. 4,811,243 3, 1989 Racine CPC 4,813,074 3, 1989 Marcus G10L 15/1815 (2013.01); G 10L 15/1822 4,819,271 4, 1989 Bahl et al. (2013.01); G 10L 17/00 (2013.01); G 10L 4,827,518 5, 1989 Feustel et al. 2015/223 (2013.01); G 10L 2015/227 4,827,520 5, 1989 Zeinstra (2013.01); G 10L 2015/228 (2013.01) 4,829,576 5, 1989 Porter 4,829,583 5, 1989 Monroe et al. References Cited 4,831,551 5, 1989 Schalk et al. (56) 4,833,712 5, 1989 Bahl et al. 4,833,718 5, 1989 Sprague U.S. PATENT DOCUMENTS 4,837,798 6, 1989 Cohen et al. 4,837,831 6, 1989 Gillick et al. 3,704,345 11, 1972 Coker et al. 4,839,853 6, 1989 Deerwester et al. 3,710,321 1, 1973 Rubenstein 4,852,168 7, 1989 Sprague 3,828,132 8, 1974 Flanagan et al. 4,862.504 8, 1989 Nomura 3,979,557 9, 1976 Schulman et al. 4,875,187 10, 1989 Smith 4,013,085 3, 1977 Wright 4,878,230 10, 1989 Murakami et al. 4,081,631 3, 1978 Feder 4,887.212 12, 1989 Zamora et al. 4,090,216 5, 1978 Constable 4,896.359 1, 1990 Yamamoto et al. 4,107,784 8, 1978 Van Bemmelen 4,903,305 2, 1990 Gillick et al. 4,108,211 8, 1978 Tanaka 4.905,163 2, 1990 Garber et al. 4,159,536 6, 1979 Kehoe et al. 4,908,867 3, 1990 Silverman 4,181,821 1, 1980 Pirz et al. 4.914,586 4, 1990 Swinehart et al. 4,204,089 5, 1980 Key et al. 4.914,590 4, 1990 Loatman et al. 4,241,286 12, 1980 Gordon 4,918,723 4, 1990 Iggulden et al. 4,253,477 3, 1981 Eichman 4,926,491 5, 1990 Maeda et al. 4.278,838 T. 1981 Antonov 4,928.307 5, 1990 Lynn 4,282.405 8, 1981 Taguchi 4,931,783 6, 1990 Atkinson 4,310,721 1, 1982 Manley et al. 4,935,954 6, 1990 Thompson et al. 4,332,464 6, 1982 Bartulis et al. 4,939,639 7, 1990 Lee et al. 4,348,553 9, 1982 Baker et al. 4.941,488 7, 1990 Marxer et al. 4.384,169 5, 1983 Mozer et al. 4,944,013 T. 1990 Gouvianakis et al. 4,386,345 5, 1983 Narveson et al. 4,945,504 7, 1990 Nakama et al. 4.433,377 2, 1984 Eustis et al. 4,953, 106 8, 1990 Gansner et al. 4.451,849 5, 1984 Fuhrer 4,955,047 9, 1990 Morganstein et al. 4.485439 11, 1984 Rothstein 4,965,763 10, 1990 Zamora 4,495,644 1, 1985 Parks et al. 4,972.462 11, 1990 Shibata 4.513,379 4, 1985 Wilson et al. 4,974,191 11, 1990 Amirghodsi et al. 4,513.435 4, 1985 Sakoe et al. 4,975,975 12, 1990 Filipski 4,555,775 11, 1985 Pike 4,977,598 12, 1990 Doddington et al. 4,577,343 3, 1986 Oura 4,980,916 12, 1990 Zinser 4,586,158 4, 1986 Brandle 4,985,924 1, 1991 Matsuura 4,587,670 5, 1986 Levinson et al. 4,992,972 2, 1991 Brooks et al. 4,589,022 5, 1986 Prince et al. 4,994,966 2, 1991 Hutchins 4,611,346 9, 1986 Bednar et al. 4,994,983 2, 1991 Landell et al. 4,615,081 10, 1986 Lindahl 5,001,774 3, 1991 Lee 4,618,984 10, 1986 Das et al. 5,003,577 3, 1991 Ertz et al. 4,642,790 2, 1987 Minshull et al. 5,007,095 4, 1991 Nara et al. 4,653,021 3, 1987 Takagi 5,007,098 4, 1991 Kumagai 4,654,875 3, 1987 Srihari et al. 5,010,574 4, 1991 Wang 4,655,233 4, 1987 Laughlin 5,016,002 5, 1991 Levanto 4,658.425 4, 1987 Julstrom 5,020, 112 5, 1991 Chou 4,670,848 6, 1987 Schramm 5,021,971 6, 1991 Lindsay 4,677,570 6, 1987 Taki 5,022,081 6, 1991 Hirose et al. 4,680,429 7, 1987 Murdock et al. 5,027,110 6, 1991 Chang et al. 4,680,805 7, 1987 Scott 5,027.406 6, 1991 Roberts et al. 4,686,522 8, 1987 Hernandez et al. 5,027,408 6, 1991 Kroeker et al. 4,688,195 8, 1987 Thompson et al. 5,029,211 7, 1991 Ozawa 4,692,941 9, 1987 Jacks et al. 5,031,217 7, 1991 Nishimura 4,698.625 10, 1987 McCaskill et al. 5,032,989 7, 1991 Tornetta 4,709,390 11, 1987 Atal et al. 5,033,087 7, 1991 Bahl et al. 4,713,775 12, 1987 Scott et al. 5,040.218 8, 1991 Vitale et al. 4,718,094 1, 1988 Bahl et al. 5,046,099 9, 1991 Nishimura 4,724,542 2, 1988 Williford 5,047,614 9, 1991 Bianco 4,726,065 2, 1988 Froessl 9, 1991 Shepard et al. 4,727,354 2, 1988 Lindsay 5,047,617 RE32,632 3, 1988 Atkinson 5,050,215 9, 1991 Nishimura 4,736,296 4, 1988 Katayama et al. 5,053,758 10, 1991 Cornett et al. 4,750,122 6, 1988 Kaji et al. 5,054,084 10, 1991 Tanaka et al. 4,754,489 6, 1988 Bokser 5,057,915 10, 1991 Von Kohorn 4,755,811 T. 1988 Slavin et al. 5,067,158 11, 1991 Arjmand 4,776,016 10, 1988 Hansen 5,067,503 11, 1991 Stile 4,783,804 11, 1988 Juang et al. 5,072,452 12, 1991 Brown et al. 4,783,807 11, 1988 Marley 5,075,896 12, 1991 Wilcox et al. 4,785,413 11, 1988 Atsumi 5,079,723 1, 1992 Herceg et al. US 9,715,875 B2 Page 3 (56) References Cited RE34,562 E 3, 1994 Murakami et al. 5,291,286 3, 1994 Murakami et al. U.S. PATENT DOCUMENTS 5,293,254 3, 1994 Eschbach 5,293,448 3, 1994 Honda 5,083,119 1, 1992 Trevett et al.