DOCSLIB.ORG

United States Patent ( 10 ) Patent No.: US 10,706,841 B2 Gruber Et Al

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
United States Patent ( 10 ) Patent No.: US 10,706,841 B2 Gruber Et Al US010706841B2 (12 ) United States Patent ( 10 ) Patent No.: US 10,706,841 B2 Gruber et al. (45 ) Date of Patent : * Jul. 7 , 2020 (54 ) TASK FLOW IDENTIFICATION BASED ON (52 ) U.S. CI. USER INTENT CPC GIOL 15/1815 (2013.01 ) ; B60K 35/00 ( 2013.01 ) ; G06F 3/167 (2013.01 ) ; (71 ) Applicant: Apple Inc., Cupertino , CA (US ) ( Continued ) (58 ) Field of Classification Search (72 ) Inventors : Thomas Robert Gruber , Emerald CPC GIOL 15/22 ; G10L 15/28 ; G1OL 15/285 ; Hills , CA (US ) ; Adam John Cheyer , GIOL 15/30 ; G1OL 15/32 ; G1OL 15/34 Oakland, CA ( US ) ; Dag Kittlaus, See application file for complete search history . Cupertino , CA ( US ) ; Didier Rene Guzzoni, Mont sur- Rolle (CH ) ; (56 ) References Cited Christopher Dean Brigham , San Jose, CA (US ) ; Richard Donald Giuli, U.S. PATENT DOCUMENTS Arroyo Grande, CA ( US ) ; Marcello 1,559,320 A 10/1925 Hirsh Bastea -Forte , Cupertino , CA (US ) ; 2,180,522 A 11/1939 Henne Harry Joseph Saddler , Berkeley , CA ( Continued ) (US ) FOREIGN PATENT DOCUMENTS ( 73 ) Assignee : Apple Inc., Cupertino , CA (US ) CA 2694314 A1 8/2010 ( * ) Notice: Subject to any disclaimer , the term of this CA 2792412 A1 7/2011 patent is extended or adjusted under 35 ( Continued ) U.S.C. 154 ( b ) by 402 days. OTHER PUBLICATIONS This patent is subject to a terminal dis claimer . Advisory Action received for U.S. Appl .No. 13 /913,336 , dated Feb. 20 , 2018 , 3 pages . ( 21 ) Appl. No .: 15 /394,162 (Continued ) ( 22 ) Filed : Dec. 29 , 2016 Primary Examiner Michael N Opsasnick ( 74 ) Attorney , Agent, or Firm - Dentons US LLP (65 ) Prior Publication Data US 2017/0178626 A1 Jun . 22 , 2017 (57 ) ABSTRACT The intelligent automated assistant system engages with the user in an integrated , conversational manner using natural Related U.S. Application Data language dialog , and invokes external services when appro priate to obtain information or perform various actions . The (63 ) Continuation of application No. 13 / 492,809 , filed on system can be implemented using any of a number of Jun . 9 , 2012 , now Pat. No. 9,548,050 , which is a different platforms, such as the web , email, smartphone , and ( Continued ) the like , or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, ( 51 ) Int . Ci. GIOL 15/22 ( 2006.01 ) and employs additional functionally powered by external GIOL 15/18 ( 2013.01 ) services with which the system can interact . (Continued ) 60 Claims, 47 Drawing Sheets 4.1 Onion Dinnye Die Kenici , WONOGI: VS . TO Fow's 1975 Pia kui Pirata US 10,706,841 B2 Page 2 Related U.S. Application Data 4,513,435 A 4/1985 Sakoe et al. 4,577,343 A 3/1986 Oura continuation of application No. 12 / 987,982 , filed on 4,586,158 A 4/1986 Brandle Jan. 10 , 2011, now Pat. No. 9,318,108 . 4,587,670 A 5/1986 Levinson et al. 4,589,022 A 5/1986 Prince et al. (60 ) Provisional application No. 61/ 295,774 , filed on Jan. 4,611,346 A 9/1986 Bednar et al. 4,615,081 A 10/1986 Lindahl 18 , 2010 . 4,618,984 A 10/1986 Das et al . 4,642,790 A 2/1987 Minshull et al. ( 51 ) Int . Ci. 4,653,021 A 3/1987 Takagi G06F 16/332 (2019.01 ) 4,654,875 A 3/1987 Srihari et al . GOOF 16/33 ( 2019.01 ) 4,655,233 A 4/1987 Laughlin G06F 16/9537 ( 2019.01 ) 4,658,425 A 4/1987 Julstrom 4,670,848 A 6/1987 Schramm GO6F 1/30 ( 2020.01 ) 4,677,570 A 6/1987 Taki G06F 40/40 (2020.01 ) 4,680,429 A 7/1987 Murdock et al. G06F 40/279 ( 2020.01) 4,680,805 A 7/1987 Scott G06F 3/16 ( 2006.01 ) 4,686,522 A 8/1987 Hernandez et al . GO6F 9/54 4,688,195 A 8/1987 Thompson et al. ( 2006.01 ) 4,692,941 A 9/1987 Jacks et al . GIOL 15/26 ( 2006.01 ) 4,698,625 A 10/1987 McCaskill et al . GIOL 21/06 ( 2013.01 ) 4,709,390 A 11/1987 Atal et al. BOOK 35/00 ( 2006.01) 4,713,775 A 12/1987 Scott et al . GIOL 13/02 ( 2013.01 ) 4,718,094 A 1/1988 Bahl et al. GIOL 13/08 4,724,542 A 2/1988 Williford ( 2013.01 ) 4,726,065 A 2/1988 Froessl GIOL 15/183 ( 2013.01 ) 4,727,354 A 2/1988 Lindsay H04M 1/60 ( 2006.01 ) RE32,632 E 3/1988 William H04M 1/725 ( 2006.01 ) 4,736,296 A 4/1988 Katayama et al . GIOL 13/00 4,750,122 A 6/1988 Kaji et al. ( 2006.01 ) 4,754,489 A 6/1988 Bokser (52 ) U.S. CI. 4,755,811 A 7/1988 Slavin et al . CPC G06F 9/54 (2013.01 ) ; G06F 16/3329 4,759,070 A 7/1988 Voroba et al . ( 2019.01 ) ; G06F 16/3344 ( 2019.01 ) ; G06F 4,776,016 A 10/1988 Hansen 4,783,804 A 11/1988 Juang et al . 16/9537 ( 2019.01) ; G06F 40/279 ( 2020.01) ; 4,783,807 A 11/1988 Marley G06F 40/30 (2020.01 ) ; G06F 40/40 4,785,413 A 11/1988 Atsumi ( 2020.01 ) ; GIOL 13/02 (2013.01 ) ; GIOL 13/08 4,790,028 A 12/1988 Ramage (2013.01 ) ; GIOL 15/183 (2013.01 ) ; GIOL 4,797,930 A 1/1989 Goudie 15/22 ( 2013.01 ) ; GIOL 15/26 (2013.01 ) ; GIOL 4,802,223 A 1/1989 Lin et al. 4,803,729 A 2/1989 Baker 15/265 (2013.01 ) ; GIOL 21/06 ( 2013.01) ; 4,807,752 A 2/1989 Chodorow H04M 1/6091 (2013.01 ) ; H04M 1/72547 4,811,243 A 3/1989 Racine ( 2013.01 ) ; H04M 1/72563 (2013.01 ) ; H04M 4,813,074 A 3/1989 Marcus 1/72597 ( 2013.01) ; GIOL 13/00 ( 2013.01) ; 4,819,271 A 4/1989 Bahl et al. GIOL 15/1822 ( 2013.01 ) 4,827,518 A 5/1989 Feustel et al. 4,827,520 A 5/1989 Zeinstra 4,829,576 A 5/1989 Porter ( 56 ) References Cited 4,829,583 A 5/1989 Monroe et al . 4,831,551 A 5/1989 Schalk et al . U.S. PATENT DOCUMENTS 4,833,712 A 5/1989 Bahl et al . 4,833,718 A 5/1989 Sprague 2,495,222 A 1/1950 Bierig 4,837,798 A 6/1989 Cohen et al . 3,704,345 A 11/1972 Coker et al . 4,837,831 A 6/1989 Gillick et al . 3,710,321 A 1/1973 Rubenstein 4,839,853 A 6/1989 Deerwester et al . 3,787,542 A 1/1974 Gallagher et al. 4,852,168 A 7/1989 Sprague 3,828,132 A 8/1974 Flanagan et al. 4,862,504 A 8/1989 Nomura 3,979,557 A 9/1976 Schulman et al . 4,875,187 A 10/1989 Smith 4,013,085 A 3/1977 Wright 4,878,230 A 10/1989 Murakami et al . 4,081,631 A 3/1978 Feder 4,887,212 A 12/1989 Zamora et al . 4,090,216 A 5/1978 Constable 4,896,359 A 1/1990 Yamamoto et al . 4,107,784 A 8/1978 Van Bemmelen 4,903,305 A 2/1990 Gillick et al . 4,108,211 A 8/1978 Tanaka 4,905,163 A 2/1990 Garber et al. 4,159,536 A 6/1979 Kehoe et al. 4,908,867 A 3/1990 Silverman 4,181,821 A 1/1980 Pirz et al . 4,914,586 A 4/1990 Swinehart et al. 4,204,089 A 5/1980 Key et al. 4,914,590 A 4/1990 Loatman et al. 4,241,286 A 12/1980 Gordon 4/1990 Cole et al. 4,253,477 A 3/1981 Eichman 4,914,704 A 4,278,838 A 7/1981 Antonov 4,918,723 A 4/1990 Iggulden et al. 4,282,405 A 8/1981 Taguchi 4,926,491 A 5/1990 Maeda et al . 4,310,721 A 1/1982 Manley et al . 4,928,307 A 5/1990 Lynn 4,332,464 A 6/1982 Bartulis et al . 4,931,783 A 6/1990 Atkinson 4,348,553 A 9/1982 Baker et al. 4,935,954 A 6/1990 Thompson et al. 4,384,169 A 5/1983 Mozer et al. 4,939,639 A 7/1990 Lee et al. 4,386,345 A 5/1983 Narveson et al . 4,941,488 A 7/1990 Marxer et al . 4,433,377 A 2/1984 Eustis et al . 4,944,013 A 7/1990 Gouvianakis et al. 4,451,849 A 5/1984 Fuhrer 4,945,504 A 7/1990 Nakama et al . 4,485,439 A 11/1984 Rothstein 4,953,106 A 8/1990 Gansner et al. 4,495,644 A 1/1985 Parks et al . 4,955,047 A 9/1990 Morganstein et al. 4,513,379 A 4/1985 Wilson et al . 4,965,763 A 10/1990 Zamora US 10,706,841 B2 Page 3 ( 56 ) References Cited 5,179,652 A 1/1993 Rozmanith et al. 5,194,950 A 3/1993 Murakami et al. U.S. PATENT DOCUMENTS 5,195,034 A 3/1993 Garneau et al. 5,195,167 A 3/1993 Bahl et al. 4,972,462 A 11/1990 Shibata 5,197,005 A 3/1993 Shwartz et al.
Load more

Recommended publications
  • Getting to Know Siri
    Chapter 1 Getting to Know Siri In This Chapter ▶ Seeing what — or rather, who — Siri is ▶ Setting up Siri for your personal use ▶ Exploring different ways to use Siri ▶ Finding out how to get fast and reliable replies ▶ Teaching Siri what to call you ongratulations! You’re now the owner of the most definitive Cguide to Siri on the planet. This easy-to-read For Dummies title will teach you everything you need to know about Siri — and then some. Be prepared to master all of Siri’s amazing features, at your own pace, so you can get a lot more out of your beloved iPhone, iPad (and iPad mini), or iPod touch. But first, a few words about my introduction to Siri, what Siri is exactly, and a bit of history. As a longtime technology reviewer, I firmly believe Siri (pronounced SEAR-ree) is the start of something very special, and it was love at first sight — er, speech. Here I am, sitting in the crowd at Apple headquarters in Cupertino, California, on October 4, 2011. The exclusive press event is called “Let’s Talk iPhone,” and like many other journalists and analysts in theCOPYRIGHTED room, I was expecting Apple CEO MATERIAL Tim Cook to take the wraps off the iPhone 5. When the iPhone 4S was initially debuted, you could sense the ini- tial disappointment among the attendees — after all, there were so many rumors leading up to the event that it seemed inevitable that a dramatically new smartphone would be unveiled that day. But that letdown feeling completely vanished the moment Siri was introduced.
    [Show full text]
  • Case 2:17-Cv-00592-JRG Document 1 Filed 08/18/17 Page 1 of 49 Pageid #: 1
    Case 2:17-cv-00592-JRG Document 1 Filed 08/18/17 Page 1 of 49 PageID #: 1 UNITED STATES DISTRICT COURT FOR THE EASTERN DISTRICT OF TEXAS MARSHALL DIVISION WORD TO INFO, INC., Plaintiff, Civil Action No.: 2:17-cv-592 v. JURY TRIAL DEMANDED APPLE INC., Defendant. COMPLAINT FOR PATENT INFRINGEMENT Plaintiff Word to Info, Inc. (“Word to Info”), by way of its Complaint for Patent Infringement (“Complaint”) against the above-named Defendant Apple Inc. (“Apple” or “Defendant”), alleges the following: NATURE OF THE ACTION 1. This is an action for patent infringement arising under the Patent Laws of the United States, Title 35 of the United States Code. THE PARTIES 2. Plaintiff Word to Info, Inc. is a corporation organized under the laws of the State of Texas with a place of business at 1106 Edgewood Dr., Richardson, Texas 75081. 3. Upon information and belief, Defendant Apple is a corporation organized under the laws of the State of California with its principal place of business at 1 Infinite Loop, Cupertino, California 95014. JURISDICTION AND VENUE 4. This Court has subject matter jurisdiction under 28 U.S.C. §§ 1331 and 1338. Case 2:17-cv-00592-JRG Document 1 Filed 08/18/17 Page 2 of 49 PageID #: 2 5. This Court has personal jurisdiction over Apple at least because Apple has ongoing and systematic contacts with this District and the United States. Specifically, Apple does business in the Eastern District of Texas and has thereby availed itself of the privileges and the protections of the laws of the State of Texas and this Judicial District.
    [Show full text]
  • Ontology and Information Systems
    Ontology and Information Systems 1 Barry Smith Philosophical Ontology Ontology as a branch of philosophy is the science of what is, of the kinds and structures of objects, properties, events, processes and relations in every area of reality. ‘Ontology’ is often used by philosophers as a synonym for ‘metaphysics’ (literally: ‘what comes after the Physics’), a term which was used by early students of Aristotle to refer to what Aristotle himself called ‘first philosophy’.2 The term ‘ontology’ (or ontologia) was itself coined in 1613, independently, by two philosophers, Rudolf Göckel (Goclenius), in his Lexicon philosophicum and Jacob Lorhard (Lorhardus), in his Theatrum philosophicum. The first occurrence in English recorded by the OED appears in Bailey’s dictionary of 1721, which defines ontology as ‘an Account of being in the Abstract’. Methods and Goals of Philosophical Ontology The methods of philosophical ontology are the methods of philosophy in general. They include the development of theories of wider or narrower scope and the testing and refinement of such theories by measuring them up, either against difficult 1 This paper is based upon work supported by the National Science Foundation under Grant No. BCS-9975557 (“Ontology and Geographic Categories”) and by the Alexander von Humboldt Foundation under the auspices of its Wolfgang Paul Program. Thanks go to Thomas Bittner, Olivier Bodenreider, Anita Burgun, Charles Dement, Andrew Frank, Angelika Franzke, Wolfgang Grassl, Pierre Grenon, Nicola Guarino, Patrick Hayes, Kathleen Hornsby, Ingvar Johansson, Fritz Lehmann, Chris Menzel, Kevin Mulligan, Chris Partridge, David W. Smith, William Rapaport, Daniel von Wachter, Chris Welty and Graham White for helpful comments.
    [Show full text]
  • Ukrainian and Foreign Science: Yesterday, Today, Tomorrow
    MINISTRY OF EDUCATION AND SCIENCE OF UKRAINE THE NATIONAL TECHNICAL UNIVERSITY OF UKRAINE "IGOR SIKORSKY KYIV POLYTECHNIC INSTITUTE" FACULTY OF LINGUISTICS IX INTERNATIONAL STUDENTS’ RESEARCH AND DEVELOPMENT CONFERENCE Ukrainian and Foreign Science: Yesterday, Today, Tomorrow CONFERENCE PROCEEDINGS December 2, 2020 Kyiv, Ukraine UKRAINIAN AND FOREIGN SCIENCE: YESTERDAY, TODAY, TOMORROW ENGINEERING SCIENCES THE USE OF INFORMATION TECHNOLOGIES CUSTODIANS Egor Morskyi Politechnika Rzeszowska im. Ignacego Łukasiewicza, Poland The on-line processing of information from a remote terminal is needed due to the increasing multiplicity of information systems and growing requirements for the speed of information processing. A general requirement for all remote access technologies is the protection of information from unauthorized access (2020). The largest custodians in the world are developing their remote access systems, with the help of which the client can initiate an order from his computer. The experts are seriously interested in the problem solving of the stock information system integrating with banking and accounting systems. So, they do not ignore the issues of data protection, access, and maintaining their integrity. These tasks require new approaches and make scientists pay attention to modern solutions that are already available on the information technology market. The basis of the modern approach to building an information system is the "client-server" technology. One of the most important conditions for the development of a civilized securities market in Poland is the creation of information systems that allow paperless office (storage and circulation of documents in electronic form). Due to the fact that the secondary securities market in the country has been underdeveloped, special attention of the developers is drawn to the constantly increasing demand for systems operating with securities of private enterprises, the main of which is the depository system.
    [Show full text]
  • Getting to Know Siri
    Chapter 1 Getting to Know Siri In This Chapter ▶ Seeing what — or rather, who — Siri is ▶ Setting up Siri for your personal use ▶ Exploring different ways to use Siri ▶ Finding out how to get fast and reliable replies ▶ Teaching Siri what to call you ongratulations! You’re now the owner of the most defini- Ctive guide to Siri on the planet. This easy-to-read For Dummies title will teach you everything you need to know about Siri — and then some. Be prepared to master all of Siri’s amazing features, at your own pace, so you can get a lot more out of your beloved iPhone 4S. But first, a few words about my introduction to Siri, what Siri is exactly, and a bit of history. As a longtime technology reviewer, I firmly believe Siri (pro- nounced SEAR-ree) is the start of something very special, and it was love at first sight — er, speech. Here I am, sitting in the crowd at Apple’s headquarters in Cupertino,COPYRIGHTED California, on October MATERIAL 4, 2011. The exclusive press event is called “Let’s Talk iPhone,” and like many other jour- nalists and analysts in the room, I was expecting Apple’s CEO Tim Cook to take the wraps off the iPhone 5. When the iPhone 4S was initially debuted, you could sense the initial disappointment among the attendees — after all, there were so many rumors leading up to the event that it seemed inevitable that a dramatically new smartphone would be unveiled that day. 004_9781118299289-ch01.indd4_9781118299289-ch01.indd 7 33/16/12/16/12 22:51:51 PMPM 8 Siri For Dummies, Portable Edition But that letdown feeling completely vanished the moment Siri was introduced.
    [Show full text]