Personal Virtual Assistants: Primer and Planning Guide

Total Page:16

File Type:pdf, Size:1020Kb

Personal Virtual Assistants: Primer and Planning Guide Personal Virtual Assistants: Primer and Planning Guide We used to laugh at the idea of “the talking toaster” when thinking about the gratuitous addition of a speech-based interface to household appliances, consumer electronics, self-service kiosks or even ATMs. Now the machines laugh at us, as improvements in natural language understanding, artificial intelligence and text-to-speech rendering make phones, tablets, computers and (yes) household appliances more conversational, human-like and responsive to spoken input. November 2012 Dan Miller, Senior Analyst – Conversational Commerce Opus Research, Inc. 350 Brannan St., Suite 340 San Francisco, CA 94107 For sales inquires please e-mail [email protected] or call +1(415)904-7666 This report shall be used solely for internal information purposes. Reproduction of this report without prior written permission is forbidden. Access to this report is limited to the license terms agreed to originally and any changes must be agreed upon in writing. The information contained herein has been obtained from sources believe to be reliable. However, Opus Research, Inc. accepts no responsibility whatsoever for the content or legality of the report. Opus Research, Inc. disclaims all warranties as to the accuracy, completeness or adequacy of such information. Further, Opus Research, Inc. shall have no liability for errors, omissions or inadequacies in the information contained herein or interpretations thereof. The opinions expressed herein may not necessarily coincide with the opinions and viewpoints of Opus Research, Inc. and are subject to change without notice. Published November 2012 © Opus Research, Inc. All rights reserved. PVA Planning Guide Page ii Key Findings Personal Virtual Assistants (PVAs), like Apple’s Siri, are here to stay thanks to steady improvement in Natural Language Understanding (NLU), Artificial Intelligence (AI) and underlying computer and networking power. In this document, Opus Research will describe, compare and contrast different products and services to help readers determine what will work in both mobile and enterprise settings: • “Personal Virtual Assistant” (PVA) describes the “conversational user interface” - enabling individuals to use their own words to provide instructions to devices, describe what they want, schedule events or conduct searches. • The role for PVAs on mobile devices and in contact centers is growing rapidly – thanks to improvements and expansion of natural language processing (NLP) in popular verticals like financial services, telecommunications, retailing and, more generally, customer care • Competition comes from multiple disciplines – including device makers (Apple, Google), chatbots, knowledge management and contact center automation • There’s a business case for PVAs in the enterprise – as solutions providers integrate artificial intelligence and decisioning into agent workstations, Web chat and interactive voice response systems to achieve common business objectives (like customer retention, customer satisfaction, increased sales, etc.) • PVAs accelerate the trend toward “human-aided self service” – PVAs steer people “around” traditional interactive voice response (IVR) systems and are being embedded in Web chat to make it less clear whether an individual is interacting with an automated system or a live agent • Progress focuses on verticals and specific functions – while it is tempting to “boil the ocean” and provide a broad set of features, functions or services, PVAs perform best when addressing specific verticals, emulating well-understood activities (E.g. customer care for telecoms) © 2012 Opus Research, Inc. PVA Planning Guide Page iii Table of Contents Key Findings ........................................................................................ ii! Siri Rekindles Interest in Personal Virtual Assistants .................................. 1! Search Giant Responds with Google Now ............................................ 1! Precursors to Siri: Voice Portals and PVAs ................................................ 2! Lessons Learned from the First Generation ......................................... 2! Requirements for the New Millennium ................................................ 3! PVA Competitors .................................................................................. 5! Nuance’s Portfolio: Nina, DragonGo! and Vlingo (Hey Dragon) .............. 5! Angel’s Lexee Leverages Deep Roots in Analytics ................................ 6! SRI Tailors Lola for Spanish Banking Leader ....................................... 7! “Chatbots” Finding Their Voice As Virtual Agents ...................................... 8! VirtuOz’ IVAs Leverage Customer Care Infrastructure ........................ 10! Creative Virtual’s 2,500 Questions ................................................... 11! A Bright Future for the Conversational Interface ..................................... 12! Implications for Customer Care and Mobile Commerce ....................... 12! “Have Your Assistant Call My Assistant” ........................................... 13! Appendix I: Selected Vendor Profiles ..................................................... 14! Anboto ........................................................................................ 14! Artificial Solutions ......................................................................... 15! Expert System .............................................................................. 16! Indisys ........................................................................................ 17! NextIT ......................................................................................... 18! Nuance Communications ................................................................ 19! SpeakToIt .................................................................................... 20! TrueKnowlege .............................................................................. 21! VirtuOz ........................................................................................ 22! VoiceBox Technologies ................................................................... 23! Tables Figure 1: The PVA Life-Cycles ................................................................ 3! Figure 2: Siri's Direct Competitors .......................................................... 4! Figure 3: From the Ranks of Chatbots and NLP ......................................... 9! Figure 4: Enterprise-based Initiatives .................................................... 12! For Information on Ordering the Full Report Contact: Pete Headrick (415) 904-7666 or e-mail: [email protected] © 2012 Opus Research, Inc. .
Recommended publications
  • Nicolae Duta Natural Language Understanding and Prediction
    Natural Language Understanding and Prediction Technologies Nicolae Duta Cloud ML @ Microsoft 1 IJCAI 2015 Tutorial Outline • Voice and language technologies: history, examples and technological challenges • Short intro to ASR: modeling, architecture, analytics • Language prediction (aka modeling) • Natural Language Understanding • Supervised learning approaches: training & annotation issues • Semi-supervised learning approaches • Parsers & hybrid models, multilingual models • Client-server architectures, dialog & semantic equations • Human interaction with voice & language technologies • Semantic web-search • Disclosure 2 IJCAI 2015 Tutorial Deployed language technologies Most applications that translate some signal into text employ a Bayesian approach: arg max P(sentence | signal) sentence arg max P(signal | sentence ) P(sentence ) sentence Applications • Speech recognition • Optical character recognition • Handwriting recognition • Machine translation • Spelling correction • Word/sentence auto completion 3 IJCAI 2015 Tutorial Technologies based on voice input • Technologies that use spoken input for requesting information, web navigation or command execution – DA systems: Nuance (bNuance+PhoneticSystems), BBN/Nortel, TellMe/Microsoft, Jingle, Google, AT&T, IBM (mid 1990s) – Dictation/speech to text systems: Dragon (mid1990s) – TV close captioning BBN/NHK (early 2000s) – Automated attendant & Call routing: AT&T, BBN, Nuance, IBM (early 2000s) – Form-filling directed dialog (flight reservations) (early 2000s) – Personal assistants/Full
    [Show full text]
  • Phillips, Michael Poster
    creation of industries Michael Phillips • CEO, Sense • Founder, Vlingo • Co-founder, SpeechWorks BIO: Mike Phillips is the CEO of Sense, a Cambridge-based company developing intelligent devices and applications for the home. Mike previously founded SpeechWorks in 1994, which applied emerging speech recognition technology to the call center industry and had an IPO in August 2000. In 2006, Mike founded Vlingo which developed the first voice-based virtual assistant applications for mobile phones. Vlingo had both a successful consumer facing application, and also powered virtual assistants for hundreds of millions of phones, including worldwide support for the Samsung Galaxy S phones. Vlingo was acquired in 2012 and Mike and others from Vlingo formed Sense in 2013. Mike got his start as an electrical engineer undergrad at CMU before moving on to research roles in the early days of speech recognition at CMU and MIT. ABSTRACT: From Impossible Research Projects to Creation of Industries In 1980, I was an undergrad at CMU and wandered into a professors office looking for a research project. That led to me joining a small group of people working on what seemed like an impossible problem: making computers which could understand human speech. In fact, it turns out it was an impossible problem at the time, but a lot has changed since then! A number of members of that small team have been instrumental in creating an industry around machine learning and conversation systems. Most of the successful speech recognition companies have been based on core teams with direct or indirect ties to CMU. I’ll discuss my path to starting multiple companies in the speech and natural language processing world and also how the core of what we built is now being used across multiple industries.
    [Show full text]
  • Siri App for Android Phone
    Siri app for android phone Continue If you watched last week's iPhone 4S ad from your Android phone and went a little green with envy when Siri, iOS's new voice-recognition personal assistant, was announced and demoted on stage, shake up. You have a lot of great voice recognition apps to choose from on Android that can help you keep up with friends, search the weather, find local businesses, and more. Here's a look at your options. If you haven't looked into voice recognition apps on Android before, you may be wondering how many apps get the job done. None of the apps currently available for Android are as well integrated with OS as Siri with iOS (sorry), but some are closer than others, and you can bet that they will all be updated and improved now that Siri is available for iOS. Best of all, they're all free. The one you already have: Google Voice ActionsIf you have an Android phone, you already have Google Voice Actions for Android installed. When everyone got their first look at Siri on the iPhone 4S, most people jumped at the assumption that Siri was just the voice of action for iOS. It's not - Siri does more than Voie Actions, but Voice Actions is the closest that Android users have to a voice assistant. Pros: Voice action can control a large swath of Android features. You can post phone calls, listen to music by the name of a track, artist, or album, send SMS or emails, get driving and step-by-step navigation, search the web, and more.
    [Show full text]
  • Idea Lab Session: Smartphone Tips & Tools for Success
    Idea Lab Session: SmartPhone Tips & Tools for Success Thursday, February 28, 2013, 8:30 and 11:10 a.m. Randall Dean, MBA Author and Trainer Randall Dean Consulting and Training, LLC East Lansing, Mich. Randall Dean, the "totally obsessed" time management/PDA guy and email sanity expert and author of the recent Amazon email bestseller, “Taming the E-mail Beast: 45 Key Strategies for Managing Your E-mail Overload,” is a preferred source for speaking and training programs on advanced time management-using technology, managing the mess of email and information overload, and related topics including managing great meetings and ending office clutter. Randy has more than 20 years of experience using and teaching advanced principles of time management, project management, and personal organization. His popular keynote/breakout programs, "Finding an Extra Hour Every Day" and "Taming the E-mail Beast: Managing the Mess of E-mail and Info Overload" are great sessions for conference and association meetings. These programs combine humor with extraordinarily relevant and useful content and provide strategy- rich information on finding and saving time and taming the email beast at home and work. Session Description: Get organized and maximize your efficiency by learning amazing smartphone tips and tools during this interactive session. Top Three Session Ideas Tools or tips you learned from this session and can apply back at the office. 1. ______________________________________________________________________ 2. _______________________________________________________________________
    [Show full text]
  • Ellen Swallow Richards Pm12
    THE AUTHORITY ON THE FUTURE OF TECHNOLOGY September/October 2007 The iPhone, www.technologyreview.com Cracked Open p30 Can a Pill Extend Life? p78 MIT NEWS Ellen Swallow Richards pM12 Contents Volume 110, Number 5 Features 47 The TR35 Technology Review presents its seventh class of outstanding innovators under the age of 35. These driven, creative people will alter the state of medicine, computing, communications, and energy. Their work represents the future of technology. 78 The Enthusiast A controversial biologist at Harvard claims he can extend life span and treat diseases of aging. He just may be right. By David Ewing Duncan 84 Essay: Letter to a Young Scientist In this excerpt from his newly released memoir, the famous biologist tells By James Watson Cover illustration by Oliver Hibert of his role in determining the structure of DNA. 7 Contributors Hack Reviews Letters 8 30 The iPhone 98 Higher Games 10 From the Editor Apples phone sets a new standard, Its been 10 years since IBMs Deep but not with wholly unique hardware. Blue beat Garry Kasparov in chess. Forward By Daniel Turner What did the match mean? By Daniel C. Dennett 19 Mapping Censorship When it comes to Internet censorship, Q&A 100 Electric Cars 2.0 China and Iran top the list 32 Alieu Conteh Plug-in hybrids could bring gas-free 20 Shopping Search How an African entrepreneur put commutes. But will they get made? A cell-phone service guides users to cell phones in Congo By Kevin Bullis nearby bargains—sometimes By Jason Pontin 102 Patent Law Gets Saner 20 Portable Hurricane The U.S.
    [Show full text]
  • Voice Typing: a New Speech Interaction Model for Dictation on Touchscreen Devices
    Voice Typing: A New Speech Interaction Model for Dictation on Touchscreen Devices †‡ † † Anuj Kumar , Tim Paek , Bongshin Lee † ‡ Microsoft Research Human-Computer Interaction Institute, One Microsoft Way Carnegie Mellon University Redmond, WA 98052, USA Pittsburgh, PA 15213, USA {timpaek, bongshin}@microsoft.com [email protected] [12] and other ergonomic issues such as the “fat finger ABSTRACT problem” [10]. Automatic dictation using speech Dictation using speech recognition could potentially serve recognition could serve as a natural and efficient mode of as an efficient input method for touchscreen devices. input, offering several potential advantages. First, speech However, dictation systems today follow a mentally throughput is reported to be at least three times faster than disruptive speech interaction model: users must first typing on a hardware QWERTY keyboard [3]. Second, formulate utterances and then produce them, as they would compared to other text input methods, such as handwriting with a voice recorder. Because utterances do not get or typing, speech has the greatest flexibility in terms of transcribed until users have finished speaking, the entire screen size. Finally, as touchscreen devices proliferate output appears and users must break their train of thought to throughout the world, speech input is (thus far) widely verify and correct it. In this paper, we introduce Voice considered the only plausible modality for the 800 million Typing, a new speech interaction model where users’ or so non-literate population [26]. utterances are transcribed as they produce them to enable real-time error identification. For fast correction, users However, realizing the potential of dictation critically leverage a marking menu using touch gestures.
    [Show full text]
  • Cognitive Assistance at Work
    Cognitive Assistance in Government Papers from the AAAI 2015 Fall Symposium Cognitive Assistance at Work Hamid R. Motahari Nezhad IBM Almaden Research Center San Jose, CA 95120 United Stated [email protected] Abstract their main communication paradigm and infor- Today’s businesses, government and society work and ser- mation sharing, vices are centered around interactions, collaborations and 5) Vast amount of information that are produced, knowledge work. The pace, amount and veracity of data communicated, processed and needed to be man- generated and processed by a worker has accelerated signif- aged by a worker in the work context in order to icantly to the level that challenged human cognitive load and productivity. On the other hand, big data has provided perform work effectively; an unprecedented opportunity for AI to tackle one of the 6) And, the fast pace of the work that has led to main challenges hindering the AI progress: building models shaping new interaction and communication pat- of world in a scalable, adaptive and dynamic manner. In this terns and habit, and in particular the increasing paper, we describe the technology requirements of building use of instant and real-time communication as in- cognitive assistance technologies that assists human work- ers, and present a cognitive work assistant framework that tegrated part of work productivity tools. There are aims at offering intelligence assistance to workers to im- already startups and enterprise applications that prove their productivity and agility. We then describe the innovate by bringing messaging tools and inte- design and development of a set of cognitive services of- grating it into enterprise collaboration platforms.
    [Show full text]
  • Possibilities of Using Speech Recognition Systems of Smart Terminal Devices in Traffic Environment
    Available online at www.sciencedirect.com ScienceDirect Procedia Engineering 69 ( 2014 ) 778 – 787 24th DAAAM International Symposium on Intelligent Manufacturing and Automation, 2013 Possibilities of using Speech Recognition Systems of Smart Terminal Devices in Traffic Environment Sinisa Husnjak*, Dragan Perakovic, Ivan Jovovic University of Zagreb, Faculty of Transport and Traffic Sciences, 10000 Zagreb, Republic of Croatia Abstract The ability to recognize human speech has always been an area of interest of people primarily because of the large range of applications in almost every segment of society. The development of science and technology made visible improvements in the capabilities and the quality of recognition of the human voice/speech using some kind of terminal devices. Speech recognition enables devices to adapt voice information in understandable form, which means complete identification and understanding of information. The primary purpose of recognizing of human speech is the ability to customize information (which are intended to people) for using with devices. The aim of voice recognition systems is to provide links and ease of communication between the device and the man and the development of further possible applications. Given the current trends in the use of smart terminal devices and technical and technological opportunities that they offer, it is inevitable to study the potential of these devices in the area of human voice recognition. The purpose of the paper is to show the possibilities of human voice recognition using smart terminal devices. Furthermore, all of this will be analyzed primarily in the transport(car) environment with emphasis on the potential advantages and disadvantages of such tools and principles.
    [Show full text]
  • The Antipatent: a Proposal for Startup Immunity Amy L
    Nebraska Law Review Volume 93 | Issue 4 Article 5 2015 The Antipatent: A Proposal for Startup Immunity Amy L. Landers Drexel University Thomas R. Kline School of Law, [email protected] Follow this and additional works at: https://digitalcommons.unl.edu/nlr Recommended Citation Amy L. Landers, The Antipatent: A Proposal for Startup Immunity, 93 Neb. L. Rev. 950 (2014) Available at: https://digitalcommons.unl.edu/nlr/vol93/iss4/5 This Article is brought to you for free and open access by the Law, College of at DigitalCommons@University of Nebraska - Lincoln. It has been accepted for inclusion in Nebraska Law Review by an authorized administrator of DigitalCommons@University of Nebraska - Lincoln. Amy L. Landers* The Antipatent: A Proposal for Startup Immunity TABLE OF CONTENTS I. Introduction .......................................... 951 II. The Proposed Solution: The Antipatent ................ 957 III. Assumptions: Ideas, Inventions, and Innovations ...... 961 IV. The Value of Experimentation Without Adverse Consequences ......................................... 966 A. Clearer Paths to Creation ......................... 966 B. Components of Creative Endeavors ................ 972 V. Patent Lock-in: Standing on the Shoulders of Plaintiffs ............................................. 977 A. The Difficult Path to Permission: Search ........... 980 B. Patent Lock-In .................................... 984 C. Patent Law’s Limited Experimental Use Defense . 987 D. Prior User Rights ................................. 988 E. Other Private
    [Show full text]
  • Controlling Mobile Devices Using Voice Commands
    Voice Recognition– Controlling mobile devices using voice commands http://patseer.com Imp. Note: All analysis and charts shown in this report have been prepared online using PatSeer. This report should not be construed as business advice and the insights are not to be used as the basis for investment or business decisions of any kind without your own research and validation. Gridlogics Technologies Pvt. Ltd disclaims all warranties whether express, implied or statutory, of reliability, accuracy or completeness of results, with regards to the information contained in this report. Voice Recognition and Commands - Background • Speech recognition (SR) is the translation of spoken words into text. It is also known as automatic speech recognition (ASR), computer speech recognition , speech to text (STT) • Speech recognition applications include voice user interfaces such as voice dialing, call routing (hands free communication), domotic appliance control, search (find a podcast where particular words were spoken), data entry (transcription), preparation of structured documents (radiology report), speech- to-text processing (word processors or emails), and aircraft (Direct Voice Input) • Speech recognition systems made more than 10 years ago also faced a choice between discrete and continuous speech. It is much easier for the program to understand words when we speak them separately, with a distinct pause between each one. However, most users prefer to speak in a normal, conversational speed. Most modern systems are capable of understanding continuous speech. • This report looks at the patenting activity around voice control of mobile devices and also captures key litigations and NPE’s operating in this area. Search Strategy Using PatSeer as our database, we used the following search query to create our patent set.
    [Show full text]
  • Apps for College Students
    COLLEGE DISCOVER THE DIFFERENCE Apps for College Students Noteability: Handwriting, note taking, audio recording, annotate PDFs, cloud sync your notes to Dropbox, and more - http://itunes.apple.com/us/app/notability-handwriting-note/id360593530?mt=8 PDF-Notes: Utilize pdf-notes to manage all the pdf files on your iPad. Fast display, quick page-turning even a thousand pages, useful finger-writing and email your notes to your friends. There are many pdf readers allow you to annotate; but do you know which app allows you can write any notes in a second? If you are using pdf-notes, you may experience very fast and intuitive finger-writing like: zoom-in and note by double-tap or; writing with one finger, page-turning with two fingers, pen- changing with three fingers. Easy importing PDF files through (DropBox, Email or Safari's) "Open In..." or iTunes. Categorized multiple bookshelves(booklists) with powerful search; Displaying pages as optimized size 1024x768 of iPad http://itunes.apple.com/us/app/pdf-notes-free-for-ipad-pdf/id391487223?mt=8 inClass: Organize your schedule. Share your notes. Ace your classes are a free app that has some features similar to iStudiez Pro. It is a good basic app for organizing your terms, courses and daily calendar but it also has the additional benefit of note-taking with the app. So, your notes are organized for you within your courses and your daily schedule. However, there are some important features within the note-taking option that allow it to stand out: when note-taking you have the option to record audio (even in the background), insert or take a picture as well as file-share.
    [Show full text]
  • (12) United States Patent (10) Patent No.: US 9,668,024 B2 Os Et Al
    USOO9668024B2 (12) United States Patent (10) Patent No.: US 9,668,024 B2 Os et al. (45) Date of Patent: *May 30, 2017 (54) INTELLIGENT AUTOMATED ASSISTANT (58) Field of Classification Search FOR TV USER INTERACTIONS CPC combination set(s) only. See application file for complete search history. (71) Applicant: Apple Inc., Cupertino, CA (US) (56) References Cited (72) Inventors: Marcel Van Os, Cupertino, CA (US); Harry J. Saddler, Berkeley, CA (US); U.S. PATENT DOCUMENTS Lia T. Napolitano, San Francisco, CA 1,559,320 A 10, 1925 Hirsh (US); Jonathan H. Russell, Cupertino, 2,180,522 A 11/1939 Henne CA (US); Patrick M. Lister, Cupertino, (Continued) CA (US); Rohit Dasari, Cupertino, CA (US) FOREIGN PATENT DOCUMENTS CA 2666438 C 6, 2013 (73) Assignee: Apple Inc., Cupertino, CA (US) CH 681573 A5 4f1993 (*) Notice: Subject to any disclaimer, the term of this (Continued) patent is extended or adjusted under 35 U.S.C. 154(b) by 0 days. OTHER PUBLICATIONS This patent is Subject to a terminal dis API.AI, “Android App Review—Speaktoit Assistant”. Available at claimer. <https://www.youtube.com/watch?v=myE498nyfCw>, Mar. 30. 2011, 3 pages. (21) Appl. No.: 15/085.465 (Continued) (22) Filed: Mar. 30, 2016 Primary Examiner — Kieu Oanh T Bui (74) Attorney, Agent, or Firm — Morrison & Foerster (65) Prior Publication Data LLP US 2016/0212488 A1 Jul. 21, 2016 (57) ABSTRACT Systems and processes are disclosed for controlling televi Related U.S. Application Data sion user interactions using a virtual assistant. A virtual assistant can interact with a television set-top box to control (63) Continuation of application No.
    [Show full text]