Cars and Cuis Primer Summary
Total Page:16
File Type:pdf, Size:1020Kb
ABC CONNECTED CAR Exploring voice-led interaction and CUIs ABC R+D ABC Digital Network Research and Development – ABC Connected Car: CUIs WHAT IS THIS PROJECT DEMONSTRATING? ABC media moments in a future car driver’s morning commute, in a connected car, using conversational user interfaces (CUIs) and voice-led interaction. What are CONVERSATIONAL USER INTERFACES? ABC Digital Network Research and Development – ABC Connected Car: Defining CUIs A conversational interface is any user interface that mimics chatting with a real human - i.e. it allows us to use natural language to find answers, get directions and more. A conversational UI can take place as a back-and- forth text chat, email or spoken conversation. “A conversational interface enables humans to converse with machines (in much the same way we communicate with one another) in order to create, access, and manage information and to solve problems.” — MIT THE ERA OF CONVERSATIONAL INTELLIGENCE Speech Natural Language Artificial + + recognition Understanding Intelligence (NLU) Understanding intent, contextually aware = always listening and learning ABC Digital Network Research and Development – ABC Connected Car: Defining CUIs Three ways that CUIs will change our lives: 1. The interface is a conversation. 2. The conversation is with a smart, connected object or thing, or with a bot or virtual assistant like Siri, Cortana, Alexa or Google Assistant. 3. The smart object or virtual assistant we are conversing with can also start the conversation. This is a novelty today - but in the future many objects, devices and apps will initiate conversations with us. ABC Digital Network Research and Development – ABC Connected Car: Defining CUIs Future, advanced CUIs will allow us to talk “with” them, not “at” them… Your CUI + virtual assistant will know you the way a friend or colleague does > They will use perceptive listening (automatically wake up when you speak) > They will remember context and past conversations, and detect how you are feeling based on the sound of your voice and even your body language. ABC Digital Network Research and Development – ABC Connected Car: Defining CUIs CUIs will become ubiquitous They are perfect for smart environments and the ‘Internet of Things’ > In smart homes, cars, and workplaces where hands-free mobility is key. > Smart objects will be EVERYWHERE - many will be too small to have screens. > We’ll increasingly feel less self-conscious about interacting with our voices. What’s driving the rise of CUI’s & VOICE INTERACTION? ABC Digital Network Research and Development – ABC Connected Car: Defining CUIs MESSENGER APPS, BOTS, VIRTUAL ASSISTANTS AND ADVANCED AI = MAKING LIFE EASIER 1. Messenger apps are now like “mini webs” - conversations include mini applications. Chatbots are super easy to install and use. These, along with voice-driven virtual assistants such as Apple Siri, Microsoft Cortana, Google Assistant, Facebook M and Amazon Alexa are becoming increasingly intelligent, more sophisticated and more human. “There are already 3 billion of us using instant messaging apps, with nearly a billion more expected to come on board by the end of the decade.” — SMH, April 2016 WeChat CUI — micro apps within a Telegram Quartz News Today’s big virtual assistants conversation timeline are audio bots - Siri, Google Assistant, Alexa, Cortana Viv ABC Digital Network Research and Development – ABC Connected Car: The rise of CUIs Bots + Virtual Assistants + CUIs + Advanced AI = future with no apps? Why open and close a bunch of apps on your phone to get stuff done when you can invoke a text-message-like window and just say what you want done to a chatbot? Facebook M Google Allo (currently in beta testing) (ties in with Google Assistant) ABC Digital Network Research and Development – ABC Connected Car: Defining CUIs HOW BOTS WILL INTEGRATE OUR TECH LIVES “Bots will do what Apps hoped to accomplish, but failed to deliver… One day soon, you will have a personal bot that will be able to do things like set up appointments, help with your do-to’s, check your emails, pull data for you (say your company's info) and even give conversational updates to your friends, family, and co- workers. It will integrate your entire digital life in one place, make it easily accessible and then automatically handle certain tasks for you. Currently, Facebook and Google are working on creating Master Bots. The Master Bot is basically a bot that can seamlessly summon services from other bots. For instance let’s say you wanted to order a burger, currently you have to do a small research project or use an app… In the near future, Siri, Alexa, Facebook M or Google’s Master Bot will have access to all of bot services be able to process orders on the back-end seamlessly. In other words, you will tell Siri what you want, Siri will find it and give you a few great options and you will be able to order and pay for it seamlessly.” — How Chatbots and AI Will Fundamentally Change the Future, 2016 ABC Digital Network Research and Development – ABC Connected Car: The rise of CUIs THE INTERNET OF THINGS & THE CONNECTED WORLD 1. It makes sense that voice is the ideal operating system of Internet of Things (IoT). Many smart objects and devices don’t have screens and keyboards, and graphical user interfaces aren’t likely to be very practical or easy Only 6 slices left to use when we start to use content and services BUY seamlessly across smarter environments. Voice control will make the Internet of Things more human. ABC Digital Network Research and Development – ABC Connected Car: The rise of CUIs THE INTERNET OF THINGS & THE CONNECTED WORLD Big tech companies like Apple, Google and Amazon are looking to win the ‘voice wars’ - so that their products and services are the ones we can easily use in all life contexts. Apple Siri Google Assistant & Google Voice ABC Digital Network Research and Development – ABC Connected Car: Defining CUIs THE VOICE WARS > Amazon - announced the Alexa Fund in June 2015, providing up to $100m in investments to support developers, manufacturers, and start-ups of all sizes who are passionate about creating new experiences designed around the human voice. So far Amazon has sold approximately 3 million Echo devices - the Echo launched in the US in late 2014. > Apple - has made big investments in voice recognition companies — VocalIQ (Oct 2015), Novauris (April 2014). Apple bought Siri in 2010, launched it in 2011 on phones and in 2012 in selected cars; CarPlay launched in 2014, and Apple announced it would be opening up Siri to developers at WWDC 2016 so that they could connect Siri to their car apps. > Viv AI - Viv Labs was established in 2012 by Siri’s creators; has $30m investment so far; first demo launched May 2016. > Google - invested in speech recognition company Mobvoi in Oct 2015; acquired voice and image research firm DNN Research in March 2013; acquired SayNow in 2011; launched Google Voice in 2008 after acquiring GrandCentral; plus big investments in deep learning & machine learning (e.g. bought Deep Mind for $400m in 2014); launched Google Voice Search 2011, Google Now 2012 and Google Assistant 2016; released Android Auto app in March 2015. > Microsoft - launched voice control for Kinect in 2011; Cortana launched in Windows 10 in 2014; builds prototype of Cortana-powered car in 2015; announced its “Conversation as a Platform” strategy at Build 2016 and bought Wand Labs to add more natural language tech to messaging apps and bots. > Facebook - is developing it’s virtual assistant M - a beta version launched in August 2015; running FAIR (artificial intelligence research program); acquired Wit.ai in January 2015 to help it’s developers with speech recognition and voice interfaces. ABC Digital Network Research and Development – ABC Connected Car: The rise of CUIs ‘CONVERSATION AS A PLATFORM’ This is the phrase that has been coined for a key new focus for the five tech giants - Microsoft, Apple, Google, Facebook and Amazon. > people are downloading apps less and less, and want to be able to jump between digital services across devices and spaces more easily. > virtual assistants and bots are gaining traction because they are starting to feel more convenient - combining many services and features all in one place (e.g. media players, games, in-message payments, images, bookings, social engagement). > when you add in voice-led, conversational interaction to all of this then things start to feel natural and intuitive. According to comScore, As of September 2015, In February 2016 200 billion searches per Siri was being used by Google reported that month will be done with 52% of iPhone users. voice searches had voice by 2020. By June 2016 , Siri was doubled from 2015-16. receiving 2 billion This creates a $50+ billion requests per week. A 2014 Google study per year market revealed that 55% of opportunity around voice search. teens and 41% of adults used voice search more than once a day. Voice-driven CUIs are PERFECT FOR CONNECTED CAR DRIVERS ABC Digital Network Research and Development – ABC Connected Car: Why CUIs and voice are appropriate It’s all about all talk, no buttons - allowing the driver to control and interact with services easily with their hands on the wheel > these could be complimented with supplementary visual elements - e.g. simple/ subtle visual activity on your windscreen — but ultimately drivers need minimal distractions Voice interactions are: > CUIs will work with other systems and > fast - we can speak faster than we can type elements - e.g. wearables, smart