Cortana / Speech Platform

Total Page:16

File Type:pdf, Size:1020Kb

Cortana / Speech Platform Cortana / Speech Platform 2 Cortana truly personal across all your devices get things done. Cortana Across your Devices Cortana Usage is Growing In 9 months since Windows 10 launched • Over 270 million active Windows 10 devices • Over 5 billion questions asked of Cortana • One million voice questions are directed towards Cortana on a daily basis On any given day, 25% of Cortana PC users use speech & Of these, 15% use the keyword to initiate Hey Cortana Cortana Drives Customer Satisfaction intent to recommend improve customer satisfaction increase “re-purchase” intent With Windows 10 Anniversary Update Nearly 1,000 Apps with Voice Commands Geographies Cortana functionality for Windows 10 is available in the following languages and countries English-US Japanese-Japan English-UK English-India Chinese-China English-Canada In plan for Windows 10 English-Australia German-Germany Anniversary Update French-France Portuguese-Brazil Italian-Italy Spanish-Spain French-Canada Spanish-Mexico Cortana with Voice (CwV) Marketing Assets Icons only Icons + Titles Cortana with Voice Titles and Cortana with Voice Your truly personal digital assistant who helps you get things done, even descriptions hands-free - just say “Hey Cortana” to get started. Technical *The “Cortana with Voice” title, icon, description, and associated assets Requirements such as messaging can only be used if all following criteria are met: to market 1. The device is tested using Microsoft’s “Speech platform tools” Cortana with 2. The device’s test results meet or exceed the Standard spec Voice (CwV) Standard vs. Premium Spec Windows 10 Anniversary Update & Beyond Standard • Normal ambient noise level • Normal ambient noise level • 0.5m • 0.5m • Standard experience • Standard experience • Cortana with voice (CwV) • Cortana with Voice (CwV) • Additional tests for Voice Activation (optional) Premium • More challenging conditions • More challenging conditions • <1m • 4m • Talk level: 89 dBA • Talk level: 99 dBA • Premium experience • Far-field experience • Additional tests for Voice Activation *Early draft, subject to change Cortana with Voice Testing Scenarios Cortana with Voice Validation Process Run the OEM Verifier tool and ensure the driver settings aligns with the design • Utility - OEMVerificationx86.exe • Driver reports these key elements correctly Number of microphones Audio effects supported Microphone geometry Exposes Audio Pipeline being used Driver mode supported Default microphone gain Follow the test guidance to validate Cortana with Voice performance • Validate in 3 scenarios: Quite, Ambient Noise (café and pub), Echo Parse data and ensure the test result are at or above the provided benchmark • Utility - OEMScoreUtilityFarAndNearx64.exe • Calculate the speech accuracy score & troubleshoot the issues Examples of Test Result OEM Pipeline Microsoft Pipeline Speech Accuracy Score Future Planning for CwV Requirements *Early draft, subject to change Platform Experience Release People Scenario Near-field Far-field 0 50 0 50 • Platform providers test voice degrees degrees degrees degrees activation false accepts (FA) Quiet (Private Office, Living Room) and correct accepts (CA) for Male Medium (Coffee Shop, Kitchen) 90% 90% Music listening in Quiet 2016 every supported locale Quiet (Private Office, Living Room) Female Medium (Coffee Shop, Kitchen) 90% 90% • These two tests are not needed Music listening in Quiet to be run by OEMs Quiet (Private Office, Living Room) Music listening in Quiet Male Medium (Coffee Shop, Kitchen) 92% 92% 90% 90% Music listening in Medium Ambient Quiet (Private Office, Living Room) Music listening in Quiet Future Female Medium (Coffee Shop, Kitchen) 92% 92% 90% 90% Music listening in Medium Ambient Quiet (Private Office, Living Room) Music listening in Quiet Children 92% 92% 90% 90% (5-12) Medium (Coffee Shop, Kitchen) Music listening in Medium Ambient OEM Experience OEMs test specific devices for good OEMs test specific devices for good voice speech recognition on EN-US only. activation accuracy on EN-US and JA-JP. These tests will become quality gates beyond 2016. Recommended Array for Far-Field When the Microsoft far-field processing is used the recommendation is to use the microphone array geometry shown above For 360 degree operation an 8-mic circular array is recommended For 3rd party solutions use their spec recommendations for microphone array and geometry Technical Requirement References Requirement Detail Reference / Spec Speech Platform Application and Microsoft Speech Platform Test Tools http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=59735 test tools content guidance for testing Speech Platform Audio Calibration files http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=57500 v1.1 “Standard” Quiet, Ambient, Echo Speech Platform Input Device Recommendations v1.2 (§2 – Device.SpeechRecognition recommendations) benchmark scores http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=58099 https://msdn.microsoft.com/en-us/library/windows/hardware/dn915051(v=vs.85).aspx v1.1 Test setup Measurement setup Speech Platform Input Device Test Setup v1.1 http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=58099 https://msdn.microsoft.com/en-us/library/windows/hardware/dn915051(v=vs.85).aspx Test setup for Measurement setup Speech Platform Input Device Recommendations – Accessories Support v1.0 http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=59861 accessories v2.0pre3 Specs Benchmarks and Speech Platform Input Device Recommendations v2.0pre3 Speech Platform Input Device Test Setup v2.0pre3 measurement setup https://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=60086 Call to Action • Ensure your drivers have the correct settings (mic geometry, mic gain, number of mics, expose audio pipeline being used) • Download and test the latest specs and tools • Provide feedback on Speech Platform v2.0pre3 specs Join WinHEC LINE Online Survey Form Community @winhec http://aka.ms/winhecfeedback Download WinHEC presentations here: * Gifts are limited. They will be offered at https://channel9.msdn.com/Blogs/WinHEC “a first come, first serve” basis. Please provide feedback on this session: http://aka.ms/winhecfeedback .
Recommended publications
  • Before the FEDERAL COMMUNICATIONS COMMISSION Washington, D.C
    Before the FEDERAL COMMUNICATIONS COMMISSION Washington, D.C. 20554 In the Matter of ) ) PN Comments – Accessibility of ) CG Docket No. 10-213 Communications Technologies ) To: Consumer & Governmental Affairs Bureau COMMENTS OF MICROSOFT CORPORATION Accessibility is a business imperative for Microsoft, as both a matter of compliance and an area ripe for innovation. We are investing in design principles and natural user interfaces that help individuals of all abilities,1 and innovating in touch, gesture, and speech recognition that can be used to improve communications services available to people with disabilities. Some of our innovations were not designed exclusively for accessibility, such as the work we’ve done on the Windows touch interface, or Bing’s voice-activated search for our Windows Phone digital personal assistant Cortana. Other innovation is focused on helping people with disabilities, such as Microsoft’s partnership with the UK non-profit “Guide Dogs for the Blind” to enable better independent mobility, which we discuss below. In implementing the Twenty-First Century Communications and Video Accessibility Act of 2010 (“CVAA”), the Commission has left space for such innovation to occur by avoiding overly prescriptive regulations and setting reasonable compliance deadlines that provide industry time to research break-through solutions. For a company like Microsoft, that is already investing 1 Microsoft, Digital Inclusion and Natural User Interface Technology: A Policy Framework, http://download.microsoft.com/download/C/1/A/C1AA2411-C3AE-4D21-8C46- F33CE49BBFCF/Digital-Inclusion-Natural-User-Interface-Technology.pdf. in accessibility solutions and offers a multitude of devices, software and services to a wide range of customers around the world, that space is key for us to best use our technological know-how to deliver accessibility advancements that benefit people with disabilities.
    [Show full text]
  • Steps to Disable Or Uninstall Skype for Business Method 1: Disable Skype for Business Via Skype Settings
    Steps to Disable or Uninstall Skype for Business Method 1: Disable Skype for Business via Skype Settings To disable this feature to prevent it from starting up, please following the instruction below. Step 1: Open the Settings of Skype for Business, navigate to the Tools tab and choose the Options option. Step 2: Select the Personal option from the left side, and uncheck Automatically start the app when I log on to Windows 10 and Start the app in the foreground, and then click the OK button to confirm the changes. Step 3: Click the Settings button again on the Skype for Business interface and choose File then Exit. After the three steps, you have successfully disabled Skype for Business from your PC and you will no longer see it although it is still on your computer. Method 2: Uninstall Skype for Business via Control Panel This method requires you to clear all your profile cache for the Skype for Business account and then uninstall it from Windows 10 via Control Panel. Here is the detailed tutorial on uninstalling Skype for Business. Step 1: Open your Skype for business and then sign out of this application. Step 2: In the Sign in interface, please click the Delete my sign-in info option. Note: This step will clear all your profile cache for the Skype for Business account and will disable the auto sign-in when the application opens. Step 3: Close Skype for Business. Step 4: You should uninstall Skype for Business like any other software on your computer. Click on the Windows button in the bottom left of your screen and type Control Panel.
    [Show full text]
  • Opening Skype on Windows 10
    Skype Opening Skype on Windows 10 ................... 1 Making a Video Call ..................................... 3 Checking Your Audio & Video .................... 2 Accepting a Video Call .................................4 Using Skype ................................................. 3 Installing Skype ........................................... 5 Finding Someone ........................................ 3 Opening Skype on Windows 10 1. On a Windows 10 computer, in the lower left corner click the Windows icon. 2. Type in “Skype” and as soon as you see “Skype” click on that selection, and enter your Skype username and password if prompted. If you do not already have a Skype account, you can easily create one—they are free. You can even create a Microsoft account just for Skype at https://outlook.live.com/owa Checking Your Audio & Video 1. Open Skype. 2. In the left pane, in the top right corner, click on the ellipse (…). 3. Your Settings open. 4. In the left pane, select Audio & Video. 5. In the Camera section your live picture should appear. If it does not, see if there is an option above your picture, and try selecting a different web camera. 6. Scroll down until you see the Audio section. Test your microphone and speakers and adjust the volume as needed. 7. Close the dialog box by clicking the X in the top left corner. Using Skype Once you open Skype, you will select someone to call from the left pane. You have some important options there: Search, Chats, Contacts The first couple times you use Skype you may need to search for your friends and family. You can search by name or email address associated with their Skype account.
    [Show full text]
  • Adobe Introduction to Scripting
    ADOBE® INTRODUCTION TO SCRIPTING © Copyright 2007 Adobe Systems Incorporated. All rights reserved. Adobe® Introduction to Scripting NOTICE: All information contained herein is the property of Adobe Systems Incorporated. No part of this publication (whether in hardcopy or electronic form) may be reproduced or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written consent of Adobe Systems Incorporated. The software described in this document is furnished under license and may only be used or copied in accordance with the terms of such license. This publication and the information herein is furnished AS IS, is subject to change without notice, and should not be construed as a commitment by Adobe Systems Incorporated. Adobe Systems Incorporated assumes no responsibility or liability for any errors or inaccuracies, makes no warranty of any kind (express, implied, or statutory) with respect to this publication, and expressly disclaims any and all warranties of merchantability, fitness for particular purposes, and non-infringement of third-party rights. Any references to company names in sample templates are for demonstration purposes only and are not intended to refer to any actual organization. Adobe®, the Adobe logo, Illustrator®, InDesign®, and Photoshop® are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States and/or other countries. Apple®, Mac OS®, and Macintosh® are trademarks of Apple Computer, Inc., registered in the United States and other countries. Microsoft®, and Windows® are either registered trademarks or trademarks of Microsoft Corporation in the United States and other countries. JavaScriptTM and all Java-related marks are trademarks or registered trademarks of Sun Microsystems, Inc.
    [Show full text]
  • Microsoft Windows 10 Update Hello, Microsoft Has Begun
    Subject Line: Microsoft Windows 10 Update Hello, Microsoft has begun pushing a warning message to Windows 10 computers that a critical security update must be performed. Several clients have informed us that they are seeing the warning message. It will appear as a generic blue screen after your computer has been powered up, and it states that after April 10, 2018 Microsoft will no longer support your version of Windows 10 until the critical security update has been performed. Please note if your UAN computer has not been recently connected to the internet, you would not have received this message. UAN has confirmed that the warning message is a genuine message from Microsoft, and UAN strongly encourages all clients to perform this critical security update as soon as possible. Please note: ‐ This update is a Microsoft requirement and UAN cannot stop or delay its roll out. To perform the critical security updated select the ‘Download update’ button located within the warning message. ‐ This update is very large, for those clients that have metered internet usage at their home may want to perform the update at a different location with unmetered high speed internet, perhaps at another family member’s home. ‐ Several UAN staff members have performed the critical security update on their home computers, and the process took more than an hour to complete. To check that your computer has been updated or to force the update at a time that is convenient to you, go to the windows Start button and click on Settings (the icon that looks like a gear above the Start button) > Update and Security > Windows Update > Check for Updates and then follow the instructions on the screen.
    [Show full text]
  • How to Set up Cortana (Or Remove Her) in Windows 10
    How to set up Cortana (or remove her) in Windows 10 Cortana, the personal digital assistant feature in Windows 10, will help you complete tasks, make it to your appointments on time, send messages and emails on your behalf, research the web and even launch applications. Orignally released with the Windows Phone (and named after the AI character from Microsoft's Halo franchise, looks to be a key element in the Windows 10 operating system. To begin the set up process, click or tap the microphone icon in the search bar and say "Hey Cortana" (if listening is enabled), followed by your question or search term. When properly set up Cortana is a powerful digital assistant. Start by clicking into the Cortana search box, and waiting for the results pane to appear. In the top- left corner of this, click the “hamburger” menu and then open Notebook. This tool allows you to determine what information Cortana can gather about you, and the more data she has, the more she can do. Cortana will have already asked you to input your name, but you can change this and more by opening About Me. Here, set the name you want her to use. Under Settings you can enable tracking info by switching on Find flights and more, which analyses your emails for such details. The Settings screen also enables you to toggle whether Cortana responds to “Hey, Cortana” which is very similar to Android’s “OK, Google“–the system will constantly be on the look-out for you saying this phrase, and will open Cortana when it is detected.
    [Show full text]
  • Windows 10-New Features & Apps
    Windows 10-New Features & Apps By Tom Krauser This article discusses some of the new features and apps that come packaged in Windows 10. It is only a brief summary of these features. For more information you can search the internet or check YouTube for instructional videos on your topic of interest. The following links provide some good basic information on Windows 10 and should be helpful to you. https://support.microsoft.com/en-us/products/windows?os=windows-10 https://support.microsoft.com/en-us/help/4043948/windows-10-whats-new-in-fall-creators-update-1709 The following article from PC World Magazine provides articles on a lot of new features in Windows 10. https://www.pcworld.com/tag/windows10/ The following article by CNET discusses some of new features in the latest update to Windows 10. https://www.cnet.com/how-to/windows-10-tips-best-features/ Alarms & Clocks: A combination of alarm clock, world clock, timer, and stopwatch. Set alarms and reminders, check times around the world, and time your activities, including laps and splits. The following link discusses how to set timers, alarms, and stopwatches: https://www.howtogeek.com/225211/how-to-set-timers-alarms-and-stopwatches-in-windows-10/ Camera: Many modern devices with Windows include a webcam and, to use it, you need an app that helps you take pictures, record videos or stream video while video chatting. For this purpose, Microsoft has built an app called Camera, which is available by default in Windows 10. Connect: Use Connect App to Cast Your Smartphone Screen to Your PC.
    [Show full text]
  • Quick Guide Page | 1
    Quick Guide Page | 1 Contents Welcome to Windows 10 ................................................................................................................................................................................................... 3 Key innovations ...................................................................................................................................................................................................................... 3 Cortana ................................................................................................................................................................................................................................. 3 Microsoft Edge .................................................................................................................................................................................................................. 4 Gaming & Xbox ................................................................................................................................................................................................................ 5 Built-in apps ....................................................................................................................................................................................................................... 7 Enterprise-grade secure and fast ...................................................................................................................................................................................
    [Show full text]
  • Feature Description
    NTLM Feature Description UPDATED: 19 March 2021 NTLM Copyright Notices Copyright © 2002-2021 Kemp Technologies, Inc. All rights reserved. Kemp Technologies and the Kemp Technologies logo are registered trademarks of Kemp Technologies, Inc. Kemp Technologies, Inc. reserves all ownership rights for the LoadMaster and Kemp 360 product line including software and documentation. Used, under license, U.S. Patent Nos. 6,473,802, 6,374,300, 8,392,563, 8,103,770, 7,831,712, 7,606,912, 7,346,695, 7,287,084 and 6,970,933 kemp.ax 2 Copyright 2002-2021, Kemp Technologies, All Rights Reserved NTLM Table of Contents 1 Introduction 4 1.1 Document Purpose 6 1.2 Intended Audience 6 1.3 Related Firmware Version 6 2 Configure NTLM Authentication 7 2.1 Configure Internet Options on the Client Machine 7 2.2 Configure the LoadMaster 11 2.2.1 Enable NTLM Proxy Mode 13 2.2.2 Configure the Server Side SSO Domain 13 2.2.3 Configure the Client Side SSO Domain 15 2.2.4 Configure the Virtual Service 15 2.3 Configure Firefox to Allow NTLM (if needed) 17 2.4 Troubleshooting 18 References 19 Last Updated Date 20 kemp.ax 3 Copyright 2002-2021, Kemp Technologies, All Rights Reserved NTLM 1 Introduction 1 Introduction NT LAN Manager (NTLM) is a Windows Challenge/Response authentication protocol that is often used on networks that include systems running the Windows operating system and Active Directory. Kerberos authentication adds greater security than NTLM systems on a network and provides Windows-based systems with an integrated single sign-on (SSO) mechanism.
    [Show full text]
  • Web Server IIS Deployment
    https://www.halvorsen.blog ASP.NET Core Web Server IIS Deployment Hans-Petter Halvorsen Introduction • Introduction to IIS deployment • If you have never used ASP.NET Core, I suggest the following Videos: – ASP.NET Core - Hello World https://youtu.be/lcQsWYgQXK4 – ASP.NET Core – Introduction https://youtu.be/zkOtiBcwo8s 2 Scenario Development Environment Test/Production Environment Local PC with Windows 10 Windows 10/Windows Server ASP.NET Core IIS Web Application SQL Server Visual Studio ASP.NET Core SQL Server Express Web Application Visual Studio Web Server • A web server is server software that can satisfy client requests on the World Wide Web. • A web server can contain one or more websites. • A web server processes incoming network requests over HTTP and several other related protocols. • The primary function of a web server is to store, process and deliver web pages to clients. • The communication between client and server takes place using the Hypertext Transfer Protocol (HTTP). • Pages delivered are most frequently HTML documents, which may include images, style sheets and scripts in addition to the text content. https://en.wikipedia.org/wiki/Web_server 4 Web Pages and Web Applications Web Server Client Web Server software, e.g., Internet Information Services (IIS) Request Web Browser, (URL) e.g., Edge, Internet Chrome, Safari, or Local etc. Response Network (LAN) Data- (HTML) base Operating System, e.g., Windows Server PC with Windows 10, macOS or Linux Smartphone with Android or iOS, etc. Web Server Software PHP (pronounced "engine x") Internet Information Services - Has become very popular lately ASP.NET Cross-platform: UNIX, Linux, OS X, Windows, ..
    [Show full text]
  • Vbscript Programmer’S Reference Third Edition
    VBScript Programmer’s Reference Third Edition Adrian Kingsley-Hughes Kathie Kingsley-Hughes Daniel Read Wiley Publishing, Inc. ffirs.indd iii 8/28/07 9:41:21 AM ffirs.indd vi 8/28/07 9:41:22 AM VBScript Programmer’s Reference Third Edition Introduction . xxv Chapter 1: A Quick Introduction to Programming . 1 Chapter 2: What VBScript Is — and Isn’t! . 31 Chapter 3: Data Types . 45 Chapter 4: Variables and Procedures . 83 Chapter 5: Control of Flow . 109 Chapter 6: Error Handling and Debugging . 129 Chapter 7: The Scripting Runtime Objects . 183 Chapter 8: Classes in VBScript (Writing Your Own COM Objects) . 209 Chapter 9: Regular Expressions . 233 Chapter 10: Client-Side Web Scripting . 261 Chapter 11: Windows Sidebars and Gadgets . 287 Chapter 12: Task Scheduler Scripting . 309 Chapter 13: PowerShell . 345 Chapter 14: Super-Charged Client-Side Scripting . 375 Chapter 15: Windows Script Host . 405 Chapter 16: Windows Script Components . 465 Chapter 17: Script Encoding . 489 Chapter 18: Remote Scripting . 509 Chapter 19: HTML Applications . 517 Chapter 20: Server-Side Web Scripting . 535 Chapter 21: Adding VBScript to Your VB and .NET Applications . 569 (Continued) ffirs.indd i 8/28/07 9:41:21 AM Appendix A: VBScript Functions and Keywords . 603 Appendix B: Variable Naming Convention . 675 Appendix C: Coding Conventions . 677 Appendix D: Visual Basic Constants Supported in VBScript . 681 Appendix E: VBScript Error Codes and the Err Object . 687 Appendix F: The Scripting Runtime Library Object Reference . 703 Appendix G: The Windows Script Host Object Model . 715 Appendix H: Regular Expressions . 723 Appendix I: The Variant Subtypes .
    [Show full text]
  • Windows 10 Open the Start Menu This Pamphlet Online Windows 10 - Press Start Button Or the Icon Resize App Tile on the Start Menu
    Start Menu Windows 10 Open the Start Menu This Pamphlet Online Windows 10 - Press Start button or the icon https://its.niagaracollege.ca/ Resize App Tile on the Start Menu - Right click the Tile, Click size, Choose preference Contents Rearrange Tiles How to Guides on the - Click and drag tile to preferred spot following topics Start Menu Remove a Tile from the Start Menu - Right click the tile, select Blackboard Apps Add a Tile to the Start Menu Desktop - Right click the app, Click Windows 10 Stop Updating on Apps Live Tile Settings and personalization - Right click the live Tile, Click More, Click Office 365 Turn live tile off File Explorer OneDrive Search for Files or Apps Action Center Skype for Business - Click Cortana and type Cortana the File or Applications Name https://its.niagaracollege.ca/ Rename Live Tile Groups Keyboard Shortcuts - Click the Name you want to change. Adjust the text Lock your Computer - Click , click Account, Click Lock Sign Out of Windows Install OneDrive Mobile and - Click , click Account, Desktop App Click Sign Out Switch Users Visit https://onedrive.live.com/ - Click , click Account, click the download tab on your Click Switch User Change Account Settings mobile device or desktop - Click , click Account, Click Change Account Settings Niagara College Help Desk Niagara College Help Desk Monday-Thursday 8:30am to 10:00pm Monday-Thursday 8:30am to 10:00pm Friday 8:30am to 4:30pm Friday 8:30am to 4:30pm Phone: 905-735-2211 ext. 7642 Phone: 905-735-2211 ext. 7642 https://its.niagaracollege.ca/ https://its.niagaracollege.ca/
    [Show full text]