Building Smart Applications with Conversational Interfaces and Language Services Alex Casalboni SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. About me • Software Engineer & Web Developer • Startupper for 4.5 years • Serverless Lover & AI Enthusiast • ServerlessDays Organizer • AWS Customer since 2013 SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Our mission Put machine learning in the hands of every developer SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Our Approach Customer-focused 200+ new launches Wide range of roadmap (90%+) during 2018 services in production Most popular frameworks Security and analytics Embedded Research & (Tensorflow, MXNET) capabiities Development SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon ML Stack Vision Speech Language Chatbots Forecasting Recommendations A I SERVICES REKOGNITION REKOGNITION TEXTRACT POLLY TRANSCRIBE TRANSLATE COMPREHEND LEX FORECAST PERSONALIZE IMAGE VIDEO AMAZON S AGEMAKER ML SERVICES BUILD TRAIN DEPLOY Frameworks Interfaces Infrastructure ML FRAMEWORKS & INFRASTRUCTURE EC2 P3 EC2 C5 FPGAs GREENGRASS ELASTIC & P3dn INFERENCE SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AI capabilities Vision Speech-to-Text (STT) Text-to-Speech (TTS) Natural Language Understanding Language Translation Uniform programming interface for text and voice apps SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AI capabilities on AWS * * and more! Vision Amazon Rekognition Speech-to-Text (STT) Amazon Transcribe Text-to-Speech (TTS) Amazon Polly Natural Language Understanding Amazon Comprehend Language Translation Amazon Translate Chatbot Interface Amazon Lex SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. End-to-end workloads (media) store trigg er Audio Input call in aggregate analyze cascade SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Add intelligent image and video analysis to your applications SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Deep Learning-Based Image and Video Analysis SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Optical Character Recognition (OCR) SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Object & Scene Detection SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Facial Analysis SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Face Search/Comparison SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Marinus Analytics uses facial recognition to stop human trafficking “Now with Traffic Jam’s FaceSearch, powered by Amazon Rekognition, investigators are able to take effective action by searching through millions of records in seconds to find victims.” SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Discover insights and relationships in text SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. NLU Functionalities Language Topic Sentiment Entities Keyphrases s modeling Syntax SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Supported Languages English Italian French German Portuguese SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Syntax detection $ aws comprehend detect-syntax --language-code 'en' --text 'I love cloud!’ { "SyntaxTokens": [ { "TokenId": 1, "Text": "I", "BeginOffset": 0, "EndOffset": 1, "PartOfSpeech": { "Tag": "PRON", "Score": 0.9999802112579346 } }, ...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sentiment Analysis $ aws comprehend detect-sentiment --language-code 'en' --text 'I love cloud!’ { "Sentiment": "POSITIVE”, "SentimentScore": { "Mixed": 0.012617903761565685, "Positive": 0.9599817991256714, "Neutral": 0.021758323535323143, "Negative": 0.005641999188810587 } } SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. « Amazon Comprehend helps us analyze the key sentiments, objects, and geos in our 30 million plus reviews & testimonies. Now we are able to discover new insights into the unique experiences available at each property, so our customers can make the best decision possible for their travel.” Matt Fryer, VP and Chief Data Science Officer, Hotels.com SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Extract health information from patient notes, clinical trial reports, and other electronic health records SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Turn text into lifelike speech using deep learning SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Polly Use cases Key features • Content creation • 58 voices across 28 • Mobile & desktop languages applications • Lip-syncing & text • Internet of Things (IoT) highlighting • Education & e-learning • Fine-grained voice control • Telephony • Custom vocabularies • Game development • Available in 17 AWS Regions SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. “With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market.” Severin Hacker CTO, Duolingo SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Yes, natural language translation SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Supported languages * Arabic Japanese Danish Simplified Chinese Traditional Chinese Dutch French Italian Finnish German Russian Swedish Spanish Turkish Polish Portuguese Czech Hebrew * 417 translation combinations SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. «We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believe that Amazon Translate presents a quick, efficient and most importantly, accurate solution. » Matt Fryer, VP and Chief Data Science Officer, Hotels.com SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Turn speech into text SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Supported Languages English Italian French Spanish Portuguese SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Use cases Call Subtitles for Broadcast closed Transcribe centers VOD captions meetings SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. ringDNA • End-to-end communications platform for sales teams. • Hundreds of enterprise organizations use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate. Speech to Text "A critical component of RingDNA’s Conversation AI requires best of breed speech-to-text to deliver transcriptions of every phone call. RingDNA is excited about since it Amazon Transcribe https://www.youtube.com/watch?v=1ZJ_f1bDdog provides high-quality speech recognition at scale, helping us to better transcribe every call to text " Howard Brown, CEO & Founder, RingDNA SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Conversational interfaces for your applications powered by the same deep learning technologies as Alexa SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Lex Dialog Management Deployment Native support & One click deployment maintains context Speech to Intent Scale ASR+NLU Completely managed integrated into one service API EndEnd toto End End Text to Speech Business Logic Amazon Polly integrated Native integration with into API AWS Lambda Analytics Security Monitor and improve Encrypted data in transit & at rest SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. OCR++ service to extract data from virtually any document (No ML experience required) SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Textract: How it works SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Accurate time-series forecasting service (No ML experience required) SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SALES FORECAST The perils of poor predictions in forecasting SALES TIME SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Forecast: How it works Historical data Amazon Forecast Supply chain, inventory, etc. Related “causal” data Load Inspect Identify Select Select Train Optimize Host Customized Weather, special offers, product forecasting API details data data features from 8 Hyperparameters models models models algorithms SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Real-time personalization and recommendation service (No ML experience required) SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Personalize: How it works Activity stream from app Views, signups, conversion, etc. Amazon Personalize Inventory Articles, products, videos, etc. LOAD DATA INSPECT SELECT TRAIN HOST CREATE Customized (EMR Cluster) DATA ALGORITHMS MODELS MODELS REAL-TIME CACHES personalization & Demographics recommendation API (optional) IDENTIFY SELECT OPTIMIZE BUILD FEATURE Age, location, etc. FEATURES HYPERPARAMETERS MODELS STORE Fully m anaged by Amazon Personalize SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved..