Build Intelligent Applications Using AI Services

Building Smart Applications with Conversational Interfaces and Language Services Alex Casalboni

• Software Engineer & Web Developer • Startupper for 4.5 years • Serverless Lover & AI Enthusiast • ServerlessDays Organizer • AWS Customer since 2013

Put machine learning in the hands of every developer

Customer-focused 200+ new launches Wide range of roadmap (90%+) during 2018 services in production

Most popular frameworks Security and analytics Embedded Research & (Tensorflow, MXNET) capabiities Development

Vision Speech Language Chatbots Forecasting Recommendations

A I SERVICES

REKOGNITION REKOGNITION TEXTRACT POLLY TRANSCRIBE TRANSLATE COMPREHEND LEX FORECAST PERSONALIZE IMAGE VIDEO

AMAZON S AGEMAKER

ML SERVICES BUILD TRAIN DEPLOY

Frameworks Interfaces Infrastructure

ML FRAMEWORKS & INFRASTRUCTURE EC2 P3 EC2 C5 FPGAs GREENGRASS ELASTIC & P3dn INFERENCE

Vision

Speech-to-Text (STT)

Text-to-Speech (TTS)

Natural Language Understanding

Language Translation

Uniform programming interface for text and voice apps

Vision Amazon Rekognition

Speech-to-Text (STT) Amazon Transcribe

Text-to-Speech (TTS) Amazon Polly

Natural Language Understanding Amazon Comprehend

Language Translation Amazon Translate

Chatbot Interface Amazon Lex

store

trigg er Audio Input call in aggregate analyze cascade

“Now with Traffic Jam’s FaceSearch, powered by Amazon Rekognition, investigators are able to take effective action by searching through millions of records in seconds to find victims.”

Language Topic Sentiment Entities Keyphrases s modeling

Syntax

English Italian French German Portuguese

$ aws comprehend detect-syntax --language-code 'en' --text 'I love cloud!’ { "SyntaxTokens": [ { "TokenId": 1, "Text": "I", "BeginOffset": 0, "EndOffset": 1, "PartOfSpeech": { "Tag": "PRON", "Score": 0.9999802112579346 } }, ...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sentiment Analysis

$ aws comprehend detect-sentiment --language-code 'en' --text 'I love cloud!’

{ "Sentiment": "POSITIVE”, "SentimentScore": { "Mixed": 0.012617903761565685, "Positive": 0.9599817991256714, "Neutral": 0.021758323535323143, "Negative": 0.005641999188810587 } }

SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. « Amazon Comprehend helps us analyze the key sentiments, objects, and geos in our 30 million plus reviews & testimonies. Now we are able to discover new insights into the unique experiences available at each property, so our customers can make the best decision possible for their travel.”

Matt Fryer, VP and Chief Data Science Officer, Hotels.com

Use cases Key features

• Content creation • 58 voices across 28 • Mobile & desktop languages applications • Lip-syncing & text • Internet of Things (IoT) highlighting • Education & e-learning • Fine-grained voice control • Telephony • Custom vocabularies • Game development • Available in 17 AWS Regions

Severin Hacker CTO, Duolingo

Arabic Japanese Danish Simplified Chinese Traditional Chinese Dutch French Italian Finnish German Russian Swedish Spanish Turkish Polish Portuguese Czech Hebrew

* 417 translation combinations

SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. «We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believe that Amazon Translate presents a quick, efficient and most importantly, accurate solution. »

Matt Fryer, VP and Chief Data Science Officer, Hotels.com

English Italian French Spanish Portuguese

Call Subtitles for Broadcast closed Transcribe centers VOD captions meetings

• End-to-end communications platform for sales teams. • Hundreds of enterprise organizations use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate.

Speech to Text "A critical component of RingDNA’s Conversation AI requires best of breed speech-to-text to deliver transcriptions of every phone call. RingDNA is excited about since it Amazon Transcribe https://www.youtube.com/watch?v=1ZJ_f1bDdog provides high-quality speech recognition at scale, helping us to better transcribe every call to text " Howard Brown, CEO & Founder, RingDNA SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Conversational interfaces for your applications powered by the same deep learning technologies as Alexa

Native support & One click deployment maintains context

Speech to Intent Scale

ASR+NLU Completely managed integrated into one service API EndEnd toto End End

Text to Speech Business Logic

Amazon Polly integrated Native integration with into API AWS Lambda

Analytics Security

Monitor and improve Encrypted data in transit & at rest SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. OCR++ service to extract data from virtually any document (No ML experience required)

FORECAST

The perils of poor predictions in forecasting SALES

TIME

Historical data Amazon Forecast Supply chain, inventory, etc.

Related “causal” data Load Inspect Identify Select Select Train Optimize Host Customized Weather, special offers, product forecasting API details data data features from 8 Hyperparameters models models models algorithms

Activity stream from app Views, signups, conversion, etc. Amazon Personalize Inventory Articles, products, videos, etc. LOAD DATA INSPECT SELECT TRAIN HOST CREATE Customized (EMR Cluster) DATA ALGORITHMS MODELS MODELS REAL-TIME CACHES personalization & Demographics recommendation API (optional) IDENTIFY SELECT OPTIMIZE BUILD FEATURE Age, location, etc. FEATURES HYPERPARAMETERS MODELS STORE

Fully m anaged by Amazon Personalize