AWS Media Services - Enabling Advanced Media Workflows
Total Page:16
File Type:pdf, Size:1020Kb
SessionD AWS Media Services - Enabling Advanced Media Workflows Andrew Thornton GM AWS Elemental APAC SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Traditional industry chain IS RIGID & YET FRAGILE 3 SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. The industry is reorienting around the viewer QualityShift MobilityAgility Resiliency Personal ReliabilityQuality ScalabilityReliable 4 SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. “ digital technology completely altered the behavior, expectations, and power of consumers ” Image courtesy of Wikimedia Commons: https://commons.wikimedia.org/wiki/File:Bob_Iger_crop_2.jpg SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. 5 © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Trademark AWS Media Services SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Media Services SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Media Services SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Live and VOD Workflow SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Managed Services used for Media Workloads AWS AWS Amazon S3 Amazon EC2 AWS Elemental Amazon Elastic Amazon Amazon AWS AWS Elemental Storage Gateway Direct Connect MediaConvert Transcoder Polly Comprehend Step Functions MediaTailor AWS S3 Transfer Amazon Glacier Amazon VPC AWS Elemental Amazon Amazon Amazon Amazon SQS Amazon Snowball Acceleration MediaLive RDS Machine Learning Translate CloudFront AWS AWS Elemental Amazon EBS Lambda AWS Elemental Amazon Amazon Amazon Amazon SNS AWS WAF Import/ Export MediaConnect MediaPackage DynamoDB Lex Transcribe Amazon EFS AWS Elemental Amazon Amazon Route 53 MediaStore Rekognition CloudSearch Ingest/Create Store Process Deliver © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SUMMIT 10 SessionD Enabling Advanced Media Workflows Andrew Thornton GM AWS Elemental APAC SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Advanced Video workflows • Quality optimisation & lower costs with intelligent encoding. QVBR • Reducing Latency • Personalised Ad insertion • Examples of the role of Machine Learning, AI & IoT in Media workloads • Recognition • Advanced Meta data tagging • Recommendation • ML IoT & Analytics • Live Subtitling with translation 12 SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Intelligent Encoding QVBR 9 8 Bitrate over Time 7 6 5 4 v2.11 3 v2.10 2 1 0 mbps Very hard Very hard Moderate Moderate Very hard Information contained in a video is natively VBR Different content and scenes carry varying amounts of information in the video frames 13 SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Quality-Defined Variable Bitrate (QVBR) • A content-conscious version of VBR bitrate control • QVBR analyses every macroblock, frame, and scene in the video source, and automatically allocates bits to address information differences: • Higher bitrate use during complex video segments, and Lower bitrate use during less complex video segments. • The result: an enhanced version of variable bitrate control that minimizes wasted bits and scales video bitrate to maintain consistent video quality. 14 SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. What are customers saying? • Transcode videos from car test drives • Initial tests have shown a 50% savings in storage • Comparison was with ffmpeg on EC2 • Transcode education and online learning content • Tests showed over a 50% decrease in storage and delivery costs • Win from Akamai encoding • Transcode short form social content • Tests on a sample of 100 videos showed a 20% decrease in output file size • Comparison was with Amazon Elastic Transcoder SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Better- than- Broadcast Latency What are the trade off’s in order to reduce end-to-end latency? • Video quality / video bitrate Short segments mean shorter GOPs, and this impacts video quality, or increases bitrates • Quality of experience—risk of buffering Players have less buffer stored up, so less time to calculate and execute bitrate switches to avoid buffering • Extra features—monetization and content protection Adding monetization and/or encryption becomes more challenging as they need time to complete interactions with ad decision servers or key exchanges © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SUMMIT 16 Achievable end-to-end latency LEGACY LATENCY RANGE LOW LATENCY RANGE ULTRA-LOW LATENCY RANGE SUB-SEC VOICE LIVE AUCTIONS Typical Broadcast Broadcast INTERACTIVE GAMING APPLICATIONS Latency GAMBLING, BETTING BUSINESS BUSINESS USE CASES USE CASES LIVE SPORTS 10s segments BROADCAST LATENCY – DTT, DTH, CABLE 6s segments 2s segments 1s segments TECHNOLOGY TECHNOLOGY DISTRIBUTION DISTRIBUTION CHUNKED CMAF segments 1s-6s OTT STREAMING OTT STREAMING WITH HLS & DASH WITH HLS WITH HLS & DASH & HLS WITH WebRTC 45+ 30 20 10 8 6 4 2 1 200 seconds seconds seconds seconds seconds seconds seconds seconds second ms Latencies that are achievable at scale ususinging mainstream CDN streaming technologies SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Low latency workloads with Chunked encoding AWS Elemental AWS Elemental Amazon Live MediaStore CloudFront Global Content ABR Encoding and Media-Optimized Delivery Network Players Live Feed Packaging Storage and Origin Capture Encoding Ingest Delivery Last Mile Player CAPTURE ENCODING INGEST DELIVERY LAST MILE PLAYER 0.39 SECONDS 1.48 SECONDS 0.27 SECONDS 0.17 SECONDS 0.28 SECONDS 2.55 SECONDS 7.58% 28.79% 5.25% 3.33% 5.44% 49.61% Sub-3 second latency is possible under ideal conditions Network performance is the key; this won’t work unless 5.14SECONDS the network itself is fast and reliable SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Evolution of Advertising in Streaming Media Client-side Server-side Burnt-in 2007 2012 advertising 2017 advertising static ads insertion Insertion SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Media Tailor Server Side Ad-Insertion Personalize and monetize internet video content Deliver Provide Improve personalised broadcast- tracking of ad ads to viewers grade ad views experience SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Elemental MediaTailor Amazon S3 AWS Elemental MediaTailor Dynamic / Managed Transcoding Manifest Amazon AWS Elemental AWS Elemental cache AWS Elemental MediaLive MediaPackage MediaTailor CloudFront Content Delivery Network Live Video Origination and Manifest Processing JIT Packaging Manipulation Devices Video with SCTE 35/104 Conditioned manifest with ad markers Ad Decision Server DFP, Freewheel or other ads . EasilyImproveIncrease deliver theviewing accuracy targeted experiences of ads ad to view any reporting platform © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. SUMMIT 21 Thursday Night Football on Amazon Prime Video Personalized Seamless Ads on Live Video Live stream NFL Thursday Night Football with Problem Statement personalized ads to millions of Prime subscribers Low-latency workflow required for minimal time-behind-live performance while maintaining maximum quality, uptime, and distribution Use of AWS • AWS Elemental MediaTailor, AWS Elemental Server, Amazon S3 for ad encoding and live ad insertion • AWS Elemental encoders functions as a playout server into CloudFront Business Benefits • Deploy user-centric features like viewer-selectable audio tracks and content personalization • Live stream availability on 600+ device types SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Fully Integrated AI Services in AWS Amazon Transcribe Subtitling and captioning service Leverage Complementary ML Services New set of ML services allows companies to Amazon Translate A 文 Multi-language translations easily caption text, translate that text into multiple languages, and create an audio Amazon Polly track with those new spoken languages Text-to-speech Object recognition also simplifies detection Amazon Rekognition of specific people, objects, or brands to Image recognition & analysis mark them in the video Amazon Lex Natural Language Understanding (NLU) & Automatic Speech Recognition (ASR) SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AI and ML Media use Cases Media Metadata Automate the creation of rich metadata index (object, scene, activity, faces etc.), extracted from audio Tagging visual content and integrated into digital and media asset management systems AWS SERVICES TO BUILD USE CASE: AMAZON REKOGNITION, AMAZON SAGEMAKER, AMAZON TRANSCRIBE, AMAZON COMPREHEND Identify objects and emotion in content that enables users to integrate personalized ads into Ad Personalization subscriber video streams AWS SERVICES TO BUILD USE CASE: AMAZON SPARK/EMR, AMAZON SAGEMAKER, AWS MEDIATAILOR Closed Captioning Automated captions, transcription and translation of audio content AWS SERVICES TO BUILD USE CASE: AMAZON TRANSCRIBE, AMAZON TRANSLATE, AMAZON COMPREHEND Detect potentially inappropriate