S U M M I T Using Machine Learning for Serverless Analytics S U M M I T What is serverless? No infrastructure provisioning, no management Automatic scaling Pay for value Highly available and secure S U M M I T F R A M E W O R K S A N D I N T E R F A C E S M L f o r d a t a s c i e n t i s t s KERAS Frameworks Interfaces A P P L I C A T I O N S E R V I C E S M L f o r e v e r y o n e P L A T F O R M S E R V I C E S M L f o r e n g i n e e r s NVIDIA Tesla V100 GPUs (14x faster than P2) Machine Learning AMIs I N F R A S T R U C T U R E P o w e r i n g t h e M L Intel Xeon Skylake (Optimized for ML) A W S G R E E N G R A S S M L L E X P O L L Y R E K O G N I T I O N I M A G E & V I D E O T R A N S C R I B E T R A N S L A T E C O M P R E H E N D F O R E C A S T P E R S O N A L I Z E A M A Z O N S A G E M A K E R A W S D E E P L E N S S A G E M A K E R G R O U N D T R U T H & M E C H A N I C A L T U R K S P A R K & E M R S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS IoT Core S3 Bucket • Validate syntax • Enrich data • External lookups • DynamoDB Table • RDS Database • Anything, it’s your code! S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket • Integrated Data Catalog • Automatic schema discovery • Code generation • Developer endpoints • Flexible job scheduler S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket • Analyze data in Amazon S3 using standard SQL • There is no infrastructure to manage • You pay only for the queries that you run S U M M I T Serverless Machine Learning + Analytics Files S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core S3 Bucket • Self-service business intelligence (BI) • Deliver rich, interactive dashboards for your readers • Pay-per-session pricing S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Firehose S3 Bucket S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose S3 Bucket S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose • Capture • Transform • Load data streams • Process data streams in real time with SQL and Java (Apache Flink) • Sliding windows • Tumbling windows • Use built-in functions that are optimized for stream processing • Anomaly detection • Top-K analysis • Process or analyze streaming data S U M M I T Serverless Machine Learning + Analytics Files Data Stream S3 Bucket Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose S3 Bucket Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing S U M M I T Serverless Machine Learning + Analytics Video Stream Kinesis Video Stream AWS IoT Core Custom Processing Securely stream video from connected devices to AWS for analytics, machine learning (ML), and other processing Kinesis Video Producer SDK • Gstreamer-plugin, • Docker images for Ubuntu, MacOS, and Raspberry Pi • Kinesis Video Streams applications get data, such as fragments and frames, from a Kinesis video stream to view, process, or analyze it • Get media with low-latency using the Kinesis Video Stream Parser Library Serverless But you may need it :) Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing S U M M I T Serverless Machine Learning + Analytics AWS IoT Analytics IoT Device AWS IoT Core • Standard SQL queries • Run time-series analyses • Cleans false readings • Fill gaps in the data • Perform mathematical transformations of message data • Use Lambda functions to enrich your device data from external sources Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose Outside of AWS S3 Bucket Custom Processing Serverless Machine Learning + Analytics Files Data Stream Video Stream S3 Bucket Kinesis Video Stream Custom Processing Amazon Athena Amazon QuickSight AWS Glue (Crawlers, Jobs & Data Catalog) AWS IoT Analytics IoT Device AWS IoT Core Kinesis Data Streams Kinesis Data Analytics Kinesis Data Firehose AWS Greengrass Outside of AWS S3 Bucket Serverless Machine Learning + Analytics Video Stream IoT Device AWS IoT Core AWS Greengrass Outside of AWS • Local compute (Lambda functions) • Messaging • Data caching • Synchronize data • ML inference Connected devices