AWS AI Services Overview VISION SPEECH TEXT SEARCH CHATBOTS PERSONALIZATION FORECASTING FRAUD DEVELOPMENT CONTACT CENTERS Ground Truth AWS Marketplace for ML Neo Augmented AI Built-in algorithms Notebooks Experiments Processing Model training and tuning Debugger Autopilot Model hosting Model Monitor Deep Learning AMIs & Containers GPUs & CPUs Elastic Inference Inferentia FPGA Amazon Rekognition Amazon Polly Amazon Transcribe +Medical Amazon Lex Amazon Personalize Amazon Forecast Amazon Comprehend +Medical AI SERVICES ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE Amazon Textract Amazon Kendra Contact Lens For Amazon Connect SageMaker Studio IDE Amazon CodeGuru Amazon SageMaker D eep G raph L ibrary Amazon Fraud Detector Amazon Translate The AWS ML Stack If I needed Butter.... Managed AI Services Custom Models Custom Models and Algorithms - Purchase Churn - Churn Maintenance - Time to make Butter - Purchase Cow, Churn, Field, Barn - Look after Cow (food, shelter, care, milking) - Field/Barn/Churn Maintenance - Time to make Butter Buy butter from shop Buy raw milk from farm Self-Sufficient – own Cow The AWS ML Stack Amazon Polly Text to Speech Nov 2016 Serverless - Choose from dozens of languages and voices - Adjust Speaking Style, Speech Rate, Pitch and Loudness - Custom Lexicons - Newscaster and Conversational style Modes - Standard TTS and Neural TTS options Standard TTS $4.00 per 1 million characters Neural TTS $16.00 per 1 million characters for speech Amazon Lex Conversational Interface Builder Nov 2016 Serverless $0.004 per voice request, $0.00075 per text request **plus charges as per service - High quality speech recognition - Natural Language Understanding - Multi-turn conversations, Intent Chaining - Quick deploy to multiple platforms - Native integrations with Amazon Polly, AWS Lambda, Amazon Comprehend Sentiment and Kendra** Amazon Rekognition Image and Video Analysis Nov 2016 Serverless - Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) Standard: $0.001/image, $0.10/min Live Video Face Search: $0.12/min Face storage: $0.00001/face per month Amazon Rekognition Image and Video Analysis Nov 2016 Serverless - Object and Scene Detection (built-in labels) - Content Moderation - Text detection - Face detection and analysis - Celebrity recognition - Pathing - Facial recognition (face search) - Custom Labels (images) – Nov 2019 Custom Label Training $1/hour Custom Label Inference $4/hour - Offline and Real-time transcription - Custom vocabulary - Vocabulary filtering - Multiple speaker and channel identification - Automatic content redaction - Automatic language identification - Custom language models (Aug 2020) Amazon Transcribe Speech to Text Nov 2017 Serverless Transcription: $0.0004/second Custom Transcription: $0.060/second additional cost Content Redaction: $0.00004/second Amazon Translate Neural Machine Translation Nov 2017 Serverless - Language Identification - Batch and Real-Time Translations - Custom Terminology $0.000015 per character, billed monthly - Keyphrase Extraction - Sentiment Analysis - Syntax Analysis - Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sept 2020) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Standard APIs: $0.0001/100 characters Topic Modelling: $1 (first 100MB) + $0.004/additional MB - Keyphrase Extraction - Sentiment Analysis - Syntax Analysis - Entity Recognition - Language Detection - Topic Modelling - PII Detection (Sep 2020) - Custom Classification (Nov 2018) - Custom Named Entity Recognition (Nov 2018) Amazon Comprehend Natural Language Processing (NLP) Nov 2017 Serverless Custom Training $3/hour, Model Management $0.50/month Inference Batch $0.0005/100 chars, Real Time $0.0005/instance per second Amazon Textract OCR – text, forms and tables Nov 2018 Serverless OCR - $0.0015/page Tables - $0.015/page (OCR included) Forms - $0.05/page (OCR included) - Optical Character Recognition (OCR) - Table Detection - Forms Extraction (key-value pairs) Amazon Personalize Recommendations Engine Nov 2018 Serverless $0.05 data ingestion/GB, $0.24/training hour Real Time: $0.20 per TPS-hour Batch: $0.067/ 1000 recommendations - Real Time and Batch Recommendations - New user and new item recommendations - Contextual recommendations - Similar item recommendations Amazon Forecast Forecasts Nov 2018 Serverless $0.088 data ingestion/GB, $0.24 per training hour Forecasts $0.60 per 1,000 forecasts - AutoML using historical time series data to create forecast - Visualisations - Probabilistic forecasts Amazon Fraud Detector Fraud Detection Dec 2019 Serverless $0.39 training/hour, $0.06 model hosting/hour Real Time: $0.030/prediction Real Time with Rules: $0.005/prediction - Real time Fraud Detection - AutoML for Fraud Detection - Integrated Rules Engine - SageMaker Integration Amazon Kendra Enterprise Search with Natural Language Capabilities Dec 2019 Serverless $7.00/hour up to 500,000 docs and 40,000 requests/day Connector: $0.000001/document and $0.35/hour when syncing - Natural language & keyword support - Reading comprehension & FAQ matching - Document ranking - Connectors - Relevance tuning - Domain optimization Amazon CodeGuru Automated Code Review and Application Performance Recommendations Dec 2019 Serverless Code Profiler: $0.005/hour (for first 36,000 per month, then free) Review Full Repo: $0.50 per 100 lines of code Review Pull Request: $0.75 per 100 lines of code - Runtime Profiler - Intelligent recommendations - Anomaly detection - Code Reviewer (Java only) - Pull Request Automated Recommendations - Full Repository Analysis Amazon SageMaker Ground Truth Label Training Data Nov 2018 Serverless Standard Dataset Unit: $0.08/object 3D point cloud: $3.00/frame (additional charges for using Mechanical Turk for reviewer) - Out of the Box templates for: - Video object detection, tracking and clip classification - 3D point clouds object detection, tracking and semantic segmentation - Image object detection, classification and semantic segmentation - Text classification and NER (named entity recognition) - Ability to use either private or public workforces - Ability to create custom templates and workflows Amazon Augmented AI (A2I) Human Review of Machine Learning Predictions Dec 2019 Serverless Rekognition Review: $0.03 / image Textract Review: $0.03 / page Custom Model: $0.08 / object (additional charges for using Mechanical Turk for reviewer) - Integration with AI Services for Human Review of low confidence machine learning predictions - Built in Workflows - Ability to use either private or public workforces - Out of the Box Templates for reviewer instructions - Ability to use Custom Templates and Workflows