Machine Learning Week at the San Francisco Loft: Add Intelligence to Applications with AWS ML Services Organizations are increasingly turning to machine learning to build intelligent applications and get more insights out of their data in real-time. In this session, you’ll learn about AWS Machine Learning APIs for computer vision and language, and how to get started with these pre-trained services: Amazon Rekognition, Amazon Comprehend, Amazon Transcribe, Amazon Translate, Amazon Polly, and Amazon Lex. We’ll also show how these services connect to AWS’s comprehensive data platform and services to drive the success of your machine learning projects. Level: 200 Speaker: Anjana Kandalam - Solutions Architect, AWS

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Pop-up Loft
Build Intelligent Applications with AWS ML Services
Speaker Name
Title

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
A Long History of Machine Learning at Amazon
Personalized
recommendations
Inventing entirely
new customer
experiences
Fulfillment
automation and
inventory
management
Drones Voice driven
interactions

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Put machine learning in the hands
of every developer and data scientist
Machine Learning at AWS
Our mission:

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
The AWS Machine Learning Stack
AI SERVICES
ML PLATFORMS
ML FRAMEWORKS
VISION
Rekognition
Video
Rekognition
SPEECH
TranscribePolly
LANGUAGE
ComprehendTranslate
CHATBOTS
Lex
AWS DeepLensAmazon SageMaker
TensorFlow MXNet PyTorch Caffe2 Chainer Horvod Gluon Keras
Mechanical Turk

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Bottom Layer: Frameworks & interfaces
NVIDIA
Tesla V100 GPUs
P3
AWS Deep Learning AMI
5,120 Tensor cores
128GB of memory
1 Petaflop of compute
NVLink 2.0
~14X faster than P2

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
The Amazon machine learning stack
PLATFORM SERVICES
APPLICATION SERVICES
FRAMEWORKS & INTERFACES
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker
Rekognition Transcribe Translate Polly Comprehend Lex
AWS
DeepLen
s
EDUCATION
The Amazon Machine Learning Stack
Amazon Mechanical Turk

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon SageMaker
Collect and prepare
training data
Choose and
optimize your ML
algorithm
Set up and manage
environments for
training
Train and tune model
(trial and error)
Deploy model
in production
Scale and manage
the production
environment
E a s i l y b u i l d , t r a i n , a n d d e p l o y m a c h i n e l e a r n i n g m o d e l s

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon SageMaker
Pre-built
notebooks for
common
problems
K-Means Clustering
Principal Component Analysis
Neural Topic Modelling
Factorization Machines
Linear Learner - Regression
XGBoost
Latent Dirichlet Allocation
Image Classification
Seq2Seq
Linear Learner - Classification
ALGORITHMS
Apache MXNet
TensorFlow
Caffe2, CNTK,
PyTorch, Torch
FRAMEWORKS
Set up and manage
environments for
training
Train and tune
model (trial and
error)
Deploy model
in production
Scale and manage the
production environment
Built-in, high
performance
algorithms
BUILD

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon SageMaker
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
Hyperparameter
optimization
BUILD TRAIN
Deploy model
in production
Scale and manage
the production
environment

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon SageMaker
Fully managed
hosting with auto-
scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
Hyperparameter
optimization
BUILD TRAIN DEPLOY

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Can we do more to put ML in the hands of
all developers (literally)?

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
AWS DeepLens
HD video camera
Custom-designed
deep learning
inference engine
Micro-SD
Mini-HDMI
USB
USB
Reset
Audio out
Power
HD video camera
with on-board
compute optimized
for deep learning
Tutorials, examples,
demos, and pre-built
models
From unboxing to
first inference in
<10 minutes
Integrates with Amazon
SageMaker and AWS
Lambda
10
MIN

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
The Amazon machine learning stack
PLATFORM SERVICES
APPLICATION SERVICES
FRAMEWORKS & INTERFACES
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker
Rekognition Transcribe Translate Polly Comprehend Lex
AWS
DeepLen
s
EDUCATION
The Amazon Machine Learning Stack
Amazon Mechanical Turk

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
AWS Machine Learning Services for Computer Vision

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Rekognition
Easy-to-use deep learning-based computer vision analysis
Fully
managed
service
Easy-to-use
API
Low costImage
analysis

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Rekognition Image
Detect objects, scenes, and faces, extract text and identify unsafe content in images
Object and Scene
Detection
Facial
Analysis
Face
Recognition
Text in ImageUnsafe Image
Detection
Celebrity
Recognition
Face
Comparison

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Demo
Rekognition Console

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Demo
https://amzn.to/takeselfie

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Demo
Rekognition API

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Example: Serverless Image Processing Workflow
https://github.com/aws-samples/lambda-refarch-imagerecognition/

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
2. Submit
Image
4. DetectFaces 7. DetectText
1. Upload
3. Store image Lambda Step Functions
5.DetectLabels 6.DetectModerationLabels
8. Store Metadata
& analysis
DynamoDB
ElasticSearch
Analyze Images

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Video Analysis
Limitations of traditional solutions
Temporal
information lost
Motion
context lost

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Rekognition Video
Analyze activity and recognize people in stored and live video
Facial
Analysis

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Language and Speech Services

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Common Language Use Cases
Information Bots
Education
Accessibility
Knowledge Management
Voice of Customer
Applications
Customer Service/
Call Centers
Enterprise
Digital Assistant
Semantic Search
Captioning Workflows
LocalizationPersonalization

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Powerful speech and language capabilities
Amazon Transcribe
Automatic conversion of speech into accurate, grammatically correct
text
Amazon Translate Natural and fluent language translation
Amazon Polly Turn text into lifelike speech using deep learning
Amazon Comprehend Discover insights and relationships in text
Amazon Lex Conversational interfaces for text-based and voice-based applications

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Transcribe
Automatic conversion of speech into accurate, grammatically correct text
Support for
telephony
audio
Timestamp
generation
Intelligent
punctuation and
formatting
Recognize
multiple
speakers
Custom
vocabulary
Multiple
languages

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Timestamping and Confidence Score
1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 15.0 16.0 17.0
“Hi I would like to reschedule my flight to Seattle to later tonight”
3.480 sec
Confidence : 1
6.402 sec
Confidence : 0.95
10.541 sec
Confidence : 1

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Transcribe Demo

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Translate
Natural and fluent language translation
Real-time
translation
Batch analysis Automatic language
recognition
Low cost

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Translate Demo
• Translate a greeting
• Speak the greeting
• Add SSML for further control

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Polly
Turn text into lifelike speech using deep learning
Wide selection of
voices and languages
Synchronize
speech
Fine-grained
control
Unlimited replay

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Polly Demo
• Call Amazon Polly
• Save output locally as mp3 files

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Demo: Translate a chat channel using Amazon Translate

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Comprehend
Storm
World Series
Stock market
Washington
Library of news
articles
Amazon
Comprehend
Discover insights and relationships in text using deep learning

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Comprehend
Discover insights and relationships in text using deep learning
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A m a z o n . c o m , I n c . i s l o c a t e d i n
S e a t t l e , W A a n d w a s f o u n d e d
J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s .
O u r c u s t o m e r s l o v e b u y i n g
e v e r y t h i n g f r o m b o o k s t o
b l e n d e r s a t g r e a t p r i c e s
• N a m e d E n t i t i e s
– A m a z o n . c o m : O r g a n i z a t i o n
– S e a t t l e , W A : L o c a t i o n
– J u l y 5 t h , 1 9 9 4 : D a t e
– J e f f B e z o s : P e r s o n
• K e y p h r a s e s
– O u r c u s t o m e r s
– b o o k s
– b l e n d e r s
– g r e a t p r i c e s
• S e n t i m e n t
– P o s i t i v e
• L a n g u a g e
– E n g l i s h
Text Analysis

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Comprehend Demo
• Download Amazon Video review data
• Use Amazon Comprehend
– detect sentiment
– identify key phrases

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Lex
Building conversational interfaces into any application using voice and text
Integrated
development in
the AWS console
Trigger
Lambda
functions
Multi-step
conversations
One-click
deployment
Enterprise
connectors
Fully
managed

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Demo
• Create an Amazon Lex chatbot for ordering coffee
• Call the chatbot

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
The broadest ML platform, that’s easiest to use, and has
the most customers
DATA LAKE STORAGE
Amazon S3
SECURITY
Access Control
Encryption
COMPUTE
Powerful GPU and CPU Instances
ANALYTICS
Amazon Athena
Amazon Redshift and Redshift Spectrum
Amazon EMR
(Spark, Hive, Presto, Pig)
AWS Glue
Amazon Kinesis
Amazon QuickSight
Amazon Macie
AWS Organizations
Complementary Services
APPLICATION SERVICES
Amazon Lex
Amazon Polly
Amazon Comprehend
Amazon Translate
Amazon Transcribe
Amazon Rekognition Image
Amazon Rekognition Video
PLATFORM SERVICES
Amazon SageMakerAWS DeepLens
FRAMEWORKS AND INTERFACES
AWS Deep Learning AMI
Apache MXNet
Caffe2
CNTK
PyTorch
TensorFlow
Theano
Torch
Gluon
Keras
AWS ML Platform AWS ML Customers

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Try it yourself!
https://github.com/aws-samples/aws-ai-bootcamp-labs

43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Pop-up Loft
aws.amazon.com/activate
Everything and Anything Startups
Need to Get Started on AWS