More Related Content Similar to Enriching your app with Image recognition and AWS AI services Hebrew Webinar (20) More from Boaz Ziniman (20) Enriching your app with Image recognition and AWS AI services Hebrew Webinar1. © 2019, Amazon Web Services, Inc. or its Affiliates.
Enriching your App with Image
Recognition and AWS AI Services
Boaz Ziniman, Technical Evangelist
Amazon Web Services
@ziniman
ziniman
2. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
• The History of Image Recognition
• Introduction to the AWS AI Services
• Amazon Rekognition and the different APIs
• Use Cases
• Demos
Agenda
3. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
• Classification, Detection, segmentation
• Face Detection
• Face Verification
• Face Recognition
• Text Detection
Image Processing
4. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Convolutional Neural Networks (CNN)
Le Cun, 1998: handwritten digit recognition, 32x32 pixels
https://devblogs.nvidia.com/parallelforall/deep-learning-nutshell-core-concepts/
5. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Our deep experience with AI/ML
differentiates our approach
Product
recommendation
engine
Robot-enabled
fulfillment
centers
New
product
categories
Amazon has invested in AI/ML since our inception, and we
share our knowledge and capabilities with our customers
20181995
Natural language
processing-supported
contact centers
ML-driven supply
chain and
capacity planning
Checkout-free
shopping
using deep learning
6. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Our mission at AWS
Put machine learning in the hands
of every developer
7. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
A I S E R V I C E S
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
& C O M P R E H E N D
M E D I C A L
L E XR E K O G N I T I O N
V I D E O
Vision Speech Chatbots
A M A Z O N
S A G E M A K E R
B U I L D T R A I N
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
D E P L O Y
Pre-built algorithms & notebooks
Data labeling (G R O U N D T R U T H )
One-click model training & tuning
Optimization (N E O )
One-click deployment & hosting
M L S E R V I C E S
F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e
E C 2 P 3
& P 3 d n
E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C
I N F E R E N C E
Reinforcement learningAlgorithms & models ( A W S M A R K E T P L A C E
F O R M A C H I N E L E A R N I N G )
Language Forecasting Recommendations
The Amazon ML stack: Broadest & deepest set
of capabilities
8. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon SageMaker
Machine learning for every developer and data scientist.
9. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon SageMaker: Build, train, and deploy ML
1
2
3
1
2
3
10. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
A I S E R V I C E S
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
& C O M P R E H E N D
M E D I C A L
L E XR E K O G N I T I O N
V I D E O
Vision Speech Chatbots
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
Language Forecasting Recommendations
Put AI to work for your business
11. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition
Easily add intelligent image and video analysis
to your applications.
12. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition:
Deep Learning-Based Image and Video Analysis
13. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition Benefits
Low cost
Your data
is your ownServerless
Rapid
integration
State of the
art capabilities
Continuous
improvement
14. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition Image
Object and scene
detection
Facial
analysis
Face
recognition
Text in
image
Unsafe image
detection
Celebrity
recognition
Face comparison
15. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Object & Scene Detection
16. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Smiling?
Facial Analysis
17. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Crowd Detection – up to 100 faces
18. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Facial Search
19. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Explicit Nudity
Nudity
Graphic Male Nudity
Graphic Female Nudity
Sexual Activity
Partial Nudity
Suggestive
Female Swimwear or Underwear
Male Swimwear or Underwear
Revealing Clothes
Image Moderation
20. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Celebrity Recognition
21. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Text in Image
22. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
DEMO
https://github.com/ziniman/aws-rekognition-demo
23. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Amazon Rekognition Video
Deep Learning-based video analysis service
24. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Video Analysis
26. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Scaling video indexing
C-SPAN uses Amazon Rekognition to
automatically index video news footage
for search. With Rekognition, C-SPAN
reduced indexing time per video from 1
hour to 20 minutes and uploaded 97,000
images in under 2 hours.
27. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Real-time
identity verification
Aella Credit uses Amazon Rekognition to
analyze images to verify an individual’s identity in
real-time without human intervention, allowing it
to provide instant loans to eligible customers
through its mobile app.
28. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
boazz: ~/ aws rekognition detect-labels
--image '{"S3Object":{"Bucket":"demos.ziniman.com","Name":"photos/reko.jpg"}}’
{
"Labels": [
{
"Confidence": 99.14048767089844,
"Name": "Human"
},
{
"Confidence": 99.1404800415039,
"Name": "People"
},
{
"Confidence": 99.14048767089844,
"Name": "Person"
}……
Rekognition API Example
29. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
boazz: ~/ aws rekognition detect-faces
--image '{"S3Object":{"Bucket":"demos.ziniman.com","Name":"photos/reko.jpg"}}'
--attributes "ALL”
{
"FaceDetails": [
{
....
"Gender": {
"Confidence": 99.9211654663086,
"Value": "Male"
},
"AgeRange": {
"High": 52,
"Low": 35
},
....
Rekognition API Example
30. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Rekognition Lambda Python Example
31. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Demo – https://reko.ziniman.com
https://github.com/ziniman/aws-serverless-website-photo-tagging
32. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
Amazon
Cognito
JavaScript
SDK
https://reko.ziniman.com
• Write images into Images Bucket
• Read list of images
• Read data from DynamoDB
Static Site
Bucket
Images Bucket
Lambda
Function
Role
Amazon
DynamoDB
Amazon
CloudFront
Amazon
Rekognition
33. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
JavaScript
SDK
• Read image from Images Bucket
• Execute Rekognition detect_moderation_labels()
• Execute Rekognition detect_labels()
• Write data to DynamoDB• Write images into Images Bucket
• Read list of images
• Read data from DynamoDB
Amazon
Cognito
Static Site
Bucket
Images Bucket
Lambda
Function
Amazon
DynamoDB
Amazon
CloudFront
Amazon
Rekognition
Role
Role
Lambda
Function
Amazon API
Gateway
34. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
JavaScript
SDK
Static Site
Bucket
Images Bucket
Amazon
DynamoDB
Amazon
CloudFront
Lambda
Function
Amazon
RekognitionAmazon API
Gateway
35. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
JavaScript
SDK
[
{"photo_id": "IMG_2018920-213126787.jpg”},
{"photo_id": "IMG_2018920-213320377.jpg"}
]
Static Site
Bucket
Images Bucket
Amazon
DynamoDB
Amazon
CloudFront
Lambda
Function
Amazon
RekognitionAmazon API
Gateway
36. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
• https://aws.amazon.com/rekognition/
• https://aws.amazon.com/blogs/machine-learning/
• https://aws.amazon.com/blogs/machine-learning/classify-your-own-
images-using-amazon-sagemaker/
• https://github.com/ziniman/aws-rekognition-demo
• https://github.com/ziniman/aws-serverless-website-photo-tagging
Where to Start?
37. © 2019, Amazon Web Services, Inc. or its Affiliates.
Thank You!
Boaz Ziniman, Technical Evangelist
Amazon Web Services
@ziniman
ziniman