Amazon Rekognition makes it easy to add image and video analysis to your applications. You only need to provide an image or video to the Rekognition API, and the service can identify objects, people, text, scenes, and activities, and detect any inappropriate content. It also provides highly accurate facial analysis and facial recognition. You can detect, analyze, and compare faces for a wide variety of user verification, cataloging, people counting, and public safety use cases. Amazon Rekognition is based on proven, scalable, deep learning technology developed by Amazon’s computer vision scientists to analyze billions of images and videos daily, and requires no machine learning expertise to use.

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Julien Simon
Principal Technical Evangelist, AI and Machine Learning
@julsimon
Adding Image and Video Analysis
to your Applications

2. Put Machine Learning in the hands of every developer
and data scientist
Our mission

3. Application
Services
Platform
Services
Frameworks
&
Infrastructure
API-driven services: Vision, Language & Speech Services, Chatbots
AWS ML Stack
Deploy machine learning models with high-performance machine learning
algorithms, broad framework support, and one-click training, tuning, and
inference.
Develop sophisticated models with any framework, create managed, auto-
scaling clusters of GPUs for large scale training, or run prediction
on trained models.

4. Application
Services
Platform
Services
Frameworks
&
Infrastructure
API-driven services: Vision, Language & Speech Services, Chatbots
AWS ML Stack
Deploy machine learning models with high-performance machine learning
algorithms, broad framework support, and one-click training, tuning, and
inference.
Develop sophisticated models with any framework, create managed, auto-
scaling clusters of GPUs for large scale training, or run prediction
on trained models.

5. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon Rekognition
FREE
TIER

6. Amazon Rekognition
Fully
managed
service
Easy-to-use
API
Low costImage
analysis
Video
analysis
Easy-to-use deep learning-based computer vision analysis
Real-time
and batch
analysis

7. Amazon Rekognition Image
Object and Scene
Detection
Facial
Analysis
Face
Recognition
Text in ImageUnsafe Image
Detection
Celebrity
Recognition
Detect objects, scenes, and faces, extract text, recognize celebrities, and identify
unsafe content in images
Face
Comparison

8. Object & Scene Detection

9. Facial Analysis

10. Crowd Detection – up to 100 faces

11. Facial Search

12. Explicit Nudity
Nudity
Graphic Male Nudity
Graphic Female Nudity
Sexual Activity
Partial Nudity
Suggestive
Female Swimwear or Underwear
Male Swimwear or Underwear
Revealing Clothes
Image Moderation

13. Celebrity Recognition

14. Text in Image

15. Marinus Analytics
Marinus Analytics provides law
enforcement with tools founded in
artificial intelligence.
Traffic Jam, is a suite of tools for use by
law enforcement agencies on sex
trafficking investigations.
Before using Amazon Rekognition, their
only recourse was manual processing;
this was time-intensive or not possible.
Now, investigators are able to take
effective action by searching through
millions of records in seconds to find
victims.
http://www.marinusanalytics.com/articles/
2017/10/17/amazon-rekognition-helps-
marinus-analytics-fight-human-trafficking

16. Rekognition demo

17. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon Rekognition Video
FREE
TIER

18. Manually intensive Slow and error-prone Expensive
Challenges of video analysis
Temporal information lost Motion context lost

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

22. Amazon Rekognition Video
Analyze activity, recognize, and track people in stored and live video
Object and activity
detection
Person tracking
Face recognition
Real-time
live stream
Unsafe video
detection
Celebrity
recognition
Facial
Analysis

23. Sky News will use Amazon
Rekognition to perform
real-time identification of
guests as they enter St.
George’s Chapel

24. Use case: video search index
Video Amazon S3 AWS Lambda Amazon Rekognition Video
Amazon Elasticsearch Amazon DynamoDB
1. Video is uploaded
and stored to S3
2. Amazon Rekognition Video
creates metadata for celebrities,
emotions, key topics in video with
time segments for search
4. Lambda also pushes
the metadata and confidence
scores into Elasticsearch
3. The output is persisted as
metadata into DynamoDB
to ensure durability

25. Indexed 99,000 people
Saves ~9,000 hours a year in labor
CSPAN: automatic footage tagging

26. Amazon Rekognition Video
Public safety
Recognize a person of interest across a collection
of millions in real time across hundreds of cameras
Track a person of interest across a video
Create alerts by detecting objects and activities
of interest, such as car, license plate, running, etc.

27. Use case: public safety immediate response
Live Street Camera Amazon Kinesis Video Streams Amazon Rekognition Video Face collection
1. Camera-captured video
streams are processed by
Kinesis Video Streams
2. Amazon Rekognition Video analyses
the video and searches faces on screen
against a collection of millions of faces
User
3. User is notified
in case of face matches
Amazon SNS AWS Lambda Amazon Kinesis
Streams

28. Orlando: real-time public safety
Real-time video analysis
”The City of Orlando is excited to work with
Amazon to pilot the latest in public safety
software through a unique, first-of-it's-kind
public-private partnership. Through the pilot,
Orlando will utilize Amazon Rekognition
Video and Amazon Kinesis Video Streams
technology in a way that will use existing City
resources to provide real-time detection and
notification of persons-of-interests, further
increasing public safety, and operational
efficiency opportunities for the City of
Orlando and other cities across the nation”.
John Mina, Police Chief, City of Orlando

29. Rekognition Video demo
https://aws.amazon.com/blogs/machine-learning/easily-perform-facial-analysis-on-live-
feeds-by-creating-a-serverless-video-analytics-environment-with-amazon-rekognition-video-
and-amazon-kinesis-video-streams

30. FRAMEWORKS AND INTERFACES
PLATFORM SERVICES
APPLICATION SERVICES
Amazon
Rekognition
Amazon Polly Amazon Lex
Democratization of ML
Amazon
Rekognition Video
Amazon Transcribe
Amazon Comprehend
Amazon SageMaker AWS DeepLens Amazon EMR
Deep Learning AMI
Amazon Translate

31. Thank you!
Julien Simon
Principal Technical Evangelist, AI and Machine Learning
@julsimon
https://aws.amazon.com/machine-learning
https://aws.amazon.com/rekognition
https://aws.amazon.com/blogs/ai
https://medium.com/@julsimon
https://youtube.com/juliensimonfr