Today, we can harness the power of machine learning services, such as Amazon Rekognition, Amazon Translate, and Amazon SageMaker, to automatically extract detailed information in the form of metadata to describe video content. Previously, creating the metadata for user-generated and professional video content was performed manually, which was both time-consuming and expensive. With Amazon Machine Learning, this metadata can be automatically generated and combined with viewers’ self-identified interests to create personalized advertising within video streams. This session features a demo of a camera matching objects in real time and a machine learning application suggesting relevant advertisements.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Personalized Ad Targeting Using
Real-Time, Content-Aware
Machine Learning
Leah Siddall
Technical Marketing Engineer
AWS Elemental
C T D 4 0 3
Joan Morgan
Technical Marketing Engineer
AWS Elemental
Bryan Samis
Senior Solutions Architect
AWS Elemental

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
 How ads are targeted today
 Respecting personal privacy as new technologies evolve
 Our idea: content-aware ad targeting
 AWS services used to build our solution
 Live demo

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Digital ad targeting
Platform based
 Device type, location, ISP, or site visited
Personal information based
 Search, shopping, or browsing history
 Social media posts, profiles, or activity

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The future of advertisements?
New technologies have opened many doors for advertisers
 Turn on webcam for sentiment analysis
 Turn on microphone to listen for keywords
 Website trackers
 Spyware

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The future of advertisements?

9. How to preserve individual privacy
while still allowing advertisers to
target effectively?

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CF5K1—Content aware clipping

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CF5K1—Content aware clipping

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CF5K1 – Live indexer
2. Event Notification
Scratch Storage Location
Invoke Function on Manifest Updates
Amazon S3
Amazon
CloudWatch
HLS
Manifest
3. Parse
Parse Live Video
Analyze Video and Extract Images
1. Encoding
AWS Elemental
Deliver Live Video from
Ground to Cloud
AWS Elemental
Live Appliance
AWS Elemental
MediaLive
AWS Elemental
MediaStore
Live TV Source
AWS Lambda
video jpeg json
Amazon
DynamoDB
Amazon
Rekognition
FFMPEG
FFPROBE
4. Wait…
Process Parsed Data
Wait for Detected Label to leave Scene
AWS Lambda
Amazon
DynamoDB
5. VOD
Create VOD
Generate VOD for Detected Scene
AWS Lambda
AWS Elemental
MediaPackage
Amazon S3
AWS Elemental
MediaConvert
Amazon S3
Time-Shifted
TV

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CF5K2—Content aware ads

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ADS—Ad Decision Server

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CF5K2 – ADS Simulator
1. Encoding
AWS Elemental
Deliver Live Video from
Ground to Cloud
AWS Elemental
Live Appliance
AWS Elemental
MediaLive
AWS Elemental
MediaStore
Live TV Source
AWS Elemental
MediaPackage
3. ADS
Advertisement Decision Server
Utilize VAST Protocol for Content
Aware Advertisement Personalization
2. SSAI
Server Side Ad Insertion
Serve Personalized Advertisements
Advertising
Exchange
Advertising
Insertion
Amazon API
Gateway
AWS Lambda
Amazon
DynamoDB
AWS Elemental
MediaTailor
Amazon
CloudFront
Video
Player

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CF5K2 – Content aware ads

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continue Your Own Journey
GitHub:
https://github.com/aws-samples/aws-elemental-instant-video-highlights/
Or
Google the word:
“catfinder5000” ( one single word )

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related sessions
Thursday
CTD413: Deploy, Customize, Start, and Monitor a Channel with the Live Streaming on
AWS Solution (includes AWS Elemental MediaTailor module!)
11:30am – 1:30pm | MGM, Level 3, Premier Ballroom 318 | Workshop

22. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.