In this session, use metrics and logs from Amazon CloudFront, and tools such as Amazon CloudWatch and third-party performance measurement tools, to measure and improve your web and mobile performance.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use Monitoring, Logs, and
Analytics to Measure CDN
and Site Performance
C T D 2 0 7
Karan Desai
Solutions Architect
AWS
Hongmin Liu
SW Dev Engineer
AWS
Karthik Uthaman
SW Dev Engineer
AWS

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What will you learn?
• What are the metrics to measure for site performance
• What are the tools available to analyze CDN performance
• How to interpret Amazon CloudFront logs with Amazon Athena
• How to visualize your CDN performance with Amazon QuickSight

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDN metrics that matter
• Cache hit ratio
• Percentage of requests served from CDN edge vs. origin
• HIT, MISS, REFRESH HIT
• Latency
• Time taken to complete download of an object
• Compare for cache HIT vs. cache MISS
• Errors
• Connectivity issues
• Abandoned by user

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Measure Amazon CloudFront performance
• In-built metrics
• Cache statistics
• Popular objects
• Usage
• Viewer demographics

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Measure Amazon CloudFront performance
• CloudFront Access Logs
• Delivered to an Amazon Simple Storage Service (Amazon S3) bucket
• Includes timeToDownload, cache HIT/MISS, errors, and more
#Version: 1.0
#Fields: date time x-edge-location sc-bytes c-ip cs-method cs(Host) cs-uri-stem sc-status cs(Referer) cs(User-Agent) cs-uri-query
cs(Cookie) x-edge-result-type x-edge-request-id x-host-header cs-protocol cs-bytes time-taken x-forwarded-for ssl-protocol ssl-
cipher x-edge-response-result-type cs-protocol-version fle-status fle-encrypted-fields
2018-04-07 14:50:37 JFK5 562 207.46.13.70 GET d3vxovn305eucd.cloudfront.net /robots.txt 301
- Mozilla/5.0%2520(compatible;%2520bingbot/2.0;%2520+http://www.bing.com/bingbot.htm) - -
Redirect 9N2U5NMte4dco5qPUGnZM6rRxKsfLtRWbpTZzWHKFsTGxw_Zh2bzfA== dkaran.com http 243 0.000 -
- - Redirect HTTP/1.1 - -
2018-04-07 14:50:37 SEA32 2039 207.46.13.70 GET d3vxovn305eucd.cloudfront.net /robots.txt 404
- Mozilla/5.0%2520(compatible;%2520bingbot/2.0;%2520+http://www.bing.com/bingbot.htm) - -
Error _3CX08QRWugzYNiW0lhiK42DvAfA6BFavZc_Rs4NSpWfvZbB8BrQRQ== dkaran.com
2018-04-07 14:50:57 SEA32 7104 40.77.178.206 GET d3vxovn305eucd.cloudfront.net /style.css 200
https://dkaran.com/
Mozilla/5.0%2520(iPhone;%2520CPU%2520iPhone%2520OS%25207_0%2520like%2520Mac%2520OS%2520X)%2520AppleWebKit/537.51.1%25
20(KHTML,%2520like%2520Gecko)%2520Version/7.0%2520Mobile/11A465%2520Safari/9537.53%2520BingPreview/1.0b- -
Miss 8RDvgIp8Horvy8Lk8vlE_xZk67lmCpdM83z-aXmKi19Gl14scChbow== dkaran.com https 301 0.070 -
TLSv1.2 ECDHE-RSA-AES128-GCM-SHA256 Miss HTTP/1.1 - -

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Measure Amazon CloudFront performance
• Third-party tools
• Cedexis

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Measure Amazon CloudFront performance
• Third-party tools
• WebPageTest

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon CloudFront distribution settings
• Use longest practical TTL
• Use Cache-Control max-age on origin
• Optimize query strings
• All upper or lower case, list parameters in same order to reuse cache key
• Forward cookies only as needed
• Reduce combinations of request+cookie CloudFront caches as distinct objects
• Separate cache behaviors for static vs. dynamic content based on cookies
• Decide which headers are forwarded
• Cache based on specific headers instead of all

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon CloudFront distribution settings

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Query Amazon CloudFront logs with Amazon Athena
• Enable access logs on your CloudFront distribution
• Logs are delivered to the Amazon S3 bucket of your choice
CloudFront
log files

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Athena queries for CloudFront logs
CREATE EXTERNAL TABLE IF NOT EXISTS default.cloudfront_logs (
`date` DATE,
time STRING,
location STRING,
bytes BIGINT,
requestip STRING,
method STRING,
host STRING,
uri STRING,
status INT,
referrer STRING,
useragent STRING,
querystring STRING,
cookie STRING,
resulttype STRING,
requestid STRING,
hostheader STRING,
requestprotocol STRING,
requestbytes BIGINT,
timetaken FLOAT,
xforwardedfor STRING,
sslprotocol STRING,
sslcipher STRING,
responseresulttype STRING,
httpversion STRING,
filestatus STRING,
encryptedfields INT
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY 't'
LOCATION 's3://dkaran.com-replica/cf-logs/'
TBLPROPERTIES ( 'skip.header.line.count'='2' )

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Athena queries for CloudFront logs
SELECT date,
time,
location,
requestip,
uri,
resulttype,
requestprotocol,
requestbytes,
timetaken
FROM "default"."cloudfront_logs"
WHERE uri LIKE '%jpg%'
ORDER BY timetaken DESC limit 50;
Requests for JPG images sorted by download time, highest to lowest

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Visualize CDN performance with Amazon QuickSight
• Pull data from Athena table created for CloudFront logs analysis
• Auto-detects data types to fit into graphs
CloudFront
log files

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Visualize CDN performance with Amazon QuickSight
• Select visual type
• Line graphs for trends
over time
• Bar charts to compare
between locations
• Build a story
• Snapshot in time to
present to executives
• Share and export visuals
as needed

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
https://cloudfront.reinvent2018.com/

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Resources
Measuring CloudFront Performance
https://aws.amazon.com/blogs/networking-and-content-
delivery/measuring-cloudfront-performance/
Dynamic Whole Site Delivery with Amazon CloudFront
https://aws.amazon.com/blogs/networking-and-content-
delivery/dynamic-whole-site-delivery-with-amazon-cloudfront/
Querying Amazon CloudFront Logs with Athena
https://docs.aws.amazon.com/athena/latest/ug/cloudfront-logs.html

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Breakout repeats
Tuesday, November 27
CTD207-R1 Use Monitoring, Logs, and Analytics Tools to Measure CDN and Site Performance
2:30 p.m. – 3:30 p.m. | Mirage, Grand Ballroom B, Table 5, T1
Wednesday, November 28
CTD207-R2 Use Monitoring, Logs, and Analytics Tools to Measure CDN and Site Performance
5:30 p.m. – 6:30 p.m. | Aria West, Level 3, Starvine 10, Table 6, T1
Thursday, November 29
CTD207-R3 Use Monitoring, Logs, and Analytics Tools to Measure CDN and Site Performance
11:30 a.m. – 12:30 p.m. | Mirage, Grand Ballroom D, Table 1, T1

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related breakouts
Monday, November 26 (Repeats Tuesday, Wednesday)
CTD303 - Image Optimization at the Edge with Amazon CloudFront and Lambda@Edge
4:00 p.m. – 5:00 p.m. | Mirage, Grand Ballroom B, Table 6
Tuesday, November 27
CTD317 - Speed and Performance: How to Manage and Originate Live Video at Scale
8:30 a.m. – 9:30 a.m. | Aria East, Level 1, Joshua 6
Wednesday, November 28
CTD416 - The Few Milliseconds in the Life of an HTTP Request
12:15 p.m. -1:15 p.m. | Aria East, Level 1, Joshua 8

26. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Karthik Uthaman
uthamank@amazon.com
Hongmin Liu
hongmliu@amazon.com
Karan Desai
deskaran@amazon.com

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.