Delivered in Akamai Japan Tech Conf 2018. Presented on various methods to measure a website, and how each of them can be off from what you expected.

1. Making the Internet fast, reliable and secure
P T S G E I P
.0 A 0 0 0 @0C0 0 0 0 0 0 <
) @ > > > @ @
<10 (< A @ > ) (

2. ©2018 AKAMAI | FASTER FORWARDTM
Agenda 1
2
3
4
5

3. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•

4. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•

5. ©2018 AKAMAI | FASTER FORWARDTM
21
.
.

6. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•

7. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•
•

8. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•
•
•

9. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•
•
•
•

10. ©2018 AKAMAI | FASTER FORWARDTM

11. ©2018 AKAMAI | FASTER FORWARDTM
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
SOASTA mPulse Akamai

12. ©2018 AKAMAI | FASTER FORWARDTM
Real Ride
Performance
→ RUM
Simulated
Performance
→ Synthetic
Trace User Path
→ Web Analytics
Photos from left: 1) https://pixabay.com/photo-1281628/, 2) http://freedesignfile.com/365848-concept-sport-car-design-vector/ , 3) Photo by JESHOOTS.COM on Unsplash

13. ©2018 AKAMAI | FASTER FORWARDTM
–
KPI
JavaScript
API

14. ©2018 AKAMAI | FASTER FORWARDTM

15. ©2018 AKAMAI | FASTER FORWARDTM

16. ©2018 AKAMAI | FASTER FORWARDTM
I
I I
I

17. ©2018 AKAMAI | FASTER FORWARDTM
Before → After

18. ©2018 AKAMAI | FASTER FORWARDTM

19. ©2018 AKAMAI | FASTER FORWARDTM

20. ©2018 AKAMAI | FASTER FORWARDTM
• N
• M J C
• D
•

21. ©2018 AKAMAI | FASTER FORWARDTM
• N
• M J C
• D
•

22. ©2018 AKAMAI | FASTER FORWARDTM
: 1953ms
: 640ms

23. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•

24. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•

25. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•

26. ©2018 AKAMAI | FASTER FORWARDTM
Akamai Other
10000ms

27. ©2018 AKAMAI | FASTER FORWARDTM

28. ©2018 AKAMAI | FASTER FORWARDTM
NO JMeter WPT
(C)

29. ©2018 AKAMAI | FASTER FORWARDTM
100-400ms
~10ms

30. ©2018 AKAMAI | FASTER FORWARDTM

31. ©2018 AKAMAI | FASTER FORWARDTM

32. ©2018 AKAMAI | FASTER FORWARDTM

33. ©2018 AKAMAI | FASTER FORWARDTM
g D
•
• Ds DT P J
• r N D r M vC
• D Ce t M D N C
• T b M
• W a D D

34. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•
•
•
•
•

35. ©2018 AKAMAI | FASTER FORWARDTM
JMeter
1. latency time – 1
2. elapsed time – 1
(elapsed time – latency time)

36. ©2018 AKAMAI | FASTER FORWARDTM

37. ©2018 AKAMAI | FASTER FORWARDTM

38. ©2018 AKAMAI | FASTER FORWARDTM

39. ©2018 AKAMAI | FASTER FORWARDTM
0

40. ©2018 AKAMAI | FASTER FORWARDTM
0

41. ©2018 AKAMAI | FASTER FORWARDTM
0

42. ©2018 AKAMAI | FASTER FORWARDTM

43. ©2018 AKAMAI | FASTER FORWARDTM

44. ©2018 AKAMAI | FASTER FORWARDTM
(´ ω )

45. ©2018 AKAMAI | FASTER FORWARDTM
KB
607ms

46. ©2018 AKAMAI | FASTER FORWARDTM

47. ©2018 AKAMAI | FASTER FORWARDTM

48. ©2018 AKAMAI | FASTER FORWARDTM
.
• C H
• H
• T 61/ 2610
• H P T 2

49. ©2018 AKAMAI | FASTER FORWARDTM
.
• C H
• H
• T 61/ 2610
• H P T 2
Chrome 6 10
19
ID

50. ©2018 AKAMAI | FASTER FORWARDTM
Nic

51. ©2018 AKAMAI | FASTER FORWARDTM
https://www.chromium.org/developers/design-documents/multi-process-resource-loading
Chrome
Browser
Renderer

52. ©2018 AKAMAI | FASTER FORWARDTM
https://www.chromium.org/developers/design-documents/multi-process-resource-loading
Browser
(main/UI thread)
Browser
(IO thread)
Renderer
(render thread)
Renderer
(main/IO thread)
Chrome
UI
IO

53. ©2018 AKAMAI | FASTER FORWARDTM
https://www.chromium.org/developers/design-documents/multi-process-resource-loading
Browser
(main/UI thread)
Browser
(IO thread)
Renderer
(render thread)
Renderer
(main/IO thread)
HTML
JavaScript
CRP (Critical
Rendering Path)

54. ©2018 AKAMAI | FASTER FORWARDTM
https://www.chromium.org/developers/design-documents/multi-process-resource-loading
Browser
(main/UI thread)
Browser
(IO thread)
Renderer
(render thread)
Renderer
(main/IO thread)
Renderer IO thread
OK

55. ©2018 AKAMAI | FASTER FORWARDTM
https://www.chromium.org/developers/design-documents/multi-process-resource-loading
Browser
(main/UI thread)
Browser
(IO thread)
Renderer
(render thread)
Renderer
(main/IO thread)
Render thread
NG

56. ©2018 AKAMAI | FASTER FORWARDTM
RJ S
• c
• a
•

57. ©2018 AKAMAI | FASTER FORWARDTM
d R e J
• i S c
•
• h c
a

58. ©2018 AKAMAI | FASTER FORWARDTM
https://www.chromium.org/developers/design-documents/multi-process-resource-loading
Browser
(main/UI thread)
Browser
(IO thread)
Renderer
(render thread)
Renderer
(main/IO thread)
Browser process
ResourceTiming
DevTool
OK

59. ©2018 AKAMAI | FASTER FORWARDTM
/ - - - -
T rH mH
B H eHk
a B P l s i CP
o w H
B B L S H
H aAP eHL Liv H

60. ©2018 AKAMAI | FASTER FORWARDTM
L SP C m m
• h r C ie
• h r ie F
• C H F H T
T H o m F

61. ©2018 AKAMAI | FASTER FORWARDTM
SSLKEYLOGFILE
TLS (pre-)master
secret

62. ©2018 AKAMAI | FASTER FORWARDTM
$ export SSLKEYLOGFILE=/path/to/sslkey.log
$ chrome http://site.example.jp/
SSLKEYLOGFILE Chrome
Firefox HTTPS
(pre-)master secret

63. ©2018 AKAMAI | FASTER FORWARDTM
$ wireshark -o ssl.keylog_file:/path/to/sslkey.log -r capture-data.pcap
$ tshark -o ssl.keylog_file:/path/to/sslkey.log -r capture-data.pcap
SSLKEYLOGFILE
TLS
GUI

64. ©2018 AKAMAI | FASTER FORWARDTM

65. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•
•
•
•

66. ©2018 AKAMAI | FASTER FORWARDTM
•
•
•
•
•
•
J

67. ©2018 AKAMAI | FASTER FORWARDTM