1. CONTINOUS DEPLOYMENT
WITH AMAZON WEB SERVICES
Carlos Conde | Solutions Architecture

2. CONTINUOUS
INTEGRATION

3. DEVELOPER

4. SOURCE CODE
REPOSITORY

5. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER

6. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER

7. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER
PICK
TASKS

8. SOURCE CODE
REPOSITORY
SUBMIT
CODE
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER

9. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
SCHEDULE
BUILD
PROJECT MANAGEMENT
SERVER

10. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
RECURENT
BUILDS
PROJECT MANAGEMENT
SERVER

11. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
CODE
FETCH
PROJECT MANAGEMENT
SERVER

12. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
CODE QUALITY
TESTS
PROJECT MANAGEMENT
SERVER
TEST
RESULTS

13. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
BUILD OUTPUT
PROJECT MANAGEMENT
SERVER

14. SOURCE CODE
REPOSITORY
CONTINUOUS DOCS
INTEGRATION SERVER
BINARIES /
PACKAGES
PROJECT MANAGEMENT
SERVER

16. SOURCE CODE
REPOSITORY
BUILDS
CONTINUOUS
INTEGRATION SERVER
DNS PROJECT
MANAGEMENT SERVER

17. PAIN POINTS:
• UNIT TESTS INCOMPLETE
• MOCKS MAINTENANCE
• TEST ENV EXPENSIVE
• TEST ENV ≠ PROD

19. KEY = ITERATION

20. ITERATION
=
MODIFY THE SYSTEM TO BETTER
MEET THE EXPECTATIONS OF
YOUR USERS

21. ON-DEMAND ELASTIC
PAY AS YOU GO

22. =
PROGRAMMABLE
PLATFORM

26. AWS
CLOUDFORMATION
STACK-BASED DEPLOYMENT
SERVICE

27. CLOUDFORMATION
TEMPLATE

29. {
"Description" : "Create RDS with username and
password",
"Resources" : {
"MyDB" : {
"Type" : "AWS::RDS::DBInstance",
"Properties" : {
"AllocatedStorage" : "500",
"DBInstanceClass" : "db.m1.small",
"Engine" : "MySQL",
"EngineVersion" : "5.5",
"MasterUsername" : "MyName",
"MasterUserPassword" : "MyPassword"
}
}
}
}

30. "AWS::CloudFormation::Init" : {
"config" : {
"packages" : {
"yum" : {
"mysql" : [],
"mysql-server" : [],
"httpd" : [],
"php" : [],
"php-mysql" : []
}
},
"sources" : {
"/var/www/html" :
"https://s3.amazonaws.com/my-builds/build-
v4.zip"
}
}
}

31. {
"Parameters" : {
"KeyName" : {
"Description" : "Name of an existing EC2
KeyPair to enable SSH
access to the instance",
"Type" : "String"
}
},
}

32. PROCEDURAL KNOWN
DEFINITION CONFIGURATION
Create it programmatically Store stack configuration in
source control
CLOUDFORMATION
TEMPLATE
PARAMETER COLLABORATION
DRIVEN Share templates with ease
Dynamic and user-driven as just files
templates

35. CLOUDFORMATION TEMPLATE
VIDEO CACHING
INFRASTRUCTURE
Stack
ELBs to front
Template
secondary cache
~100 Nginx
secondary cache
servers
2-3 Nginx mid-tier
cache servers

36. APPLICATION
VERSIONS
&
INFRASTRUCTURE
VERSIONS

37. CLOUDFORMATION
TEMPLATE

38. TEST ENVIRONMENTS

40. 30,000 REQUESTS / SECOND
1 TB TRAFFIC / DAY

41. “…AWS seemed to be the best solution available
to allow a small, independent company to rapidly
develop and test a completely new
infrastructure, and host it.
We also loved the flexibility that AWS allowed
us, when spinning up smaller test
environments, for beta
trials, QA, localization, and during development.
The low initial cost was also crucial.”
Alex Evans, CTO

42. CONTINUOUS
DEPLOYMENT
SMALL, FREQUENT CHANGES
CONSTANTLY INTEGRATING INTO
PRODUCTION.

43. DEPLOYMENTS AT
AMAZON.COM
11.6s 1,079 10,000 30,000
Mean time Max number of Mean number of Max number of
between deployments in a hosts hosts
deployments single hour simultaneously simultaneously
(weekday) receiving a receiving a
deployment deployment

44. SOFTWARE DEPLOY
≠
PRODUCT LAUNCH

46. 1.5 BILLION PAGE VIEWS
$83 MILLION IN TRANSACTIONS
4.2 MILLION ITEMS SOLD
OCTOBER 2012

47. 30 DEPLOYS PER DAY
1 DEPLOY EVERY 20 MINUTES

48. "Production is truly the only place you
can validate your code."

53. HTTP://CODEASCRAFT.ETSY.COM/
HTTPS://GITHUB.COM/ETSY/DEPLOYINATOR

58. HTTP://SORCERY.SMUGMUG.COM/

59. AWS OPSWORKS
INTEGRATED APPLICATION
MANAGEMENT

60. MODEL, CONTROL AND AUTOMATE
AT ANY SCALE AND COMPLEXITY

61. A stack represents A layer defines how to Tell OpsWorks where Scale your stack
your application. One setup and configure a it can find your code based on time or
stack might be used set of instances and and define any load. Clone your
for staging and related resources additional deployment production stack to a
another for production. such as volumes tasks. OpsWorks will different region.
and software. take care of deploying Automate workflows
your app. for common tasks.

62. A stack represents A layer defines how to Tell OpsWorks where Scale your stack
your application. One setup and configure a it can find your code based on time or
stack might be used set of instances and and define any load. Clone your
for staging and related resources additional deployment production stack to a
another for production. such as volumes tasks. OpsWorks will different region.
and software. take care of deploying Automate workflows
your app. for common tasks.

63. A stack represents A layer defines how to Tell OpsWorks where Scale your stack
your application. One setup and configure a it can find your code based on time or
stack might be used set of instances and and define any load. Clone your
for staging and related resources additional deployment production stack to a
another for production. such as volumes tasks. OpsWorks will different region.
and software. take care of deploying Automate workflows
your app. for common tasks.

64. A stack represents A layer defines how to Tell OpsWorks where Scale your stack
your application. One setup and configure a it can find your code based on time or
stack might be used set of instances and and define any load. Clone your
for staging and related resources additional deployment production stack to a
another for production. such as volumes tasks. OpsWorks will different region.
and software. take care of deploying Automate workflows
your app. for common tasks.

65. AWS Elastic AWS AWS Amazon EC2
Beanstalk OpsWorks CloudFormation

66. AWS Elastic AWS AWS Amazon EC2
Beanstalk OpsWorks CloudFormation
CONVENIENCE CONTROL

67. HIGH-LEVEL DO IT YOURSELF
AWS Elastic AWS AWS Amazon EC2
Beanstalk OpsWorks CloudFormation
CONVENIENCE CONTROL

68. FREE OF CHARGE

70. 14 BILLION REQUESTS/MONTH
50 000 DATABASE UPDATES / SEC
NO CACHE

71. “AWS OpsWorks gives us the tools we
need to automate operations.
We can scale Monster World, one of the
largest Facebook games, to millions of
users without ever needing more than two
backend developers”
Jesper Richter-Reichhelm
Head of engineering – Wooga

72. A / B TESTING

77. LOAD TESTING

83. USING AMAZON EC2 TO SIMULATE
2.4 MILLION PLAYERS

84. DATA-DRIVEN
ARCHITECTURES

85. METRICS @ETSY

86. COST-ORIENTED
ARCHITECTURES

87. PHP+APACHE+VARNISH
NGINX+NODEJS

89. CONTINUOUS
DEPLOYMENT
CONTINUOUS
INTEGRATION

90. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
EXPERIMENTATION

91. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
IMPROVEMENT

92. INNOVATE

93. « Want to increase innovation?
Lower the cost of failure »
Joi Ito

94. SPEED AND AGILITY
“ON-PREMISE”
Experiment Experiment
Infrequently Often
Failure is Fail quickly
expensive at a low cost
Less More
Innovation Innovation

97. ARCHITECTURE CENTER
http://aws.amazon.com/architecture
TECHNICAL ARTICLES
http://aws.amazon.com/articles
PODCAST
http://aws.amazon.com/podcast
BLOG
http://aws.typepad.com