1. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
DevOps in the Public Sector
How the Democratic Party Implemented
DevOps to Migrate democrats.org to AWS
Leo Zhadanovsky
Nick Gaw
Sunil Chopra
Alberto Manrique
©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

2. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
DevOps

3. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
What is DevOps?
• « DevOps is the practice of operations and
development engineers participating together in
the entire service lifecycle, from design through
the development process to production support.
»
- theagileadmin.com

4. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Continuous Integration

5. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
What is continuous integration?
• Changes to code automatically deployed to
mainline branch
– After passing unit and mock tests
• Makes deployments and changes to code
iterative, not monolithic
• Bugs are detected quickly
• Helps automate deployments
• Allows rapid development and deployment

6. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
DEVELOPER
PICK
TASKS
SUBMIT
CODE
SCHEDULE
BUILD
RECURRENT
BUILDS
CODE
FETCHCODE QUALITY
TESTS
TEST RESULTS
BUILD OUTPUT
DOCS
BINARIES
& PACKAGES
DEV FACING
NOTIFICATIONS
AWS
CLOUDFORMATION
AMIS or CONTAINERS

8. SOURCE CODE
REPOSITORY
DNS
CONTINUOUS
INTEGRATION SERVER
PROJECT
MANAGEMENT SERVER
BUILDS

9. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
AWS code services
AWS CodeCommit
Coming soon
AWS CodePipeline
Coming soon
AWS CodeDeploy
Launched Nov. 2014

10. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Cloud software development lifecycle
10/13/14
MonitorProvisionDeployTestBuildCode
AWS Elastic Beanstalk
AWS OpsWorks
Amazon
CloudWatch
AWS
CloudFormation
?

11. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Source control
Private Git repositories hosted on Amazon S3
• Full Git compatibility (use with existing tools)
• All the benefits of the cloud
(scalable, durable, reliable, low pay-as-you-
go pricing)
• No size limits on repositories (store binary
files)
• Online code tools with browse, edit, diff
10/13/14

12. Same Git experience
$ git clone https://git-codecommit.us-east-1.amazonaws.com/v1/repos/aws-cli
Cloning into 'aws-cli'...
Receiving objects: 100% (16032/16032), 5.55 MiB | 1.25 MiB/s, done.
Resolving deltas: 100% (9900/9900), done.
Checking connectivity... done.
$ nano README.rst
$ git commit -am 'updated README'
[master 4fa0318] updated README
1 file changed, 1 insertion(+)
$ git push
Counting objects: 3, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (3/3), done.
Writing objects: 100% (3/3), 297 bytes | 0 bytes/s, done.
Total 3 (delta 2), reused 0 (delta 0)
remote:
To https://git-codecommit.us-east-1.amazonaws.com/v1/repos/aws-cli
4dacd6d..4fa0318 master -> master

13. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Continuous delivery
Customizable release automation, with integrated build and test
• Model and visualize custom release workflow
(source  build  beta  gamma  prod)
• Automate builds, tests, and deployments
• Enforce custom rules, approvals, and gates
• Integrate with third-party and custom tools
10/13/14

15. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Deployment
Coordinate software updates to fleets of EC2 instances
• Rolling updates for no downtime
• Deployment health checks and easy rollback
• Auto Scaling integration
• Works with any application
• Reuse existing setup tools
(Bash, Windows PowerShell, Chef, Puppet…)
10/13/14

16. 9/25/14 Slides not intended for 16

17. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Cloud software development lifecycle
10/13/14
MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
CloudWatchCloudFormationCodeDeploy
CodeCommit CodePipeline

18. CODECOMMIT
DNS
CODEPIPELINE
PROJECT
MANAGEMENT SERVER
BUILDS

19. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Pain points
• Unit tests incomplete
• Mock tests maintenance
• Expensive test environment
• Test environment ≠ production
• Deployment cycles

20. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
On-demand
Pay as you go
Elastic

21. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
=
Programmable platform

24. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
If you can program it
you can automate it

25. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
A lot of options…
• Configuration management systems
– Puppet
– Chef
– Saltstack
• Deployment frameworks
– CodeDeploy
– Elastic Beanstalk
– OpsWorks
– Ansible
– Fabric
– Capistrano
• Infrastructure management
– CloudFormation
• Containers
– Amazon EC2 Container Service

26. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Bake an image Configure dynamically
Time-consuming configuration
(startup time)
Static configurations (less change
management)
Bootstrapping

27. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Bake an image Configure dynamically
Continuous deployment (latest
code)
Environment specific (dev-test-
prod)
Bootstrapping

28. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Stack-based deployment service
AWS CloudFormation

29. CloudFormation
template

30. Headers
Parameters
Mappings
Resources
Outputs

31. {
"Description" : "Create RDS with username and password",
"Resources" : {
"MyDB" : {
"Type" : "AWS::RDS::DBInstance",
"Properties" : {
"AllocatedStorage" : "500",
"DBInstanceClass" : "db.m1.small",
"Engine" : "MySQL",
"EngineVersion" : "5.5",
"MasterUsername" : "MyName",
"MasterUserPassword" : "MyPassword"
}
}
}
}

32. "AWS::CloudFormation::Init" : { "config" : {
"packages" : {
"yum" : {
"mysql" : [],
"mysql-server" : [],
"httpd" : [],
"php" : [],
"php-mysql" : []
}
},
"sources" : {
"/var/www/html" :
"https://s3.amazonaws.com/my-builds/build-v4.zip"
}
}

33. {
"Parameters" : {
"KeyName" : {
"Description" : "Name of an existing EC2
KeyPair to enable SSH
access to the instance",
"Type" : "String"
}
},
}

34. CLOUDFORMATION
TEMPLATE
Procedural
definition
Create it programmatically
Known
configuration
Store stack configuration
in source control
Parameter driven
Dynamic and user-driven
templates
Collaboration
Share templates with ease
as just files

36. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Application versions
+
Infrastructure versions

37. CLOUDFORMATION
TEMPLATE

38. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Continuous deployment
Small, frequent changes constantly
integrating into production

39. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Key = iteration

40. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Iteration
=
Modify the system to better meet the
expectations of your users

41. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
11.6 sec.
Mean time between
deployments
(weekday)
1,079
Maximum number of
deployments in a
single hour
10,000
Mean number of
hosts simultaneously
receiving a
deployment
30,000
Maximum number of
hosts simultaneously
receiving a
deployment
Deployments at
Amazon.com
(in 2011)

42. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Software deploy
≠
Product launch

43. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Data-driven
architectures

44. Metrics @ Etsy

45. Metrics @ Obama for America

46. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Metrics and monitoring options
CloudWatch
… and many more

47. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Continuous integration
Continuous
deployment

48. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Continuous deployment
=
Continuous experimentation

49. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Continuous deployment
=
Continuous improvement

50. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
INNOVATE

51. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Speed and agility
Experiment
often
Fail quickly at a
low cost
More
innovation
Experiment
infrequently
Failure is
expensive
Less innovation
On-premises

52. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Democrats.org in AWS
Nick Gaw
Alberto Manrique
Sunil Chopra

53. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

54. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

55. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

56. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

57. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

58. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

59. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

60. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015

61. AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015
Thank You.
This presentation will be loaded to SlideShare the week following the Symposium.
http://www.slideshare.net/AmazonWebServices
AWS Government, Education, and Nonprofit Symposium
Washington, DC I June 25-26, 2015