Continuous Delivery with Docker and Amazon ECS

1. Daniele Stroppa
AWS Solutions Architect
@moviolone
Continuous Delivery with Docker
and Amazon ECS

2. What to expect from the session
• Best practices for containers in continuous delivery
solutions
• Toolset to implement such solutions
• Demos

3. Why use containers?
• Process isolation
• Portable
• Fast
• Efficient

4. Why use containers for continuous delivery?
• Roll out features as quickly as possible
• Predictable and reproducible environment
• Fast feedback

5. Demo application architecture
Nginx Proxy
Ruby on Rails
web app
PostgreSQL
on RDS

6. Development and deployment workflow
Orchestration
layer
Code
repository
Build
environment
Test
environment
Deployment
environment
Source

7. Stage 1 - Source

8. Development environment
Code
repository
Source

9. AWS CodeCommit
• Private Git repository
• Fully managed
• Secure
• Highly available and scalable
• Alternatives:
• Github
• Bitbucket

10. Docker and Docker Toolbox
• Docker (Linux > 3.10) or Docker Toolbox (OS X,
Windows)
• Define app environment with Dockerfile

11. Dockerfile
FROM ruby:2.2.2
RUN apt-get update -qq && apt-get install -y build-
essential libpq-dev
RUN mkdir -p /opt/web
WORKDIR /tmp
ADD Gemfile /tmp/
ADD Gemfile.lock /tmp/
RUN bundle install
ADD . /opt/web
WORKDIR /opt/web

12. Docker Compose
Define and run multi-container applications:
1. Define app environment with Dockerfile
2. Define services that make up your app in docker-
compose.yml
3. Run docker-compose up to start and run entire app

13. docker-compose.yml
proxy:
build: ./proxy
ports:
- "80:80"
links:
- web
web:
build: ./web
command: bundle exec rails server -b 0.0.0.0
environment:
- SECRET_KEY_BASE=secretkey
expose:
- "3000"

14. Amazon ECS CLI
• Easily create Amazon ECS clusters & supporting
resources such as EC2 instances
• Run Docker Compose configuration files on Amazon
ECS
• Available today – http://amzn.to/1jBf45a

15. Amazon ECS CLI
> ecs-cli configure
> ecs-cli compose build
> ecs-cli compose up --local

16. It’s Dem-o-clock!

17. Stage 2 - Build

18. Build environment
Build
environment

19. Partners

20. Jenkins
• Extensible
• Flexible builds
• Ant or Maven based projects
• Docker images
• Optionally runs in Docker container

21. CloudBees Docker Build and Publish plugin

22. Stage 3 - Test

23. Test environment
Test
environment

24. rspec and capybara-webkit
require 'rails_helper.rb'
feature 'Signing in' do
scenario 'can sign in' do
visit '/users/sign_in'
within("#new_user") do
fill_in 'Email', :with => 'test@test.com'
fill_in 'Password', :with => 'password'
end
click_button 'Log in'
expect(page).to have_content('Signed in successfully.')
end
end

25. Jenkins
• Run tests directly via Docker run
• Run tests in a Docker slave on Amazon ECS

26. CloudBees Jenkins ECS plugin

27. Jenkins slave Dockerfile
FROM jenkinsci/jnlp-slave
USER root
RUN apt-get update -qq &&
apt-get install -y -qq git curl wget build-essential […]
RUN apt-get install -y qt5-default libqt5webkit5-dev
RUN apt-get install -y xvfb x11-xkb-utils xfonts-100dpi xfonts-
75dpi xfonts-scalable xfonts-cyrillic x11-apps
ENV RUBY_VERSION 2.2.2
RUN echo 'gem: --no-document' >> /usr/local/etc/gemrc &&
mkdir /src && cd /src && git clone
https://github.com/sstephenson/ruby-build.git &&
cd /src/ruby-build && ./install.sh &&
cd / && rm -rf /src/ruby-build && ruby-build $RUBY_VERSION
/usr/local

28. Jenkins slave Dockerfile
RUN gem update --system && gem install bundler
# Install Gems
WORKDIR /tmp
ADD Gemfile /tmp/
ADD Gemfile.lock /tmp/
RUN bundle install
USER jenkins

29. Stage 4 - Deploy

30. Deployment environment
Deployment
environment

31. Amazon ECS CLI
> ecs-cli up
> ecs-cli compose up
> ecs-cli compose ps

32. AWS Elastic Beanstalk
• Deploy and manage applications without worrying about
the infrastructure
• AWS Elastic Beanstalk manages your database, Elastic
Load Balancing (ELB), Amazon ECS cluster, monitoring
and logging
• Docker support
• Single container (on Amazon EC2)
• Multi container (on Amazon ECS)

33. Putting it all together

34. Putting it all together
Orchestration
layer

35. AWS CodePipeline
Model and automate your software release processes
• Rapid delivery
• Configurable workflow
• Customizable
• Highly integrated

36. It’s Dem-o-clock!

37. Daniele Stroppa
AWS Solutions Architect
@moviolone
Thank you!