AWS is an elastic, secure, flexible, and developer-centric ecosystem that serves as an ideal platform for Docker deployments. AWS offers the scalable infrastructure, APIs, and SDKs that integrate tightly into a development lifecycle and accentuate the benefits of the lightweight and portable containers that Docker offers to its users. This session familiarizes you with the benefits of containers, introduce Amazon EC2 Container Service, and demonstrates how to use Amazon ECS to run containerized applications at scale in production.

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Getting Started with Docker on AWS
February 24th , 2017

2. Agenda
Why containers?
Cluster management
Benefits
Running services
Demo
Blox

3. Why containers?

4. What are containers?
OS virtualization
Process isolation
Images
AutomationServer
Guest OS
Bins/Libs Bins/Libs
App2App1

5. Container advantages
Portable
Flexible
Fast
EfficientServer
Guest OS
Bins/Libs Bins/Libs
App2App1

6. Services evolve to microservices
Monolithic application
Order UI User UI Shipping UI
Order
service
User
service
Shipping
service
Data
access
Host 1
Service A
Service B
Host 2
Service B
Service D
Host 3
Service A
Service C
Host 4
Service B
Service C

7. Containers are natural for microservices
Simple to model
Any app, any language
Image is the version
Test and deploy same artifact
Stateless servers decrease change risk

8. Scheduling

9. Server
Guest OS
Bins/Libs Bins/Libs
App2App1
Scheduling one resource is straightforward

10. Scheduling a cluster is hard
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS

11. Cluster management

12. Cluster management: Resource management
Docker
Task
EC2 instance
Container
Docker
Task
EC2 instance
Container
Task
Container
Docker
EC2 instance
Task
Container
AZ 1 AZ 2

13. Cluster management: Scheduling
Docker
Task
EC2 instance
Container
Docker
Task
EC2 instance
Container
Task
Container
Docker
EC2 instance
Task
Container
AZ 1 AZ 2

14. Amazon ECS: Resource management
Docker
Task
Container instance
Container
Task
Container
Docker
Task
Container instance
Container
Task
Container
Docker
Task
Container instance
Container
Task
Container
AZ 1 AZ 2
Cluster Management Engine

15. Amazon ECS: Agent communication
Docker
Task
Container instance
Container
ECS agent
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
AZ 1 AZ 2
Cluster Management Engine
Agent Communication Service

16. Amazon ECS: Key/Value Store
Docker
Task
Container instance
Container
ECS agent
ELB
Internet
ELB
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
AZ 1 AZ 2
Key/Value Store
Cluster Management Engine
Agent Communication Service

17. Amazon ECS under the hood
IDN-1 IDN IDN+1 IDN+2 IDN+3 IDN+4 IDN+5
IDN+6
IDN+5
WRITE
READ

18. Amazon ECS under the hood
IDN-1 IDN IDN+1 IDN+2 IDN+3 IDN+4 IDN+5
IDN+6IDN+3
IDN+5IDN+2
WRITE WRITE
READREAD

19. Amazon ECS: APIs
Docker
Task
Container instance
Container
ECS agent
ELB
Internet
ELB
User/
scheduler
API
Cluster Management Engine
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
AZ 1 AZ 2
Key/Value Store
Agent Communication Service

20. Amazon ECS: Scheduling
Docker
Task
Container instance
Container
ECS agent
ELB
Internet
ELB
User/
scheduler
API
Cluster Management Engine
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
AZ 1 AZ 2
Key/Value Store
Agent Communication Service

21. Amazon ECS: Scheduling

22. Amazon ECS: Scheduling

23. Amazon ECS: Scheduling

24. Amazon ECS: Scheduling

25. Benefits

26. Easily manage clusters for any scale
Nothing to run
Complete state
Control and monitoring
Scale

27. Scalable

28. Flexible container placement
Applications
Batch jobs
Multiple schedulers

29. Designed for use with other AWS services
Elastic Load Balancing (Classic & Application)
Amazon Elastic Block Store
Amazon Virtual Private Cloud
Amazon CloudWatch
AWS Identity and Access Management
AWS CloudTrail

30. Extensible
Comprehensive APIs
Custom schedulers
Open source agent and CLI

31. Amazon ECS
Docker
Task
Container instance
Amazon
ECS
Container
ECS agent
ELB
Internet
ELB
User /
Scheduler
API
Cluster Management Engine
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
Docker
Task
Container instance
Container
ECS agent
Task
Container
AZ 1 AZ 2
Key/Value Store
Agent Communication Service

32. Running services

33. Task definitions
Volume definitions
Container definitions

34. Key components: Task definitions

35. Key components: Task definitions

36. Tasks
Shared Data Volume
Containers
Schedule
Container
instance
Volume definitions
Container definitions

37. Unit of work
Grouping of related containers
Run on container instances
Tasks

38. Create service
Good for long-running
applications and services

39. Create service
Load balance traffic across containers
Automatically recover unhealthy containers
Discover services
Elastic Load Balancing
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers

40. Scale service
Scale up
Scale down
Elastic Load Balancing
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers

41. Update service
Deploy new version
Drain connections
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers
new new new
Elastic Load Balancing
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers
old old old

42. Update service (cont.)
Deploy new version
Drain connections
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers
new new new
Elastic Load Balancing
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers
old old old

43. Update service (cont.)
Deploy new version
Drain connections
Elastic Load Balancing
Shared data volume
Containers
Shared data volume
Containers
Shared data volume
Containers
new new new

44. Demo

45. Task Placement Engine

46. Anatomy of Task Placement
Cluster Constraints
Custom Constraints
Placement Strategies
Apply Filter
Satisfy CPU, memory, and port requirements
Filter for location, instance-type, AMI, or custom
attribute constraints
Identify instances that meet spread or binpack
placement strategy
Select final container instances for placement

47. Supported Placement Strategies
Binpacking Spread Affinity Distinct Instance

48. Placement Strategy Chaining
Spread tasks across Zones
and Binpack within each Zone

49. New Cluster Query Language

50. Filtering: Match on Instance Family or Type

51. Filtering: Match on Availability Zone

52. Filtering: Match on Multiple Expressions

53. Filtering: Match on Custom Attributes

54. Task Placement Examples

55. g2.2xlarge t2.small g2.2xlarge g2.2xlarge
Placement: Targeting Instance Type

56. g2.2xlarge t2.small t2.micro t2.medium
t2.medium t2.small g2.2xlarge
t2.small
t2.small t2.medium
us-east-1aus-east-1d
Placement: Targeting Instance Type & Zone

57. g2.2xlarge t2.small t2.micro t2.medium
t2.medium t2.small g2.2xlarge t2.small
us-east-1aus-east-1d
g2.2xlarge t2.medium
t2.micro t2.small
us-east-1c
Placement: Availability Zone Spread

58. g2.2xlarge t2.small t2.micro t2.medium
t2.medium t2.small g2.2xlarge t2.small
us-east-1aus-east-1d
g2.2xlarge t2.medium
t2.micro t2.small
us-east-1c
Placement: Spread across Zone and Binpack

59. g2.2xlarge t2.small t2.micro t2.medium
t2.medium t2.small g2.2xlarge t2.small
us-east-1aus-east-1d
g2.2xlarge t2.medium
t2.micro t2.small
us-east-1c
Placement: Affinity and Anti-Affinity

60. Running a Service

61. t2.medium t2.small t2.small
us-east-1aus-east-1d
t2.medium t2.micro t2.small
us-east-1c
Placement: Multiple Services on a Cluster

62. t2.medium g2.2xlarge t2.micro t2.small
t2.small t2.small g2.2xlarge t2.small
t2.small t2.small
g2.2xlarge t2.small
Placement: Services – Distinct Instances

63. Console: Getting Started with Placement

64. Console: Placement Templates to Get Started

65. Console: Customizing Placement Strategies

66. Event Stream

67. Consuming Real-time Events

68. Three Steps to Getting Started with Events
Step 1: Create CWE Rule Step 2: Create SNS Topic Step 3: Put Events to SNS

69. Consuming Events for Service Discovery
app1-tst  10.1.0.11
db1-tst  10.1.0.14
app2  10.1.0.16
db2  10.1.0.18
my-app  10.1.0.20
websrv1 10.1.0.1
websrv2 10.1.0.2
websrv3 10.1.0.4
app-dev1 10.1.0.9
app-dev2 10.1.0.5
app-dev3 10.1.0.8
db-dev 10.1.0.19

70. Introducing Blox

71. What is Blox?
Choice
Control
Developer Experience

72. Building with Blox
scheduler cluster state service

73. Set Up Blox Locally
Step 1: git clone https://github.com/blox/blox.git
Step 3: docker-compose up -d
Step 4: start using Blox locally
Step 2: deploy CloudFormation template to configure ECS event stream and SQS queue

74. Swagger Spec: Cluster State Service

75. Swagger Spec: Daemon Scheduler

76. Daemon Scheduler

77. t2.small t2.small t2.small
Blox: Daemon Scheduler
t2.small t2.small t2.small
scheduler cluster state service
t2.small t2.small t2.small

78. The Blox Vision

79. Contributing to Blox
• Blox is licensed under Apache 2.0
• Open an issue or pull request
• Watch our roadmap on GitHub
• Check out our Gitter channel

80. Thank you!