© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Moving to DevOps the Amazon
Way
Dickson Yue
Manager, Solutions Architecture
Amazon Web Services
A r c h i t e c t u r e T r a c k : D e v O p s

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gigantic Web of Micro-services at Amazon

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
= Millions of deployments a year
Thousands of teams
× Microservice architecture
× Continuous delivery
× Multiple environments
Several types of deployments

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cultural
Philosophy
Practices
and
Patterns
Tools

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Development transformation at Amazon: 2001-2002
monolithic application
+ teams
2001
Lesson learned: Decompose for agility
2002
microservices
+ 2 pizza teams

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Full ownership
Full accountability
“DevOps”
Focused innovation
Two-pizza teams

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Identify and break processes into fine-grained units
Shipping
Labeling
Cart
Checkout
Stock
Search
Listing
Assign those units to small teams

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Moving from activity-based to product-based mindset
Dedicated product teams
ProductDevelopment
ProductGo-ToMarket
ProductManagers
ProjectManagers
Developers
Testers
Implementers
Operations&Support
Product Team B
Product Team A
Product Team C
Backlog A
• Story 1
• Story 2
• Story 3
• Story 4
Backlog A
• Story 1
• Story 2
• Story 3
• Story 4
Backlog A
• Story 1
• Story 2
• Story 3
• Story 4

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Example of scrum roles
Scrum master, developers, product owner
Teams adopted agile methodologies
Example of scrum board

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Our 2-Pizza Teams learned to do these
• Write application and infrastructure code
• Write unit/integration/performance tests
• Create and automate CI/CD pipelines
• Monitor production environments
• Review code of others
• Create SQL queries
• Provision test and production hosts
• Use secure APIs and apply security policies
• Be on-call on a rotation-basis

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We built “guardrails”

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What changes
have to be made
in this new world?
Architectural patterns
Operational model

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Changes to the architectural patterns

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When the impact of change is small,
release velocity can increase
Monolith
Does everything
Microservices
Does one thing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Monolith development lifecycle
MonitorReleaseTestBuild
Developers
Delivery pipelines
Services

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Microservice development lifecycle
Developers Services
MonitorReleaseTestBuild
Delivery pipelines
MonitorReleaseTestBuild
MonitorReleaseTestBuild
MonitorReleaseTestBuild
MonitorReleaseTestBuild
MonitorReleaseTestBuild

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
MICROSERVICE
API
API
MICROSERVICE
MICROSERVICE
EVENT
API
MICROSERVICE
EVENT
API
MICROSERVICE
APPLICATION
Mobile client
Client
IoT
PERSISTENCE PERSISTENCE

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
APIs are the front door of microservices

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Manage APIs with API Gateway
Mobile apps
Websites
Services
Internet Amazon
CloudFront
Amazon CloudWatch
monitoring
API
Gateway
cache
Any other
AWS service
All publicly
accessible
endpoints
AWS
Lambda
functions
Endpoints
in your VPC
Regional API Endpoints
AWS Lambda
functions
Endpoints on
Amazon EC2
Your VPCAWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
WebSockets support in Amazon API Gateway
Real-time two-way
communications
Managed persistence
Event-based triggers
Mobile apps
Chat
Dashboards
IoT devices
Amazon API Gateway
WebSockets API
Stateful
connection
Stateless
connection
Lambda
Functions
Public
Endpoints on
Amazon EC2
Amazon
Kinesis
Any other
AWS service
All publicly
accessible
endpoints

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Event-driven architectures

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Decouple state from code using messaging
Queues
Simple
Fully managed
Any volume
Pub/sub
Simple
Fully managed
Flexible
Amazon Simple
Queue Service
Amazon Simple
Notification
Service
Messaging
Synchronization
Rapid
Fully managed
Real-time
Amazon
CloudWatch
Events
Ingest
Data streams
Data processing
Real-time
Data Store
Microservices
Performance at scale
Fast and flexible
Amazon Kinesis
Data Streams
Amazon
Dynamo DB
Data stream capture

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A serverless event bus service for
SaaS and AWS services
• Fully managed, pay-as-you-go
• Native integration with
SaaS providers
• 15 target services
• Easily build event-driven
architectures

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Event routing and storing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Event routing and storing

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Common use cases

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Changes to the operational model

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Microservice development lifecycle
Developers Services
MonitorReleaseTestBuild
Delivery pipelines
MonitorReleaseTestBuild
MonitorReleaseTestBuild
MonitorReleaseTestBuild
MonitorReleaseTestBuild
MonitorReleaseTestBuild

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We released the AWS Developer Tools for CI/CD
AWS CodeBuild +
Third Party
AWS CodeCommit AWS CodeBuild AWS CodeDeploy AWS X-Ray
Source Build Test Deploy Monitor
AWS CodePipeline

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How can we best model and provision our infrastructure?
Developer AWS
CodeCommit
AWS CodeBuild
AWS
CloudFormation
Amazon SNS
Amazon S3
bucket
AWS
Stack
Stack
Stack
Pre-create
Create stacks
Post-create
Deploy
AWS CodePipeline
Region
Region
Region
cfn-nag

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Cloud Development Kit (Amazon CDK)
AWS CDK application AWS
CloudFormation
template
Stack(s)
Construct Construct
Resources
AWS
CloudFormation
Amazon Simple
Queue Service
Lambda Amazon S3
bucket
DynamoDB

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do I observe distributed and
ephemeral applications?

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS X-Ray is built for modern applications
Analyze and debug
issues quickly
End-to-end view of
individual services
Identify customer
impact
Support for
Serverless
*New* X-Ray
Root Causes
*New* Support for
API Gateway

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS X-Ray is built for modern applications

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS X-Ray Analytics

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS X-Ray Analytics

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.