A culture of rapid innovation with DevOps, microservices, & serverless - MAD201 - Santa Clara AWS Summit.pdf

© 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T
A culture of rapid innovation with
DevOps, microservices, & serverless
Deepak Singh
Director, Containers and Linux
Amazon Web Services
M A D 2 0 1

“We want to be a large company that’s also an invention machine. We want to
combine the extraordinary customer-serving capabilitiesthat are enabled by
size with the speed of movement, nimbleness, and risk-acceptance mentality
normally associated with entrepreneurial start-ups.”
Jeff Bezos
CEO, Amazon

ListenIterate
Experiment
Innovation
flywheel
Experiments power the engine of rapid innovation

Development transformation at Amazon: 2001–2002
Monolithic application +
teams
2001
Lesson learned: Decompose for agility
2002
Microservices
+ 2 pizza teams

Culture
Team design
Architecture patterns
Powerful infrastructure
Innovation

Customer obsession
Bias for action
Highest standards
Think big
Have backbone: disagree & com
Culture

Full ownership
Full accountability
DevOps
Focused innovation
Two-pizza teams

Deployment at scale
1000s of
teams
Micro-
services
CI/CD Serverless
>60 million deployments a year*

New services and features released per year
0
500
1000
1500
2000
2500
2011 2012 2013 2014 2015 2016 2017 2018

What technical
changes have to be
made in this new
world?
Architectural patterns
Operational model
Software delivery

Changes to the architectural patterns

When the impact of change is small,
release velocity can increase
Monolith
Does everything
Microservices
Does one thing

When a small team can make a change,
release velocity can increase
Multipleteams
Loosely connected
One team
Focus and ownership

Microservice
API
API
Microservice
Microservice
Event
API
Microservice
Event
API
Microservice
Application
Mobile client
Client
IoT
Persistence Persistence

APIs are the front door of microservices

APIs are the “hardened contract” between
teams

Manage APIs with Amazon API Gateway
Mobile apps
Websites
Services
Internet Amazon
CloudFront
Amazon CloudWatch
monitoring
API
Gateway
cache
Any other
AWS service
All publicly
accessible
endpoints
AWS
Lambda
functions
Endpoints
in your VPC
Regional API endpoints
AWS Lambda
functions
Endpoints on
Amazon EC2
Your VPCAWS

Event-driven architectures

Decouple state from code using
messaging

Decouple state from code using messaging
Queues
Simple
Fully managed
Any volume
Pub/sub
Simple
Fully managed
Flexible
Amazon Simple
Queue Service
Amazon Simple
Notification Service
Messaging
Synchronization
Rapid
Fully managed
Real time
Amazon CloudWatch
Events

Microservice
Event
Event
Microservice
Microservice
Event
API
Microservice
Event
API
Microservice
Application
Mobile client
Client
IoT
Persistence Persistence
Queue
Topic

AmazonSNS
“CheckoutEventsTopic”
Event storage & backup pipeline
Event search & analytics pipeline
Event replay pipeline
Checkout event processing pipeline
filtered orders(amount>=$100)
Ordersto replay
All
orders
AWS Cloud
Ecommerce
users
Internet
AWSLambda
“CheckoutFunction”
AmazonSQS
“CheckoutQueue”
AWSLambda
“CheckoutFunction”
AmazonDynamoDB
“CheckoutTable”
Event-driven architecture

And data streams
Ingest
Data streams
Data processing
Real time
Data store
Microservices
Performance at scale
Fast and flexible
Amazon Kinesis
Data Streams
Amazon
Dynamo DB
Data stream capture

Track status of data
and execution
Remove redundant
code
Build workflows to orchestrate everything

Simpler integration, less code
With serverless
polling
With new
service integration
Start
End
AWS
Lambda
functions
Start
End
No
Lambda
functions

Cloud-native architectures are small
pieces, loosely joined

Changes to the operational model

AWS operational responsibility models
On premises Cloud
Less More
Compute Virtual machine
EC2 Elastic Beanstalk AWS LambdaFargate
Databases MySQL MySQL on EC2
RDS MySQL RDS Aurora Aurora Serverless DynamoDB
Storage Storage
S3
Messaging ESBs
Amazon MQ Kinesis SQS / SNS
Analytics
Hadoop Hadoop on EC2 EMR Amazon Elasticsearch Service Athena

What is serverless?
No infrastructure management Automatic scaling
Pay for value Highly available and secure

AWS
Lambda
AWS
Fargate
Amazon
API Gateway
Amazon
SNS
Amazon
SQS
AWS
Step Functions
COMPUTE
DATA STORES
INTEGRATION
Amazon Aurora
Serverless
Amazon
S3
Amazon
DynamoDB
AWS
AppSync

Serverless compute engine
for containers
Long-running
Bring existing code
Fully managed orchestration
AWS Fargate
Let’s focus on compute for now
Serverless event-driven
code execution
Short-lived
All language runtimes
Data source integrations
AWS Lambda

Comparison of operational responsibility
AWS Lambda
Serverless functions
AWS Fargate
Serverless containers
ECS/EKS
Container-management as a service
EC2
Infrastructure-as-a-service
More opinionated
Less opinionated
AWS manages Customer manages
• Data sourceintegrations
• Physicalhardware, software, networking,
and facilities
• Provisioning
• Application code
• Container orchestration, provisioning
• Cluster scaling
• Physicalhardware, hostOS/kernel,
networking, and facilities
• Security config and updates, network config,
management tasks
• Container orchestration controlplane
• Physicalhardwaresoftware, networking,
and facilities
• Work clusters
firewall, management tasks
• Physicalhardwaresoftware,
networking, and facilities
• Scaling
management tasks
• Provisioning, managing scaling and
patching of servers

Making development easier with AWS Lambda
Accessible for
all developers
Enable new
application patterns
Greater
productivity
Support for all runtimes
with Lambda Layers and Runtime API
ISO, PCI, HIPAA, SOC, GDPR,
and FedRamp compliances
15 minute functions
SQS for Lambda
Automatic load balancing for Lambda
Support for Kinesis Data Streams Enhanced Fan-Out
and HTTP/2
Toolkits for popular IDEs:
VSCode, IntelliJ, and PyCharm
Simplified deployment
with nested apps

Lambda Layers & Custom Runtimes
Lambda Layers Custom Runtimes
Bring any Linux compatible
language runtime
Lets functions easily share
code: Upload layer once,
reference within any function

Community Lambda Layers
UtilitiesCustom Runtimes
C++
Rust
Erlang
Bash
Node.js v10, v11
PHP 7.1, 7.2, 7.3
Pypy 3.5
Haskell
AWS CLI
Ffmpeg
Git + SSH
Kubectl
MySQL + PHP
SoX
Tesseract
Pandoc
Monitoring
PureSec
Protego
Security
Datadog
Epsagon
IOpipe
Thundra

Serverless containers with AWS Fargate
Bring existing code Containers as first-class
primitive
Production ready
No changes required of existing code,
works with existing workflows and
microservices
built on Amazon ECS
Time and event-based scheduling, network
integration,
individually metered, and billed.
Native service discovery
ISO, PCI, HIPAA, SOC compliant.
Launch tens or tens of thousands of
containers in seconds in
9 global regions (+7 in 2018)

Consistent microservice
communications
Observability & traffic control
Container orchestration compatibility
Fully managed
AWS App Mesh
Application-level networkingfor
all your resources
- Now generally available

AWS X-Ray is built for modern applications
Identify customer
impact
Support for serverlessMap all services and
ephemeral resources
Follow end to end
interactions

Object storage
Durable and scalable
Comprehensive security
Query-in-place
AWS serverless storage and database options
Non-relational
Performance at scale
Fully managed
Enterprise-ready
Relational
Fully managed
High performance
Cost effective

Changes to the delivery of software

Monolith development lifecycle
MonitorReleaseTestBuild
Developers
Delivery pipelines
Services

Microservice development lifecycle
Developers Services
Delivery pipelines

How Amazon
does DevOps
(microservices, 2 pizza teams)
(governance, templates)

We Released the AWS Developer Tools for CI/CD
AWS CodeBuild +
third party
AWS CodeCommit AWS CodeBuild AWS CodeDeploy AWS X-Ray
Source Build Test Deploy Monitor
AWS CodePipeline

AWS Developer Tools have been purpose built to support
serverless microservices
Support for Lambda
deploymentwith
CodePiplineand
AWS CloudFormation
Support for rolling
and blue/green
Lambda
deployments with
AWS CodeDeploy
Support for Fargate
and Amazon ECS
deploymentsin AWS
CodePipeline
CodePipeline
supports AWS
Config for
improved
governance
CodePipeline
supports
Amazon ECR as
a source
Support for
serverless
python apps in
AWS Toolkitfor
PyCharm
Support for
blue/green
deployments
for Fargate and
ECS with
CodeDeploy
2016 20182017
NOV NOV DEC OCT NOV NOV

Author and debug Lambda applications on AWS using
your favorite IDEs
Python, Node Python Java
Developer
preview
.NET, Node
**New today**

Developer previewAWS Cloud Development Kit
CDK application AWS
CloudFormation
template
Stack(s)
Construct Construct
Resources
AWS
CloudFormation
Amazon SQS AWS Lambda Amazon S3
bucket
Amazon DynamoDB

Application models simplify building serverless and
containerized applications

Conclusion

Increase
customer
value
Build better
products
Innovate
more often
Release
features
faster
Focus on
business
logic
Decouple
software
systems
Our goal is to automate and abstract away as much as is possible so customers can focus on
building applications for their business
We are witnessing a paradigm shift

A culture of rapid innovation with DevOps, microservices, & serverless - MAD201 - Santa Clara AWS Summit.pdf

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a A culture of rapid innovation with DevOps, microservices, & serverless - MAD201 - Santa Clara AWS Summit.pdf

Similar a A culture of rapid innovation with DevOps, microservices, & serverless - MAD201 - Santa Clara AWS Summit.pdf (20)

Más de Amazon Web Services

Más de Amazon Web Services (20)

A culture of rapid innovation with DevOps, microservices, & serverless - MAD201 - Santa Clara AWS Summit.pdf