SlideShare a Scribd company logo
1 of 28
Download to read offline
WEBINAR
Drive operational
efficiency through
cloud optimisation
Introduction
CLOUD OPTIMISATION
● Welcome
● Who we are
● What you will learn
○ How we approach cloud architecture and deployments
○ TCO and ROI considerations
○ 3 techniques for good cloud hygiene
○ 3 tips reducing your bill
How we approach cloud
architecture
CLOUD OPTIMISATION
Every project is different...
CLOUD OPTIMISATION
1 2 4 53
1 2 4 53
1 2 4 53
1 2 4 53
1 2 4 53
Project objectives / scope
Architecture
Time
Budget $$
Security
...
Problem (Start with the customer!)
● Understand the context
● What are the project objectives
Solution (Architecture)
● Operational excellence
● Security
● Reliability
● Performance efficiency
● Cost
Total cost of ownership
● Do we need to build for now or the future?
● How do we view the performance of existing investments?
Approach to cloud architecture
CLOUD OPTIMISATION
Start with the customer!
● Understand the context
● What are the project objectives
Architecture
● Operational excellence
● Security
● Reliability
● Performance efficiency
● Cost
Total cost of ownership
● Investment decisions: do we need to build for now or the future?
Approach to cloud architecture
CLOUD OPTIMISATION
Total Cost of Ownership (TCO)
CLOUD OPTIMISATION
Scenario
As a result of COVID-19, there has been an increase in demand for our signature fidget
spinner product and there is an opportunity to create a digital version.
Our innovation team has created a web-based product that allows school-aged
children to distract each other during recess, addressing a key pain point for parents
working from home.
Mission
Compare TCO of internal ECS platform build with a Beanstalk (PaaS) deployment to
release this new app to market.
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Assumptions
● Cost of delay of $5k a week
● $1k per day engineer labour cost
● 5% monthly growth in usage
Model over 3 year investment period
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Internal Platform
● 8 weeks to create an initial platform (2 developers)
● 2 days a month of maintenance (tuning, tools etc.)
● $500 monthly AWS bill (assume flat costs)
PaaS
● 1 week to setup initial platform (2 developers)
● ½ day a month of platform maintenance
● $1.5k monthly AWS bill
● 5% monthly growth in bill as new workloads
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Lessons
CLOUD OPTIMISATION
● Operational economics vary significantly on key decisions
● Understanding CD3 and initial build costs
● Understand ongoing maintenance
Platforms often take years to yield a return on investment (ROI)
Fundamental techniques
For basic cloud hygiene
CLOUD OPTIMISATION
Landing zones are a way for customers
to rapidly set up a secure account
structure and workload environment
based on best practices, without
compromising on security and
governance.
CLOUD OPTIMISATION
#1 Setting up your landing zone
Source: https://aws.amazon.com/solutions/implementations/aws-landing-zone/
CLOUD OPTIMISATION
#2 Tagging resources
Tags are one of the key ways to
organise, group and manage resources
within your cloud environment.
Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
CLOUD OPTIMISATION
Why tag resources?
Cost Management
● Visibility
● Accountability
● Target costs and measure more effectively
Automation
● Prevent orphaned / unmanaged resources
● Automate common activities for resources
of certain types and tag
Security, Governance & Compliance
● Apply general security or other policies to
resources with
Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
Cost saving techniques
Reduce your bill now!
CLOUD OPTIMISATION
CLOUD OPTIMISATION
#3 Shutdown environments
when not in use
Non-prod environments often account
for the greater portion of cloud bills.
Save up to 70% of our cloud bill by
turning them off when not in use.
#3 Shut down non-prod environments
when not in use
CLOUD OPTIMISATION
Challenges
● Impact to development team
● It optimises in broad strokes, not
granular
● Load balancing groups!
● What time(zone) is the server in?
How to do it
● Tag your resources
● Schedule / on-demand shutdowns
● SlackOps
● On first build of the day
Tools
● https://github.com/srbartlett/ec2-blackout
● https://github.com/nib-health-funds/hamm
ertime
CLOUD OPTIMISATION
#4 Use spot instances
Cloud providers have a large capacity of
unused servers that are able to be used
at a fraction of their listed price.
Save up to 80% or 90% of your bill.
Source: https://cloud.google.com/preemptible-vms
Why it’s good
● Save up to 80 or 90% on cloud bills
How to do it
● Great for offline / non-critical
workloads
○ non-prod environments
○ Batch processing
○ Ad-hoc
#4 Use spot instances (cloud spare capacity)
CLOUD OPTIMISATION
Tools
● Autospotting
Challenges
● Workloads need to be carefully
selected
● Handling instance removal
CLOUD OPTIMISATION
#5 Terminate untagged resources
Resources that do not confirm to your tagging (or other) policies can be terminated
to prevent cost leaks.
Why it’s good
● Enforces good hygiene
● Enables compliance & governance
● Reduces accidental costs
How to do it
● Tagging
● Configuration policies
● Automation
#5 Terminate untagged resources
CLOUD OPTIMISATION
Challenges
● Production 😱!
● Communicating to teams
CLOUD OPTIMISATION
#6 Automate with Infrastructure as Code (IaC)
DevOps practices such as continuous
integration (CI) and IaC ensures you get
the most out of your cloud optimisation
efforts.
Why it’s good
● Faster
● Safer
● Reliable
How to do it
● Tools:
○ Cloudformation
○ Terraform
○ Ansible/Puppet/Chef
○ Lots!
#6 Automate with Infrastructure as Code
CLOUD OPTIMISATION
Levels of maturity
● ClickOps
● CLI/API instead of console
● Scripts
● IaC tools
● Source control
● Only run it in a pipeline
Recap
CLOUD OPTIMISATION
Summary
CLOUD OPTIMISATION
● Cloud architecture and best practices is contextual
● Think about your TCO
● Landing Zone and Tagging (form the basis)
● Cost techniques
○ Shutdown environments
○ Use spot instances
○ Terminate non-conforming resources
● Use DevOps practices such as IaC
dius.com.au
Thank you!
dius.tech/slack
w. dius.com.au/blog
e. info@dius.com.au

More Related Content

More from DiUS

GameDay - Achieving resilience through Chaos Engineering
GameDay - Achieving resilience through Chaos EngineeringGameDay - Achieving resilience through Chaos Engineering
GameDay - Achieving resilience through Chaos EngineeringDiUS
 
The case for consumer-driven contracts
The case for consumer-driven contractsThe case for consumer-driven contracts
The case for consumer-driven contractsDiUS
 
Deploy with Confidence using Pact Go!
Deploy with Confidence using Pact Go!Deploy with Confidence using Pact Go!
Deploy with Confidence using Pact Go!DiUS
 
Crafting Quality Software
Crafting Quality SoftwareCrafting Quality Software
Crafting Quality SoftwareDiUS
 
Metrics on the front, data in the back
Metrics on the front, data in the backMetrics on the front, data in the back
Metrics on the front, data in the backDiUS
 
Antifragility and testing for distributed systems failure
Antifragility and testing for distributed systems failureAntifragility and testing for distributed systems failure
Antifragility and testing for distributed systems failureDiUS
 
DIY IoT Backend
DIY IoT BackendDIY IoT Backend
DIY IoT BackendDiUS
 
How to Build Hardware Lean
How to Build Hardware LeanHow to Build Hardware Lean
How to Build Hardware LeanDiUS
 
Behaviour Change and Coaching: What we can learn from BJ Fogg
Behaviour Change and Coaching: What we can learn from BJ FoggBehaviour Change and Coaching: What we can learn from BJ Fogg
Behaviour Change and Coaching: What we can learn from BJ FoggDiUS
 
Power in Agile Teams
Power in Agile Teams Power in Agile Teams
Power in Agile Teams DiUS
 
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...DiUS
 
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary SlidesRise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary SlidesDiUS
 
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...DiUS
 
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...DiUS
 
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir AnsariAgile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir AnsariDiUS
 

More from DiUS (15)

GameDay - Achieving resilience through Chaos Engineering
GameDay - Achieving resilience through Chaos EngineeringGameDay - Achieving resilience through Chaos Engineering
GameDay - Achieving resilience through Chaos Engineering
 
The case for consumer-driven contracts
The case for consumer-driven contractsThe case for consumer-driven contracts
The case for consumer-driven contracts
 
Deploy with Confidence using Pact Go!
Deploy with Confidence using Pact Go!Deploy with Confidence using Pact Go!
Deploy with Confidence using Pact Go!
 
Crafting Quality Software
Crafting Quality SoftwareCrafting Quality Software
Crafting Quality Software
 
Metrics on the front, data in the back
Metrics on the front, data in the backMetrics on the front, data in the back
Metrics on the front, data in the back
 
Antifragility and testing for distributed systems failure
Antifragility and testing for distributed systems failureAntifragility and testing for distributed systems failure
Antifragility and testing for distributed systems failure
 
DIY IoT Backend
DIY IoT BackendDIY IoT Backend
DIY IoT Backend
 
How to Build Hardware Lean
How to Build Hardware LeanHow to Build Hardware Lean
How to Build Hardware Lean
 
Behaviour Change and Coaching: What we can learn from BJ Fogg
Behaviour Change and Coaching: What we can learn from BJ FoggBehaviour Change and Coaching: What we can learn from BJ Fogg
Behaviour Change and Coaching: What we can learn from BJ Fogg
 
Power in Agile Teams
Power in Agile Teams Power in Agile Teams
Power in Agile Teams
 
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
 
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary SlidesRise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
 
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
 
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
 
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir AnsariAgile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
 

Recently uploaded

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 

Recently uploaded (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 

Drive operational efficiency through cloud optimisation

  • 2. Introduction CLOUD OPTIMISATION ● Welcome ● Who we are ● What you will learn ○ How we approach cloud architecture and deployments ○ TCO and ROI considerations ○ 3 techniques for good cloud hygiene ○ 3 tips reducing your bill
  • 3. How we approach cloud architecture CLOUD OPTIMISATION
  • 4. Every project is different... CLOUD OPTIMISATION 1 2 4 53 1 2 4 53 1 2 4 53 1 2 4 53 1 2 4 53 Project objectives / scope Architecture Time Budget $$ Security ...
  • 5. Problem (Start with the customer!) ● Understand the context ● What are the project objectives Solution (Architecture) ● Operational excellence ● Security ● Reliability ● Performance efficiency ● Cost Total cost of ownership ● Do we need to build for now or the future? ● How do we view the performance of existing investments? Approach to cloud architecture CLOUD OPTIMISATION
  • 6. Start with the customer! ● Understand the context ● What are the project objectives Architecture ● Operational excellence ● Security ● Reliability ● Performance efficiency ● Cost Total cost of ownership ● Investment decisions: do we need to build for now or the future? Approach to cloud architecture CLOUD OPTIMISATION
  • 7. Total Cost of Ownership (TCO) CLOUD OPTIMISATION
  • 8. Scenario As a result of COVID-19, there has been an increase in demand for our signature fidget spinner product and there is an opportunity to create a digital version. Our innovation team has created a web-based product that allows school-aged children to distract each other during recess, addressing a key pain point for parents working from home. Mission Compare TCO of internal ECS platform build with a Beanstalk (PaaS) deployment to release this new app to market. Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION
  • 9. Assumptions ● Cost of delay of $5k a week ● $1k per day engineer labour cost ● 5% monthly growth in usage Model over 3 year investment period Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION
  • 10. Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION Internal Platform ● 8 weeks to create an initial platform (2 developers) ● 2 days a month of maintenance (tuning, tools etc.) ● $500 monthly AWS bill (assume flat costs) PaaS ● 1 week to setup initial platform (2 developers) ● ½ day a month of platform maintenance ● $1.5k monthly AWS bill ● 5% monthly growth in bill as new workloads
  • 11. Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION
  • 12. Lessons CLOUD OPTIMISATION ● Operational economics vary significantly on key decisions ● Understanding CD3 and initial build costs ● Understand ongoing maintenance Platforms often take years to yield a return on investment (ROI)
  • 13. Fundamental techniques For basic cloud hygiene CLOUD OPTIMISATION
  • 14. Landing zones are a way for customers to rapidly set up a secure account structure and workload environment based on best practices, without compromising on security and governance. CLOUD OPTIMISATION #1 Setting up your landing zone Source: https://aws.amazon.com/solutions/implementations/aws-landing-zone/
  • 15. CLOUD OPTIMISATION #2 Tagging resources Tags are one of the key ways to organise, group and manage resources within your cloud environment. Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
  • 16. CLOUD OPTIMISATION Why tag resources? Cost Management ● Visibility ● Accountability ● Target costs and measure more effectively Automation ● Prevent orphaned / unmanaged resources ● Automate common activities for resources of certain types and tag Security, Governance & Compliance ● Apply general security or other policies to resources with Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
  • 17. Cost saving techniques Reduce your bill now! CLOUD OPTIMISATION
  • 18. CLOUD OPTIMISATION #3 Shutdown environments when not in use Non-prod environments often account for the greater portion of cloud bills. Save up to 70% of our cloud bill by turning them off when not in use.
  • 19. #3 Shut down non-prod environments when not in use CLOUD OPTIMISATION Challenges ● Impact to development team ● It optimises in broad strokes, not granular ● Load balancing groups! ● What time(zone) is the server in? How to do it ● Tag your resources ● Schedule / on-demand shutdowns ● SlackOps ● On first build of the day Tools ● https://github.com/srbartlett/ec2-blackout ● https://github.com/nib-health-funds/hamm ertime
  • 20. CLOUD OPTIMISATION #4 Use spot instances Cloud providers have a large capacity of unused servers that are able to be used at a fraction of their listed price. Save up to 80% or 90% of your bill. Source: https://cloud.google.com/preemptible-vms
  • 21. Why it’s good ● Save up to 80 or 90% on cloud bills How to do it ● Great for offline / non-critical workloads ○ non-prod environments ○ Batch processing ○ Ad-hoc #4 Use spot instances (cloud spare capacity) CLOUD OPTIMISATION Tools ● Autospotting Challenges ● Workloads need to be carefully selected ● Handling instance removal
  • 22. CLOUD OPTIMISATION #5 Terminate untagged resources Resources that do not confirm to your tagging (or other) policies can be terminated to prevent cost leaks.
  • 23. Why it’s good ● Enforces good hygiene ● Enables compliance & governance ● Reduces accidental costs How to do it ● Tagging ● Configuration policies ● Automation #5 Terminate untagged resources CLOUD OPTIMISATION Challenges ● Production 😱! ● Communicating to teams
  • 24. CLOUD OPTIMISATION #6 Automate with Infrastructure as Code (IaC) DevOps practices such as continuous integration (CI) and IaC ensures you get the most out of your cloud optimisation efforts.
  • 25. Why it’s good ● Faster ● Safer ● Reliable How to do it ● Tools: ○ Cloudformation ○ Terraform ○ Ansible/Puppet/Chef ○ Lots! #6 Automate with Infrastructure as Code CLOUD OPTIMISATION Levels of maturity ● ClickOps ● CLI/API instead of console ● Scripts ● IaC tools ● Source control ● Only run it in a pipeline
  • 27. Summary CLOUD OPTIMISATION ● Cloud architecture and best practices is contextual ● Think about your TCO ● Landing Zone and Tagging (form the basis) ● Cost techniques ○ Shutdown environments ○ Use spot instances ○ Terminate non-conforming resources ● Use DevOps practices such as IaC