SlideShare una empresa de Scribd logo
1 de 26
Descargar para leer sin conexión
Hybrid Cloud Orchestration:
How SuperChoice Does It
21st June 2017
2
Agenda
 Why automation and orchestration are critical
 How we automated 200+ apps
 The role of the Cloud Management Platform (CMP)
 Lessons Learned
3
SuperChoice at a Glance
 SuperChoice is a pension / superannuation e-commerce platform provider
with a leading Australian market position, an emerging UK business and
aspirations to expand into Asia and Europe
 SuperChoice – the company
– Established in 1996
– Sydney based with approx. 90 professional staff
– Privately owned by CPS Group and management
– 20 years of continuous, double-digit growth
 Largest player in the Australian market
– Approx. 40% of the total market by transaction numbers
– approx. 20% of the active Self Managed Superannuation Funds
4
Significant Blue-chip client base
5
The SuperChoice journey so far
SuperChoice Technology Headcount
(FTEs)
Trained
all staff
on
Agile
Commenced
SuperStream
project
Hired Full-
time Agile
Coach
Commenced
1-Click-
Build™
Commenced automated
regression testing
Selectively
outsourced
development (Aust,
NZ, Malaysia)
Adopted New Technology
Strategy
Initiated actions to
increase staff engagement
Adopted Atlassian
tool stack
Adopted
new Code
Quality
practices
Initiated capability
development programme
Started
redeveloping core
platform
Moved from 2
Monthly to Monthly
to Weekly
deployments
Started investigating
migrating database
technology
Commenced
piloting cloud
migration
100
Head
Count
75
50
25
6
Most organisations can no longer do infrastructure and
security cost effectively
 Lack economies of scale and scope and the ability to develop deep expertise
 Complex integration of people, processes and products
 Interconnectedness
 Defence in depth / layers of counter measures
 Impossible to win an Arms Race:
– Hackers compromised 2.2 Billion records in just the first 10 months of 2016
– Security budgets climbed from 22% of technology budgets in 2014 to 28% in 2016!
Source: Forrester, Develop Your Information Security Management System, January 19, 2017
7
Few Mature Corporates are Migrating Fully to Public cloud
20%
25% 24%
15%
5%
2%
9%
<20% 20% to
39%
40% to
59%
60% to
79%
80% to
99%
100% Don't
know
How much of the server-side
code that you write is deployed
to cloud environments today?
(2015; Index: N = 55)
Source: Forrester Business Technographics Infrastructure Survey, 2015
What percentage of your
infrastructure is in the Public cloud?
(2015; Index: N = 49)
14.5%
8
SuperChoice Requirements
 Core Objectives:
– Reduce costs and timeframes by automating provisioning infrastructure and deploying
environments
– Reduce operational costs with maintaining and supporting infrastructure and environments
 Clouds:
– Initially: AWS and VMware Private, Azure added in the last 6 months, investigating Google
 Applications:
– Rapidly growing list of apps (>200 currently) from adopting micro services architecture
 VMs/Instances:
– Averaging several hundred concurrent instances, varies considerably over time
 Environments:
– Multiple Development, Test and Client Acceptance Test environments
 Frequency of updates:
– Daily to Weekly
9
SuperChoice’s Overarching Strategy
 Automatically deploying entire, complex software environments
 Adopting a “Fix by Rebuild” approach
 Supporting multiple cloud service providers independently
10
Key Benefits Targeted
 Automate deployments ‘at scale’ of large sets of applications and
infrastructure to a managed baseline in a timely manner
 Deploy and test environments in approx. 60 minutes to enable moving from
a Break-Troubleshoot-Fix model to a Fix-by-Rebuild model
 Have repeatable and consistent deployments
 Support high agility for environment provisioning for dev and test teams
 Track environments and charge directly to the project team
 Optimize costs by stopping instances not in use (e.g. scheduled to run only
within business hours)
 Choose the right Cloud for the Environment’s purpose
11
Adopt Cloud IaaS / Paas / SaaS capabilities
Automate Infrastructure Provisioning
Benefit
Automation Capability
Automate Environment
Provisioning
Straight replacement
of physical
infrastructure
Uplift platform-level
provisioning and
management (for
discrete components)
Fully automate provisioning of
integrated suites of
applications and databases
Cloud technologies have the ability to transform the way
functionality is delivered while reducing costs
12
Control / Master Manufacture Use Dispose
SCM
Developer
Continuous
Integration
Platform
Management
Source
Scripts
Libraries
Reference
Data
Test Data
Reference Data
Management
Tester
Environment
Config
Release
Management
Dev
Test
Environments
DevDevelopment
Environments
Production
Environment
Changes are applied to Environments
by updating Automation
Cloud
Management
Platform
Automation
Tools
Configuration,
Deployment and
Compliance
Testing tools
Automation drives rethinking how we deliver capability
13
Automation using RightScale
14
Public or Private Cloud
Cloud Account
Network (VPC/Vnet) Boundary
Factory
Nexus Master
Confluence
BitBucket
Bamboo
Bamboo
Agents
Other …
Management
DNS2SMTP DNS1
Logging Consul 1 Consul 2
Auto-
mation
Backup
Jump-
host
Boundary Network Device
(Cloud or appliance, e.g. Palo Alto)
Inbound
Proxy
Outbound
Internet Proxy
Environment
Environment
Environment
DMZ
webserver webserver
Business
Application Servers
App
Environment
Integration
DMZ
SFTP MQIPT
Axway MQ
App
Data Tier (Master)
Shared File Storage
Application
Database
Application
Database
Application
Database
Ephemeral deployments
managed fully by Fix-By-
Rebuild.
Deployments are “Cookie-
Cutter” with no Configuration
Variance, resulting in
Simplicity and Repeatability
Long-lived Data, retained
through Environment
rebuilds
Long-lived Management
Services
Boundary Security
Network
Network
Internet
Network
A Standardised Model
 A standardised model for
DataCentre components with
standardised, segmented
Network layout
 Each ‘Cell’ is deployed using
Automation, managed as a Unit
 Lifecycle and management
approach for each Cell
tailored to the nature of the
services
 Repeat with as many Networks
across as many Clouds as
needed
15
Key Concepts / Approach
 Information Model - model all of the information associated with an
enterprise's environments. Baseline and keep separate from the execution
 Software management and control disciplines applied to Infrastructure;
“Infrastructure as code”
 Take a manufacturing approach to building complex environments.
Always go back to source and rebuild from the ground up
 Fix by rebuild model, we don’t spend time fixing environments
 Alter mindset around asset value
16
Leveraging RightScale CMP
 RightScale as the Orchestration Engine or manufacturing engine
(Multi-Cloud + Governance)
 Establish RightScale Cloud Application Templates (CAT) for automated multi-
cloud deployment:
– Specific functional areas (eg SDN, DNS, FW, Management / App tier etc)
– Generate CATs for specific purposes eg deployment models
– Launch an application / environment
17
Information that builds the CAT
18
Lessons Learned
Key Lessons:
 CI/CD tools & processes are critical
 Change Management must be a focus with respect to human resources
 Cost to Value needs to be tracked. Favour a user pays approach and cost
allocation model at the environment level
 Concept of Brittleness in Infrastructure deployment (Embrace it)
19
Misconfigurations have a major impact on costs
 80% of unplanned outages are due to ill-planned changes made by
“operations staff”
- IT Process Institute’s Visible Ops Handbook
 60% of availability and performance errors are the result of
misconfigurations
- Enterprise Management Association
 80% of outages impacting mission-critical services will be caused by people
and process issues, and more than 50% of those outages will be caused by
change / configuration / release integration and hand-off issues
- Gartner
Source: Downtime, Outages and Failures – Understanding their true costs, November 2015
20
What we have achieved so far with migrating to the Cloud
 Addressed a lot of historical tech debt
 Automated / migrated nearly 100% of our code including:
– Core legacy application
– 100% of new distributed micro services (IS’s)
 De-commissioned 4 physical environments
 Implemented software firewalls and cloud neutral backup capability
 Spun up 5 (more on the way) dedicated Client test environments
 Transitioned some staff
 Upgraded security capability (and there’s more to come!)
– Piloting Voice authentication
 Upgraded the Build process
21
What’s been more difficult than we thought it would be
 Order of operations – Which applications to migrate first?
 Some lack of clarity on requirements – Trying to replicate “existing
environments” when the requirements were implicit or poorly specified
 Finding portable cloud technologies – The cloud is fairly AWS-centric, often
difficult to find cloud solutions that were portable to other cloud providers
 Running hybrid environments – cloud environments that have
interconnectivity into our existing data centres
 Getting some basics right:
– Error reporting is slower than previously; takes an hour
– Infrastructure changes were impacting code branches
– Need to re-launch an environment when an application fails
22
What we found that surprised us
 Approx. 40% of the efforts been in addressing tech debt
 Benefits have been higher and costs at or lower (even after requiring greater
external assistance)
 Cloud service provider agnostic backups are not easy to do
 Cloud Management Platforms (CMPs) are still a maturing technology
 Demand for dedicated test environments much higher then expected
 Cloud service providers are not that interested in what we are doing:
– Focus on sole sourcing
– “Adopt AWS, resistance is futile” attitude
 Had to slow the pace of change to accommodate the team’s ability to cope:
– Adopted small, regular milestones
 Cloud environment support takes up a lot more time during transition
23
Biggest challenge is addressing the People issues
 Building the understanding of how it all should work
 Developing and upgrading new skills eg analytical and conceptual capabilities
 Getting infrastructure / operations staff to start thinking like developers
 Getting the Developers on board / caring about the Infrastructure:
– Understanding how to use and taking on greater responsibility
– Addressing Tech Debt issues
24
Observations from our experience to date
Today’s Key Messages:
 Automation is critical to staying sane
 Accessing the right mindset and skills is important
 Cultural change is the biggest barrier to success and benefits capture
 Don’t under-estimate the amount of Tech debt that you’ll need to address
along the way
– No different to the early days of virtualisation
 Moving to the cloud is not a straight lift and shift (where uplifting capability)
 While it’s all new, taking a deliberate methodical approach works
25
Ruthless Automation
Thank you for your attention
Any questions!

Más contenido relacionado

La actualidad más candente

Cloud migration strategies
Cloud migration strategiesCloud migration strategies
Cloud migration strategies
SogetiLabs
 

La actualidad más candente (20)

How MSPs Can Be Successful in AWS, Azure, and Google Clouds
How MSPs Can Be Successful in AWS, Azure, and Google CloudsHow MSPs Can Be Successful in AWS, Azure, and Google Clouds
How MSPs Can Be Successful in AWS, Azure, and Google Clouds
 
7 Common Questions About a Cloud Management Platform
7 Common Questions About a Cloud Management Platform7 Common Questions About a Cloud Management Platform
7 Common Questions About a Cloud Management Platform
 
Kubernetes and Terraform in the Cloud: How RightScale Does DevOps
Kubernetes and Terraform in the Cloud: How RightScale Does DevOpsKubernetes and Terraform in the Cloud: How RightScale Does DevOps
Kubernetes and Terraform in the Cloud: How RightScale Does DevOps
 
How to Report and Optimize Cloud Costs Across All Your Clouds by RightScale
 How to Report and Optimize Cloud Costs Across All Your Clouds by RightScale How to Report and Optimize Cloud Costs Across All Your Clouds by RightScale
How to Report and Optimize Cloud Costs Across All Your Clouds by RightScale
 
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
 
Using RightScale CMP with Cloud Provider Tools
Using RightScale CMP with Cloud Provider ToolsUsing RightScale CMP with Cloud Provider Tools
Using RightScale CMP with Cloud Provider Tools
 
The 5 Stages of Cloud Management for Enterprises
The 5 Stages of Cloud Management for EnterprisesThe 5 Stages of Cloud Management for Enterprises
The 5 Stages of Cloud Management for Enterprises
 
Multi-Cloud Management with RightScale CMP (Demo)
Multi-Cloud Management with RightScale CMP (Demo)Multi-Cloud Management with RightScale CMP (Demo)
Multi-Cloud Management with RightScale CMP (Demo)
 
Identifying Workloads to Move to the Cloud
Identifying Workloads to Move to the CloudIdentifying Workloads to Move to the Cloud
Identifying Workloads to Move to the Cloud
 
Aws cloud migration simplified
Aws cloud migration simplifiedAws cloud migration simplified
Aws cloud migration simplified
 
How a CMP Can Help You Right Now
How a CMP Can Help You Right NowHow a CMP Can Help You Right Now
How a CMP Can Help You Right Now
 
Automating Multi-Cloud Policies for AWS, Azure, Google, and More
Automating Multi-Cloud Policies for AWS, Azure, Google, and MoreAutomating Multi-Cloud Policies for AWS, Azure, Google, and More
Automating Multi-Cloud Policies for AWS, Azure, Google, and More
 
Cloud Migration
Cloud MigrationCloud Migration
Cloud Migration
 
Savig cost using application level virtualization
Savig cost using application level virtualizationSavig cost using application level virtualization
Savig cost using application level virtualization
 
Aws Migration Strategies
Aws Migration StrategiesAws Migration Strategies
Aws Migration Strategies
 
Cloud migration strategies
Cloud migration strategiesCloud migration strategies
Cloud migration strategies
 
Optimizing Your Cloud Applications in RightScale
Optimizing Your Cloud Applications in RightScaleOptimizing Your Cloud Applications in RightScale
Optimizing Your Cloud Applications in RightScale
 
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
 
How to Allocate and Report Cloud Costs with RightScale Optima
How to Allocate and Report Cloud Costs with RightScale OptimaHow to Allocate and Report Cloud Costs with RightScale Optima
How to Allocate and Report Cloud Costs with RightScale Optima
 
Best Practices for Cloud Managed Services Providers: The Path to CMP Success
Best Practices for Cloud Managed Services Providers: The Path to CMP SuccessBest Practices for Cloud Managed Services Providers: The Path to CMP Success
Best Practices for Cloud Managed Services Providers: The Path to CMP Success
 

Similar a Hybrid Cloud Orchestration: How SuperChoice Does It

Aberdeen Oil & Gas Event - Cloud Adoption Framework
Aberdeen Oil & Gas Event - Cloud Adoption FrameworkAberdeen Oil & Gas Event - Cloud Adoption Framework
Aberdeen Oil & Gas Event - Cloud Adoption Framework
Amazon Web Services
 
Presentation advanced management – the road ahead
Presentation   advanced management – the road aheadPresentation   advanced management – the road ahead
Presentation advanced management – the road ahead
solarisyourep
 

Similar a Hybrid Cloud Orchestration: How SuperChoice Does It (20)

Leveraging Hybid IT for More Robust Business Services
Leveraging Hybid IT for More Robust Business ServicesLeveraging Hybid IT for More Robust Business Services
Leveraging Hybid IT for More Robust Business Services
 
Matias Creimerman - Cloud migration and modernization effort
Matias Creimerman - Cloud migration and modernization effortMatias Creimerman - Cloud migration and modernization effort
Matias Creimerman - Cloud migration and modernization effort
 
Aberdeen Oil & Gas Event - Cloud Adoption Framework
Aberdeen Oil & Gas Event - Cloud Adoption FrameworkAberdeen Oil & Gas Event - Cloud Adoption Framework
Aberdeen Oil & Gas Event - Cloud Adoption Framework
 
A perspective on cloud computing and enterprise saa s applications
A perspective on cloud computing and enterprise saa s applicationsA perspective on cloud computing and enterprise saa s applications
A perspective on cloud computing and enterprise saa s applications
 
Why Your Digital Transformation Strategy Demands Middleware Modernization
Why Your Digital Transformation Strategy Demands Middleware ModernizationWhy Your Digital Transformation Strategy Demands Middleware Modernization
Why Your Digital Transformation Strategy Demands Middleware Modernization
 
Presentation advanced management – the road ahead
Presentation   advanced management – the road aheadPresentation   advanced management – the road ahead
Presentation advanced management – the road ahead
 
Presentation advanced management – the road ahead
Presentation   advanced management – the road aheadPresentation   advanced management – the road ahead
Presentation advanced management – the road ahead
 
AWS Summit Singapore Webinar Edition | Secrets to Successful Cloud Migrations...
AWS Summit Singapore Webinar Edition | Secrets to Successful Cloud Migrations...AWS Summit Singapore Webinar Edition | Secrets to Successful Cloud Migrations...
AWS Summit Singapore Webinar Edition | Secrets to Successful Cloud Migrations...
 
Puppet on a string
Puppet on a stringPuppet on a string
Puppet on a string
 
Cloud proposition for banking
Cloud proposition for bankingCloud proposition for banking
Cloud proposition for banking
 
Application Migrations at Scale
Application Migrations at ScaleApplication Migrations at Scale
Application Migrations at Scale
 
VMworld 2013: Exploring Technology Trends within Financial Services
VMworld 2013: Exploring Technology Trends within Financial Services VMworld 2013: Exploring Technology Trends within Financial Services
VMworld 2013: Exploring Technology Trends within Financial Services
 
Develop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
Develop an Enterprise-wide Cloud Adoption Strategy – Chris MerriganDevelop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
Develop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
 
VAS - VMware CMP
VAS - VMware CMPVAS - VMware CMP
VAS - VMware CMP
 
VMworld 2013: Architecting the Software-Defined Data Center
VMworld 2013: Architecting the Software-Defined Data Center VMworld 2013: Architecting the Software-Defined Data Center
VMworld 2013: Architecting the Software-Defined Data Center
 
Creating an Operating Model to enable a high frequency organization
Creating an Operating Model to enable a high frequency organizationCreating an Operating Model to enable a high frequency organization
Creating an Operating Model to enable a high frequency organization
 
HP Cloud System Matrix Overview
HP Cloud System Matrix OverviewHP Cloud System Matrix Overview
HP Cloud System Matrix Overview
 
Dssc Intro
Dssc IntroDssc Intro
Dssc Intro
 
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdf
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdfMaking the Journey_ 7 Essential Steps to Cloud Adoption.pdf
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdf
 
Cloud: a disruptive technlogy that CEO should use to transform their business
Cloud:  a disruptive technlogy that CEO should use to transform their businessCloud:  a disruptive technlogy that CEO should use to transform their business
Cloud: a disruptive technlogy that CEO should use to transform their business
 

Más de RightScale

Más de RightScale (20)

10 Must-Have Automated Cloud Policies for IT Governance
10 Must-Have Automated Cloud Policies for IT Governance10 Must-Have Automated Cloud Policies for IT Governance
10 Must-Have Automated Cloud Policies for IT Governance
 
Optimize Software, SaaS, and Cloud with Flexera and RightScale
Optimize Software, SaaS, and Cloud with Flexera and RightScaleOptimize Software, SaaS, and Cloud with Flexera and RightScale
Optimize Software, SaaS, and Cloud with Flexera and RightScale
 
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About NowPrepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
 
How to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your EnterpriseHow to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your Enterprise
 
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBMComparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
 
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
 
Best Practices for Multi-Cloud Security and Compliance
Best Practices for Multi-Cloud Security and ComplianceBest Practices for Multi-Cloud Security and Compliance
Best Practices for Multi-Cloud Security and Compliance
 
9 Ways to Reduce Cloud Storage Costs
9 Ways to Reduce Cloud Storage Costs9 Ways to Reduce Cloud Storage Costs
9 Ways to Reduce Cloud Storage Costs
 
Serverless Comparison: AWS vs Azure vs Google vs IBM
Serverless Comparison: AWS vs Azure vs Google vs IBMServerless Comparison: AWS vs Azure vs Google vs IBM
Serverless Comparison: AWS vs Azure vs Google vs IBM
 
Cloud Storage Comparison: AWS vs Azure vs Google vs IBM
Cloud Storage Comparison: AWS vs Azure vs Google vs IBMCloud Storage Comparison: AWS vs Azure vs Google vs IBM
Cloud Storage Comparison: AWS vs Azure vs Google vs IBM
 
2018 Cloud Trends: RightScale State of the Cloud Report
2018 Cloud Trends: RightScale State of the Cloud Report2018 Cloud Trends: RightScale State of the Cloud Report
2018 Cloud Trends: RightScale State of the Cloud Report
 
Got a Multi-Cloud Strategy? How RightScale CMP Helps
Got a Multi-Cloud Strategy? How RightScale CMP HelpsGot a Multi-Cloud Strategy? How RightScale CMP Helps
Got a Multi-Cloud Strategy? How RightScale CMP Helps
 
How to Manage Cloud Costs with RightScale Optima
How to Manage Cloud Costs with RightScale OptimaHow to Manage Cloud Costs with RightScale Optima
How to Manage Cloud Costs with RightScale Optima
 
Top 10 Cloud Trends for 2018 and Actions You Can Take Now
Top 10 Cloud Trends for 2018 and Actions You Can Take NowTop 10 Cloud Trends for 2018 and Actions You Can Take Now
Top 10 Cloud Trends for 2018 and Actions You Can Take Now
 
AWS re:Invent 2017 Recap
AWS re:Invent 2017 RecapAWS re:Invent 2017 Recap
AWS re:Invent 2017 Recap
 
Cloud Instances Price Comparison: AWS vs Azure vs Google vs IBM
Cloud Instances Price Comparison: AWS vs Azure vs Google vs IBMCloud Instances Price Comparison: AWS vs Azure vs Google vs IBM
Cloud Instances Price Comparison: AWS vs Azure vs Google vs IBM
 
Orchestrating PaaS and IaaS+ with RightScale
Orchestrating PaaS and IaaS+ with RightScaleOrchestrating PaaS and IaaS+ with RightScale
Orchestrating PaaS and IaaS+ with RightScale
 
Managing Container-as-a-Service and Docker Clusters in the Cloud with RightScale
Managing Container-as-a-Service and Docker Clusters in the Cloud with RightScaleManaging Container-as-a-Service and Docker Clusters in the Cloud with RightScale
Managing Container-as-a-Service and Docker Clusters in the Cloud with RightScale
 
Understanding VMware Cloud on AWS
Understanding VMware Cloud on AWSUnderstanding VMware Cloud on AWS
Understanding VMware Cloud on AWS
 
Compare Cloud Services: AWS vs Azure vs Google vs IBM
Compare Cloud Services: AWS vs Azure vs Google vs IBMCompare Cloud Services: AWS vs Azure vs Google vs IBM
Compare Cloud Services: AWS vs Azure vs Google vs IBM
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Último (20)

ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 

Hybrid Cloud Orchestration: How SuperChoice Does It

  • 1. Hybrid Cloud Orchestration: How SuperChoice Does It 21st June 2017
  • 2. 2 Agenda  Why automation and orchestration are critical  How we automated 200+ apps  The role of the Cloud Management Platform (CMP)  Lessons Learned
  • 3. 3 SuperChoice at a Glance  SuperChoice is a pension / superannuation e-commerce platform provider with a leading Australian market position, an emerging UK business and aspirations to expand into Asia and Europe  SuperChoice – the company – Established in 1996 – Sydney based with approx. 90 professional staff – Privately owned by CPS Group and management – 20 years of continuous, double-digit growth  Largest player in the Australian market – Approx. 40% of the total market by transaction numbers – approx. 20% of the active Self Managed Superannuation Funds
  • 5. 5 The SuperChoice journey so far SuperChoice Technology Headcount (FTEs) Trained all staff on Agile Commenced SuperStream project Hired Full- time Agile Coach Commenced 1-Click- Build™ Commenced automated regression testing Selectively outsourced development (Aust, NZ, Malaysia) Adopted New Technology Strategy Initiated actions to increase staff engagement Adopted Atlassian tool stack Adopted new Code Quality practices Initiated capability development programme Started redeveloping core platform Moved from 2 Monthly to Monthly to Weekly deployments Started investigating migrating database technology Commenced piloting cloud migration 100 Head Count 75 50 25
  • 6. 6 Most organisations can no longer do infrastructure and security cost effectively  Lack economies of scale and scope and the ability to develop deep expertise  Complex integration of people, processes and products  Interconnectedness  Defence in depth / layers of counter measures  Impossible to win an Arms Race: – Hackers compromised 2.2 Billion records in just the first 10 months of 2016 – Security budgets climbed from 22% of technology budgets in 2014 to 28% in 2016! Source: Forrester, Develop Your Information Security Management System, January 19, 2017
  • 7. 7 Few Mature Corporates are Migrating Fully to Public cloud 20% 25% 24% 15% 5% 2% 9% <20% 20% to 39% 40% to 59% 60% to 79% 80% to 99% 100% Don't know How much of the server-side code that you write is deployed to cloud environments today? (2015; Index: N = 55) Source: Forrester Business Technographics Infrastructure Survey, 2015 What percentage of your infrastructure is in the Public cloud? (2015; Index: N = 49) 14.5%
  • 8. 8 SuperChoice Requirements  Core Objectives: – Reduce costs and timeframes by automating provisioning infrastructure and deploying environments – Reduce operational costs with maintaining and supporting infrastructure and environments  Clouds: – Initially: AWS and VMware Private, Azure added in the last 6 months, investigating Google  Applications: – Rapidly growing list of apps (>200 currently) from adopting micro services architecture  VMs/Instances: – Averaging several hundred concurrent instances, varies considerably over time  Environments: – Multiple Development, Test and Client Acceptance Test environments  Frequency of updates: – Daily to Weekly
  • 9. 9 SuperChoice’s Overarching Strategy  Automatically deploying entire, complex software environments  Adopting a “Fix by Rebuild” approach  Supporting multiple cloud service providers independently
  • 10. 10 Key Benefits Targeted  Automate deployments ‘at scale’ of large sets of applications and infrastructure to a managed baseline in a timely manner  Deploy and test environments in approx. 60 minutes to enable moving from a Break-Troubleshoot-Fix model to a Fix-by-Rebuild model  Have repeatable and consistent deployments  Support high agility for environment provisioning for dev and test teams  Track environments and charge directly to the project team  Optimize costs by stopping instances not in use (e.g. scheduled to run only within business hours)  Choose the right Cloud for the Environment’s purpose
  • 11. 11 Adopt Cloud IaaS / Paas / SaaS capabilities Automate Infrastructure Provisioning Benefit Automation Capability Automate Environment Provisioning Straight replacement of physical infrastructure Uplift platform-level provisioning and management (for discrete components) Fully automate provisioning of integrated suites of applications and databases Cloud technologies have the ability to transform the way functionality is delivered while reducing costs
  • 12. 12 Control / Master Manufacture Use Dispose SCM Developer Continuous Integration Platform Management Source Scripts Libraries Reference Data Test Data Reference Data Management Tester Environment Config Release Management Dev Test Environments DevDevelopment Environments Production Environment Changes are applied to Environments by updating Automation Cloud Management Platform Automation Tools Configuration, Deployment and Compliance Testing tools Automation drives rethinking how we deliver capability
  • 14. 14 Public or Private Cloud Cloud Account Network (VPC/Vnet) Boundary Factory Nexus Master Confluence BitBucket Bamboo Bamboo Agents Other … Management DNS2SMTP DNS1 Logging Consul 1 Consul 2 Auto- mation Backup Jump- host Boundary Network Device (Cloud or appliance, e.g. Palo Alto) Inbound Proxy Outbound Internet Proxy Environment Environment Environment DMZ webserver webserver Business Application Servers App Environment Integration DMZ SFTP MQIPT Axway MQ App Data Tier (Master) Shared File Storage Application Database Application Database Application Database Ephemeral deployments managed fully by Fix-By- Rebuild. Deployments are “Cookie- Cutter” with no Configuration Variance, resulting in Simplicity and Repeatability Long-lived Data, retained through Environment rebuilds Long-lived Management Services Boundary Security Network Network Internet Network A Standardised Model  A standardised model for DataCentre components with standardised, segmented Network layout  Each ‘Cell’ is deployed using Automation, managed as a Unit  Lifecycle and management approach for each Cell tailored to the nature of the services  Repeat with as many Networks across as many Clouds as needed
  • 15. 15 Key Concepts / Approach  Information Model - model all of the information associated with an enterprise's environments. Baseline and keep separate from the execution  Software management and control disciplines applied to Infrastructure; “Infrastructure as code”  Take a manufacturing approach to building complex environments. Always go back to source and rebuild from the ground up  Fix by rebuild model, we don’t spend time fixing environments  Alter mindset around asset value
  • 16. 16 Leveraging RightScale CMP  RightScale as the Orchestration Engine or manufacturing engine (Multi-Cloud + Governance)  Establish RightScale Cloud Application Templates (CAT) for automated multi- cloud deployment: – Specific functional areas (eg SDN, DNS, FW, Management / App tier etc) – Generate CATs for specific purposes eg deployment models – Launch an application / environment
  • 18. 18 Lessons Learned Key Lessons:  CI/CD tools & processes are critical  Change Management must be a focus with respect to human resources  Cost to Value needs to be tracked. Favour a user pays approach and cost allocation model at the environment level  Concept of Brittleness in Infrastructure deployment (Embrace it)
  • 19. 19 Misconfigurations have a major impact on costs  80% of unplanned outages are due to ill-planned changes made by “operations staff” - IT Process Institute’s Visible Ops Handbook  60% of availability and performance errors are the result of misconfigurations - Enterprise Management Association  80% of outages impacting mission-critical services will be caused by people and process issues, and more than 50% of those outages will be caused by change / configuration / release integration and hand-off issues - Gartner Source: Downtime, Outages and Failures – Understanding their true costs, November 2015
  • 20. 20 What we have achieved so far with migrating to the Cloud  Addressed a lot of historical tech debt  Automated / migrated nearly 100% of our code including: – Core legacy application – 100% of new distributed micro services (IS’s)  De-commissioned 4 physical environments  Implemented software firewalls and cloud neutral backup capability  Spun up 5 (more on the way) dedicated Client test environments  Transitioned some staff  Upgraded security capability (and there’s more to come!) – Piloting Voice authentication  Upgraded the Build process
  • 21. 21 What’s been more difficult than we thought it would be  Order of operations – Which applications to migrate first?  Some lack of clarity on requirements – Trying to replicate “existing environments” when the requirements were implicit or poorly specified  Finding portable cloud technologies – The cloud is fairly AWS-centric, often difficult to find cloud solutions that were portable to other cloud providers  Running hybrid environments – cloud environments that have interconnectivity into our existing data centres  Getting some basics right: – Error reporting is slower than previously; takes an hour – Infrastructure changes were impacting code branches – Need to re-launch an environment when an application fails
  • 22. 22 What we found that surprised us  Approx. 40% of the efforts been in addressing tech debt  Benefits have been higher and costs at or lower (even after requiring greater external assistance)  Cloud service provider agnostic backups are not easy to do  Cloud Management Platforms (CMPs) are still a maturing technology  Demand for dedicated test environments much higher then expected  Cloud service providers are not that interested in what we are doing: – Focus on sole sourcing – “Adopt AWS, resistance is futile” attitude  Had to slow the pace of change to accommodate the team’s ability to cope: – Adopted small, regular milestones  Cloud environment support takes up a lot more time during transition
  • 23. 23 Biggest challenge is addressing the People issues  Building the understanding of how it all should work  Developing and upgrading new skills eg analytical and conceptual capabilities  Getting infrastructure / operations staff to start thinking like developers  Getting the Developers on board / caring about the Infrastructure: – Understanding how to use and taking on greater responsibility – Addressing Tech Debt issues
  • 24. 24 Observations from our experience to date Today’s Key Messages:  Automation is critical to staying sane  Accessing the right mindset and skills is important  Cultural change is the biggest barrier to success and benefits capture  Don’t under-estimate the amount of Tech debt that you’ll need to address along the way – No different to the early days of virtualisation  Moving to the cloud is not a straight lift and shift (where uplifting capability)  While it’s all new, taking a deliberate methodical approach works
  • 26. Thank you for your attention Any questions!