The document discusses the principles and practices of CloudOps, which aims to apply DevOps principles to managing infrastructure and applications across multiple public and private clouds. It outlines some of the challenges of a multi-cloud environment and proposes a set of values and principles drawn from Agile and DevOps. These include culture, automation, lean processes, measurement, and sharing. It then provides examples of how these principles can be applied through practices like value stream mapping, source control for all artifacts, automated testing and validation pipelines, and dashboards for visibility. The goal is to establish continuous delivery of infrastructure and applications through standardized, measurable processes.

1. © Copyright 2018 Dell Inc.1

2. Stories From Field

3. © Copyright 2018 Dell Inc.3
- VP of IT
“I’m tired of hearing - I can’t do #*$&! because I’m
waiting on Infrastructure”
© Copyright 2018 Dell Inc.3

4. © Copyright 2018 Dell Inc.4
“We built a cloud that application owners don’t love?!”
- Dir of Infra (after $2M initiative )
© Copyright 2018 Dell Inc.4

5. © Copyright 2018 Dell Inc.5
“Server requests are
a black hole….”
- VP of Innovation
© Copyright 2018 Dell Inc.5

6. © Copyright 2018 Dell Inc.6
“I am perpetually stuck in reporting
and auditing on my cloud.”
- VP of Ops & Infra
© Copyright 2018 Dell Inc.6

7. © Copyright 2018 Dell Inc.7
“We have too many cloud projects, too many priorities.”
- VP of Ops & Infra
© Copyright 2018 Dell Inc.7

8. © Copyright 2018 Dell Inc.8
“We have too many cloud projects, and I don’t know
half of the things my folks are working on.”
- VP of Ops & Infra
© Copyright 2018 Dell Inc.8

9. © Copyright 2018 Dell Inc.9
“We are not delivering environments for new projects
fast enough. We are going to public cloud.”
- CIO
© Copyright 2018 Dell Inc.9

10. CloudOps
Leveraging DevOps Principles and Practices
in a Multi-Cloud Operating Model

11. © Copyright 2018 Dell Inc.11 © Copyright 2018 Dell Inc.11
“We are going to make IT Great Again!”
- Line of Business CIO

12. Matt Schneider
Chief Architect | Office of Strategy & Technology
@md_schneider
/in/mdschneider
http://blog.mdschneider.me
Manny Rodriguez
Chief Architect | Office of Strategy & Technology
@MannyRodP
/in/manuelrodriguezperez/
Don Demcsak
Solution Partner | Consulting Services
@DonDemcsak
/in/donxml
https://www.codedpipelines.io

13. © Copyright 2018 Dell Inc.13
Cloud frameworks…and the cloud journey…
NIST / Gartner
Characteristics of
cloud
Cloud is an
operating model
IaaS, PaaS, SaaS
© Copyright 2018 Dell Inc.13
SaaS for commodity
apps, i.e. email and HR
Private cloud solutions

14. © Copyright 2018 Dell Inc.14
Cloud frameworks…and the cloud journey…
NIST / Gartner ITaaS
Characteristics of
cloud
Cloud is an
operating model
IaaS, PaaS, SaaS
Service provider
methodology
Cloud broker
functions
(service catalog,
portals, charge/show –
back, CMPs)
© Copyright 2018 Dell Inc.14
SaaS for commodity
apps, i.e. email and HR
Private cloud solutions
ITSM Portal
Hybrid cloud solutions
Cloud teams

15. © Copyright 2018 Dell Inc.15
Cloud frameworks…and the cloud journey…
NIST / Gartner ITaaS Multi-Cloud
Characteristics of
cloud
Cloud is an
operating model
IaaS, PaaS, SaaS
Service provider
methodology
Cloud broker
functions
(service catalog,
portals, charge/show –
back, CMPs)
Supply / demand
Application centric
Cloud business
functions
(marketing , supply
chain models, arbitrage)
© Copyright 2018 Dell Inc.15
SaaS for commodity
apps, i.e. email and HR
Private cloud solutions
ITSM Portal
Hybrid cloud solutions
Cloud teams
Multiple public/hybrid
IT Busi Mgmt tools
PaaS, CaaS, FaaS

16. © Copyright 2018 Dell Inc.16
NIST /
Gartner
ITaaS Multi-Cloud
Multi-cloud brings complexity…
© Copyright 2018 Dell Inc.16
1. Multiple virtual private clouds – mini DCs
2. Multiple tools to consider (Orchestration, config mgmt,
cost mgmt, logging, network, etc)
3. New skills and org capabilities

17. © Copyright 2018 Dell Inc.17
NIST /
Gartner
ITaaS Multi-Cloud
Something is missing….
A set of values and principles
A set of new practices
© Copyright 2018 Dell Inc.17
?

18. DevOpsAgile
Cloud Guiding Principles

19. DevOpsAgile
Cloud Guiding Principles

20. © Copyright 2018 Dell Inc.20
“Agile” is everywhere…
“I’m a huge proponent of Agile because it takes
care of so many of the challenges that typically
exist between IT and the business.”
- Tom Miller , CIO Anthem Healthcare
“We do not think of Agile as an IT initiative, but
as an enterprise initiative.”
- Todd Sprinkle, CIO QVC
© Copyright 2018 Dell Inc.20

21. © Copyright 2018 Dell Inc.21
Comprehensive documentation
Manifesto for Agile Software Development…
Process and tools
Contract negotiation
Following a plan
…while there is value in the items on the right, we
value the items on the left more…
PRINCIPLES PRACTICES
Individuals and interactions
Working software
Customer collaboration
Responding to change
© Copyright 2018 Dell Inc.21

22. Agile DevOps
Cloud Guiding Principles

23. © Copyright 2018 Dell Inc.23
History of DevOps – An Infrastructure & Ops Response to Agile
2008
Andrew Schafer + Patrick
Debois discuss the topic of
“Agile Infrastructure.” at Agile
Conf in Toronto Debois and
Shafer formed an Agile
Systems Administrator group
on Google, with limited
success.
2009
O’Reilly Velocity Conference, two
Flickr employees—John Allspaw,
senior vice president of technical
operations, and Paul Hammond,
director of engineering—gave a
now-famous presentation titled,
“10+ Deploys per Day: Dev and
Ops Cooperation at Flickr.”
2010
2013
2010 brought 4 DevOpsDays
conferences. Including one in
Silicon Valley. In 2018 over 60
conferences are expected.
In 2013, the seminal book
”The Phoenix Project” was
released. A parable of the
values of DevOps was
introduced to the masses.
© Copyright 2018 Dell Inc.23

24. © Copyright 2018 Dell Inc.24
2 ways to look at principles from DevOps
Culture
Automation
Lean
Measurement
Sharing
Flow
Feedback
Learning
© Copyright 2018 Dell Inc.24

25. © Copyright 2018 Dell Inc.25
Mapping principles to practices…
Principles
Culture
Automation
Lean
Measurement
Sharing
?
?
?
?
?
Flow Practices
?
?
?
© Copyright 2018 Dell Inc.25

26. © Copyright 2018 Dell Inc.26
Our Vision for CloudOps
Public Cloud and Private Data Centers
are built and managed by pipelines that
are modeled after software development
best practices (SDLC)
This code-base creates a platform and
ecosystem focused on velocity through
quality
Code is new language of IT defining,
managing, and governing
features/functions, infrastructure,
configurations, integrations, quality, and
policy
The platform and ecosystem reflect
processes (“flow”) and enable people to
create more value, more quickly, at a
lower total cost.
Current
State
Future
Vision
© Copyright 2018 Dell Inc.26

27. Making IT Real

28. © Copyright 2018 Dell Inc.28
You Can’t Improve What You Don’t Measure
Value Stream Map IT Delivery
The ability to visualize non-visible work performed as an
IT change is processed thru the IT department is an
essential first step towards implementing CloudOps.
CALMS
Culture
Automation
Lean
Measurement
Sharing

29. © Copyright 2018 Dell Inc.29
How to Get Started With Value Stream Maps
• Pick an existing process
• Get everyone in a room that is responsible for the process, and the people that do the process
• Walk the flow from beginning to end, with everyone supplying the details on how it actually works,
not how we think it works
• Collect the various activities on sticky notes on a wall, include Lead Time (before the activity kicks
off) and Value Added Time (time it takes to do the activity)
• Calculate Total Value Added Time
• Calculate Total Lead Time
• Cycle Time is Total Value Added Time + Total Lead Time
CALMS
Culture
Automation
Lean
Measurement
Sharing

30. © Copyright 2018 Dell Inc.30
Improving products through measurement and
removing nonvalue work…Value Stream Mapping
Value Stream Mapping
A flowchart method to document a high-level
process to deliver a product or service –
including key process metrics - the analysis
of which helps us remove bottle necks and
waste in the process
Key Measures:
Lead time
Process time
%Complete and Accurate
SRC: https://www.lucidchart.com/pages/value-stream-mapping
© Copyright 2018 Dell Inc.30
You can’t improve what you don’t measure. The Process
Cycle Efficiency of an IT change is a metric you can leverage
from a Value Stream Map to continuously improve into a
CloudOps operating model.

31. © Copyright 2018 Dell Inc.31
Simple Value Stream Mapping
Process Cycle Efficiency (PCE) =
(Value Time / Total Time)
% Completed/Accurate?
© Copyright 2018 Dell Inc.31

32. © Copyright 2018 Dell Inc.32
You Can’t Improve Want You Don’t
Centralize , Share, and Audit
Everything as Code in Source Control
CALMS
Culture
Automation
Lean
Measurement
Sharing
The ability to centralize artifacts and track/audit changes
through code is an essential second step towards
implementing CloudOps.

33. © Copyright 2018 Dell Inc.33
You Can’t Improve Want You Don’t
Centralize, Share and Audit
vRA
Blueprint
code
Terraform
code
Cloud
Formation
code
Ansible
code
Code Repo
Functions:
• PULL
• MERGE
• COMMIT
• COMPARE
CALMS
Culture
Automation
Lean
Measurement
Sharing
vRA Terraform Ansible
Azure
ARM
Provides an centralized point for change visibility and
encourages sharing.

34. © Copyright 2018 Dell Inc.34
What about other types of “code”
Runbooks?
Install
docs?
CALMS
Culture
Automation
Lean
Measurement
Sharing
run-
books
install
docs
security
rules /
policy
Code Repo
Functions:
• PULL
• MERGE
• COMMIT
• COMPARE
Standardizes the way an Ops and Infra org works. Provides a
common approach with developers.

35. © Copyright 2018 Dell Inc.35
All flows from source version control….
VERSION
CONTROL
COMMIT
CREATE
CHANGE
• Orchestration code
• Enhancements/fixes
• Upgrades / Patches
• Configurations
• Documentation changes
Cloud code change
Testing and validation
Change management
Auditing
Security
Product Management
CALMS
Culture
Automation
Lean
Measurement
Sharing

36. © Copyright 2018 Dell Inc.36
You can’t improve what you don’t
automate and visualize
PRODUCTION
CHANGE
SECURITY, GOVERNANCE, COMPLIANCE
Dev Stage QA Stage UAT Stage
Gate Gate Gate
Pen Test
AUTOMATED POLICY VERIFICATION
DMZ Validation
Code Analysis
OWASP Tests
Firewalll
Validation
DB Config
Validation
Backup Config
Validation
Data Retention
Validation
SSL Cert
Validation
InfoSec
Validation
CALMS
Culture
Automation
Lean
Measurement
Sharing
VERSION
CONTROL
COMMIT
CREATE
CHANGE
• Orchestration code
• Enhancements/fixes
• Upgrades / Patches
• Configurations
• Documentation
changes
Orchestrate and streamline change management

37. © Copyright 2018 Dell Inc.37
You can’t improve what you don’t
automate and visualize
CALMS
Culture
Automation
Lean
Measurement
Sharing
Pipeline Dashboards
Commit UAT PROD
1.1
1.2
1.3
1.4
1.5
PRODUCTION
CHANGE
SECURITY, GOVERNANCE, COMPLIANCE
Dev Stage QA Stage UAT Stage
Gate Gate Gate
Pen Test
AUTOMATED POLICY VERIFICATION
DMZ Validation
Code Analysis
OWASP Tests
Firewalll
Validation
DB Config
Validation
Backup Config
Validation
Data Retention
Validation
SSL Cert
Validation
InfoSec
Validation
VERSION
CONTROL
COMMI
T
CREATE
CHANGE
• Orchestration
code
• Enhancements
/fixes
• Upgrades /
Patches
• Configurations
• Documentatio
n changes
Provides work visibility , prioritization, and provides a
feedback loop.

38. © Copyright 2018 Dell Inc.38
Starting the Pipeline with Feedback Loops

39. © Copyright 2018 Dell Inc.39
120,000,000 Users
© Copyright 2018 Dell Inc.39

40. © Copyright 2018 Dell Inc.40
Cloud Roadmaps
© Copyright 2018 Dell Inc.40

41. © Copyright 2018 Dell Inc.41 © Copyright 2018 Dell Inc.41

42. © Copyright 2018 Dell Inc.42
Building a Cloud Native Organization –
Two Paths
* Zone to Win: Organizing to Compete in an Age of Disruption -- Geoffrey A. Moore
Service Catalog
Management
Incident, Problem and
Event Management
Configuration
Management
Change, Release,
Validation, Testing,
Transition Planning
•Provide Level 1 and 2 support
•Operate and monitor services and
components
•Standardized
processes
•Centralized governance
and approval
•Standard, Normal and
Emergency change
defined
•Define and control service components
and relationships
•Self-Service Portal
•Driven by business relationship, demand and
service portfolio management
•Ordered offerings become APIs and frameworks
•Services are tailored to product
•Policy and standards are managed via automated tests
•Configuration managed, versioned, and stored as
code
•Manual checks replaced with automated tests; change
control meetings become exception-based only
•Continuous deployment capabilities in place
•Test efforts “shift left” with automation to provide faster
feedback
•Service teams own end-to-end process including support
staffed by Site Reliability Engineers
•Proactive monitoring solutions detect and act on incidents
based on automation rules
•Integrated auditing and change management
•“Immutable infrastructure”
Productivity Zone Transformation Zone

43. © Copyright 2018 Dell Inc.43
Building a Cloud Native Organization –
Functional vs Market (Cross function) Teams

44. © Copyright 2018 Dell Inc.44
Organizational
Plateau
© Copyright 2018 Dell Inc.44

45. © Copyright 2018 Dell Inc.45
Scaling CALMS – Measuring Capabilities
* https://devops-research.com/assessment.html
Technical
• Version Control
• Deployment Automation
• Continuous Integration
• Trunk-based Development
• Test Automation
• Loosely coupled architecture
• Empowered teams
• Test data management
• Security
Process
• Visibility of Customer
Feedback
• Understanding of value
stream
• Small batches
• Team experimentation
• Change approval
process
Measurement
• Monitoring
• Failure notification
• WIP Limits
• Visualization of work
Cultural
• Westrum organizational
culture
• Climate for learning
• Job satisfaction
DevOps Capabilities
CALMS
Culture
Automation
Lean
Measurement
Sharing

46. © Copyright 2018 Dell Inc.46
Dip in Improvement Curves
TIME TIME
“Big Bang” “Agile”
CALMS
Culture
Automation
Lean
Measurement
Sharing

47. © Copyright 2018 Dell Inc.47
Improving Capabilities (Example)
Capability Epics KPIs
Loosely Coupled
Architecture
• CD-based Change Management
• App Z Policy MVP
• App X Continuous Delivery MVP
• Change Failure Rate
• Mean Time to Recover
• Release Frequency
• Count of application using
mock/stub test patterns
• Count of apps/components
using 12-factor pattern
Change Management • App X Continuous Delivery
MVP
• Enterprise Architecture
Leadership Team
• Continuous Delivery based
Change Management
• Lead Time to Change
• Mean Time to Approve
• Change Failure Rate
• Deployment Frequency
Empowered Teams • Communities of Practice
• Continuous Delivery based
Change Management
• Release Process Telemetrics
• Enterprise Architecture
Leadership Team
• Tool Adoption Percentage
• Lead Time to Change
• Mean Time to Approve
• Mean Time to Extend Tool
Chain
• Unplanned Work Time
Counts
CALMS
Culture
Automation
Lean
Measurement
Sharing