SlideShare a Scribd company logo
1 of 30
Download to read offline
The Reality of Managing
Microservices in Your CD Pipeline
Speakers – Experts in all things CD
Tracy Ragan, CEO & Co-founder
Microservices and Pipeline Evangelist,
Expert in microservice management.
Board Member CD Foundation, DevOps
Institute Ambassador.
Brendan O’Leary, DevOps Evangelist, GitLab
CI/CD and Jira expert. Passion for software
development and iterating on processes. Highly
focused on the end user’s experience.
Microservices are Taking Over
86% of development professionals internationally expect microservices to
become the default application architecture within the next five years.
Martin Henley, SD Times, 9/19
Its not a question of “if.” Its a question of “when.”
Key Takeaways:
q Build - Application configuration at
compile/link goes away.
q Deploy and Test - Microservices are
independently deployed.
q Orchestrate - The number of CD
Pipelines explode.
q Configuration Management – Tracking
and versioning microservices and their
usage will be critical and a new step in
the CD Pipeline.
The Way We Put Software Together is Broken
"What happened is we would release an update to a library, and
then one service would use the new service and now all of a
sudden all these other services were using an older version and
we had to try to keep track of which service was using what
version of the library."
Alexandra Noonan, Software Engineer, Segment
SDTimes April 2019 "Microservices: More isn't always better”
Microservice development “falls apart without coherent, disciplined
management”
Randy Heffner, VP and Research Analyst, Forrester
“3 Big Mistakes When It Comes to APIs and Microservices,” Akana Webinar
A massive disruption in how we write and deliver software
Container Orchestration:
An open source platform
from Google for
orchestrating containers
across clusters of servers
providing auto scaling and
fault tolerance.
Containers and Docker:
A container is a standard
unit of software that
packages up code and all
dependencies so the
application runs quickly
and reliably.
Microservices:
An architectural style that structures an
application as a collection of loosely
coupled services.
In a microservices architecture,
services are fine-grained and
independently deployable.
Let’s Talk Modern Architecture
Think small snippets of code.
• A service should implement a small set of strongly related functions;
• Services that change together should be packaged together;
• The Service can be changed without affecting clients;
• And, each team that owns one or more services must be autonomous. A team must
be able to develop and deploy their services with minimal collaboration with other
teams.
Chris Richardson of CloudFoundry
More on Microservices
• A service should implement a small set of strongly related functions;
• Services that change together should be packaged together;
• The Service can be changed without affecting clients;
Where are you in your microservice
implementation journey?
Poll Question 1
Increase Operational Efficiencies
One consistent view and collaboration space for Dev, Ops, and Security teams
Public cloud independent, deploy anywhere, SaaS and/or self-managed
Deliver Better Products Faster
Ability to work in parallel, get feedback and not have to wait on other teams
Automate testing, security, deployments to minimize manual intervention
Assess and resolve security, compliance, and code quality issues at the point of code change
Reduce Security and Compliance Risk
Decrease security exposure, cleaner and easier audits, reduce disruptions
What’s needed for digital transformation?
Today’s software delivery landscape
Toolchain tax - multiple tools, fragile integrations, hard to scale, outages
With Microservices your Landscape Changes
Shifting to a modern architecture will
disrupt our traditional CI/CD pipeline.
Why is the CI/CD process disrupted?
Microservices are deployed independently
and that change impacts everything.
Builds are Different
Smaller code means smaller builds, if at all. Python
is interpreted.
Linking is done at runtime, not at compile/link time.
Builds will focus on creating a container.
+
Reality of Builds
Traditional Modern
DEV DEVPROD PROD
Reality of Builds
Less Control
The compile/link step assembles the
complete ‘application’ package to pass
to Test and Prod. Library configuration
management decision making is done
here. This is the hear of CI.
Microservices are loosely
coupled and linked at runtime
via APIs. Configuration
information is buried in
Kubernetes Deployment files or
Helm files.
• A service should implement a small set of strongly related functions;
• Services that change together should be packaged together;
• The Service can be changed without affecting clients;
If you are writing microservices, what
language are you using?
Poll Question 2
Independently
Deployable
Because Microservices are independently
deployable - they should have their own
Repository and Workflow. Your application
will workflow will be replaced by many
microservice workflows.
Reality of Deployments
Loss of an Application Version and View
Multiple Workflows
To manage many moving parts, each
microservice will have their own repository
and CD Workflow. Orchestration of the CD
process will become increasingly critical.
Reality of Workflows
Multiple Workflows for a Single Application
• A service should implement a small set of strongly related functions;
• Services that change together should be packaged together;
• The Service can be changed without affecting clients;
Are you currently or planning to manage
each microservice in an independent
workflow?
Poll Question 3
Configuration
Management
Your application goes away, but a logical view is
of its configuration is critical. Mapping (with
versions) your service to service and application
to service dependencies replaces your
traditional software bill of material report.
Haunted Graveyards, Frankenstein
Clusters, when do we deprecate?
Reality of Configuration
Navigating the Deathstar
• A service should implement a small set of strongly related functions;
• Services that change together should be packaged together;
• The Service can be changed without affecting clients;
Are you tracking service to service or
application to service dependencies?
Poll Question 4
New Microservice Pipeline
Build
microservice
container
image
Continually track
service to service and service
to application configurations
Push a new
single
microservice
to the cluster
(Test, Prod)
Collect Feedback
Configuration reporting
identifies impact.
CD Pipeline
for each
microservice
Security Repo
Front End Repo
Product Catalog
Repo
Payment
Service Repo
Security Repo V1
Front End
Service V3
Product
Catalog Service
V5
Payment Service
V2
GitLab Workflow
GitLab Workflow
GitLab Workflow
GitLab Workflow
Application
Hipster Store
V2
Prod
Test
Dev
Hipster Store
microservices
Shifting with GitLab and DeployHub
Results
GitLab and DeployHub centralized reports
provides much needed visibility into containers
and what is running in your cluster
Container Image Build replaces
monolithic compile/link scripts
The GitLab delivery pipeline supports
independently deployable microservices
with 100s of workflows
DeployHub Configuration management is critical
to provide continuous mapping of service to
service and application to service relationships
(Your new BOM)
• DeployHub is a SaaS based central “Hub” for
sharing, managing and releasing microservices
• DeployHub tracks and shows the complete
application picture
• DeployHub simplifies the complexity of microservices
so organizations can achieve business agility
DeployHub – The First Microservice
Management Platform
DeployHub Team
Hosted Open Source
Ortelius.io
Open Source Project
We open sourced the mapping - DeployHub
Team is free and based on our Open source
Project – Ortelius.io
Microservices
Maturity
High level of re-use
and collaboration
Digital Transformation
Business Agility
Microservices
Initiatives
High Performance
Computing
Facilitates
collaboration
and reuse
Microservices
adoption
stages
DeployHub streamlines the microservices adoption journey
Reduced cost
- minimizes code redundancy
- Reduces confusion
- Reduced deployment cost
Increased Collaboration
-internal ‘marketplace’ of
microservices.
Data-Driven Decisions
- Service to Service Mapping
- Application versioning
Integrated into CD
- Automated configuration
management.
- Evolves the CD Pipeline for
microservice management.
Containerized
Applications and
traditional models
Tracking content and
microservice
relationships
Hybrid DeployDomains
Domain structure
to facilitate
microservice re-use
Independently
releases microservices
Organization
Map and
Deploy
Provides service to
service and
application to
service
relationships
mapping and
release.
Central Catalog of
microservices and
reusable components.
DeployHub facilitates microservice
collaboration and reuse as you mature
Typical starting points
Versioning
DeployHub – Benefits
Visibility gives Site
Reliability
Engineers the
knowledge of
what’s going on
and the ability to
make data-driven
decisions quickly
Automated
relationship mapping
saves 1-2 hours of
manual work per
week for every
development team
Microservice
sharing reduces
redundant coding
by up to 50% and
creates a flexible
and dynamic
ecosystem
The delivery
pipeline is
evolved to
support
microservices
without a costly
re-design
GITLAB IS REPLACING POINT TOOLS…
Project management
SCM
CI/CD
Issue tracking
Container registries
Logging
Dependency scanning
License management
AND ENABLING ENTIRELY NEW CAPABILITIES…
Concurrent development
Moving security forward (SecDevOps)
Seamless collaboration
Full accountability
Cycle time measurement
Transparency
Real-time feedback
...
A single, intuitive user experience, data model and integrations
Say Hello to GitLab - an entirely new thing
DevOps Best Practices Built In
Configure
your infra
Feedback
App
Security
DevOps Maturity
Faster releases, fewer
errors, lower costs
Digital Transformation
Faster time-to-market,
increased revenue
DevOps Initiatives
Better collaboration,
higher IT productivity
Holistic value
increases
with GitLab
adoption
DevOps
adoption
stages
GitLab streamlines the DevOps adoption journey
Reduced cost
- Single license
- Reduced maintenance
- Reduced integration costs
Auditability
- Single data store
Improved toolchain security
Speed of innovation
Improved compliance
Continuous improvement
visibility and analytics
- Cycle time analytics
- Single pane of glass visibility
Seamless collaboration
Developer experience
- Single interface
- Developer flexibility (movement
between projects/new toolsets)
Code reviews,
collaboration,
developer experience,
productivity
Security Dashboard,
Shift left Security
SecuritySCM CDCI
Automated
build/test pipeline,
quality and speed
Multi cloud,
flexible infrastructure,
infrastructure as code
Portfolio
Project
Backlog, sprint,
burndown, tracking
deliverable
Epics and roadmaps
enable visualizing and
prioritizing future work
Holistic value increases with GitLab
adoption
Typical starting points
Pricing
Team Pro Enterprise
Free $333
Per Project/Month
$160k
• Unlimited Projects
• Unlimited Users
• Unlimited Updates
• Unlimited Endpoints
• Restricted Domains
• Restricted Security
• No User Groups
• Single Project
• Unlimited Users
• Unlimited Updates
• Unlimited Endpoints
• Full Domain Hierarchy
• Secured Updates
• User and Group
Access Privileges
• Unlimited Projects
• Unlimited Users
• Unlimited Endpoints
• Unlimited Updates
• Full Domain Hierarchy
• Secured Updates
• User and Group
Access Privileges
API Developers publish
their microservices into
the Domain Catalog
allowing other developers
to easily find and reuse
the service. All meta data
is collected and
versioned.
How it Works
Application Developers define
their application by
associating which
microservices are used. They
also publish application
specific services. All
application level meta data is
collected and versioned.
DeployHub’s versioning engine
maps microservice versions to
the application versions that
consume them, with all
deployment meta data.
(Change Request, SHA, Helm
Chart, DB updates, env.
settings, etc. )
DeployHub feeds deployment data and
logic to deployment engines to update
independent microservices to the
cluster, based on application version
and service version.
DeployHub locks the deployment to
its backend engine, providing a
‘Single Source of Truth’ for what is
running in the cluster.

More Related Content

What's hot

App-First & Cloud-Native: How InterMiles Boosted CX with AWS & Infostretch
App-First & Cloud-Native: How InterMiles Boosted CX with AWS & InfostretchApp-First & Cloud-Native: How InterMiles Boosted CX with AWS & Infostretch
App-First & Cloud-Native: How InterMiles Boosted CX with AWS & Infostretch
Infostretch
 

What's hot (20)

Your Journey to the Cloud
Your Journey to the CloudYour Journey to the Cloud
Your Journey to the Cloud
 
App-First & Cloud-Native: How InterMiles Boosted CX with AWS & Infostretch
App-First & Cloud-Native: How InterMiles Boosted CX with AWS & InfostretchApp-First & Cloud-Native: How InterMiles Boosted CX with AWS & Infostretch
App-First & Cloud-Native: How InterMiles Boosted CX with AWS & Infostretch
 
Don't Let Technology Slow Down Your Digital Transformation
Don't Let Technology Slow Down Your Digital Transformation Don't Let Technology Slow Down Your Digital Transformation
Don't Let Technology Slow Down Your Digital Transformation
 
AWS Meetup: Career Day 2019 - Lightning Talk with Cloud Career Path: DevOps E...
AWS Meetup: Career Day 2019 - Lightning Talk with Cloud Career Path: DevOps E...AWS Meetup: Career Day 2019 - Lightning Talk with Cloud Career Path: DevOps E...
AWS Meetup: Career Day 2019 - Lightning Talk with Cloud Career Path: DevOps E...
 
Accelerate DevOps Transformation with App Migration to the Cloud
Accelerate DevOps Transformation with App Migration to the CloudAccelerate DevOps Transformation with App Migration to the Cloud
Accelerate DevOps Transformation with App Migration to the Cloud
 
XebiaLabs Overview Slides
XebiaLabs Overview SlidesXebiaLabs Overview Slides
XebiaLabs Overview Slides
 
How DevOps works in MOKA
How DevOps works in MOKAHow DevOps works in MOKA
How DevOps works in MOKA
 
Agile Certainty, bringing predictability in Agile engagements
Agile Certainty, bringing predictability in Agile engagementsAgile Certainty, bringing predictability in Agile engagements
Agile Certainty, bringing predictability in Agile engagements
 
Building a Bridge Between CI/CD and ITSM
Building a Bridge Between CI/CD and ITSMBuilding a Bridge Between CI/CD and ITSM
Building a Bridge Between CI/CD and ITSM
 
Operationalizing your Virtual Network: Getting to the Next Level with SDN/NFV...
Operationalizing your Virtual Network: Getting to the Next Level with SDN/NFV...Operationalizing your Virtual Network: Getting to the Next Level with SDN/NFV...
Operationalizing your Virtual Network: Getting to the Next Level with SDN/NFV...
 
Intro to dev ops and cloud services
Intro to dev ops and cloud servicesIntro to dev ops and cloud services
Intro to dev ops and cloud services
 
Code to Cloud: Three Trends for Faster, Safer Continuous Delivery
Code to Cloud: Three Trends for Faster, Safer Continuous DeliveryCode to Cloud: Three Trends for Faster, Safer Continuous Delivery
Code to Cloud: Three Trends for Faster, Safer Continuous Delivery
 
5 Steps to Developing Push-based Apps in the Age of Connected Devices
5 Steps to Developing Push-based Apps in the Age of Connected Devices5 Steps to Developing Push-based Apps in the Age of Connected Devices
5 Steps to Developing Push-based Apps in the Age of Connected Devices
 
Developer Marketing: Building Experiences
Developer Marketing: Building ExperiencesDeveloper Marketing: Building Experiences
Developer Marketing: Building Experiences
 
DevOps - The Key to Rapid Productization (Introduction to the 5C's of DevOps)
DevOps - The Key to Rapid Productization (Introduction to the 5C's of DevOps)DevOps - The Key to Rapid Productization (Introduction to the 5C's of DevOps)
DevOps - The Key to Rapid Productization (Introduction to the 5C's of DevOps)
 
DevOps Hits Adolescence – what’s next?
DevOps Hits Adolescence – what’s next?DevOps Hits Adolescence – what’s next?
DevOps Hits Adolescence – what’s next?
 
Cloud-native Data Platform Transformation | Accenture
Cloud-native Data Platform Transformation | AccentureCloud-native Data Platform Transformation | Accenture
Cloud-native Data Platform Transformation | Accenture
 
Measure Customer Value with Self-Service Observability
Measure Customer Value with Self-Service ObservabilityMeasure Customer Value with Self-Service Observability
Measure Customer Value with Self-Service Observability
 
Girls Can Do IT!
Girls Can Do IT!Girls Can Do IT!
Girls Can Do IT!
 
DevOps – Don’t Be Left Behind
DevOps – Don’t Be Left BehindDevOps – Don’t Be Left Behind
DevOps – Don’t Be Left Behind
 

Similar to The Reality of Managing Microservices in Your CD Pipeline

Chapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptx
Chapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptxChapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptx
Chapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptx
JerianMacatuggal
 

Similar to The Reality of Managing Microservices in Your CD Pipeline (20)

Automating Applications with Habitat - Sydney Cloud Native Meetup
Automating Applications with Habitat - Sydney Cloud Native MeetupAutomating Applications with Habitat - Sydney Cloud Native Meetup
Automating Applications with Habitat - Sydney Cloud Native Meetup
 
Containing your microservice sprawl
Containing your microservice sprawlContaining your microservice sprawl
Containing your microservice sprawl
 
A Guide on What Are Microservices: Pros, Cons, Use Cases, and More
A Guide on What Are Microservices: Pros, Cons, Use Cases, and MoreA Guide on What Are Microservices: Pros, Cons, Use Cases, and More
A Guide on What Are Microservices: Pros, Cons, Use Cases, and More
 
Architecting for speed: how agile innovators accelerate growth through micros...
Architecting for speed: how agile innovators accelerate growth through micros...Architecting for speed: how agile innovators accelerate growth through micros...
Architecting for speed: how agile innovators accelerate growth through micros...
 
Service Mesh Talk for CTO Forum
Service Mesh Talk for CTO ForumService Mesh Talk for CTO Forum
Service Mesh Talk for CTO Forum
 
Architecting for speed: how agile innovators accelerate growth through micros...
Architecting for speed: how agile innovators accelerate growth through micros...Architecting for speed: how agile innovators accelerate growth through micros...
Architecting for speed: how agile innovators accelerate growth through micros...
 
Whitepaper : Microservices In or Out
Whitepaper : Microservices   In or OutWhitepaper : Microservices   In or Out
Whitepaper : Microservices In or Out
 
Chapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptx
Chapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptxChapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptx
Chapter VI -CLOUD NATIVE AND EMERGENT TRENDS.pptx
 
Diving Into Docker
Diving Into Docker Diving Into Docker
Diving Into Docker
 
Microservice Best Practices The 8020 Way.pdf
Microservice Best Practices The 8020 Way.pdfMicroservice Best Practices The 8020 Way.pdf
Microservice Best Practices The 8020 Way.pdf
 
Twelve factor-app
Twelve factor-appTwelve factor-app
Twelve factor-app
 
#ATAGTR2020 Presentation - Microservices – Explored
#ATAGTR2020 Presentation - Microservices – Explored#ATAGTR2020 Presentation - Microservices – Explored
#ATAGTR2020 Presentation - Microservices – Explored
 
Application Centric Microservices from Redhat Summit 2015
Application Centric Microservices from Redhat Summit 2015Application Centric Microservices from Redhat Summit 2015
Application Centric Microservices from Redhat Summit 2015
 
Technology insights: Decision Science Platform
Technology insights: Decision Science PlatformTechnology insights: Decision Science Platform
Technology insights: Decision Science Platform
 
CWIN17 Utrecht / cg u services - frank van der wal
CWIN17 Utrecht / cg u services - frank van der walCWIN17 Utrecht / cg u services - frank van der wal
CWIN17 Utrecht / cg u services - frank van der wal
 
Evolving your Architecture to MicroServices
Evolving your Architecture to MicroServicesEvolving your Architecture to MicroServices
Evolving your Architecture to MicroServices
 
Think Small To Go Big - Introduction To Microservices
Think Small To Go Big - Introduction To MicroservicesThink Small To Go Big - Introduction To Microservices
Think Small To Go Big - Introduction To Microservices
 
Best Practices Building Cloud Scale Apps with Microservices
Best Practices Building Cloud Scale Apps with MicroservicesBest Practices Building Cloud Scale Apps with Microservices
Best Practices Building Cloud Scale Apps with Microservices
 
Cloud Native Architecture: Its Benefits and Key Components
Cloud Native Architecture: Its Benefits and Key ComponentsCloud Native Architecture: Its Benefits and Key Components
Cloud Native Architecture: Its Benefits and Key Components
 
Architecting for Scale
Architecting for ScaleArchitecting for Scale
Architecting for Scale
 

More from DevOps.com

Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
DevOps.com
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
DevOps.com
 

More from DevOps.com (20)

Modernizing on IBM Z Made Easier With Open Source Software
Modernizing on IBM Z Made Easier With Open Source SoftwareModernizing on IBM Z Made Easier With Open Source Software
Modernizing on IBM Z Made Easier With Open Source Software
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
 
Next Generation Vulnerability Assessment Using Datadog and Snyk
Next Generation Vulnerability Assessment Using Datadog and SnykNext Generation Vulnerability Assessment Using Datadog and Snyk
Next Generation Vulnerability Assessment Using Datadog and Snyk
 
Vulnerability Discovery in the Cloud
Vulnerability Discovery in the CloudVulnerability Discovery in the Cloud
Vulnerability Discovery in the Cloud
 
2021 Open Source Governance: Top Ten Trends and Predictions
2021 Open Source Governance: Top Ten Trends and Predictions2021 Open Source Governance: Top Ten Trends and Predictions
2021 Open Source Governance: Top Ten Trends and Predictions
 
A New Year’s Ransomware Resolution
A New Year’s Ransomware ResolutionA New Year’s Ransomware Resolution
A New Year’s Ransomware Resolution
 
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
 
Don't Panic! Effective Incident Response
Don't Panic! Effective Incident ResponseDon't Panic! Effective Incident Response
Don't Panic! Effective Incident Response
 
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's CultureCreating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
 
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with TeleportRole Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
 
Monitoring Serverless Applications with Datadog
Monitoring Serverless Applications with DatadogMonitoring Serverless Applications with Datadog
Monitoring Serverless Applications with Datadog
 
Deliver your App Anywhere … Publicly or Privately
Deliver your App Anywhere … Publicly or PrivatelyDeliver your App Anywhere … Publicly or Privately
Deliver your App Anywhere … Publicly or Privately
 
Securing medical apps in the age of covid final
Securing medical apps in the age of covid finalSecuring medical apps in the age of covid final
Securing medical apps in the age of covid final
 
How to Build a Healthy On-Call Culture
How to Build a Healthy On-Call CultureHow to Build a Healthy On-Call Culture
How to Build a Healthy On-Call Culture
 
The Evolving Role of the Developer in 2021
The Evolving Role of the Developer in 2021The Evolving Role of the Developer in 2021
The Evolving Role of the Developer in 2021
 
Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?
 
Secure Data Sharing in OpenShift Environments
Secure Data Sharing in OpenShift EnvironmentsSecure Data Sharing in OpenShift Environments
Secure Data Sharing in OpenShift Environments
 
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
 
Elevate Your Enterprise Python and R AI, ML Software Strategy with Anaconda T...
Elevate Your Enterprise Python and R AI, ML Software Strategy with Anaconda T...Elevate Your Enterprise Python and R AI, ML Software Strategy with Anaconda T...
Elevate Your Enterprise Python and R AI, ML Software Strategy with Anaconda T...
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 

The Reality of Managing Microservices in Your CD Pipeline

  • 1. The Reality of Managing Microservices in Your CD Pipeline
  • 2. Speakers – Experts in all things CD Tracy Ragan, CEO & Co-founder Microservices and Pipeline Evangelist, Expert in microservice management. Board Member CD Foundation, DevOps Institute Ambassador. Brendan O’Leary, DevOps Evangelist, GitLab CI/CD and Jira expert. Passion for software development and iterating on processes. Highly focused on the end user’s experience.
  • 3. Microservices are Taking Over 86% of development professionals internationally expect microservices to become the default application architecture within the next five years. Martin Henley, SD Times, 9/19 Its not a question of “if.” Its a question of “when.”
  • 4. Key Takeaways: q Build - Application configuration at compile/link goes away. q Deploy and Test - Microservices are independently deployed. q Orchestrate - The number of CD Pipelines explode. q Configuration Management – Tracking and versioning microservices and their usage will be critical and a new step in the CD Pipeline. The Way We Put Software Together is Broken "What happened is we would release an update to a library, and then one service would use the new service and now all of a sudden all these other services were using an older version and we had to try to keep track of which service was using what version of the library." Alexandra Noonan, Software Engineer, Segment SDTimes April 2019 "Microservices: More isn't always better” Microservice development “falls apart without coherent, disciplined management” Randy Heffner, VP and Research Analyst, Forrester “3 Big Mistakes When It Comes to APIs and Microservices,” Akana Webinar A massive disruption in how we write and deliver software
  • 5. Container Orchestration: An open source platform from Google for orchestrating containers across clusters of servers providing auto scaling and fault tolerance. Containers and Docker: A container is a standard unit of software that packages up code and all dependencies so the application runs quickly and reliably. Microservices: An architectural style that structures an application as a collection of loosely coupled services. In a microservices architecture, services are fine-grained and independently deployable. Let’s Talk Modern Architecture
  • 6. Think small snippets of code. • A service should implement a small set of strongly related functions; • Services that change together should be packaged together; • The Service can be changed without affecting clients; • And, each team that owns one or more services must be autonomous. A team must be able to develop and deploy their services with minimal collaboration with other teams. Chris Richardson of CloudFoundry More on Microservices
  • 7. • A service should implement a small set of strongly related functions; • Services that change together should be packaged together; • The Service can be changed without affecting clients; Where are you in your microservice implementation journey? Poll Question 1
  • 8. Increase Operational Efficiencies One consistent view and collaboration space for Dev, Ops, and Security teams Public cloud independent, deploy anywhere, SaaS and/or self-managed Deliver Better Products Faster Ability to work in parallel, get feedback and not have to wait on other teams Automate testing, security, deployments to minimize manual intervention Assess and resolve security, compliance, and code quality issues at the point of code change Reduce Security and Compliance Risk Decrease security exposure, cleaner and easier audits, reduce disruptions What’s needed for digital transformation?
  • 9. Today’s software delivery landscape Toolchain tax - multiple tools, fragile integrations, hard to scale, outages
  • 10. With Microservices your Landscape Changes Shifting to a modern architecture will disrupt our traditional CI/CD pipeline. Why is the CI/CD process disrupted? Microservices are deployed independently and that change impacts everything.
  • 11. Builds are Different Smaller code means smaller builds, if at all. Python is interpreted. Linking is done at runtime, not at compile/link time. Builds will focus on creating a container. + Reality of Builds
  • 12. Traditional Modern DEV DEVPROD PROD Reality of Builds Less Control The compile/link step assembles the complete ‘application’ package to pass to Test and Prod. Library configuration management decision making is done here. This is the hear of CI. Microservices are loosely coupled and linked at runtime via APIs. Configuration information is buried in Kubernetes Deployment files or Helm files.
  • 13. • A service should implement a small set of strongly related functions; • Services that change together should be packaged together; • The Service can be changed without affecting clients; If you are writing microservices, what language are you using? Poll Question 2
  • 14. Independently Deployable Because Microservices are independently deployable - they should have their own Repository and Workflow. Your application will workflow will be replaced by many microservice workflows. Reality of Deployments Loss of an Application Version and View
  • 15. Multiple Workflows To manage many moving parts, each microservice will have their own repository and CD Workflow. Orchestration of the CD process will become increasingly critical. Reality of Workflows Multiple Workflows for a Single Application
  • 16. • A service should implement a small set of strongly related functions; • Services that change together should be packaged together; • The Service can be changed without affecting clients; Are you currently or planning to manage each microservice in an independent workflow? Poll Question 3
  • 17. Configuration Management Your application goes away, but a logical view is of its configuration is critical. Mapping (with versions) your service to service and application to service dependencies replaces your traditional software bill of material report. Haunted Graveyards, Frankenstein Clusters, when do we deprecate? Reality of Configuration Navigating the Deathstar
  • 18. • A service should implement a small set of strongly related functions; • Services that change together should be packaged together; • The Service can be changed without affecting clients; Are you tracking service to service or application to service dependencies? Poll Question 4
  • 19. New Microservice Pipeline Build microservice container image Continually track service to service and service to application configurations Push a new single microservice to the cluster (Test, Prod) Collect Feedback Configuration reporting identifies impact. CD Pipeline for each microservice
  • 20. Security Repo Front End Repo Product Catalog Repo Payment Service Repo Security Repo V1 Front End Service V3 Product Catalog Service V5 Payment Service V2 GitLab Workflow GitLab Workflow GitLab Workflow GitLab Workflow Application Hipster Store V2 Prod Test Dev Hipster Store microservices Shifting with GitLab and DeployHub
  • 21. Results GitLab and DeployHub centralized reports provides much needed visibility into containers and what is running in your cluster Container Image Build replaces monolithic compile/link scripts The GitLab delivery pipeline supports independently deployable microservices with 100s of workflows DeployHub Configuration management is critical to provide continuous mapping of service to service and application to service relationships (Your new BOM)
  • 22. • DeployHub is a SaaS based central “Hub” for sharing, managing and releasing microservices • DeployHub tracks and shows the complete application picture • DeployHub simplifies the complexity of microservices so organizations can achieve business agility DeployHub – The First Microservice Management Platform DeployHub Team Hosted Open Source Ortelius.io Open Source Project We open sourced the mapping - DeployHub Team is free and based on our Open source Project – Ortelius.io
  • 23. Microservices Maturity High level of re-use and collaboration Digital Transformation Business Agility Microservices Initiatives High Performance Computing Facilitates collaboration and reuse Microservices adoption stages DeployHub streamlines the microservices adoption journey Reduced cost - minimizes code redundancy - Reduces confusion - Reduced deployment cost Increased Collaboration -internal ‘marketplace’ of microservices. Data-Driven Decisions - Service to Service Mapping - Application versioning Integrated into CD - Automated configuration management. - Evolves the CD Pipeline for microservice management. Containerized Applications and traditional models Tracking content and microservice relationships Hybrid DeployDomains Domain structure to facilitate microservice re-use Independently releases microservices Organization Map and Deploy Provides service to service and application to service relationships mapping and release. Central Catalog of microservices and reusable components. DeployHub facilitates microservice collaboration and reuse as you mature Typical starting points Versioning
  • 24. DeployHub – Benefits Visibility gives Site Reliability Engineers the knowledge of what’s going on and the ability to make data-driven decisions quickly Automated relationship mapping saves 1-2 hours of manual work per week for every development team Microservice sharing reduces redundant coding by up to 50% and creates a flexible and dynamic ecosystem The delivery pipeline is evolved to support microservices without a costly re-design
  • 25. GITLAB IS REPLACING POINT TOOLS… Project management SCM CI/CD Issue tracking Container registries Logging Dependency scanning License management AND ENABLING ENTIRELY NEW CAPABILITIES… Concurrent development Moving security forward (SecDevOps) Seamless collaboration Full accountability Cycle time measurement Transparency Real-time feedback ... A single, intuitive user experience, data model and integrations Say Hello to GitLab - an entirely new thing
  • 26. DevOps Best Practices Built In Configure your infra Feedback App Security
  • 27. DevOps Maturity Faster releases, fewer errors, lower costs Digital Transformation Faster time-to-market, increased revenue DevOps Initiatives Better collaboration, higher IT productivity Holistic value increases with GitLab adoption DevOps adoption stages GitLab streamlines the DevOps adoption journey Reduced cost - Single license - Reduced maintenance - Reduced integration costs Auditability - Single data store Improved toolchain security Speed of innovation Improved compliance Continuous improvement visibility and analytics - Cycle time analytics - Single pane of glass visibility Seamless collaboration Developer experience - Single interface - Developer flexibility (movement between projects/new toolsets) Code reviews, collaboration, developer experience, productivity Security Dashboard, Shift left Security SecuritySCM CDCI Automated build/test pipeline, quality and speed Multi cloud, flexible infrastructure, infrastructure as code Portfolio Project Backlog, sprint, burndown, tracking deliverable Epics and roadmaps enable visualizing and prioritizing future work Holistic value increases with GitLab adoption Typical starting points
  • 28.
  • 29. Pricing Team Pro Enterprise Free $333 Per Project/Month $160k • Unlimited Projects • Unlimited Users • Unlimited Updates • Unlimited Endpoints • Restricted Domains • Restricted Security • No User Groups • Single Project • Unlimited Users • Unlimited Updates • Unlimited Endpoints • Full Domain Hierarchy • Secured Updates • User and Group Access Privileges • Unlimited Projects • Unlimited Users • Unlimited Endpoints • Unlimited Updates • Full Domain Hierarchy • Secured Updates • User and Group Access Privileges
  • 30. API Developers publish their microservices into the Domain Catalog allowing other developers to easily find and reuse the service. All meta data is collected and versioned. How it Works Application Developers define their application by associating which microservices are used. They also publish application specific services. All application level meta data is collected and versioned. DeployHub’s versioning engine maps microservice versions to the application versions that consume them, with all deployment meta data. (Change Request, SHA, Helm Chart, DB updates, env. settings, etc. ) DeployHub feeds deployment data and logic to deployment engines to update independent microservices to the cluster, based on application version and service version. DeployHub locks the deployment to its backend engine, providing a ‘Single Source of Truth’ for what is running in the cluster.