Agile Network India | Understanding the importance of a full featured CI/CD pipeline | Apurva Saxena

•

0 recomendaciones•79 vistas

AgileNetwork

Agile Network India | Understanding the importance of a full featured CI/CD pipeline by Apurva Saxena

Tecnología

UNDERSTANDING THE
IMPORTANCE OF A FULL
FEATURED CI/CD PIPELINE
© 2021 Apurva Saxena

Introduction
Who am I and what I do?
Who can benefit from this?
© 2021 Apurva Saxena

Background
Background of our Use Case.
Background on Build, Deployment and IT Operations for us.
Migrating to Cloud.
What we thought of DevOps and CI/CD pipeline when we initially started using these terms in
2016.
© 2021 Apurva Saxena

Problems
Engineers committing to
master without testing
their code.
Backward compatibility. Quality gates.
Stability of multiple
environments.
Promotion from one
environment to another
takes hours if not days.
Demos effects Sprint
tasks and energy of
Engineers.
Multiple Jenkins and
Spinnaker jobs to be
maintained.
Multiple tools to be
maintained.
Lot of resources are
required to manage all
of this manual work.
One bad commit could
halt development for
everyone.
© 2021 Apurva Saxena

What was our expectations?
CI should be like running water.
Quality gates should stop all bad code before merge to master.
Backward compatibility should be maintained by Automated test scripts.
There should be daily upgrades to our Prod environment via CD.
Engineers should not be bothered about Deployments to multiple environments or customers.
Each Engineer should have their own developer environment.
Model should be flexible and able to support for at least next 5 years and multiple clouds.
© 2021 Apurva Saxena

Previous Model of CI and CD
© 2021 Apurva Saxena

Decisions
Why we moved to GCP.
Why we removed Spinnaker from our new pipeline.
Why we kept Jenkins at heart of our CI/CD/CT pipeline.
Why we chose Git flow vs GitHub flow for Branching strategy.
Why we decided to keep just one Jenkins job for CI of all repositories.
Why we added merge check for pull requests.
Why we added Database scripts with same code repository.
Why we moved Configurations to database.
© 2021 Apurva Saxena

Developer Environment
A fully functional on-demand environment in
GKE for each Engineer.
Ability to do anything in that environment
without hampering work for anyone else.
Managed by Jenkins jobs so that not all
Engineers have to learn K8s.
© 2021 Apurva Saxena

Challenges &
Final thoughts
© 2021 Apurva Saxena

Más contenido relacionado

La actualidad más candente

2 years ago at DOES14, I presented “Vision Versus Execution: Implementing Continuous Delivery”. I shared how we achieved a big Continuous Delivery win – increasing software test coverage and delivery velocity and efficiency. Since then, we have been busy scaling DevOps, Continuous Delivery and Lean principles across teams and practices throughout Urban Science. This rollout included both a cultural aspect, as well as an implementation of a centralized, shared, self-service automation solution for our teams – enabling them to “opt-in” to an automated pipeline. In this talk I will present anecdotes and learnings gathered through our experience over the past two years and discuss the challenges and the value of scaling DevOps across the organization.

DOES SFO 2016 - Marc Priolo - Are we there yet?

Gene Kim

Create Software Design with unit testing, build user experience with UX testing, check definition of done with functional testing – all these are my day-to-day activities. Indeed, I am a developer who has found the value of testing to deliver quality software. In this presentation I share with you how I have come to use tests for: understanding the features, choosing the best user experience design, choosing the best technical solution, implementing the features and test them to create a reliable system. You will see practical examples of how tools like Jasmine, Spock, Geb are used for the above types of tests. You will see a project with test code and we will discuss how testing can effectively enhance your professional performance.

Developer Experience to Testing

Mozaic Works

The Shift Lift scope has broadened during the Age of the Customer. As well as testing it brings other activities forward in the software development lifecycle to enable faster release cycles. For larger enterprises this can be a big cultural challenge. In this talk we will explore the new Shift Left and how you can get business stakeholder buy-in to set up your team for success and gain a huge return on the upfront investment.

Embedding a Shift Left Culture in your Enterprise

Gerald Bachlmayr

Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis

AgileSparks

Have you been wondering about the rise of open-source alternatives to LoadRunner and other legacy performance tools? Why is there such a strong shift to open source performance testing? Here are key concepts that will allow you to make the transition from centralized testing with legacy tools to widely distributed testing with Apache JMeter and other open source tools. You’ll see how a small Center of Excellence (CoE) team can drive a 10x or 100x increase in testing by handing out logins to self-service tools instead of being a finite resource for test preparation and execution. Start Testing for Free. Create your free CA BlazeMeter account today. https://www.blazemeter.com/#signup

Moving to Open-Source Tools - How to Increase Performance Test Coverage Throu...

CA Technologies

This is the slide deck from our webinar with Jeff Downs, Principal Solutions Architect at Tasktop, and Gernot Brandl, Solutions Manager at Tricentis explaining and demonstrating the critical role of integration and automation when collecting defects from multiple sources, flowing defects round-trip to development for correction, and flowing requirements to test automation tools for efficiency and traceability.

Accelerate DevOps and Quality with Integration

Tasktop

SAP’s DevOps Journey: From Building an App to Building a Cloud Marc Ng, Cloud Infrastructure Engineering & Automation, SAP SAP has been using a DevOps & Continuous Delivery approach for building its web and mobile apps for several years, and is now building and running a global cloud at the scale needed to support the digital transformation needs of its customers. This talk recaps the story of how SAP originally adopted DevOps practices before moving on to describe how the Cloud Infrastructure Services team is building and operating its 3rd generation cloud automation system using microservices, containers and open-source software. DevOps Enterprise Summit San Francisco 2016

DOES16 San Francisco - Marc Ng - SAP’s DevOps Journey: From Building an App t...

Gene Kim

How to Use KPIs in an Agile Delivery Environment

VMware Tanzu

In this talk, we will cover important elements for successful CI and CD. We will discuss how these elements make CI and CD much simpler, and hence more attainable. We will cover some best practices / recommendations to include in your application pipelines. We will look at a sample implementation of a pipeline leveraging modern tools. Finally, we will discuss some forthcoming ideas for making it even easier to declaratively enable CI and CD for applications.

Delivery Pipelines as a First Class Citizen @deliverAgile2019

ciberkleid

Agile Framework in Large Enterprises

AJ Raashid

DevOps is not just for start-ups! However, scaling DevOps in large enterprises requires shifting of culture, coordination of work across teams, reinvention of legacy applications and much more. Before you undertake any change to improve your software development processes, you would want to learn from the person who has gone before you and tasted success. Join the conversation with Gary Gruver on our next DevOps drive-in webcast. Gary will share his best practices and recommendations from his groundbreaking work at HP and Macy's and talk about how to lead a successful DevOps transformation.

Serena DevOps Drive-in: Leading the Agile and DevOps transformation with Gary...

Serena Software

Connecting ALM Tools for a DevOps World with RLIA-TE

Tasktop

DevOps - Its just Agile done right

Tomas Riha

Automating Your Way to Greatness by Combining OutSystems CI/CD with the Power...

OutSystems

Testing in a DevOps team

Laurent PY

Harmonic's Journey Scaled-Agile In The New Generation of Cable OS v4

AgileSparks

From <a href="https://en.wikipedia.org/wiki/Site_reliability_engineering" target="_blank">Wikipedia</a>: Site reliability engineering (SRE) is a discipline that incorporates aspects of software engineering and applies that to operations whose goals are to create ultra-scalable and highly reliable software systems. Over the past year Acquia has built their own SRE team to help their products and services scale with the demand of our growing number of customers. We wish to share our experience so that others are enabled to do the same and reap the rewards. This presentation will discuss how the SRE team came about at Acquia, what achievements we have made so far, and the lessons we have learned along the way. We will then show the steps on how to introduce SRE to your workplace so you can deliver more reliable and scalable services to your customers! We will specifically cover: <ul> <li>SRE's basic concepts and history from Google</li> <li>The management support you will need to get started</li> <li>Introducing the idea of service level objectives and error budgets</li> <li>Operational Responsibility Assessments as a tool to measure risk</li> <li>Creating a Launch Readiness Checklist to standardize and improve product launches</li> <li>Finding ideal candidates for your SRE team</li></ul> The intended audience are software engineers, system administrators, and managers that have a desire to improve how they do their work and how their products/services perform.

A Crash Course in Building Site Reliability

Acquia

DevOps

Ozgur Oktan

Many companies are working to define their expectations for the SRE role and the SRE toolchain, which, like the role itself, continues to evolve. The tools SREs use at any given time will depend on where an organization is in their SRE journey. Less mature organizations will tend to use more specialized operations tools while more mature organizations will see more convergence between SRE and software engineering toolchains. So, while it’s certain that there’s no “one-size-fits-all” set of tools, teams will experiment with and adapt with the right tools as they seek new, efficient ways to bring greater reliability to everything they do. Join VictorOps, Grafana and InfluxData as we explore a couple of the basic tools your SRE team can set up to drive a culture of innovation and uptime. Attendees can expect to learn: Industry expectations around service reliability and availability How to create simple and lightweight representations of your systems for everyone in the organization How Grafana, InfluxData and VictorOps work together to create a system of engagement

Innovate Everywhere: Choosing the Right Tools When Building Your SRE Toolchain

DevOps.com

We won’t build your software for you, but we will transform *how* you build it, making your software delivery process better and faster. Join us to learn how Tasktop allows your disconnected tools to act harmoniously by automating collaboration, traceability, and visibility from ideation to production, enabling your organization to accelerate its business value delivery. Product Managers Cynthia Mancha and Trevor Bruner do a live demo to show you how Tasktop lets you: * connect your Lifecycle, DevOps and Database tools into a unified software delivery toolchain * scale to hundreds of projects in a matter of minutes * collaborate in context with attachment and comment synchronization

Transform software delivery with tasktop integration hub

Tasktop

La actualidad más candente (20)

DOES SFO 2016 - Marc Priolo - Are we there yet?

Developer Experience to Testing

Embedding a Shift Left Culture in your Enterprise

Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis

Moving to Open-Source Tools - How to Increase Performance Test Coverage Throu...

Accelerate DevOps and Quality with Integration

DOES16 San Francisco - Marc Ng - SAP’s DevOps Journey: From Building an App t...

How to Use KPIs in an Agile Delivery Environment

Delivery Pipelines as a First Class Citizen @deliverAgile2019

Agile Framework in Large Enterprises

Serena DevOps Drive-in: Leading the Agile and DevOps transformation with Gary...

Connecting ALM Tools for a DevOps World with RLIA-TE

DevOps - Its just Agile done right

Automating Your Way to Greatness by Combining OutSystems CI/CD with the Power...

Testing in a DevOps team

Harmonic's Journey Scaled-Agile In The New Generation of Cable OS v4

A Crash Course in Building Site Reliability

DevOps

Innovate Everywhere: Choosing the Right Tools When Building Your SRE Toolchain

Transform software delivery with tasktop integration hub

Similar a Agile Network India | Understanding the importance of a full featured CI/CD pipeline | Apurva Saxena

As companies race to uncover data insights that will deliver a sustainable competitive advantage, leaders in IT must find and implement measures that better facilitate the process of turning those data insights into consumable digital experiences. For organizations running mainframes, IT leaders must find ways to seamlessly integrate this system of record into their end-to-end application development, test, and delivery strategy.

Extend Agile and DevOps Practices Across Hybrid IT

DevOps.com

Developing Microservices Directly in AKS/Kubernetes

Chakradhar Rao Jonagam

Delivering value to the business faster thanks to Continuous Delivery and DevOps is the new mantra of IT organizations. In this webinar, CloudBees will discuss how Jenkins, the most popular open source Continuous Integration tool, allows DevOps teams to implement Continuous Delivery. You will learn how to: * Orchestrate Continuous Delivery pipelines with the new workflow feature, * Scale Jenkins horizontally in your organization using Jenkins Operations Center by CloudBees, * Implement end to end traceability with Jenkins and Puppet and Chef. http://devops.com/news/ci-and-cd-across-enterprise-jenkins/ https://github.com/CloudBees-community/vagrant-puppet-petclinic

CI and CD Across the Enterprise with Jenkins (devops.com Nov 2014)

CloudBees

Seven years ago, Apache Mesos was born as a platform to bring the distributed computing capabilities that powered the largest digital companies to the masses. Today, Mesosphere DC/OS technologies power more containers in production than any other software stack in the world, and has emerged as the premier platform for building and elastically scaling data-rich, modern applications and the associated CI/CD infrastructure across any infrastructure, public or private. GitLab is an end-to-end software development and delivery platform with built-in CI/CD, monitoring, and performance metrics. With a unified experience for every step of the development lifecycle and seamless integration with container schedulers, GitLab provides the most efficient approach to reduce cycle time, increase velocity, and improve software quality. In this webinar, you will learn how to combine DC/OS and GitLab to easily build a CI/CD infrastructure and build a complete CI/CD pipeline in minutes. Slides cover: 1. An introduction to Apache Mesos and Mesosphere DC/OS and overview of DC/OS features and capabilities for developing, deploying, and operating containerized applications, microservices and CI/CD 2. An introduction to GitLab 3. How to use DC/OS and GitLab to build a CI/CD solution and go from idea to production

Webinar: End-to-End CI/CD with GitLab and DC/OS

Mesosphere Inc.

Jenkins Workflow Webinar - Dec 10, 2014

CloudBees

Continuous delivery pipelines are, by definition, workflows with parallel job executions, join points, retries of jobs (Selenium tests are fragile) and manual steps (validation by a QA team). Come and discover how the new workflow engine of Jenkins CI and its Groovy-based DSL will give another dimension to your continuous delivery pipelines and greatly simplify your life. Sample workflow groovy script used in this presentation: https://gist.github.com/cyrille-leclerc/796085e19d9cec4a71ef Jenkins workflow syntax reference card: https://github.com/cyrille-leclerc/workflow-plugin/blob/master/SYNTAX-REFERENCE-CARD.md

Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)

CloudBees

Tanzu Developer Connect Workshop - English

VMware Tanzu

Virtual Developer Connect Workshop - English

VMware Tanzu

GCP Meetup #3 - Approaches to Cloud Native Architectures

nine

Everyone loves Agile and the way it is replacing all the older methodologies and development models with a streamlined and sustainable system for faster delivery cycles. However, the ever-prevailing Manual testing practice has always kept the QA teams from entirely adopting Continuous Integration and Continuous Delivery, making Agility unreachable. Fortunately, tools like Jenkins help reach the goals of the CI/CD pipeline, i.e., to maintain a continuous flow of software updates in production and shorter release cycles at reduced costs.

Using Jenkins as your go-to CI/CD tool

pCloudy

Ryan Betts [InfluxData] | Influxdays Keynote: Engineering Update | InfluxDays...

InfluxData

Journée DevOps : De l'intégration continue au déploiement continu avec Jenkins

Publicis Sapient Engineering

Faster, more Secure Application Modernization and Replatforming with PKS - Ku...

VMware Tanzu

Ancestry has more than three million paying subscribers and a collection of more than 20 billion records. The company moved its operations to the cloud to enable it to scale with its customer base and implemented CI/CD processes to facilitate rapid feature rollout. However, with rapid growth in both its user base and the range of products it provides, Ancestry was hard-pressed to ensure that it was achieving optimum performance, efficiency, and customer experience with its cloud applications, while also efficiently spending their cloud budget. With tens of thousands of components processing petabytes of data, there is a lot of room for underutilization and wastage. That leads into the cloud optimization presentation with Amir Sharif from Opsani, who will review the way Ancestry has leveraged AI to optimize cloud operations. Learn in this session how Ancestry and some of the largest enterprises have autonomously optimized thousands of their workloads across their service delivery platform, saving countless human hours and dollars, while delivering a better customer experience.

How ancestry used ai and ml for continuous, autonomous cloud optimization a...

SVDevOps

You’re at the Cloud Foundry Summit, which means you are by definition a cloud-native enthusiast. There’s no question that building apps in this architectural style will produce resilient, scalable software in an agile manner, and allow you to operate it far more efficiently than you’ve been able to in the past. But you’ve also got a whole lot of software in your company’s portfolio that isn’t there yet. Do you have to resign yourself to the pains of managing those applications the old way until you can finally refactor them to be cloud-native? Kubo to the rescue. You can run legacy applications on Kubo without significant refactoring – pure and simple. As an added bonus, it allows you to satisfy the CIO mandate of running containers (check). But it’s far more than that – running those workloads on Kubo offers advantages over running them on traditional virtualized infrastructure. This session covers those advantages –resource consolidation, health management, multi-cloud and more. It will also present the abstractions in Kubernetes, things like pods and stateful sets, that support running legacy workloads in the cloud environments that are far more distributed and changing than they have been in the past. It’s a first step to cloud-native.

Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native

cornelia davis

Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native

VMware Tanzu

Continous Delivery and Continous Integration at IKERLAN

Angel Conde Manjon

In celebration of Docker's 5th birthday in March, user groups all around the world hosted birthday events with an introduction to Docker presentation and hands-on-labs. We invited Docker users to recognize where they were on their Docker journey and the goal was to help them take the next step of their journey with the help of mentors. This presentation was done at the beginning of the events (this one is from the San Francisco event in HQ) and gives a run down of the birthday event series, Docker's momentum, a basic explanation of containers, the benefits of using the Docker platform, Docker + Kubernetes and more.

Docker Bday #5, SF Edition: Introduction to Docker

Docker, Inc.

Docker Birthday #5 Meetup Cluj - Presentation

Alex Vranceanu

DevOps is a movement, a vision and a series of processes. But at its core, the right technology needs to be in place to make it a coordinated and efficient practice. In this webinar, we discuss the challenges related to a number of legacy tools and why it makes sense to upgrade to more complete toolsets. Join us as we discuss the strategic gains and day-to-day improvements that can be realized from deploying enterprise scale continuous delivery with CloudBees Jenkins Platform. We will also explain the practicalities of a migration to enterprise-scale Jenkins, from planning to execution – as well as the results that enterprises can expect to gain when complete. Attendees will learn: - The challenges of legacy DevOps tools - Planning a migration to newer DevOps tools - Tips and tricks for a smooth migration - The benefits of upgrading to the CloudBees Jenkins Platform Presenters: Kari Price, Director, Partner Marketing, Cloudbees Sanil Pillai, Director, Infostretch Labs, Infostretch

Moving from Legacy Development Tools to transformative DevOps with Enterprise...

Infostretch

Similar a Agile Network India | Understanding the importance of a full featured CI/CD pipeline | Apurva Saxena (20)

Extend Agile and DevOps Practices Across Hybrid IT

Developing Microservices Directly in AKS/Kubernetes

CI and CD Across the Enterprise with Jenkins (devops.com Nov 2014)

Webinar: End-to-End CI/CD with GitLab and DC/OS

Jenkins Workflow Webinar - Dec 10, 2014

Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)

Tanzu Developer Connect Workshop - English

Virtual Developer Connect Workshop - English

GCP Meetup #3 - Approaches to Cloud Native Architectures

Using Jenkins as your go-to CI/CD tool

Ryan Betts [InfluxData] | Influxdays Keynote: Engineering Update | InfluxDays...

Journée DevOps : De l'intégration continue au déploiement continu avec Jenkins

Faster, more Secure Application Modernization and Replatforming with PKS - Ku...

How ancestry used ai and ml for continuous, autonomous cloud optimization a...

Kubo (Cloud Foundry Container Platform): Your Gateway Drug to Cloud-native

Continous Delivery and Continous Integration at IKERLAN

Docker Bday #5, SF Edition: Introduction to Docker

Docker Birthday #5 Meetup Cluj - Presentation

Moving from Legacy Development Tools to transformative DevOps with Enterprise...

Más de AgileNetwork

ANIn Ahmedabad May 2024 | Sailing the Agile seas Leveraging Business Prioriti...

AgileNetwork

ANIn Mumbai May 2024 | Measuring Business Agility by Prashant Neharkar

AgileNetwork

ANIn Ahmedabad May 2024 | Reusability Using Agile by Pratik Patel

AgileNetwork

ANIn Chennai April 2024 |Agile Engineering: Modernizing Legacy Systems by Ana...

AgileNetwork

ANIn Chennai April 2024 |Beyond Big Bang: Technical Agility in Vintage Produc...

AgileNetwork

ANIn Gurugram April 2024 |Agile Adaptation: Driving Progress in Generative AI...

AgileNetwork

ANIn Noida Oct 2023 |AI Usage in Agile Transformation Journey by Kunal

AgileNetwork

ANIn Kolkata April 2024 |Ethics of AI by Abhishek Nandy

AgileNetwork

ANIn Kolkata April 2024 | AI Enabled Reflection in Agile Delivery by Indranil...

AgileNetwork

ANIn Gurugram April 2024 |Can Agile and AI work together? by Pramodkumar Shri...

AgileNetwork

ANIn Pune April 2024 |L&D Accelerating business growth by Mukta Nalke

AgileNetwork

ANIn Pune April 2024 | Meeting Modern Learning Needs with Innovation by Ankit...

AgileNetwork

ANIn Ahmedabad April 2024 | Powering Big Wins with Small, Agile Teams by Yoge...

AgileNetwork

ANIn Coimbatore March 2024 | Unlocking Agility with Gen AI by Balaprasanna S

AgileNetwork

ANIn Coimbatore March 2024 | Agile & AI in Project Management by Dhilipkumar ...

AgileNetwork

ANIn Chennai March 2024 |Conversational AI for Agility in Healthcare by Shine...

AgileNetwork

ANIn Chennai March 2024 |Oxygenating AI ecosystem with Agility by Gowtham Bal...

AgileNetwork

ANIn Ahmedabad March 2024 | The Power of Retrospection by Rakesh Mehta

AgileNetwork

ANIn Pune March 2024 | Customer Stratification for Business Growth by Manish ...

AgileNetwork

ANIn Coimbatore July 2023 | Business Agility in Data Science by Dr.Selvaraaju...

AgileNetwork

Más de AgileNetwork (20)