4. A Quick Check
: Yes, I know it all.
: Let’s give it a name !! After
all “what’s in a name” !!
: Now I don’t know it!! Need
to know about best practices,
Dos and Donts, etc.!!
5. Revisiting basics.
• Is very much contextual.
• Has no silver bullet.
• Must start, even if small.
• Grow it with need.
• Educate and train the team.
• Make it available, yet secure it.
7. The Requirement
• 125+ Microservices and 250+ Sparks jobs
• 4 environments
• Creating and managing various Git repos
• Ensuring DevOps readiness on repo creation
• 100+ developers needs access
• Spark jobs are not alike. The main class differs and specific to a job
• Some are streaming job, and some are batch
8. 3 Layered Lean DevOps Solution
Orchestrated
Modular
Data
Driven
Data Driven: Lots of meta data and log
data.
Modular: Jobs build with SRP principle
Orchestrated: Façade layer on top of
modular jobs.
9. Automation benefits
Orchestrated
Modular
Data
Driven
Instant readiness of new repo for CI/CD
Snapshot of build/deployment information
Infinite Microservice Repository
Infinite Spark Repository
Infinite Number of Environment
Any branch
Role specific jobs
Selective quality gates check for Microservices
and Spark jobs
On click migration to any environment
24. Disclaimer
All the images used in the PPT were taken from internet, and not the
property of the author of the PPT. Author has no ownership of these
images and has only, reused the images to make the PPT little
interesting.
Notas del editor
To change the image on this slide, select the picture and delete it. Then click the Pictures icon in the placeholder to insert your own image.