As part of key IT initiatives to improve customer experience, reduce IT costs, ensure compliance and increase reliability, Akbank took on an audacious project to apply DevOps principles and an Agile approach as standard across all of the bank's applications, including customer-facing, branch infrastructure, multi-channel architecture and mainframe areas. Building a tool chain that covers project initiation through to deployment in production in such a complex environment is a challenging task. Akbank chose to link its existing toolset using CA Release Automation as a Continuous Delivery backbone, with CA Harvest and CA Endevor to manage source code, build and package tasks. This session will explore the vision to improve the development cycle, as well as the requirements for the project, and ultimately the benefits being realized.
For more information, please visit http://cainc.to/Nv2VOe
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Applying DevOps from the Mobile to the Mainframe
1. Applying DevOps from the
Mobile to the Mainframe
N. İlker Altıntaş PhD
DevOps: Continuous Delivery
Senior VP, IT Architecture and Core Banking
November 2015, Las Vegas
DO4X155S
@ilkeraltintas
2. Agenda
Akbank Overview
IT Overview
Technology Landscape, Key Figures, IT Strategies
Continuous Delivery
DevOps Objectives
Solution Approach
Why CA & Project Scope & Where We Are
1
2
3
4
5
6
7
Lessons Learned8
3.
4. A talented team of developers, business analysts, functional
and technical architects working close with business teams
IT Governance &
CIO Office
Infrastructure
Application Development
Architecture
& Core
Banking
Payment
Systems
Direct
Banking
High Level Organization
Strong infrastructure team managing different technologies
with intensive attention targeting highest availability
Transversal structure for managing all IT governance and
administrative activities together with project management and
quality assurance tests
Akbank IT IT Overview
5. Akbank IT IT Overview – Application Delivery
• 900 IT personel, +500 developers, +100 testers
• +50 Application Delivery competency center
• Waterfall & Scrum
• DevOps and Change Management teams
• Competitive Market to push frequent deployment
6. Akbank IT Technology Landscape
Presentation
Layer
Middle
Layer
Backend
Layer
Direct Branch
Multi Channel Architecture
Distributed
Systems
IBM
Mainframe
IBM BPM
BSA
Java
JEE
WAS
Unix
CICS
COBOL
Z/OS
Unix
Tibco
Unix
Android/IOS/Windows Apps
Mobile Web
Asp.net MVC
Asp.net MVC
Java Swing
DEV
INT
UAT
PREPROD
PROD
hourly
daily
weekly
monthly
7. 9370
deployments to live
stage in 2015
Target
Fast, reliable and
continous deployments
to test stages
Bi-weekly (dependency-
managed) multi-layer
deployments
793minutes
outage in live in 2015
360minutes
outage in live after deployment in
2015
Target
%20 improvement
every year for deployment origin
outage
Akbank IT Key Figures
Target
Reduce time to market %40
23 big (10.3 months) projects
65 mid (7,9 month) projects
58 small (6,3 month) projects
5000+ minor release
35strategic programs
in 2015
140K per./day yearly dev. cap.
8. Akbank IT Strategies
Digitalization
Agile and
Industrial IT
Innovative IT
«State-of-the-Art»
Infrastructure & ArchitectureMobile Bank
Industrial Bank
Analytic Bank
Cybersecurity
“Time-to-Market”
Continuous Service
Optimum Cost
Production Quality
“Business Enablement”
Compliance & Regulations
• Mobile for customers & employees
• Best mobile app and experience
• Point of sales digital applications
• Holistic digitalization approach:
products & process
• “Bottom-up” analytical culture
• Analytically embedded apps and processes
• New trends and technologies- big data
• Customized banking via «customer insight»
• Fast, systematic, lean, efficient processes and apps
• Visionary approach to support industrialized sales
• End-to-end digitalization (STP)
• Application and infrastructure modernization
• Flexible service base aligned with digital vision
• Renewals and/or preparations of critical apps
• “Lean”, “Agile” and “Automated”
• New ways and standard approaches synthesis
• «Continuous Delivery»
• «Traditional» vs. «exploratory» projects
• «Bottom-up» innovation culture creation
IT strategic roadmap 2015-2017: towards the digital era «Now & Easy»
10. DevOps and Architecture Management
IT Reference Architecture
Application Architectures
Agile DevOps
Product
Backlog
DEV INT UAT PREPROD PROD
complies
Deployable
units
Development
units
Continous
delivery
DevOps
Plan &
Measure
Release &
Deploy
Develop &
Test
Monitor &
Optimize
12. Solution Approaches
• Automation in software development lifecycle
• Standardized software development and runtime stages
• Keeping relation between business requests, source code changes and deployment
packages in JIRA
• Managing multi-layered platforms as a whole
• Managing test runtime environments and test data
13. Solution Approaches (cont.)
• Improving the productivity by increasing the speed of build and deployment
• Error-free change management operations
• Providing easy-to-use IDE integrations
• Tracing code quality metrics and using test automation
• Supporting heterogenous technologies
14. Tool sets covering the
requirements both for
distributed and mainframe
platforms
Passionate, project
adoption and desire for
success
Knowledgeable
consultancy
for DevOps
Why ?
15. SCM & Continous
Integration
IT ERP Task
Management
Continous Build Continous
Deployment
Test Automation Test Data
Management
Test Runtime
Management
IBM Mainframe
(core banking)
CA Endevor Atlassian Jira CA Endevor
CA Release
Automation
Distributed
Backends
(BSA)
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Middlelayer
(MCA)
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Branch UI
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Direct Internet UI
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Mobile
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
TechnologyPlatforms
Phase 1
(Current Project Scope)
Phase 2
Designing The Journey
16. Project
Management
Release Planning :
• Business Prioritization
• IT Prioritization
Release Management Plan
• Analysis
• Design
• Development
ITSM
Release Execution :
• Release ID
• JIRA Trunk Tasks
Sub Tasks
• Analysis subtasks
• Design subtasks
Development
Tasks Creation
DevOps and IT ERP
CA Harvest
CA Endevor
Meister
Product
Backlog
DEV
CA Release
Automation
INT UAT PREPROD PROD
Runtime
Stages
Continuous Integration Continuous Deployment Continuous Deployment Continuous Deployment Continuous Delivery
Build
Quality Check
Deploy
Automated Test
IT ERP Update
Build
Deploy
Automated Test
IT ERP Update
Build
Deploy
Automated Test
IT ERP Update
Build
Deploy
Automated Test
IT ERP Update
17. Starting a DevOps Competency Center
DevOps Competency Center
Responsibilities
Leadership
Manage organizational
transformation
Define mision and goal
Engage stakeholders
Mentorship &
Communication
Establish communication
across teams
Manage training sessions
Provide mentorship
support for pilot domains
Tooling
Assess tooling options
Implement tooling
solutions for build,
deployment, test
automation, reporting,
monitoring, and measuring
Process
Optimization &
Automation
Evaulate existing
processes, find out
reuasble assets
Discover quickwin
opportunities and
implement
Design to-be process with
process owners
Best Practices
Run small experiments to
decide which approach is
the best for the
organization
Present to others the best
practices and success
stories
Identify and solve the
problem cases before
application development
teams use
18. SCM & Continous
Integration
IT ERP Task
Management
Continous Build Continous
Deployment
IBM Mainframe
(core banking)
CA Endevor Atlassian Jira CA Endevor
CA Release
Automation
Distributed
Backends
(BSA)
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Middlelayer
(MCA)
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Branch UI
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Direct Internet UI
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
Mobile
CA Harvest Atlassian Jira
Openmake
Meister
CA Release
Automation
TechnologyPlatforms
Where We Are?
19. BEFORE NOW
SCM & CI
IT ERP Task Man.
Continous Build
Continous Deployment
TFS CA Harvest
None Jira
Custom Solution
None, Script Based CA Release Automation
Openmake Meister
Middle Layer (Multi Channel Architecture)
20. IBM Mainframe
BEFORE NOW
SCM & CI
IT ERP Task Man.
Continous Build
Continous Deployment
ASG CCC CA Endevor
None Jira
ASG CCC
None CA Release Automation
CA Endevor
21. BSA (Distributed Backend System)
BEFORE NOW
SCM & CI
IT ERP Task Man.
Continous Build
Continous Deployment
SVN CA Harvest
None Jira
Cruise Control
None, Script Based CA Release Automation
Openmake Meister
22. Branch UI (AkbankFace System)
BEFORE NOW
SCM & CI
IT ERP Task Man.
Continous Build
Continous Deployment
TFS TFS
TFS TFS
TFS Build Server
None CA Release Automation
TFS Build Server
23. Build and Deployment Dashboards
BSA & MCA platforms build dashboard (OpenMake Meister)
BSA platform deployment dashboard (CA Release Automation)
24. Organization
training
coaching
scm trouble shooting
Mentoring
Designing & Developing Automation
Release trouble shooting
Driving culture change
Designing processes
Empowering as champions
Leaning application structure
Designing topologies to
support «continous»
Getting operation support
Designing deployment automation
Designing provision processes
Stabilizing run times
Driving test automations
Preparing test data
Optimizing test approvals
Designing ITSM processes
Providing toolset for deployments
Development
Delivery
Continuity
DevOps
Competency
Center
Developers
Change Managers
Testers Domain Change Managers
LOB Release Managers
System Admins
Architects
26. • Start with a mature project, which results in early success
• Don’t be put off if you hit a pothole
• DevOps will challenge your processes
• Agile is a must for Devops programs
• Culture change is needed for success, create a culture of
«continous improvement»
• DevOps is a journey not a final destination
Lessons Learned