Em Campbell-Pretty gave a presentation on scaling agile practices to a large enterprise data warehousing program. The data warehouse contained over 80 TB of business data across 28 servers processing 400 million records daily. Campbell-Pretty described establishing agile teams, organizing them into a release train, and using SAFe principles and practices to coordinate their work. This resulted in delivery cycle times decreasing from 12 months to 3 months with weekly deployments, cost reductions of 70%, and improvements in quality, on-time delivery, and team satisfaction.
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
Scaling Agile Data Warehousing with the Scaled Agile Framework (SAFe)
1. Em Campbell-Pretty
Partner, Context Matters
@PrettyAgile
www.prettyagile.com
au.linkedin.com/in/ejcampbellpretty/
em@contextmatters.com.au
Scaling Agile Data
Warehousing with SAFe
Agile Denver Meetup
8th October 2015
2. THE ENTERPRISE DATA WAREHOUSE
80 TB of business data
28 Teradata nodes
3 TB of new data per month
350 SQL users
47 business systems feeding into the
EDW
400 million records loaded daily
13 billion records extracted daily
43 billion records in largest table
4 tables with over 35 billion records
124 different client apps
6.8 million queries daily
16K tables, 28K views
and 2K macros
7K jobs running daily
21K processes
13. Project
Manager
Product Owner
Business
Analyst Change Lead Technical Lead
Logical Data
Modeller
Physical Data
Modeller
Physical Data
Modeller
Vender Project
Manger
On Site ETL On Site ETL
On Site ETL Off shore ETL
Off shore ETL Off shore ETL
DBA
Business
Intelligence Test Lead
Test Analyst
Enterprise
Architect Data SME
Scrum Master
A 22 PERSON AGILE TEAM???
53. ü Average delivery cycle time down from 12 month to 3 months
ü Frequency of deployment increased from quarterly to weekly
ü Cost to deliver down 70%
ü 95% decrease in product defects
ü 99% projects delivered on time and on budget
ü Happy project sponsors (NPS +50)
ü Happy teams (NPS +56)
THE RESULTS
“This is probably the most well-scaled agile data
warehousing group I’ve ever observed, and they are
still getting better”
Ken Collier
Director of Agile Analytics at Thoughtworks
& author of Agile Analytics
54. Em Campbell-Pretty
Partner, Context Matters
@PrettyAgile
www.prettyagile.com
au.linkedin.com/in/ejcampbellpretty/
em@contextmatters.com.au
QUESTIONS?
WANT TO KNOW MORE?
Check out my blog: www.prettyagile.com
You can also download a free copy of my article on
“Scaling Agile Data Warehousing”
from the Cutter IT Journal using this link:
http://www.cutter.com/offers/campbellpretty.html