SlideShare a Scribd company logo
1 of 29
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
SQL Server Club
6th of May 2008
Lausanne, Switzerland
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Consolidation Strategies for MS SQL Server
for Manageability and Efficiency of Enterprise Platforms
Charley Hanania
B.Sc (Computing Science), MCP, MCDBA, MCITP, MCTS, MCT
UBS Investment Bank
Charley.Hanania@gmail.com
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
General Overview
 Manageability and efficiency of platforms through
consolidation are key drivers in IT strategy.
 This session focuses on reviewing some of the guiding
principles of these drivers, as well as looking at what
things should be taken into account when looking at a
SQL Server consolidation strategy.
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Agenda
 Enterprise Rationalisation
 Keys Drivers to Success
 Technology Considerations
 Recap
 Questions
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Enterprise Rationalisation
 What are your drivers to Rationalisation?
 Service Delivery Quality Improvements
 Mergers and Acquisitions
 Business Model Design / Redesign
 Total Cost of Ownership (TCO) Reductions
 .
 .
 .
 General Business Profitability…
The Triggers…
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Enterprise Rationalisation
 Server Utilisation Rates
 5-10%
 10-15%
 15-20%
 Service Level Agreements not being met
 Active Directory reaching Capacity
 Monitoring Infrastructure Overloaded
 Resource (human) to Component ratio not optimal.
 Platform Stability & Standards a thing of Myth and Legend
 Root Cause Analysis
 Change Management
 Application Availability
Truth be told…
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Enterprise Rationalisation
Bad
Operational Habits
To sum it up
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Key Drivers to Success
 Long Term Strategies
 What are the key drivers of your organisation?
 What’s the Utopia of Operations for you?
 Don’t treat the rationalisation as a Project
 Turn it into a strategy
○ If your operations are healthy then your business will have a very
good chance at being guided by solid reasoning.
 Look at what IT needs to achieve, and architect the solutions
around what the technologies of the time can afford.
Lies not in the technologies…
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Key Drivers to Success
This won’t be easy…
The Strategy:
…But it is possible.
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Key Drivers to Success
Gartner Inc:
“…Poll Confirms Internal Politics is the Major
Problem Area for Server Consolidation
Rationalisation…”
John R Phelps, 1 Feb 2007
The Strategy:
“Train up a child in the way he should go and
when he is old, he will not depart from it.”
(Proverbs 22:6)
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Technology Considerations
Overriding approaches available currently…
Do Nothing
Server
Farms
Virtualise
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Technology Considerations
Don’t Consolidate…
Do Nothing
Server
Farms
Virtualise
 System too:
○ Critical
○ Complex
○ Badly Written
 System is:
○ Managed Externally (3rd Party)
○ Legacy
○ High Risk
 User Base is too Broad
○ Measuring true utilisation and risk is too difficult
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Technology Considerations
Virtualise…
Do Nothing
Server
Farms
Virtualise
 Why:
○ If CPU / Memory etc metrics show that you severely
underutilise hardware, then co-existence in VM's might
be slower but a viable approach.
 eg: if 8% CPU and 10% memory used on a server, then
going for an 8:1 consolidation ratio may be viable.
 Why Not:
○ OS Disk Space and Memory overhead,
abstraction/obfuscation of performance indicators.
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Technology Considerations
Server Farms… (“Databases as a Service”)
Do Nothing
Server
Farms
Virtualise
 Why:
○ Great Consolidation Ratios
○ SQL server manages its memory space well
 x64: a good option to better utilise memory and resources.
○ Pushes for simpler/better coded DB objects
○ Organisational discipline
 Long Term Benefit…
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Technology Considerations
Server Farms… (“Databases as a Service”)
Do Nothing
Server
Farms
Virtualise
 Why Not:
○ instance suffers from lowest common denominator, so if
a third party or legacy application needs to use SA,
you'll open up SA exposing all databases within the
instance.
 Other lockdown areas; xp_cmdshell, DAC, CLR etc
○ Object clashes within the instance scope; logins with
default databases, logins, database names, SSIS
packages
○ Database profile - OLTP, DSS, data warehouse, batch
jobs, etc.
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Technology Considerations
Server Farms… (“Databases as a Service”)
Do Nothing
Server
Farms
Virtualise
 Additional options:
○ Many DB's to one instance
○ Many instances per machine.
 Allows logical and configuration isolation for databases
within the instance
 if a hot fix is needed, then that hot fix can be focussed to
affect the smallest subset of databases.
 Why not:
○ slight capacity planning overhead on memory side.
 General Rule of Thumb is (memory - OS pool)/(x instances)
 Note: needs more detailed planning than general RoT
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Other Considerations
 Infrastructure
○ Many AD computer objects
○ SNMP traps or MOM/SCOM/Foglight events per server etc raise many more informational alerts
per OS than if all just on one.
○ Simpler view on scope of capacity issues or performance but many more to shift focus to.
○ Server racks, data centre space, etc, (licences, hardware, electricity, rental, sight rental etc)
 Operational
○ Patching
○ Tracking permission breaches or security vulnerabilities
○ Number of DBA's per server decreases or more DBA's / Operations Staff to handle many
servers
○ Difficult to maintain consistency plus control over the environment
○ Higher risk of component failure/ lower scope of impact
 Financial
○ DBA costs (MS DBA's cost as much as Oracle DBA's now!!)
○ Licensing costs-SQL/windows
○ hardware costs and maintenance agreements
○ Redundant hardware component costs
○ Server room space etc
Overhead of Many Servers…
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Other Considerations
 Infrastructure
○ Well… None!
 Operational
○ Structured approach to operations support
○ Stringent change control policies and communications
○ Concentration risk for outages on:
 Number of DB's within scope
 Instance
 Server
 Data Centre
○ Monitoring tools need to be well configured (thresholds and filters)
○ Adequate capacity planning tools and capacity management procedures
○ Application teams following a development framework (including induction process)
 Financial
○ Larger capacity servers to handle federated approach (CPU's, network cards, disks and disk arrays)
○ Possible investment in DR technologies (GEO clusters, SAN replication)
○ Investment in network abstraction technologies (Big IP/F5, DNS etc for failover or re-placement of DB's
○ Training
 Developer inductions on standards, best practices and procedures
 Admin inductions on procedures, policies and standards
Overhead of Fewer Servers…
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
“Core” Technical Considerations
 Server Level
○ SSIS packages
○ SQL Version
○ I/O Utilisation
○ Network Utilisation
 In / Out
○ Memory Utilisation
 Per Instance
○ Availability Needs
 Clustering
SQL Server Specific…
 Instance Level
○ Patch Levels
○ Collations
○ DB Names
○ Login Types
○ Linked Servers
○ Login Names
○ Login/User Privileges
○ Instance Options (Configuration Settings)
○ SQL Version
○ Number Of Users Connected
○ Availability Needs
 Clustering
 Replication
 Mirroring
 Inter-database Synchronisation
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
“Core” Technical Considerations
 Database Level
○ I/O Utilisation
 Temp DB
 Data
 Log
 Partitioning
○ Availability Needs
 Replication
 Log Shipping
 Mirroring
 Inter-database Synchronisation
○ DB Importance
 Recovery Priority/Sequence
SQL Server Specific…
 Operations
○ Provisioning Process (Provisioning Tool)
○ Database
○ Login / User Creation
○ Capacity Planning
○ Exceptional Feature Requests
○ Change Windows
○ Largest Tables
○ Special Needs eg: Partitioning
○ System Profile
○ Batched Runs
○ OLTP
○ Execution Times
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Performance Counters
Object Counter Instance
LogicalDisk % Disk Time _Total
LogicalDisk % Disk Time …Each Disk…
LogicalDisk Avg. Disk Queue Length _Total
LogicalDisk Avg. Disk Queue Length …Each Disk…
LogicalDisk
Current Disk Queue
Length
_Total
LogicalDisk
Current Disk Queue
Length
…Each Disk…
Memory Available Bytes
Memory Page Faults/sec
Memory Pages/sec
Network Interface Bytes Received/sec …Each Card…
Network Interface Bytes Sent/sec …Each Card…
Network Interface Output Queue Length …Each Card…
PhysicalDisk Avg. Disk Queue Length _Total
PhysicalDisk Avg. Disk Queue Length …Each Disk…
Process % Processor Time _Total
Process % Processor Time MsDtsSrvr
Process % Processor Time msftesql
Process % Processor Time SQLAGENT90
Process % Processor Time sqlbrowser
Process % Processor Time sqlservr
Process % Processor Time SqlWb
Process % Processor Time sqlwriter
Processor % Processor Time _Total
Processor % Processor Time …Each Processor…
Object Counter Instance
Processor % User Time _Total
Processor % User Time …Each Processor…
SQLServer:Buffer
Manager
Buffer cache hit ratio
SQLServer:Buffer
Manager
Page life expectancy
SQLServer:Buffer
Manager
Page reads/sec
SQLServer:Buffer
Manager
Page writes/sec
SQLServer:Gener
al Statistics
User Connections
SQLServer:Locks Lock Wait Time (ms) _Total
SQLServer:Locks Lock Waits/sec _Total
SQLServer:Memo
ry Manager
Connection Memory
(KB)
SQLServer:Memo
ry Manager
Memory Grants
Outstanding
SQLServer:Memo
ry Manager
Memory Grants Pending
SQLServer:Wait
Statistics
Log write waits Waits in progress
SQLServer:Wait
Statistics
Memory grant queue
waits
Waits in progress
SQLServer:Wait
Statistics
Page IO latch waits Waits in progress
System
Processor Queue
Length
Use the following Counters to baseline application workload profile
and measure ongoing capacity thresholds
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Recap
 Rationalising Server Estate is a key issue in most medium to large organisations.
 Generally, the issue isn’t Rationalisation itself, but why, and which tools and technologies
are suitable
 Using a mix of Virtualisation, Server Farms and bare metal Servers, SQL Server within
the enterprise can be managed effectively and efficiently.
 Operational efficiency and good operational habits are far more important in the SQL
Server Enterprise environment.
 Once good operational habits have been formed and engrained into the business model,
issues around SQL Server technologies, including rampant deployments will decrease,
and operations will be able to focus more on adding core technological value to the
business rather than meeting operational stability and Service Level metrics.
 When looking at reducing an SQL Server Estate, base lining, planning and monitoring for
capacity, performance and fault tolerance are the key technological focuses' that should
be built into the toolset for day to day operations.
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Topic Resources
 Whitepaper:
 Optimizing HP Servers with Microsoft SQL Server 2008.
 HP
 SQL Server Technical Article
 Server Consolidation with SQL Server 2008.
 Microsoft
 Whitepaper:
 A Pragmatic Approach to Server and Data Center Consolidation.
 Platespin
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Community
 Swiss PASS Chapter
 www.sqlpass-swiss.org
 Swiss IT Pro user group
 www.swissitpro.ch
 Monthly sessions in Zurich and Geneva
06 May 2008 SQL Club Meeting – Lausanne, Switzerland
Thank you…

More Related Content

What's hot

DataLogicIT - Steve Renalds 2016
DataLogicIT - Steve Renalds 2016DataLogicIT - Steve Renalds 2016
DataLogicIT - Steve Renalds 2016
Steve Renalds
 

What's hot (20)

Architecting your own DBaaS in a Private Cloud with EM12c (WP)
Architecting your own DBaaS in a Private Cloud with EM12c (WP)Architecting your own DBaaS in a Private Cloud with EM12c (WP)
Architecting your own DBaaS in a Private Cloud with EM12c (WP)
 
The Evolution of the Oracle Database - Then, Now and Later (Fontys Hogeschool...
The Evolution of the Oracle Database - Then, Now and Later (Fontys Hogeschool...The Evolution of the Oracle Database - Then, Now and Later (Fontys Hogeschool...
The Evolution of the Oracle Database - Then, Now and Later (Fontys Hogeschool...
 
Managing user Online Training in IBM Netezza DBA Development by www.etraining...
Managing user Online Training in IBM Netezza DBA Development by www.etraining...Managing user Online Training in IBM Netezza DBA Development by www.etraining...
Managing user Online Training in IBM Netezza DBA Development by www.etraining...
 
SQL vs NoSQL
SQL vs NoSQLSQL vs NoSQL
SQL vs NoSQL
 
Harnessing the power of both worlds
Harnessing the power of both worldsHarnessing the power of both worlds
Harnessing the power of both worlds
 
A to z for sql azure databases
A to z for sql azure databasesA to z for sql azure databases
A to z for sql azure databases
 
Vskills Apache Cassandra sample material
Vskills Apache Cassandra sample materialVskills Apache Cassandra sample material
Vskills Apache Cassandra sample material
 
A History of Oracle Corporation
A History of Oracle CorporationA History of Oracle Corporation
A History of Oracle Corporation
 
No sql
No sqlNo sql
No sql
 
Management data warehouse
Management data warehouseManagement data warehouse
Management data warehouse
 
DataLogicIT - Steve Renalds 2016
DataLogicIT - Steve Renalds 2016DataLogicIT - Steve Renalds 2016
DataLogicIT - Steve Renalds 2016
 
20100513brown
20100513brown20100513brown
20100513brown
 
Redis Cashe is an open-source distributed in-memory data store.
Redis Cashe is an open-source distributed in-memory data store.Redis Cashe is an open-source distributed in-memory data store.
Redis Cashe is an open-source distributed in-memory data store.
 
Evolution of the DBA to Data Platform Administrator/Specialist
Evolution of the DBA to Data Platform Administrator/SpecialistEvolution of the DBA to Data Platform Administrator/Specialist
Evolution of the DBA to Data Platform Administrator/Specialist
 
Comparison between rdbms and nosql
Comparison between rdbms and nosqlComparison between rdbms and nosql
Comparison between rdbms and nosql
 
Rittman endeca
Rittman endecaRittman endeca
Rittman endeca
 
Resume
ResumeResume
Resume
 
Pentaho and NoSQL
Pentaho and NoSQLPentaho and NoSQL
Pentaho and NoSQL
 
Datastage
DatastageDatastage
Datastage
 
Stretch Database
Stretch DatabaseStretch Database
Stretch Database
 

Viewers also liked

Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...
Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...
Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...
Charley Hanania
 
Tech days 2011 - database design patterns for keeping your database applicati...
Tech days 2011 - database design patterns for keeping your database applicati...Tech days 2011 - database design patterns for keeping your database applicati...
Tech days 2011 - database design patterns for keeping your database applicati...
Charley Hanania
 
Designing and developing your database for application availability
Designing and developing your database for application availabilityDesigning and developing your database for application availability
Designing and developing your database for application availability
Charley Hanania
 
Using ux to change company culture – london content strategy october 2012
Using ux to change company culture – london content strategy october 2012Using ux to change company culture – london content strategy october 2012
Using ux to change company culture – london content strategy october 2012
cxpartners
 
TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...
TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...
TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...
Charley Hanania
 

Viewers also liked (17)

Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...
Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...
Pass chapter meeting dec 2013 - compression a hidden gem for io heavy databas...
 
Comunicato n 12 16 dicembre
Comunicato n 12 16 dicembreComunicato n 12 16 dicembre
Comunicato n 12 16 dicembre
 
Tech days 2011 - database design patterns for keeping your database applicati...
Tech days 2011 - database design patterns for keeping your database applicati...Tech days 2011 - database design patterns for keeping your database applicati...
Tech days 2011 - database design patterns for keeping your database applicati...
 
Kits cadena distribución FAI
Kits cadena distribución FAIKits cadena distribución FAI
Kits cadena distribución FAI
 
SQLBits 2008 - SQL Server High Availability and Disaster Recovery Overview - ...
SQLBits 2008 - SQL Server High Availability and Disaster Recovery Overview - ...SQLBits 2008 - SQL Server High Availability and Disaster Recovery Overview - ...
SQLBits 2008 - SQL Server High Availability and Disaster Recovery Overview - ...
 
Designing and developing your database for application availability
Designing and developing your database for application availabilityDesigning and developing your database for application availability
Designing and developing your database for application availability
 
Using ux to change company culture – london content strategy october 2012
Using ux to change company culture – london content strategy october 2012Using ux to change company culture – london content strategy october 2012
Using ux to change company culture – london content strategy october 2012
 
AndroidPlaphoons Presentación Taller Bajo Coste 2015 Albacete
AndroidPlaphoons Presentación Taller Bajo Coste 2015 AlbaceteAndroidPlaphoons Presentación Taller Bajo Coste 2015 Albacete
AndroidPlaphoons Presentación Taller Bajo Coste 2015 Albacete
 
DEL “HUMANISMO” DE SARTRE AL “ANTI-HUMANISMO” DE HEIDEGGER_ DR. ADOLFO VASQUE...
DEL “HUMANISMO” DE SARTRE AL “ANTI-HUMANISMO” DE HEIDEGGER_ DR. ADOLFO VASQUE...DEL “HUMANISMO” DE SARTRE AL “ANTI-HUMANISMO” DE HEIDEGGER_ DR. ADOLFO VASQUE...
DEL “HUMANISMO” DE SARTRE AL “ANTI-HUMANISMO” DE HEIDEGGER_ DR. ADOLFO VASQUE...
 
Bajo Coste 2014 Taller Sintetizadores de voz gratuïtos y de calidad
Bajo Coste 2014 Taller Sintetizadores de voz gratuïtos y de calidadBajo Coste 2014 Taller Sintetizadores de voz gratuïtos y de calidad
Bajo Coste 2014 Taller Sintetizadores de voz gratuïtos y de calidad
 
Fanjac Girona conferència Luz Pérez "Altes capacitats a l'escola"
Fanjac Girona conferència Luz Pérez "Altes capacitats a l'escola"Fanjac Girona conferència Luz Pérez "Altes capacitats a l'escola"
Fanjac Girona conferència Luz Pérez "Altes capacitats a l'escola"
 
Proyecto IN-TIC: accesibilidad y tecnologías de apoyo para las personas con d...
Proyecto IN-TIC: accesibilidad y tecnologías de apoyo para las personas con d...Proyecto IN-TIC: accesibilidad y tecnologías de apoyo para las personas con d...
Proyecto IN-TIC: accesibilidad y tecnologías de apoyo para las personas con d...
 
Palabras que hablan - Matrakes esspacial - Projecte Fressa
Palabras que hablan - Matrakes esspacial - Projecte FressaPalabras que hablan - Matrakes esspacial - Projecte Fressa
Palabras que hablan - Matrakes esspacial - Projecte Fressa
 
TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...
TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...
TehDays Basel - Auditing in sql server 2012 - charley hanania - tech days bas...
 
Attenzione alle persone e cambiamento. La riforma al bivio
Attenzione alle persone e cambiamento. La riforma al bivioAttenzione alle persone e cambiamento. La riforma al bivio
Attenzione alle persone e cambiamento. La riforma al bivio
 
Insegnare a progettare il proprio apprendimento con il coding - Lezione 1
Insegnare a progettare il proprio apprendimento con il coding - Lezione 1Insegnare a progettare il proprio apprendimento con il coding - Lezione 1
Insegnare a progettare il proprio apprendimento con il coding - Lezione 1
 
Insegnare a progettare il proprio apprendimento con il coding - Lezione 2
Insegnare a progettare il proprio apprendimento con il coding - Lezione 2Insegnare a progettare il proprio apprendimento con il coding - Lezione 2
Insegnare a progettare il proprio apprendimento con il coding - Lezione 2
 

Similar to SQL Server Club - SQL Server Enterprise Consolidation - charley hanania

Sql server club - performance management methodologies and enhancements in sq...
Sql server club - performance management methodologies and enhancements in sq...Sql server club - performance management methodologies and enhancements in sq...
Sql server club - performance management methodologies and enhancements in sq...
Charley Hanania
 
Financial, Retail And Shopping Domains
Financial, Retail And Shopping DomainsFinancial, Retail And Shopping Domains
Financial, Retail And Shopping Domains
Sonia Sanchez
 
Sql server operational best practices notes from the field - charley hanan...
Sql server operational best practices    notes from the field - charley hanan...Sql server operational best practices    notes from the field - charley hanan...
Sql server operational best practices notes from the field - charley hanan...
Charley Hanania
 
Implementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCTImplementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCT
Khalid Tariq
 
Microsoft Sql Server 2016 Is Now Live
Microsoft Sql Server 2016 Is Now LiveMicrosoft Sql Server 2016 Is Now Live
Microsoft Sql Server 2016 Is Now Live
Amber Moore
 
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Aaron Shilo
 
AnalysisServices
AnalysisServicesAnalysisServices
AnalysisServices
webuploader
 

Similar to SQL Server Club - SQL Server Enterprise Consolidation - charley hanania (20)

Sql server club - performance management methodologies and enhancements in sq...
Sql server club - performance management methodologies and enhancements in sq...Sql server club - performance management methodologies and enhancements in sq...
Sql server club - performance management methodologies and enhancements in sq...
 
Financial, Retail And Shopping Domains
Financial, Retail And Shopping DomainsFinancial, Retail And Shopping Domains
Financial, Retail And Shopping Domains
 
Sql server operational best practices notes from the field - charley hanan...
Sql server operational best practices    notes from the field - charley hanan...Sql server operational best practices    notes from the field - charley hanan...
Sql server operational best practices notes from the field - charley hanan...
 
Implementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCTImplementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCT
 
My sql cluster case study apr16
My sql cluster case study apr16My sql cluster case study apr16
My sql cluster case study apr16
 
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015 2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
2015: Whats New in MySQL 5.7, At Oracle Open World, November 3rd, 2015
 
Should I stay or should I go?
Should I stay or should I go?Should I stay or should I go?
Should I stay or should I go?
 
Microsoft Sql Server 2016 Is Now Live
Microsoft Sql Server 2016 Is Now LiveMicrosoft Sql Server 2016 Is Now Live
Microsoft Sql Server 2016 Is Now Live
 
Sql Server tips from the field
Sql Server tips from the fieldSql Server tips from the field
Sql Server tips from the field
 
ADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data ArchitectureADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
 
What's New in MySQL 5.7
What's New in MySQL 5.7What's New in MySQL 5.7
What's New in MySQL 5.7
 
ADV Slides: Comparing the Enterprise Analytic Solutions
ADV Slides: Comparing the Enterprise Analytic SolutionsADV Slides: Comparing the Enterprise Analytic Solutions
ADV Slides: Comparing the Enterprise Analytic Solutions
 
BI Environment Technical Analysis
BI Environment Technical AnalysisBI Environment Technical Analysis
BI Environment Technical Analysis
 
MySQL 5.7: What's New, Nov. 2015
MySQL 5.7: What's New, Nov. 2015MySQL 5.7: What's New, Nov. 2015
MySQL 5.7: What's New, Nov. 2015
 
Benchmark Showdown: Which Relational Database is the Fastest on AWS?
Benchmark Showdown: Which Relational Database is the Fastest on AWS?Benchmark Showdown: Which Relational Database is the Fastest on AWS?
Benchmark Showdown: Which Relational Database is the Fastest on AWS?
 
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
 
AnalysisServices
AnalysisServicesAnalysisServices
AnalysisServices
 
KoprowskiT_SQLRelay2014#3_Bristol_FromPlanToBackupToCloud
KoprowskiT_SQLRelay2014#3_Bristol_FromPlanToBackupToCloudKoprowskiT_SQLRelay2014#3_Bristol_FromPlanToBackupToCloud
KoprowskiT_SQLRelay2014#3_Bristol_FromPlanToBackupToCloud
 
2010/10 - Database Architechs - Perf. & Tuning Tools
2010/10 - Database Architechs - Perf. & Tuning Tools2010/10 - Database Architechs - Perf. & Tuning Tools
2010/10 - Database Architechs - Perf. & Tuning Tools
 
Data Lakehouse, Data Mesh, and Data Fabric (r2)
Data Lakehouse, Data Mesh, and Data Fabric (r2)Data Lakehouse, Data Mesh, and Data Fabric (r2)
Data Lakehouse, Data Mesh, and Data Fabric (r2)
 

More from Charley Hanania

Pass chapter meeting - november - partitioning for database availability - ch...
Pass chapter meeting - november - partitioning for database availability - ch...Pass chapter meeting - november - partitioning for database availability - ch...
Pass chapter meeting - november - partitioning for database availability - ch...
Charley Hanania
 
Swiss pass chapter deck lausanne - june 2011
Swiss pass chapter deck   lausanne - june 2011Swiss pass chapter deck   lausanne - june 2011
Swiss pass chapter deck lausanne - june 2011
Charley Hanania
 
Swiss pass chapter deck - zurich - april 2011
Swiss pass chapter deck - zurich - april 2011Swiss pass chapter deck - zurich - april 2011
Swiss pass chapter deck - zurich - april 2011
Charley Hanania
 
Pass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck Dives
Pass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck DivesPass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck Dives
Pass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck Dives
Charley Hanania
 
Sql connections germany - migration considerations when migrating your on pre...
Sql connections germany - migration considerations when migrating your on pre...Sql connections germany - migration considerations when migrating your on pre...
Sql connections germany - migration considerations when migrating your on pre...
Charley Hanania
 

More from Charley Hanania (6)

2024.03.01 - My weakness, Your Glory - Contemplations on Jonah.pptx
2024.03.01 - My weakness, Your Glory - Contemplations on Jonah.pptx2024.03.01 - My weakness, Your Glory - Contemplations on Jonah.pptx
2024.03.01 - My weakness, Your Glory - Contemplations on Jonah.pptx
 
Pass chapter meeting - november - partitioning for database availability - ch...
Pass chapter meeting - november - partitioning for database availability - ch...Pass chapter meeting - november - partitioning for database availability - ch...
Pass chapter meeting - november - partitioning for database availability - ch...
 
Swiss pass chapter deck lausanne - june 2011
Swiss pass chapter deck   lausanne - june 2011Swiss pass chapter deck   lausanne - june 2011
Swiss pass chapter deck lausanne - june 2011
 
Swiss pass chapter deck - zurich - april 2011
Swiss pass chapter deck - zurich - april 2011Swiss pass chapter deck - zurich - april 2011
Swiss pass chapter deck - zurich - april 2011
 
Pass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck Dives
Pass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck DivesPass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck Dives
Pass camp 2010 - DBA 101 to 401 - From Spring Board to Deep Wreck Dives
 
Sql connections germany - migration considerations when migrating your on pre...
Sql connections germany - migration considerations when migrating your on pre...Sql connections germany - migration considerations when migrating your on pre...
Sql connections germany - migration considerations when migrating your on pre...
 

Recently uploaded

Recently uploaded (20)

🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 

SQL Server Club - SQL Server Enterprise Consolidation - charley hanania

  • 1. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland SQL Server Club 6th of May 2008 Lausanne, Switzerland
  • 2. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Consolidation Strategies for MS SQL Server for Manageability and Efficiency of Enterprise Platforms Charley Hanania B.Sc (Computing Science), MCP, MCDBA, MCITP, MCTS, MCT UBS Investment Bank Charley.Hanania@gmail.com
  • 3. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland General Overview  Manageability and efficiency of platforms through consolidation are key drivers in IT strategy.  This session focuses on reviewing some of the guiding principles of these drivers, as well as looking at what things should be taken into account when looking at a SQL Server consolidation strategy.
  • 4. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Agenda  Enterprise Rationalisation  Keys Drivers to Success  Technology Considerations  Recap  Questions
  • 5.
  • 6. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Enterprise Rationalisation  What are your drivers to Rationalisation?  Service Delivery Quality Improvements  Mergers and Acquisitions  Business Model Design / Redesign  Total Cost of Ownership (TCO) Reductions  .  .  .  General Business Profitability… The Triggers…
  • 7. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Enterprise Rationalisation  Server Utilisation Rates  5-10%  10-15%  15-20%  Service Level Agreements not being met  Active Directory reaching Capacity  Monitoring Infrastructure Overloaded  Resource (human) to Component ratio not optimal.  Platform Stability & Standards a thing of Myth and Legend  Root Cause Analysis  Change Management  Application Availability Truth be told…
  • 8. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Enterprise Rationalisation Bad Operational Habits To sum it up
  • 9.
  • 10. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Key Drivers to Success  Long Term Strategies  What are the key drivers of your organisation?  What’s the Utopia of Operations for you?  Don’t treat the rationalisation as a Project  Turn it into a strategy ○ If your operations are healthy then your business will have a very good chance at being guided by solid reasoning.  Look at what IT needs to achieve, and architect the solutions around what the technologies of the time can afford. Lies not in the technologies…
  • 11. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Key Drivers to Success This won’t be easy… The Strategy: …But it is possible.
  • 12. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Key Drivers to Success Gartner Inc: “…Poll Confirms Internal Politics is the Major Problem Area for Server Consolidation Rationalisation…” John R Phelps, 1 Feb 2007 The Strategy: “Train up a child in the way he should go and when he is old, he will not depart from it.” (Proverbs 22:6)
  • 13.
  • 14. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Technology Considerations Overriding approaches available currently… Do Nothing Server Farms Virtualise
  • 15. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Technology Considerations Don’t Consolidate… Do Nothing Server Farms Virtualise  System too: ○ Critical ○ Complex ○ Badly Written  System is: ○ Managed Externally (3rd Party) ○ Legacy ○ High Risk  User Base is too Broad ○ Measuring true utilisation and risk is too difficult
  • 16. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Technology Considerations Virtualise… Do Nothing Server Farms Virtualise  Why: ○ If CPU / Memory etc metrics show that you severely underutilise hardware, then co-existence in VM's might be slower but a viable approach.  eg: if 8% CPU and 10% memory used on a server, then going for an 8:1 consolidation ratio may be viable.  Why Not: ○ OS Disk Space and Memory overhead, abstraction/obfuscation of performance indicators.
  • 17. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Technology Considerations Server Farms… (“Databases as a Service”) Do Nothing Server Farms Virtualise  Why: ○ Great Consolidation Ratios ○ SQL server manages its memory space well  x64: a good option to better utilise memory and resources. ○ Pushes for simpler/better coded DB objects ○ Organisational discipline  Long Term Benefit…
  • 18. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Technology Considerations Server Farms… (“Databases as a Service”) Do Nothing Server Farms Virtualise  Why Not: ○ instance suffers from lowest common denominator, so if a third party or legacy application needs to use SA, you'll open up SA exposing all databases within the instance.  Other lockdown areas; xp_cmdshell, DAC, CLR etc ○ Object clashes within the instance scope; logins with default databases, logins, database names, SSIS packages ○ Database profile - OLTP, DSS, data warehouse, batch jobs, etc.
  • 19. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Technology Considerations Server Farms… (“Databases as a Service”) Do Nothing Server Farms Virtualise  Additional options: ○ Many DB's to one instance ○ Many instances per machine.  Allows logical and configuration isolation for databases within the instance  if a hot fix is needed, then that hot fix can be focussed to affect the smallest subset of databases.  Why not: ○ slight capacity planning overhead on memory side.  General Rule of Thumb is (memory - OS pool)/(x instances)  Note: needs more detailed planning than general RoT
  • 20. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Other Considerations  Infrastructure ○ Many AD computer objects ○ SNMP traps or MOM/SCOM/Foglight events per server etc raise many more informational alerts per OS than if all just on one. ○ Simpler view on scope of capacity issues or performance but many more to shift focus to. ○ Server racks, data centre space, etc, (licences, hardware, electricity, rental, sight rental etc)  Operational ○ Patching ○ Tracking permission breaches or security vulnerabilities ○ Number of DBA's per server decreases or more DBA's / Operations Staff to handle many servers ○ Difficult to maintain consistency plus control over the environment ○ Higher risk of component failure/ lower scope of impact  Financial ○ DBA costs (MS DBA's cost as much as Oracle DBA's now!!) ○ Licensing costs-SQL/windows ○ hardware costs and maintenance agreements ○ Redundant hardware component costs ○ Server room space etc Overhead of Many Servers…
  • 21. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Other Considerations  Infrastructure ○ Well… None!  Operational ○ Structured approach to operations support ○ Stringent change control policies and communications ○ Concentration risk for outages on:  Number of DB's within scope  Instance  Server  Data Centre ○ Monitoring tools need to be well configured (thresholds and filters) ○ Adequate capacity planning tools and capacity management procedures ○ Application teams following a development framework (including induction process)  Financial ○ Larger capacity servers to handle federated approach (CPU's, network cards, disks and disk arrays) ○ Possible investment in DR technologies (GEO clusters, SAN replication) ○ Investment in network abstraction technologies (Big IP/F5, DNS etc for failover or re-placement of DB's ○ Training  Developer inductions on standards, best practices and procedures  Admin inductions on procedures, policies and standards Overhead of Fewer Servers…
  • 22. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland “Core” Technical Considerations  Server Level ○ SSIS packages ○ SQL Version ○ I/O Utilisation ○ Network Utilisation  In / Out ○ Memory Utilisation  Per Instance ○ Availability Needs  Clustering SQL Server Specific…  Instance Level ○ Patch Levels ○ Collations ○ DB Names ○ Login Types ○ Linked Servers ○ Login Names ○ Login/User Privileges ○ Instance Options (Configuration Settings) ○ SQL Version ○ Number Of Users Connected ○ Availability Needs  Clustering  Replication  Mirroring  Inter-database Synchronisation
  • 23. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland “Core” Technical Considerations  Database Level ○ I/O Utilisation  Temp DB  Data  Log  Partitioning ○ Availability Needs  Replication  Log Shipping  Mirroring  Inter-database Synchronisation ○ DB Importance  Recovery Priority/Sequence SQL Server Specific…  Operations ○ Provisioning Process (Provisioning Tool) ○ Database ○ Login / User Creation ○ Capacity Planning ○ Exceptional Feature Requests ○ Change Windows ○ Largest Tables ○ Special Needs eg: Partitioning ○ System Profile ○ Batched Runs ○ OLTP ○ Execution Times
  • 24. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Performance Counters Object Counter Instance LogicalDisk % Disk Time _Total LogicalDisk % Disk Time …Each Disk… LogicalDisk Avg. Disk Queue Length _Total LogicalDisk Avg. Disk Queue Length …Each Disk… LogicalDisk Current Disk Queue Length _Total LogicalDisk Current Disk Queue Length …Each Disk… Memory Available Bytes Memory Page Faults/sec Memory Pages/sec Network Interface Bytes Received/sec …Each Card… Network Interface Bytes Sent/sec …Each Card… Network Interface Output Queue Length …Each Card… PhysicalDisk Avg. Disk Queue Length _Total PhysicalDisk Avg. Disk Queue Length …Each Disk… Process % Processor Time _Total Process % Processor Time MsDtsSrvr Process % Processor Time msftesql Process % Processor Time SQLAGENT90 Process % Processor Time sqlbrowser Process % Processor Time sqlservr Process % Processor Time SqlWb Process % Processor Time sqlwriter Processor % Processor Time _Total Processor % Processor Time …Each Processor… Object Counter Instance Processor % User Time _Total Processor % User Time …Each Processor… SQLServer:Buffer Manager Buffer cache hit ratio SQLServer:Buffer Manager Page life expectancy SQLServer:Buffer Manager Page reads/sec SQLServer:Buffer Manager Page writes/sec SQLServer:Gener al Statistics User Connections SQLServer:Locks Lock Wait Time (ms) _Total SQLServer:Locks Lock Waits/sec _Total SQLServer:Memo ry Manager Connection Memory (KB) SQLServer:Memo ry Manager Memory Grants Outstanding SQLServer:Memo ry Manager Memory Grants Pending SQLServer:Wait Statistics Log write waits Waits in progress SQLServer:Wait Statistics Memory grant queue waits Waits in progress SQLServer:Wait Statistics Page IO latch waits Waits in progress System Processor Queue Length Use the following Counters to baseline application workload profile and measure ongoing capacity thresholds
  • 25.
  • 26. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Recap  Rationalising Server Estate is a key issue in most medium to large organisations.  Generally, the issue isn’t Rationalisation itself, but why, and which tools and technologies are suitable  Using a mix of Virtualisation, Server Farms and bare metal Servers, SQL Server within the enterprise can be managed effectively and efficiently.  Operational efficiency and good operational habits are far more important in the SQL Server Enterprise environment.  Once good operational habits have been formed and engrained into the business model, issues around SQL Server technologies, including rampant deployments will decrease, and operations will be able to focus more on adding core technological value to the business rather than meeting operational stability and Service Level metrics.  When looking at reducing an SQL Server Estate, base lining, planning and monitoring for capacity, performance and fault tolerance are the key technological focuses' that should be built into the toolset for day to day operations.
  • 27. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Topic Resources  Whitepaper:  Optimizing HP Servers with Microsoft SQL Server 2008.  HP  SQL Server Technical Article  Server Consolidation with SQL Server 2008.  Microsoft  Whitepaper:  A Pragmatic Approach to Server and Data Center Consolidation.  Platespin
  • 28. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Community  Swiss PASS Chapter  www.sqlpass-swiss.org  Swiss IT Pro user group  www.swissitpro.ch  Monthly sessions in Zurich and Geneva
  • 29. 06 May 2008 SQL Club Meeting – Lausanne, Switzerland Thank you…