SlideShare a Scribd company logo
1 of 16
Is “the bigger the better” valid in the
database world?
Best practices around VLDBs
HP FastTrack Solution
Tips, tricks and gotchas with multi-TB databases
About me
 Ivan Donev, MCT
 SQL Server Technology Team Lead, HP




2 |
Agenda
     Introduction
     Best practices in configuration
     HP FastTrack Reference Architecture 4.0
     Share the experience




3 |
Introduction

  More data
         Needs larger hardware
         Needs optmization
         Needs time
         Requires more responsiblities
  More responsibilities
       Need more attention
       Require more knowledge
       Give you more headaches




4 |
Best practices - IO

     Hardware - trust your vendor
     Follow the Storage Top 10 Best Practices
     HBA Queue Depth
     TEST, TEST, TEST




5 |
Best practices – SQL Server

  Startup options
       -E and T1117
       T834?

  MaxServerMemory
  MaxDop – never leave it to 0
  Local policy
       Lock pages in memory
       Perform Volume maintenance tasks
  Resource governor!




6 |
Best practices – Inside SQL Server

  TempDB
       Microsoft rules – 1 file per CPU
       Experience
     Partitioning
     Compression – be careful!
     Column Store index
     Maintenance, maintenance, maintenance!!!




7 |
HP FastTrack 4.0

  Prebuild Hardware for best
   performance
  Configuration Guide
  Performance




8 |
Let’s talk about reality

  The hardware - HP DL980 G7
       2TB RAM
       8x8-core Intel Xeon => 128 logical CPUs
       Storage – dedicated P2000 and XP24000
  The Software
       Windows Server 2008 R2 with SP1
       SQL Server 2008 R2 Enterprise with CU7




9 |
10 |
Let’s talk about reality - servicing

   T834 flag or why the engine is not booting up
   Patching and ugrade
        Upgrade from SQL Server 2005 to 2008 R2
           Approach
           Licensing
           Bugs




11 |
Let’s talk about reality - maintenance

   Examine fragmentation
   Do not forget about statistics
   Check the integrity
        Size matters
   Autogrowth and proportional fill




12 |
Let’s talk about reality - compression

   Estimate compression gain
   Compress and keep compressing
   How do we reclaim the space?
        Moving object to new file
        Shrinking




13 |
IS THE BIGGER THE BETTER?




14 |
15 |
Sponsors

More Related Content

What's hot

Spectrum Scale final
Spectrum Scale finalSpectrum Scale final
Spectrum Scale final
Joe Krotz
 
Nimble storage
Nimble storageNimble storage
Nimble storage
dvmug1
 
EarthLink Business Cloud Server Backup
EarthLink Business Cloud Server BackupEarthLink Business Cloud Server Backup
EarthLink Business Cloud Server Backup
Mike Ricca
 
1 rh storage - architecture whitepaper
1 rh storage - architecture whitepaper1 rh storage - architecture whitepaper
1 rh storage - architecture whitepaper
Accenture
 

What's hot (20)

PernixData FVP Overview
PernixData FVP OverviewPernixData FVP Overview
PernixData FVP Overview
 
DataCore Executive Brief
DataCore Executive BriefDataCore Executive Brief
DataCore Executive Brief
 
Capacity Efficiency: Identifying the Right Solutions for the Right Challenge
Capacity Efficiency: Identifying the Right Solutions for the Right ChallengeCapacity Efficiency: Identifying the Right Solutions for the Right Challenge
Capacity Efficiency: Identifying the Right Solutions for the Right Challenge
 
IBM general parallel file system - introduction
IBM general parallel file system - introductionIBM general parallel file system - introduction
IBM general parallel file system - introduction
 
ICEOTOPE & OCF: Performance for Manufacturing
ICEOTOPE & OCF: Performance for Manufacturing ICEOTOPE & OCF: Performance for Manufacturing
ICEOTOPE & OCF: Performance for Manufacturing
 
Présentation NUTANIX - ÉVÉNEMENT TOUR D’ARGENT : ACROPOLIS - NUTANIX - SIPART...
Présentation NUTANIX - ÉVÉNEMENT TOUR D’ARGENT : ACROPOLIS - NUTANIX - SIPART...Présentation NUTANIX - ÉVÉNEMENT TOUR D’ARGENT : ACROPOLIS - NUTANIX - SIPART...
Présentation NUTANIX - ÉVÉNEMENT TOUR D’ARGENT : ACROPOLIS - NUTANIX - SIPART...
 
In-Memory Computing: Myths and Facts
In-Memory Computing: Myths and FactsIn-Memory Computing: Myths and Facts
In-Memory Computing: Myths and Facts
 
Why Government Agencies Should Consider Dell 13th Gen Servers
Why Government Agencies Should Consider Dell 13th Gen ServersWhy Government Agencies Should Consider Dell 13th Gen Servers
Why Government Agencies Should Consider Dell 13th Gen Servers
 
V3700 infographic final
V3700 infographic finalV3700 infographic final
V3700 infographic final
 
Get significantly better transactional database performance for less with val...
Get significantly better transactional database performance for less with val...Get significantly better transactional database performance for less with val...
Get significantly better transactional database performance for less with val...
 
Spectrum Scale final
Spectrum Scale finalSpectrum Scale final
Spectrum Scale final
 
Netbackup advantages features and benefits Netbackup classes may help hands o...
Netbackup advantages features and benefits Netbackup classes may help hands o...Netbackup advantages features and benefits Netbackup classes may help hands o...
Netbackup advantages features and benefits Netbackup classes may help hands o...
 
PHD Virtual: Optimizing Backups for Any Storage
PHD Virtual: Optimizing Backups for Any StoragePHD Virtual: Optimizing Backups for Any Storage
PHD Virtual: Optimizing Backups for Any Storage
 
Nimble storage
Nimble storageNimble storage
Nimble storage
 
Inter connect2016 yss1841-cloud-storage-options-v4
Inter connect2016 yss1841-cloud-storage-options-v4Inter connect2016 yss1841-cloud-storage-options-v4
Inter connect2016 yss1841-cloud-storage-options-v4
 
EarthLink Business Cloud Server Backup
EarthLink Business Cloud Server BackupEarthLink Business Cloud Server Backup
EarthLink Business Cloud Server Backup
 
GPFS Solution Brief
GPFS Solution BriefGPFS Solution Brief
GPFS Solution Brief
 
1 rh storage - architecture whitepaper
1 rh storage - architecture whitepaper1 rh storage - architecture whitepaper
1 rh storage - architecture whitepaper
 
The Cloud as a means of Recovery
The Cloud as a means of RecoveryThe Cloud as a means of Recovery
The Cloud as a means of Recovery
 
Microsoft private cloud with Cisco and Netapp - Flexpod solution
Microsoft private cloud with Cisco and Netapp -  Flexpod solutionMicrosoft private cloud with Cisco and Netapp -  Flexpod solution
Microsoft private cloud with Cisco and Netapp - Flexpod solution
 

Viewers also liked

Get the most out of your Windows Azure VMs
Get the most out of your Windows Azure VMsGet the most out of your Windows Azure VMs
Get the most out of your Windows Azure VMs
Ivan Donev
 

Viewers also liked (6)

Welcome to the nightmare of locking, blocking and isolation levels!
Welcome to the nightmare of locking, blocking and isolation levels!Welcome to the nightmare of locking, blocking and isolation levels!
Welcome to the nightmare of locking, blocking and isolation levels!
 
Get the most out of your Windows Azure VMs
Get the most out of your Windows Azure VMsGet the most out of your Windows Azure VMs
Get the most out of your Windows Azure VMs
 
Securing SQL Azure DB? How?
Securing SQL Azure DB? How?Securing SQL Azure DB? How?
Securing SQL Azure DB? How?
 
The Nightmare of Locking, Blocking and Isolation Levels
The Nightmare of Locking, Blocking and Isolation LevelsThe Nightmare of Locking, Blocking and Isolation Levels
The Nightmare of Locking, Blocking and Isolation Levels
 
Tips and tricks to optimiza SQL Server Backup and Restore
Tips and tricks to optimiza SQL Server Backup and RestoreTips and tricks to optimiza SQL Server Backup and Restore
Tips and tricks to optimiza SQL Server Backup and Restore
 
Data science & data scientist
Data science & data scientistData science & data scientist
Data science & data scientist
 

Similar to Is "the bigger the beter" valid in the database world

Similar to Is "the bigger the beter" valid in the database world (20)

Performance tuning intro
Performance tuning introPerformance tuning intro
Performance tuning intro
 
Performance Tuning intro
Performance Tuning introPerformance Tuning intro
Performance Tuning intro
 
Adding Value in the Cloud with Performance Test
Adding Value in the Cloud with Performance TestAdding Value in the Cloud with Performance Test
Adding Value in the Cloud with Performance Test
 
Hadoop-DS: Which SQL-on-Hadoop Rules the Herd
Hadoop-DS: Which SQL-on-Hadoop Rules the HerdHadoop-DS: Which SQL-on-Hadoop Rules the Herd
Hadoop-DS: Which SQL-on-Hadoop Rules the Herd
 
S de0882 new-generation-tiering-edge2015-v3
S de0882 new-generation-tiering-edge2015-v3S de0882 new-generation-tiering-edge2015-v3
S de0882 new-generation-tiering-edge2015-v3
 
S sy0883 smarter-storage-strategy-edge2015-v4
S sy0883 smarter-storage-strategy-edge2015-v4S sy0883 smarter-storage-strategy-edge2015-v4
S sy0883 smarter-storage-strategy-edge2015-v4
 
Sql server tips from the field
Sql server tips from the fieldSql server tips from the field
Sql server tips from the field
 
Management and Automation of MongoDB Clusters - Slides
Management and Automation of MongoDB Clusters - SlidesManagement and Automation of MongoDB Clusters - Slides
Management and Automation of MongoDB Clusters - Slides
 
Splice machine-bloor-webinar-data-lakes
Splice machine-bloor-webinar-data-lakesSplice machine-bloor-webinar-data-lakes
Splice machine-bloor-webinar-data-lakes
 
Virtual Storage Center
Virtual Storage CenterVirtual Storage Center
Virtual Storage Center
 
Sql server 2016 it just runs faster sql bits 2017 edition
Sql server 2016 it just runs faster   sql bits 2017 editionSql server 2016 it just runs faster   sql bits 2017 edition
Sql server 2016 it just runs faster sql bits 2017 edition
 
Architecting with power vm
Architecting with power vmArchitecting with power vm
Architecting with power vm
 
The benefits of IBM FlashSystems
The benefits of IBM FlashSystemsThe benefits of IBM FlashSystems
The benefits of IBM FlashSystems
 
Informix warehouse accelerator update
Informix warehouse accelerator updateInformix warehouse accelerator update
Informix warehouse accelerator update
 
Best Practices for a Complete Postgres Enterprise Architecture Setup
Best Practices for a Complete Postgres Enterprise Architecture SetupBest Practices for a Complete Postgres Enterprise Architecture Setup
Best Practices for a Complete Postgres Enterprise Architecture Setup
 
HPC DAY 2017 | HPE Storage and Data Management for Big Data
HPC DAY 2017 | HPE Storage and Data Management for Big DataHPC DAY 2017 | HPE Storage and Data Management for Big Data
HPC DAY 2017 | HPE Storage and Data Management for Big Data
 
Red hat Storage Day LA - Designing Ceph Clusters Using Intel-Based Hardware
Red hat Storage Day LA - Designing Ceph Clusters Using Intel-Based HardwareRed hat Storage Day LA - Designing Ceph Clusters Using Intel-Based Hardware
Red hat Storage Day LA - Designing Ceph Clusters Using Intel-Based Hardware
 
Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
 Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ... Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
 
Delivering High Availability and Performance with SQL Server 2014 (Silviu Nic...
Delivering High Availability and Performance with SQL Server 2014 (Silviu Nic...Delivering High Availability and Performance with SQL Server 2014 (Silviu Nic...
Delivering High Availability and Performance with SQL Server 2014 (Silviu Nic...
 
Presentation oracle optimized solutions
Presentation   oracle optimized solutionsPresentation   oracle optimized solutions
Presentation oracle optimized solutions
 

More from Ivan Donev

Self-service BI with PowerPivot and PowerView
Self-service BI with PowerPivot and PowerViewSelf-service BI with PowerPivot and PowerView
Self-service BI with PowerPivot and PowerView
Ivan Donev
 

More from Ivan Donev (9)

Discovery Day 2019 Sofia - Big data clusters
Discovery Day 2019 Sofia - Big data clustersDiscovery Day 2019 Sofia - Big data clusters
Discovery Day 2019 Sofia - Big data clusters
 
Discovery Day 2019 Sofia - What is new in SQL Server 2019
Discovery Day 2019 Sofia - What is new in SQL Server 2019Discovery Day 2019 Sofia - What is new in SQL Server 2019
Discovery Day 2019 Sofia - What is new in SQL Server 2019
 
Bi and AI updates in the Microsoft Data Platform stack
Bi and AI updates in the Microsoft Data Platform stackBi and AI updates in the Microsoft Data Platform stack
Bi and AI updates in the Microsoft Data Platform stack
 
Power bi - enterprise cloud reporting platform Azure Bootcamp 19
Power bi - enterprise cloud reporting platform Azure Bootcamp 19Power bi - enterprise cloud reporting platform Azure Bootcamp 19
Power bi - enterprise cloud reporting platform Azure Bootcamp 19
 
Develop your database with Visual Studio
Develop your database with Visual StudioDevelop your database with Visual Studio
Develop your database with Visual Studio
 
Windows Azure Bootcamp - Microsoft BI in Azure VMs
Windows Azure Bootcamp - Microsoft BI in Azure VMsWindows Azure Bootcamp - Microsoft BI in Azure VMs
Windows Azure Bootcamp - Microsoft BI in Azure VMs
 
Building your first AS solution
Building your first AS solutionBuilding your first AS solution
Building your first AS solution
 
Sql server consolidation and virtualization
Sql server consolidation and virtualizationSql server consolidation and virtualization
Sql server consolidation and virtualization
 
Self-service BI with PowerPivot and PowerView
Self-service BI with PowerPivot and PowerViewSelf-service BI with PowerPivot and PowerView
Self-service BI with PowerPivot and PowerView
 

Recently uploaded

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Recently uploaded (20)

Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 

Is "the bigger the beter" valid in the database world

  • 1. Is “the bigger the better” valid in the database world? Best practices around VLDBs HP FastTrack Solution Tips, tricks and gotchas with multi-TB databases
  • 2. About me Ivan Donev, MCT SQL Server Technology Team Lead, HP 2 |
  • 3. Agenda  Introduction  Best practices in configuration  HP FastTrack Reference Architecture 4.0  Share the experience 3 |
  • 4. Introduction  More data  Needs larger hardware  Needs optmization  Needs time  Requires more responsiblities  More responsibilities  Need more attention  Require more knowledge  Give you more headaches 4 |
  • 5. Best practices - IO  Hardware - trust your vendor  Follow the Storage Top 10 Best Practices  HBA Queue Depth  TEST, TEST, TEST 5 |
  • 6. Best practices – SQL Server  Startup options  -E and T1117  T834?  MaxServerMemory  MaxDop – never leave it to 0  Local policy  Lock pages in memory  Perform Volume maintenance tasks  Resource governor! 6 |
  • 7. Best practices – Inside SQL Server  TempDB  Microsoft rules – 1 file per CPU  Experience  Partitioning  Compression – be careful!  Column Store index  Maintenance, maintenance, maintenance!!! 7 |
  • 8. HP FastTrack 4.0  Prebuild Hardware for best performance  Configuration Guide  Performance 8 |
  • 9. Let’s talk about reality  The hardware - HP DL980 G7  2TB RAM  8x8-core Intel Xeon => 128 logical CPUs  Storage – dedicated P2000 and XP24000  The Software  Windows Server 2008 R2 with SP1  SQL Server 2008 R2 Enterprise with CU7 9 |
  • 10. 10 |
  • 11. Let’s talk about reality - servicing  T834 flag or why the engine is not booting up  Patching and ugrade  Upgrade from SQL Server 2005 to 2008 R2  Approach  Licensing  Bugs 11 |
  • 12. Let’s talk about reality - maintenance  Examine fragmentation  Do not forget about statistics  Check the integrity  Size matters  Autogrowth and proportional fill 12 |
  • 13. Let’s talk about reality - compression  Estimate compression gain  Compress and keep compressing  How do we reclaim the space?  Moving object to new file  Shrinking 13 |
  • 14. IS THE BIGGER THE BETTER? 14 |
  • 15. 15 |

Editor's Notes

  1. Some clarifications: we are talking about multiterabyte databases, running on high-end hardware and primarily DATAWAREHOUSE LOAD
  2. The SQL Server environment is just like a garden – the more you want, the more you need to invest
  3. HARDWARE – use the vendors best practices for configuration; every vendor has a guide for SQL Server Best IO performanceTEST – use SQLIO to see if you have the performance needed RAID 10 for disks;Split data from log LUNs1 data file per LUN (use single LOG file) http://technet.microsoft.com/en-us/library/cc966534.aspx
  4. MAX Server Memory – Total Physical Memory – 4-8 GBs for the OSWith the -E startup option, an administrator can increase the number of extents allocated per file in the filegroup during each iteration of the round robin cycle used to distribute extents across files
  5. Lining up the number of data files with CPU’s has scalability advantages for allocation intensive workloads. It is recommended to have .25 to 1 data files (per filegroup) for each CPU on the host server. This is especially true for TEMPDB where the recommendation is 1 data file per CPU.Dual core counts as 2 CPUs; logical procs (hyperthreading) do not.
  6. HARDWARE - DL G7 Bades with MSA P2000 storage
  7. SIZE MATTERS – after 2008R2 SP1 you can take advantage from faster DBCC PHYSICAL_ONLY
  8. SIZE MATTERS – after 2008R2 SP1 you can take advantage from faster DBCC PHYSICAL_ONLY
  9. Do you need big?Do you want big?Can you handle big?