SlideShare una empresa de Scribd logo
1 de 11
Virtual Heterogeneous Database
Platform
Smith Yang 楊士岳
Trend Micro-Corp IT Technology Team DBA
7/19/2013
Version 0.1
Agenda
 Project Background
 Project Objective
 Virtual Platform and Solutions
 DB Server Model Selection
 DB High Availability Solution
 Datakeeper vs Failover Clustering
 Operation Team’s Concern
 Monitoring Team’s Endorsement
7/19/2013 | Virtual Heterogeneous Database Platform2 |
Project Background
Current physical DB server challenges
• Low utilization : High occupation of rack space
for physical servers
• Physical limitation: Difficulty to move services
in the rack
• High Cost : Hosting and maintenance of
physical servers dedicated for single projects
7/19/2013 | Virtual Heterogeneous Database Platform3 |
Project Objective
 Support direction of Cloud Enablement by
moving 100% of Data Center Virtualization
 Provide a Virtualization Platform to host
multiple database platforms and solutions
requiring high performance
 Provide Security and Performance Isolation
for services while still achieving high degree of
Hardware Utilization
 Improve Efficiency of DB Service through
automated provisioning and management
7/19/2013 | Virtual Heterogeneous Database Platform4 |
7/19/2013 | Virtual Heterogeneous Database Platform5 |
APP APP
SQL SQL
SSD/SAS
CPU
RAM
Hypervisors
SSD/SAS
CPU
RAM
SSD/SAS
CPU
RAM
SSD/SAS
CPU
RAM
Management Layer
APP APP
VIRTUAL SOLUTIONS
VIRTUAL PLATFORM
• Support Legacy DB Services (SQL2005,
2008, MySQL, etc..)
• Multiple HA Solutions depending on
Service Needs (DataKeeper, Replication,
AlwaysOn, Load Balancing Solutions etc..)
• Automated Deployment and Configuration
• Leveraging Application or Database HA
Solutions (not VMware HA)
• Platform to Support Cloud Design
• Utilize local SSD and Caching Technology
to improve IO capability by a factor of x10
• Segregation of Services into Different
Virtual Machines
• Compute Performance Isolated Per
Service
• Security Isolated per Service
• Platform to Support Package Apps (see
above)
• Full Utilization of Hardware
Orchestration
Virtual Platform and Solutions
DB Server Model Selection
Consumption Low Medium High
CPU 1 v-CPU 2 v-CPU 4 v-CPU
Memory 8 GB 16 GB 32 GB
 Compute resource allocation for VM server
• VM local storage allocation base on service need
Model High
Performance
High
Capacity
Hard disk Pure SSD Hybrid SSD+SAS
Capacity Up to 2880 GB Up to 4860 GB
Note. Higher resource request would be exception only
Local Datastore
DB High Availability Solution
Features Datakeeper Clustering Mirroring AlwaysOn
Log
Shipping
Replication
Software
Hardware
DKCE
Licenses
MS-SQL /
Storage
MS-SQL
MS-SQL
2012
MS-SQL MS-SQL
Auto
Failover
Yes Yes
Yes
(HA mode)
Yes No No
Units
Node
Server
Node
Server
DB
Group of
DB
DB
Table
Articles
Data
Replica
1 (*) 0 1 0-4 Unlimited Unlimited
Note (*) New version DKCE allow for snapshot at Mirror node,
offload the backup and reporting from Primary node
Our application level solutions can also utilized similar to physical DB servers.
7/19/2013 | Virtual Heterogeneous Database Platform7 |
Datakeeper - Alternative Approach to Clustering
Traditional Clustering - Shared SAN Storage Clustering with Local Storage and Datakeeper
Challenges :
• No Persistent Shared Storage Options
in AWS – Not cloud ready
• Requirement for Shared SAN Storage
• Disaster Recovery Requires Expensive
SAN Replication Technology
• 1 Copy of the Data
• Complex Setup – Raw Device
Mappings
Benefits :
• Fully Supported HA Solution in AWS
Public Cloud – more here
• Local Storage – no SAN
• Low cost solution for keeping
Disaster Recovery site in synch.
• Mirror Copy of data can be used to
offload backups and reporting
• Simple to configure
7/19/2013 | Virtual Heterogeneous Database Platform8 |
 Future Flexibility : DC OPs consider to reserve more resources
(HBA/Memory/HDD) in server.
 Multiple Cluster Nodes Design : We could have enough time to
recovery from any hardware failure.
 Standard SOP : Exercise and rebuild in pilot test servers.
 Parallel Pilot : P2V transformation from Production then test
together with service owners.
 Get Familiar With : Maintenance for Windows Cluster + SQL 2012
AlwaysOn AG + Datakeeper.
 Performance Impact : While multiple DB Instance running
together in one physical server.
 Network Loading : Monitor 1GB Ethernet Switch within
DataCenter and cross-site utilization.
Operation Team’s Concern
7/19/2013 | Virtual Heterogeneous Database Platform9 |
The monitoring scope of new DB platform can be covered by
the following tools.
Monitoring Team’s Endorsement
Item Monitor Tools
Service availability PRTG, Quest Foglight
Performance Monitoring Quest Performance Analysis
Capacity Management PRTG, Quest Capacity Manager
Backup Quest LiteSpeed, Veeam, SQL Backup,
CommVault
Audit MS SQL Audit tool
7/19/2013 | Virtual Heterogeneous Database Platform10 |
Q & A
7/19/2013 | Virtual Heterogeneous Database Platform11 |

Más contenido relacionado

La actualidad más candente

EDB Postgres Replication Server
EDB Postgres Replication ServerEDB Postgres Replication Server
EDB Postgres Replication ServerEDB
 
An Expert Guide to Migrating Legacy Databases to PostgreSQL
An Expert Guide to Migrating Legacy Databases to PostgreSQLAn Expert Guide to Migrating Legacy Databases to PostgreSQL
An Expert Guide to Migrating Legacy Databases to PostgreSQLEDB
 
Solution Brief: Commvault & Red Hat Storage
Solution Brief: Commvault & Red Hat StorageSolution Brief: Commvault & Red Hat Storage
Solution Brief: Commvault & Red Hat StorageMarcel Hergaarden
 
Hadoop Virtualization - Intel White Paper
Hadoop Virtualization - Intel White PaperHadoop Virtualization - Intel White Paper
Hadoop Virtualization - Intel White PaperBlueData, Inc.
 
Best practices: running high-performance databases on Kubernetes
Best practices: running high-performance databases on KubernetesBest practices: running high-performance databases on Kubernetes
Best practices: running high-performance databases on KubernetesMariaDB plc
 
Big Data Quickstart Series 3: Perform Data Integration
Big Data Quickstart Series 3: Perform Data IntegrationBig Data Quickstart Series 3: Perform Data Integration
Big Data Quickstart Series 3: Perform Data IntegrationAlibaba Cloud
 
The Need For Speed - Strategies to Modernize Your Data Center
The Need For Speed - Strategies to Modernize Your Data CenterThe Need For Speed - Strategies to Modernize Your Data Center
The Need For Speed - Strategies to Modernize Your Data CenterEDB
 
Red Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and FutureRed Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and FutureRed_Hat_Storage
 
Virtual Storage Center
Virtual Storage CenterVirtual Storage Center
Virtual Storage CenterIBM Danmark
 
Public Sector Virtual Town Hall: High Availability for PostgreSQL
Public Sector Virtual Town Hall: High Availability for PostgreSQLPublic Sector Virtual Town Hall: High Availability for PostgreSQL
Public Sector Virtual Town Hall: High Availability for PostgreSQLEDB
 
How to Integrate Hyperconverged Systems with Existing SANs
How to Integrate Hyperconverged Systems with Existing SANsHow to Integrate Hyperconverged Systems with Existing SANs
How to Integrate Hyperconverged Systems with Existing SANsDataCore Software
 
Oracle Cloud Infrastructure – Compute
Oracle Cloud Infrastructure – ComputeOracle Cloud Infrastructure – Compute
Oracle Cloud Infrastructure – ComputeMarketingArrowECS_CZ
 
CloudBridge and NetApp Storage Solutions - The Killer App
CloudBridge and NetApp Storage Solutions - The Killer AppCloudBridge and NetApp Storage Solutions - The Killer App
CloudBridge and NetApp Storage Solutions - The Killer AppNetApp
 
Beginner's Guide to High Availability for Postgres
Beginner's Guide to High Availability for PostgresBeginner's Guide to High Availability for Postgres
Beginner's Guide to High Availability for PostgresEDB
 
Transform your DBMS to drive engagement innovation with Big Data
Transform your DBMS to drive engagement innovation with Big DataTransform your DBMS to drive engagement innovation with Big Data
Transform your DBMS to drive engagement innovation with Big DataAshnikbiz
 
Caching for Microservices Architectures: Session I
Caching for Microservices Architectures: Session ICaching for Microservices Architectures: Session I
Caching for Microservices Architectures: Session IVMware Tanzu
 
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers Red_Hat_Storage
 

La actualidad más candente (20)

EDB Postgres Replication Server
EDB Postgres Replication ServerEDB Postgres Replication Server
EDB Postgres Replication Server
 
An Expert Guide to Migrating Legacy Databases to PostgreSQL
An Expert Guide to Migrating Legacy Databases to PostgreSQLAn Expert Guide to Migrating Legacy Databases to PostgreSQL
An Expert Guide to Migrating Legacy Databases to PostgreSQL
 
Solution Brief: Commvault & Red Hat Storage
Solution Brief: Commvault & Red Hat StorageSolution Brief: Commvault & Red Hat Storage
Solution Brief: Commvault & Red Hat Storage
 
Hadoop Virtualization - Intel White Paper
Hadoop Virtualization - Intel White PaperHadoop Virtualization - Intel White Paper
Hadoop Virtualization - Intel White Paper
 
Best practices: running high-performance databases on Kubernetes
Best practices: running high-performance databases on KubernetesBest practices: running high-performance databases on Kubernetes
Best practices: running high-performance databases on Kubernetes
 
Big Data Quickstart Series 3: Perform Data Integration
Big Data Quickstart Series 3: Perform Data IntegrationBig Data Quickstart Series 3: Perform Data Integration
Big Data Quickstart Series 3: Perform Data Integration
 
The Need For Speed - Strategies to Modernize Your Data Center
The Need For Speed - Strategies to Modernize Your Data CenterThe Need For Speed - Strategies to Modernize Your Data Center
The Need For Speed - Strategies to Modernize Your Data Center
 
Sql Server 2008 Server Consolidation
Sql Server 2008 Server ConsolidationSql Server 2008 Server Consolidation
Sql Server 2008 Server Consolidation
 
Red Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and FutureRed Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and Future
 
Virtual Storage Center
Virtual Storage CenterVirtual Storage Center
Virtual Storage Center
 
Public Sector Virtual Town Hall: High Availability for PostgreSQL
Public Sector Virtual Town Hall: High Availability for PostgreSQLPublic Sector Virtual Town Hall: High Availability for PostgreSQL
Public Sector Virtual Town Hall: High Availability for PostgreSQL
 
How to Integrate Hyperconverged Systems with Existing SANs
How to Integrate Hyperconverged Systems with Existing SANsHow to Integrate Hyperconverged Systems with Existing SANs
How to Integrate Hyperconverged Systems with Existing SANs
 
Oracle Cloud Infrastructure – Compute
Oracle Cloud Infrastructure – ComputeOracle Cloud Infrastructure – Compute
Oracle Cloud Infrastructure – Compute
 
Scale Out Database Solution
Scale Out Database SolutionScale Out Database Solution
Scale Out Database Solution
 
CloudBridge and NetApp Storage Solutions - The Killer App
CloudBridge and NetApp Storage Solutions - The Killer AppCloudBridge and NetApp Storage Solutions - The Killer App
CloudBridge and NetApp Storage Solutions - The Killer App
 
Beginner's Guide to High Availability for Postgres
Beginner's Guide to High Availability for PostgresBeginner's Guide to High Availability for Postgres
Beginner's Guide to High Availability for Postgres
 
Transform your DBMS to drive engagement innovation with Big Data
Transform your DBMS to drive engagement innovation with Big DataTransform your DBMS to drive engagement innovation with Big Data
Transform your DBMS to drive engagement innovation with Big Data
 
AltaVault
AltaVaultAltaVault
AltaVault
 
Caching for Microservices Architectures: Session I
Caching for Microservices Architectures: Session ICaching for Microservices Architectures: Session I
Caching for Microservices Architectures: Session I
 
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
 

Destacado

SQL PASS Taiwan 七月份聚會-5
SQL PASS Taiwan 七月份聚會-5SQL PASS Taiwan 七月份聚會-5
SQL PASS Taiwan 七月份聚會-5SQLPASSTW
 
SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性
SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性
SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性SQLPASSTW
 
Sharia'a compliant activities
Sharia'a compliant activitiesSharia'a compliant activities
Sharia'a compliant activitiesDésirée Di Iesu
 
SQL PASS Taiwan 七月份聚會-2
SQL PASS Taiwan 七月份聚會-2SQL PASS Taiwan 七月份聚會-2
SQL PASS Taiwan 七月份聚會-2SQLPASSTW
 
SQL PASS Taiwan 七月份聚會-3
SQL PASS Taiwan 七月份聚會-3SQL PASS Taiwan 七月份聚會-3
SQL PASS Taiwan 七月份聚會-3SQLPASSTW
 
opputunities in Belgium for india
opputunities in Belgium for india opputunities in Belgium for india
opputunities in Belgium for india itzmeyash
 
Native Ads: Ad Content in Context
Native Ads: Ad Content in ContextNative Ads: Ad Content in Context
Native Ads: Ad Content in ContextMichael Wörmann
 
Speak, wave, touch: How to do it right. User research insights about Natural ...
Speak, wave, touch: How to do it right. User research insights about Natural ...Speak, wave, touch: How to do it right. User research insights about Natural ...
Speak, wave, touch: How to do it right. User research insights about Natural ...Michael Wörmann
 
We think our feelings Part two
We think our feelings Part twoWe think our feelings Part two
We think our feelings Part twoAndrew Milne
 
Feelings and Emotions : We think our feelings Part 1
Feelings and Emotions : We think our feelings Part 1Feelings and Emotions : We think our feelings Part 1
Feelings and Emotions : We think our feelings Part 1Andrew Milne
 
Ch 1 introduction_om
Ch 1 introduction_omCh 1 introduction_om
Ch 1 introduction_omitzmeyash
 

Destacado (12)

SQL PASS Taiwan 七月份聚會-5
SQL PASS Taiwan 七月份聚會-5SQL PASS Taiwan 七月份聚會-5
SQL PASS Taiwan 七月份聚會-5
 
SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性
SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性
SQL PASS 臺灣分部八月份聚會 - Windows Azure 和 SQL Server 的Hybrid運用-備援以及高可用性
 
Sharia'a compliant activities
Sharia'a compliant activitiesSharia'a compliant activities
Sharia'a compliant activities
 
SQL PASS Taiwan 七月份聚會-2
SQL PASS Taiwan 七月份聚會-2SQL PASS Taiwan 七月份聚會-2
SQL PASS Taiwan 七月份聚會-2
 
SQL PASS Taiwan 七月份聚會-3
SQL PASS Taiwan 七月份聚會-3SQL PASS Taiwan 七月份聚會-3
SQL PASS Taiwan 七月份聚會-3
 
opputunities in Belgium for india
opputunities in Belgium for india opputunities in Belgium for india
opputunities in Belgium for india
 
Native Ads: Ad Content in Context
Native Ads: Ad Content in ContextNative Ads: Ad Content in Context
Native Ads: Ad Content in Context
 
Speak, wave, touch: How to do it right. User research insights about Natural ...
Speak, wave, touch: How to do it right. User research insights about Natural ...Speak, wave, touch: How to do it right. User research insights about Natural ...
Speak, wave, touch: How to do it right. User research insights about Natural ...
 
Mooc takaful
Mooc takafulMooc takaful
Mooc takaful
 
We think our feelings Part two
We think our feelings Part twoWe think our feelings Part two
We think our feelings Part two
 
Feelings and Emotions : We think our feelings Part 1
Feelings and Emotions : We think our feelings Part 1Feelings and Emotions : We think our feelings Part 1
Feelings and Emotions : We think our feelings Part 1
 
Ch 1 introduction_om
Ch 1 introduction_omCh 1 introduction_om
Ch 1 introduction_om
 

Similar a SQL PASS Taiwan 七月份聚會-1

1. beyond mission critical virtualizing big data and hadoop
1. beyond mission critical   virtualizing big data and hadoop1. beyond mission critical   virtualizing big data and hadoop
1. beyond mission critical virtualizing big data and hadoopChiou-Nan Chen
 
Big App Workloads on Microsoft Azure - TechEd Europe 2014
Big App Workloads on Microsoft Azure - TechEd Europe 2014Big App Workloads on Microsoft Azure - TechEd Europe 2014
Big App Workloads on Microsoft Azure - TechEd Europe 2014Brian Benz
 
windows server 2012 R2
windows server 2012 R2windows server 2012 R2
windows server 2012 R2Gol D Roger
 
Windows Server 2012 R2 Jump Start - Intro
Windows Server 2012 R2 Jump Start - IntroWindows Server 2012 R2 Jump Start - Intro
Windows Server 2012 R2 Jump Start - IntroPaulo Freitas
 
Optimizing Open Source for Greater Database Savings & Control
Optimizing Open Source for Greater Database Savings & ControlOptimizing Open Source for Greater Database Savings & Control
Optimizing Open Source for Greater Database Savings & ControlEDB
 
Implement SQL Server on an Azure VM
Implement SQL Server on an Azure VMImplement SQL Server on an Azure VM
Implement SQL Server on an Azure VMJames Serra
 
Provisioning server high_availability_considerations2
Provisioning server high_availability_considerations2Provisioning server high_availability_considerations2
Provisioning server high_availability_considerations2Nuno Alves
 
Oracle big data appliance and solutions
Oracle big data appliance and solutionsOracle big data appliance and solutions
Oracle big data appliance and solutionssolarisyougood
 
Should I move my database to the cloud?
Should I move my database to the cloud?Should I move my database to the cloud?
Should I move my database to the cloud?James Serra
 
Introducing Azure SQL Data Warehouse
Introducing Azure SQL Data WarehouseIntroducing Azure SQL Data Warehouse
Introducing Azure SQL Data WarehouseJames Serra
 
Oracle database 12c introduction- Satyendra Pasalapudi
Oracle database 12c introduction- Satyendra PasalapudiOracle database 12c introduction- Satyendra Pasalapudi
Oracle database 12c introduction- Satyendra Pasalapudipasalapudi123
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2Raul Chong
 
Windows Server 2012 Deep-Dive - EPC Group
Windows Server 2012 Deep-Dive - EPC GroupWindows Server 2012 Deep-Dive - EPC Group
Windows Server 2012 Deep-Dive - EPC GroupEPC Group
 
Azure SQL Database
Azure SQL DatabaseAzure SQL Database
Azure SQL Databaserockplace
 
Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...
Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...
Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...Jason Himmelstein
 
Database Administration & Management - 01
Database Administration & Management - 01Database Administration & Management - 01
Database Administration & Management - 01FaisalMashood
 
DBAM-01.pdf
DBAM-01.pdfDBAM-01.pdf
DBAM-01.pdfhania80
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesKamesh Pemmaraju
 

Similar a SQL PASS Taiwan 七月份聚會-1 (20)

1. beyond mission critical virtualizing big data and hadoop
1. beyond mission critical   virtualizing big data and hadoop1. beyond mission critical   virtualizing big data and hadoop
1. beyond mission critical virtualizing big data and hadoop
 
Big App Workloads on Microsoft Azure - TechEd Europe 2014
Big App Workloads on Microsoft Azure - TechEd Europe 2014Big App Workloads on Microsoft Azure - TechEd Europe 2014
Big App Workloads on Microsoft Azure - TechEd Europe 2014
 
windows server 2012 R2
windows server 2012 R2windows server 2012 R2
windows server 2012 R2
 
Windows Server 2012 R2 Jump Start - Intro
Windows Server 2012 R2 Jump Start - IntroWindows Server 2012 R2 Jump Start - Intro
Windows Server 2012 R2 Jump Start - Intro
 
Optimizing Open Source for Greater Database Savings & Control
Optimizing Open Source for Greater Database Savings & ControlOptimizing Open Source for Greater Database Savings & Control
Optimizing Open Source for Greater Database Savings & Control
 
Implement SQL Server on an Azure VM
Implement SQL Server on an Azure VMImplement SQL Server on an Azure VM
Implement SQL Server on an Azure VM
 
Provisioning server high_availability_considerations2
Provisioning server high_availability_considerations2Provisioning server high_availability_considerations2
Provisioning server high_availability_considerations2
 
Oracle big data appliance and solutions
Oracle big data appliance and solutionsOracle big data appliance and solutions
Oracle big data appliance and solutions
 
Should I move my database to the cloud?
Should I move my database to the cloud?Should I move my database to the cloud?
Should I move my database to the cloud?
 
Introducing Azure SQL Data Warehouse
Introducing Azure SQL Data WarehouseIntroducing Azure SQL Data Warehouse
Introducing Azure SQL Data Warehouse
 
Oracle database 12c introduction- Satyendra Pasalapudi
Oracle database 12c introduction- Satyendra PasalapudiOracle database 12c introduction- Satyendra Pasalapudi
Oracle database 12c introduction- Satyendra Pasalapudi
 
IBM - Introduction to Cloudant
IBM - Introduction to CloudantIBM - Introduction to Cloudant
IBM - Introduction to Cloudant
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
 
Windows Server 2012 Deep-Dive - EPC Group
Windows Server 2012 Deep-Dive - EPC GroupWindows Server 2012 Deep-Dive - EPC Group
Windows Server 2012 Deep-Dive - EPC Group
 
Azure SQL Database
Azure SQL DatabaseAzure SQL Database
Azure SQL Database
 
Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...
Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...
Navigating the turbulence on take-off: Setting up SharePoint on Azure IaaS th...
 
IaaS for DBAs in Azure
IaaS for DBAs in AzureIaaS for DBAs in Azure
IaaS for DBAs in Azure
 
Database Administration & Management - 01
Database Administration & Management - 01Database Administration & Management - 01
Database Administration & Management - 01
 
DBAM-01.pdf
DBAM-01.pdfDBAM-01.pdf
DBAM-01.pdf
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference Architectures
 

Último

Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 

Último (20)

Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 

SQL PASS Taiwan 七月份聚會-1

  • 1. Virtual Heterogeneous Database Platform Smith Yang 楊士岳 Trend Micro-Corp IT Technology Team DBA 7/19/2013 Version 0.1
  • 2. Agenda  Project Background  Project Objective  Virtual Platform and Solutions  DB Server Model Selection  DB High Availability Solution  Datakeeper vs Failover Clustering  Operation Team’s Concern  Monitoring Team’s Endorsement 7/19/2013 | Virtual Heterogeneous Database Platform2 |
  • 3. Project Background Current physical DB server challenges • Low utilization : High occupation of rack space for physical servers • Physical limitation: Difficulty to move services in the rack • High Cost : Hosting and maintenance of physical servers dedicated for single projects 7/19/2013 | Virtual Heterogeneous Database Platform3 |
  • 4. Project Objective  Support direction of Cloud Enablement by moving 100% of Data Center Virtualization  Provide a Virtualization Platform to host multiple database platforms and solutions requiring high performance  Provide Security and Performance Isolation for services while still achieving high degree of Hardware Utilization  Improve Efficiency of DB Service through automated provisioning and management 7/19/2013 | Virtual Heterogeneous Database Platform4 |
  • 5. 7/19/2013 | Virtual Heterogeneous Database Platform5 | APP APP SQL SQL SSD/SAS CPU RAM Hypervisors SSD/SAS CPU RAM SSD/SAS CPU RAM SSD/SAS CPU RAM Management Layer APP APP VIRTUAL SOLUTIONS VIRTUAL PLATFORM • Support Legacy DB Services (SQL2005, 2008, MySQL, etc..) • Multiple HA Solutions depending on Service Needs (DataKeeper, Replication, AlwaysOn, Load Balancing Solutions etc..) • Automated Deployment and Configuration • Leveraging Application or Database HA Solutions (not VMware HA) • Platform to Support Cloud Design • Utilize local SSD and Caching Technology to improve IO capability by a factor of x10 • Segregation of Services into Different Virtual Machines • Compute Performance Isolated Per Service • Security Isolated per Service • Platform to Support Package Apps (see above) • Full Utilization of Hardware Orchestration Virtual Platform and Solutions
  • 6. DB Server Model Selection Consumption Low Medium High CPU 1 v-CPU 2 v-CPU 4 v-CPU Memory 8 GB 16 GB 32 GB  Compute resource allocation for VM server • VM local storage allocation base on service need Model High Performance High Capacity Hard disk Pure SSD Hybrid SSD+SAS Capacity Up to 2880 GB Up to 4860 GB Note. Higher resource request would be exception only Local Datastore
  • 7. DB High Availability Solution Features Datakeeper Clustering Mirroring AlwaysOn Log Shipping Replication Software Hardware DKCE Licenses MS-SQL / Storage MS-SQL MS-SQL 2012 MS-SQL MS-SQL Auto Failover Yes Yes Yes (HA mode) Yes No No Units Node Server Node Server DB Group of DB DB Table Articles Data Replica 1 (*) 0 1 0-4 Unlimited Unlimited Note (*) New version DKCE allow for snapshot at Mirror node, offload the backup and reporting from Primary node Our application level solutions can also utilized similar to physical DB servers. 7/19/2013 | Virtual Heterogeneous Database Platform7 |
  • 8. Datakeeper - Alternative Approach to Clustering Traditional Clustering - Shared SAN Storage Clustering with Local Storage and Datakeeper Challenges : • No Persistent Shared Storage Options in AWS – Not cloud ready • Requirement for Shared SAN Storage • Disaster Recovery Requires Expensive SAN Replication Technology • 1 Copy of the Data • Complex Setup – Raw Device Mappings Benefits : • Fully Supported HA Solution in AWS Public Cloud – more here • Local Storage – no SAN • Low cost solution for keeping Disaster Recovery site in synch. • Mirror Copy of data can be used to offload backups and reporting • Simple to configure 7/19/2013 | Virtual Heterogeneous Database Platform8 |
  • 9.  Future Flexibility : DC OPs consider to reserve more resources (HBA/Memory/HDD) in server.  Multiple Cluster Nodes Design : We could have enough time to recovery from any hardware failure.  Standard SOP : Exercise and rebuild in pilot test servers.  Parallel Pilot : P2V transformation from Production then test together with service owners.  Get Familiar With : Maintenance for Windows Cluster + SQL 2012 AlwaysOn AG + Datakeeper.  Performance Impact : While multiple DB Instance running together in one physical server.  Network Loading : Monitor 1GB Ethernet Switch within DataCenter and cross-site utilization. Operation Team’s Concern 7/19/2013 | Virtual Heterogeneous Database Platform9 |
  • 10. The monitoring scope of new DB platform can be covered by the following tools. Monitoring Team’s Endorsement Item Monitor Tools Service availability PRTG, Quest Foglight Performance Monitoring Quest Performance Analysis Capacity Management PRTG, Quest Capacity Manager Backup Quest LiteSpeed, Veeam, SQL Backup, CommVault Audit MS SQL Audit tool 7/19/2013 | Virtual Heterogeneous Database Platform10 |
  • 11. Q & A 7/19/2013 | Virtual Heterogeneous Database Platform11 |

Notas del editor

  1. We have a legacy data center, SJDC. The architecture is very complex and hard to maintain. We have had many P0 incidents in the past due to the complexity, and many P0 incidents due to the manual change in order to provision service.The power & cooling capacity is another issue in SJDC. We can’t fully utilize all the rack space we have which means we need to spend more money in order to get more space.SJDC is located in bay area and has a great change of having a big earthquake in the future.