SlideShare una empresa de Scribd logo
1 de 34
Descargar para leer sin conexión
Exadata Migration
   How to modernize your database platform to realize consolidation savings




Chris Bradham
About Applied Engineering Management
Applied Engineering Management (AEM) Corporation Founded in 1986 as a
100% woman-owned business

More than 25 years of profitable growth

Headquartered in Chantilly, VA with offices located in major metropolitan
areas including; Los Angeles, San Antonio, and Jacksonville

Diversified client base including Fortune 500 and major government
agencies

Industry recognized awards and certifications for performance, capability
and delivery
Chris Bradham

•Oracle DBA experience 1997 to present (Oracle 7 to 11.2)

•Replication, Materialized Views, Data Guard, GoldenGate, Exadata, RAC

•Part-time Instructor George Mason University (OCA/OCP)

•Oracle Certified Exadata Implementation Specialist, Oracle Certified
Professional (11g), Oracle Performance Tuning Certified(11g), ITIL
Foundation, Security+

•Oracle Application Server, SAN Administration, Linux Administration,
VMWare, IBM / Sun Blade Administration


chris.bradham@aemcorp.com
What’s being covered?
 •Technology Refresh
 •Legacy Environment / Options
 •Exadata Components
 •Operational Considerations
 •Migration Considerations
 •Results of Migration
 •Lessons Learned
 •References
 •Q & A
Disclaimer


 The US Navy, Commander Navy Installations Command (CNIC), nor
 any related government organization in no way endorse Oracle
 Corporation or the Oracle Exadata Database Machine. The opinions
 expressed during the presentation are solely those of the presenter
 and in no way reflects those of the government or any government
 interest.
Background Information
   Global multi-service DoD Web-based Housing application


   Over 300 schemas


   750 Gb of data


   4,300 Active Users


   4.2 million annual log ins



   4,500 Reports Generated Per Day


   AEM Corporation responsible for Hosting / Operations & Maintenance / Technology Refresh
Legacy Configuration



                       Physical Application Servers
                       4 Gbps Fibre Channel
                       Clarion Disk Array (10k / 15k RPM)
                       5 Node RAC Servers
                       Oracle 10gR2 RAC install
Pre-Tech Refresh Issues

 Legacy hardware over six years old

 •Patches (5 nodes, slower machines)
 •Deployments, data updates time consuming
 •Large or complex reports often hang
 •Node evictions due to network / disk speed issues
 •Oracle 10.2.0.4 Support ended 6/31/11




 Data Warehouse delay due to performance requirements
 (Oracle Streams attempt)
Alternative 1 : Based on Legacy Solution



                       Virtualized application servers
                       Network bonding
                       8 Gbps Fibre Channel
                       EMC Disk Array
                       5 Node RAC Servers
                       Oracle 11gR2 RAC install
Alternative 2 : Based on Exadata Solution


                      Virtualized application servers
                      Network bonding
                      40 Gbps backbone
                      Oracle Storage Servers
                      2 node Quarter Rack
                      Oracle 11gR2 RAC preconfigured




                     Surprise, we chose Exadata!
Exadata Selection Points

•Licensing fees made Exadata the low cost solution

•Total database hardware solution
    o2 nodes vs. 5 nodes
    oNumber of Vendors

•Patch Strategy

•Sizable and expandable

•Oracle vested to help DoD succeed

•Storage Indexes / Smart Scan / Smart Flash Cache
Throughput Gb/Second
  80.0

                                                         75
  70.0

  60.0

  50.0                                                        2 Gbps Fibre Channel x2

                                                              4 Gbps Fibre Channel x2
   40.0
                                                              8 Gbps Fibre Channel x2
   30.0                                             37
                                                              Exadata 1/4 - Disk

   20.0                                   25
                                                              Exadata 1/2 - Disk

   10.0                            12.5        16             Exadata Full - Disk
           0.4   0.8         5.4
                       1.6                                    Exadata 1/4 - Disk & Flash
     0.0
                                                              Exadata 1/2 - Disk & Flash

                                                              Exadata Full - Disk & Flash
Exadata Planning/Considerations
•Pre-configuration customer worksheet (DBM Configuration spreadsheet)

•Initial Setup Activities
     •Network Configuration / Software Installation

•Procurement considerations (2 Quarter Racks)

•Space Choices
    •High Capacity (3 Tb / 7.2 K RPM)
    •High Performance ( 600 Gb / 15k RPM)

•Space Allocation (ASM Disk Group layout)
    •78% DATA, 20% RECO, 2% DBFS_DG
            o25 Tb      <- Production (Triple Mirror)
            o8 Tb       <- Test (Mirror)
Tech Refresh Challenges
•100% hardware replacement and Data Center move

•Narrow window for outage to avoid negative impact on end users

•Performance of system, database growth, and network bandwidth

•Exadata unproven in DoD space at the time (Security)

•Upgrading Database versions (data/code/reports)



Lots of change, what if issues surface???
Summary of Choices (X2)
                                       X2-8 Full     X2-2 Full        X2-2 Half     X2-2 Quarter
Initial / Licensing Cost                 $$$            $$$              $$              $
Database Servers                          2              8               4               2
Database Grid Cores                      160            96               48              24
Database Grid Memory (GB)                4096      768 (max 1152)   384 (max 576)   192 (max 288)
InfiniBand switches                       3              3               3               2
Ethernet switch                           1              1               1               1
KVM                                       No            Yes             Yes             Yes
Exadata Storage Servers                   14            14               7               3
Storage Grid CPU Cores                   168            168              84              36
Raw Flash Capacity                      5.3 TB         5.3 TB          2.6 TB          1.1 TB

Raw Storage                High Perf   100 TB         100 TB           50 TB          21.6 TB
Capacity                   High Cap    504 TB         504 TB           252 TB          108 TB

Usable mirrored            High Perf    45 TB          45 TB          22.5 TB          9.5 TB
capacity                   High Cap    224 TB         224 TB           112 TB          48 TB

Usable Triple              High Perf    30 TB          30 TB           15 TB           6.5 TB
mirrored capacity          High Cap    150 TB         150 TB           75 TB           32 TB
Summary of Choices (X3)
                                       X3-8 Full   X3-2 Full     X3-2 Half    X3-2 Quarter   X3-2 Eighth
Initial / Licensing Cost                 $$$         $$$            $$              $             $
Database Servers                          2           8              4              2             2
Database Grid Cores                      160         128            64             32            16
                                                   1024 (max
Database Grid Memory (GB)               4096                   512 (max 1024) 256 (max 512) 256 (max 512)
                                                     2048)
InfiniBand switches                       3           3              3              2             2
Ethernet switch                           1           1              1              1             1
KVM                                      Yes         Yes            Yes           Yes            Yes
Exadata Storage Servers                   14          14             7              3             3
Storage Grid CPU Cores                   168         168            84             36            36
Raw Flash Capacity                     22.4 TB      22.4 TB       11.2 TB        4.8 TB         2.4TB

Raw Storage                High Perf   100 TB       100 TB         50 TB         21.6 TB       10.8TB
Capacity                   High Cap    504 TB       504 TB        252 TB         108 TB         54 TB

Usable mirrored            High Perf    45 TB       45 TB         22.5 TB        9.5 TB        4.5 TB
capacity                   High Cap    224 TB       224 TB        112 TB         48 TB          23 TB
Smart Flash Cache Considerations
Helps with…
   •Write-Through cache voids caching data that will not be reused
   •Holds hot data, much faster than disk (small, random I/O)
   •Data not duplicated from cache in other Storage Servers
   •Reduce latency of log write by simultaneous write to flash / disk
   (faster writes) with minimal space (512 Mb)
   •Write-Back cache 11.2.0.3.9

Don’t touch except for…
   •Alter table <table_name> flash_cache keep;
   •Create Flash Disks out of the Flash Cache
       •Reassign portion for TEMP tablespace on index builds
Database Node Considerations
•Database Consolidation
•SGA Settings
    •AMM Bad! ASMM Good! (set minimum values)
•Huge Pages (reduce overhead)
•Where’s the shared storage space?
    •DBFS is the answer (fix_control=8,ac_timeout=60 and SGA=2Gb)
•Is everything setup correctly?
    •Exachk is the answer
•Indexes / Hints / Compression
•Large Segments <- 8 Mb Initial / Next Size with Autoallocate
•TEMP <- BIGFILE, Autoextend 1 Gb, Uniform 1 Mb
Exadata Patch Management

Multiple Patches

    •Infiniband (once per year)

    •DB Nodes / Storage Server (quarterly)

    •Bundle Patch (BP) DB Software (quarterly)

    •Additional components (Ethernet switch, KVM, PDU)

Bug Fixes included so important to apply

One-off patches / opatch before and after patch

Rolling option time a consideration
Security
•DoD 8570 Requirements

•Security Technical Implementation Guide (STIG)

    oOracle installation not customizable

    oDBFS and idle_time don’t play well together

    oAutomatic Service Request (ASR) / Configuration Manager Limitation

    oGrid Control / Third Party Certificates (September release)

    oBanners / SQLNET.ORA settings impact on tools

Don’t assume security settings will not have impact. Must TEST!!!
Migration Strategies

10.2.0.4 to 11.2.0.x Options Considered
    •DBFS with external tables (5 to 7 GB/sec file system I/O throughput)
    •GoldenGate with datapump (near-zero downtime)
    •Datapump
Factors
    •Maintenance window
    •Risk of data loss
    •Familiarity with technology

Whatever the choice, perform multiple trial runs for optimal settings.
2011 – Technical Refresh (Data Center move)

On 9/9/11 at 7pm application
servers at legacy site were Turned
Off:
•Transferred all data to Data Center
•Reloaded data for all installations
•Network outage occurred during
data transfer (2 hours)
•On 9/10/11at 7am New System
Testing was Initiated
• Users were on the system by 3pm


•In Future-> X3 or Storage Expansion
Migration Timeline


                                            Text            Initial
1/4 Rack           Grid                                       DB                      Cutover
Delivered                               Migration   Oracle Setup / STIG Prod/
          Migrate Control     Setup                                                      to
 (Test) Options Setup         DBFS        Test       CAB     Load   Apply BP          Exadata




   1/11        2/11    3/11      4/11        5/11    6/11       7/11      8/11        9/11




    Chris Initial DB   STIG     Apply BP      Migration     1/4 Rack    Migration   Grid
    First Setup /      Test       Test        Selection     Delivered     Test    Control
    Day     Load
                                                             (Prod)                Setup
Post Tech Refresh Performance (in hours)


     Event          Legacy       Exadata
     BOR1 Process   4 hours      1 hour

     BOR2 Process   4 minutes    23 seconds

     Datamart IU    3 hours      35 minutes

     MV refresh     37 minutes   13 minutes
Exadata Lessons Learned
•Ensure hosting center can accommodate Exadata’s dimensions (door height)

•Staff requirements (more communication necessary)
•Smart Scan <- direct path reads, table access full, fast full index scans,
parallel with parallel_degree_policy not auto
•Chained rows / “small” tables void smart scans

•Ideally 2 Exadata Database machines

•EHCC 10x space and performance (DML)

•Expect CPU utilization to decrease



                                                                In-Memory
                                           X2-8                Massive Memory       X3
                                           2010               All I/Os to Memory   2012
Exadata Lessons Learned (cont.)

•Grid Control for monitoring / managing components

•Platinum Support, major assistance

•Exachk and opatch before / after patching

•Standard tuning principles apply (OLTP)

•Bring over OLTP database “AS-IS”

•Time, Experience keys to stability
References
http://www.oracle.com/technetwork/database/options/olap/olap-exadata-x2-2-
performance-1429042.pdf
http://www.scribd.com/doc/57026846/Exadata-Smart-Flash-Cache-366203
http://www.oracle.com/technetwork/database/exadata/exadata-technical-whitepaper-
134575.pdf
http://www.oracle.com/technetwork/server-storage/engineered-
systems/exadata/exadata-storage-technical-overview-128045.pdf
http://www.oracle.com/technetwork/database/features/availability/exadata-consolidation-
522500.pdf
http://www.ioug.org/Portals/0/Documents/Anuj%20Mohan.pdf
http://nyoug.org/Presentations/2011/March/Niemiec_Keynote_Exadata.pdf
http://www.oracle.com/technetwork/articles/oem/exadata-commands-part1-402441.html
http://www.centroid.com/webinars/ExadataChangestheGame.pdf
http://www.centroid.com/knowledgebase/blog/using-dbfs-and-external-tables
References (cont.)
Database Machine and Exadata Storage Server (888828.1)
Oracle Exadata Database Machine exachk (1070954.1)
Oracle Exadata Best Practices (757552.1)
Best Practices for OLTP on the Sun Oracle Database Machine (1269706.1)
Best Practices for Data Warehousing on Database Machine (1297112.1)
Oracle Sun Database Machine Application Best Practices for Data Warehousing
(1094934.1)
Oracle Sun Database Machine Diagnosability and Troubleshooting Best Practices
(1274324.1)
Expert Oracle Exadata (Osborne, Johnson, Poder)
Questions???
Backup Slides
Exadata Rack Options
2 six Core Processors / 96 Gb RAM per DB node
2 six Core Processors / 24 Gb RAM per Storage Server
Dual ported 40 Gb/sec InfiniBand
Quarter Rack
   •2 DB nodes
   •2 Infiniband switches
Half Rack
   •4 DB nodes
   •3 Infiniband switches
Full Rack
   •8 DB nodes
   •3 Infiniband switches
Infiniband 10x faster than Fiber Channel
Cache Hierarchy (Full Rack X2-2)

                    Database DRAM

   768 GB Raw Capacity                100 GB / Second


                        Flash Cache

    5 TB Raw Capacity                 50 GB / Second


                           Disk
 100 – 300 TB Raw Capacity            21 GB / Second
Quarter Rack Selected
 •2 Xeon-based Dual-processor Database Servers (Sun Fire
 X4170 M2)
       • 24 cores (12 per server)
       • 192 GB memory expandable to 288 GB (96 GB per
         server expandable to 144 GB)
       • 10 GigE connectivity to Data Center
             • 4 x 10GbE ports (2 per server)
 •1.1 TB High Speed Flash
 •3 Exadata Storage Servers X2-2
       • All with High Performance 600GB disks
       OR
       • All with High Capacity 3 TB disks
 •2 Sun Datacenter InfiniBand Switch
       • 36-port Managed QDR (40Gb/s) switch
 •1 “Admin” Cisco Ethernet switch
 •Keyboard, Video, Mouse (KVM) hardware        Can Upgrade to a Half   Rack
 •Redundant Power Distributions Units (PDUs)   or just add storage
Storage Components and Expansion (X2)
-Local Storage (750 GB)
-Storage Servers (12 Disks per server)
                                          Full      Half    Quarter
       InfiniBand switches                 3         3        2
       Ethernet switch                     1         1        1
       KVM                                Yes       Yes      Yes
       Exadata Storage Servers             18        9        4
       Storage Grid CPU Cores             216       108       48
       Raw Flash Capacity                6.75 TB   3.4 TB   1.5 TB
       Raw Storage           High Perf   128 TB    64 TB     28 TB
       Capacity              High Cap    648 TB    324 TB   144 TB
       Usable mirrored       High Perf   58 TB     29 TB     13 TB
       capacity              High Cap    288 TB    144 TB    64 TB
       Usable Triple         High Perf    38 TB    19 TB     8.5TB
       mirrored capacity     High Cap    192 TB    96 TB     43 TB

Más contenido relacionado

La actualidad más candente

Collier exadata technical overview presentation 4 14-10
Collier exadata technical overview presentation 4 14-10Collier exadata technical overview presentation 4 14-10
Collier exadata technical overview presentation 4 14-10xKinAnx
 
Oracle Exadata Version 2
Oracle Exadata Version 2Oracle Exadata Version 2
Oracle Exadata Version 2Jarod Wang
 
Introduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning ToolIntroduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning ToolSuresh Paulraj
 
MySQL Cluster Performance Tuning - 2013 MySQL User Conference
MySQL Cluster Performance Tuning - 2013 MySQL User ConferenceMySQL Cluster Performance Tuning - 2013 MySQL User Conference
MySQL Cluster Performance Tuning - 2013 MySQL User ConferenceSeveralnines
 
Linux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQLLinux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQLYoshinori Matsunobu
 
Exadata Patching Demystified
Exadata Patching DemystifiedExadata Patching Demystified
Exadata Patching DemystifiedEnkitec
 
London + Dublin Cassandra 2.0
London + Dublin Cassandra 2.0London + Dublin Cassandra 2.0
London + Dublin Cassandra 2.0jbellis
 
Webinar NETGEAR - ReadyNAS, le novità hardware e software
Webinar NETGEAR - ReadyNAS, le novità hardware e softwareWebinar NETGEAR - ReadyNAS, le novità hardware e software
Webinar NETGEAR - ReadyNAS, le novità hardware e softwareNetgear Italia
 
[3]dell storage spaces c 1
[3]dell storage spaces c 1[3]dell storage spaces c 1
[3]dell storage spaces c 1Megan Warren
 
State of Cassandra 2012
State of Cassandra 2012State of Cassandra 2012
State of Cassandra 2012jbellis
 
Oracle Exadata 1Z0-485 Certification
Oracle Exadata 1Z0-485 CertificationOracle Exadata 1Z0-485 Certification
Oracle Exadata 1Z0-485 CertificationExadatadba
 
OSS Presentation by Kevin Halgren
OSS Presentation by Kevin HalgrenOSS Presentation by Kevin Halgren
OSS Presentation by Kevin HalgrenOpenStorageSummit
 
Enterprise Virtualization with Xen
Enterprise Virtualization with XenEnterprise Virtualization with Xen
Enterprise Virtualization with XenFrank Martin
 
Oracle Real Application Cluster ( RAC )
Oracle Real Application Cluster ( RAC )Oracle Real Application Cluster ( RAC )
Oracle Real Application Cluster ( RAC )varasteh65
 
Oow 2008 yahoo_pie-db
Oow 2008 yahoo_pie-dbOow 2008 yahoo_pie-db
Oow 2008 yahoo_pie-dbbohanchen
 
Managing Exadata in the Real World
Managing Exadata in the Real WorldManaging Exadata in the Real World
Managing Exadata in the Real WorldEnkitec
 

La actualidad más candente (20)

Collier exadata technical overview presentation 4 14-10
Collier exadata technical overview presentation 4 14-10Collier exadata technical overview presentation 4 14-10
Collier exadata technical overview presentation 4 14-10
 
Oracle Exadata Version 2
Oracle Exadata Version 2Oracle Exadata Version 2
Oracle Exadata Version 2
 
Introduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning ToolIntroduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning Tool
 
Oracle Exadata X2-8: A Critical Review
Oracle Exadata X2-8: A Critical ReviewOracle Exadata X2-8: A Critical Review
Oracle Exadata X2-8: A Critical Review
 
MySQL Cluster Performance Tuning - 2013 MySQL User Conference
MySQL Cluster Performance Tuning - 2013 MySQL User ConferenceMySQL Cluster Performance Tuning - 2013 MySQL User Conference
MySQL Cluster Performance Tuning - 2013 MySQL User Conference
 
Linux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQLLinux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQL
 
Exadata Patching Demystified
Exadata Patching DemystifiedExadata Patching Demystified
Exadata Patching Demystified
 
V L S
V L SV L S
V L S
 
London + Dublin Cassandra 2.0
London + Dublin Cassandra 2.0London + Dublin Cassandra 2.0
London + Dublin Cassandra 2.0
 
Webinar NETGEAR - ReadyNAS, le novità hardware e software
Webinar NETGEAR - ReadyNAS, le novità hardware e softwareWebinar NETGEAR - ReadyNAS, le novità hardware e software
Webinar NETGEAR - ReadyNAS, le novità hardware e software
 
Exadata database machine_x5-2
Exadata database machine_x5-2Exadata database machine_x5-2
Exadata database machine_x5-2
 
[3]dell storage spaces c 1
[3]dell storage spaces c 1[3]dell storage spaces c 1
[3]dell storage spaces c 1
 
State of Cassandra 2012
State of Cassandra 2012State of Cassandra 2012
State of Cassandra 2012
 
Oracle Exadata 1Z0-485 Certification
Oracle Exadata 1Z0-485 CertificationOracle Exadata 1Z0-485 Certification
Oracle Exadata 1Z0-485 Certification
 
OSS Presentation by Kevin Halgren
OSS Presentation by Kevin HalgrenOSS Presentation by Kevin Halgren
OSS Presentation by Kevin Halgren
 
Enterprise Virtualization with Xen
Enterprise Virtualization with XenEnterprise Virtualization with Xen
Enterprise Virtualization with Xen
 
Oracle Real Application Cluster ( RAC )
Oracle Real Application Cluster ( RAC )Oracle Real Application Cluster ( RAC )
Oracle Real Application Cluster ( RAC )
 
Oow 2008 yahoo_pie-db
Oow 2008 yahoo_pie-dbOow 2008 yahoo_pie-db
Oow 2008 yahoo_pie-db
 
Managing Exadata in the Real World
Managing Exadata in the Real WorldManaging Exadata in the Real World
Managing Exadata in the Real World
 
5 Steps to PostgreSQL Performance
5 Steps to PostgreSQL Performance5 Steps to PostgreSQL Performance
5 Steps to PostgreSQL Performance
 

Similar a How to Modernize Your Database Platform to Realize Consolidation Savings

Hadoop on a personal supercomputer
Hadoop on a personal supercomputerHadoop on a personal supercomputer
Hadoop on a personal supercomputerPaul Dingman
 
Exadata_X10M-Hardware-Overview.pdf
Exadata_X10M-Hardware-Overview.pdfExadata_X10M-Hardware-Overview.pdf
Exadata_X10M-Hardware-Overview.pdfKoko842772
 
Theta and the Future of Accelerator Programming
Theta and the Future of Accelerator ProgrammingTheta and the Future of Accelerator Programming
Theta and the Future of Accelerator Programminginside-BigData.com
 
SUN主机产品介绍.ppt
SUN主机产品介绍.pptSUN主机产品介绍.ppt
SUN主机产品介绍.pptPencilData
 
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...Dell Technologies
 
Sun storage tek 6140 technical presentation
Sun storage tek 6140 technical presentationSun storage tek 6140 technical presentation
Sun storage tek 6140 technical presentationxKinAnx
 
Dmx3 950-technical specifications
Dmx3 950-technical specificationsDmx3 950-technical specifications
Dmx3 950-technical specificationsRaghul P
 
Trend - HPC-29mai2012
Trend - HPC-29mai2012Trend - HPC-29mai2012
Trend - HPC-29mai2012Agora Group
 
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...Red_Hat_Storage
 
Nextserver Evo
Nextserver EvoNextserver Evo
Nextserver Evodellarocco
 
Exaflop In 2018 Hardware
Exaflop In 2018   HardwareExaflop In 2018   Hardware
Exaflop In 2018 HardwareJacob Wu
 
Argonne's Theta Supercomputer Architecture
Argonne's Theta Supercomputer ArchitectureArgonne's Theta Supercomputer Architecture
Argonne's Theta Supercomputer Architectureinside-BigData.com
 
Exadata x2 ext
Exadata x2 extExadata x2 ext
Exadata x2 extyangjx
 
QsNetIII, An HPC Interconnect For Peta Scale Systems
QsNetIII, An HPC Interconnect For Peta Scale SystemsQsNetIII, An HPC Interconnect For Peta Scale Systems
QsNetIII, An HPC Interconnect For Peta Scale SystemsFederica Pisani
 
Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...
Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...
Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...Jeff Larkin
 
QCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference ArchitectureQCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference ArchitectureCeph Community
 
QCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference ArchitectureQCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference ArchitecturePatrick McGarry
 

Similar a How to Modernize Your Database Platform to Realize Consolidation Savings (20)

Hadoop on a personal supercomputer
Hadoop on a personal supercomputerHadoop on a personal supercomputer
Hadoop on a personal supercomputer
 
Exadata_X10M-Hardware-Overview.pdf
Exadata_X10M-Hardware-Overview.pdfExadata_X10M-Hardware-Overview.pdf
Exadata_X10M-Hardware-Overview.pdf
 
Theta and the Future of Accelerator Programming
Theta and the Future of Accelerator ProgrammingTheta and the Future of Accelerator Programming
Theta and the Future of Accelerator Programming
 
SUN主机产品介绍.ppt
SUN主机产品介绍.pptSUN主机产品介绍.ppt
SUN主机产品介绍.ppt
 
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...
Dell Technologies Dell EMC Data Protection Solutions On One Single Page - POS...
 
Sun storage tek 6140 technical presentation
Sun storage tek 6140 technical presentationSun storage tek 6140 technical presentation
Sun storage tek 6140 technical presentation
 
Dmx3 950-technical specifications
Dmx3 950-technical specificationsDmx3 950-technical specifications
Dmx3 950-technical specifications
 
Trend - HPC-29mai2012
Trend - HPC-29mai2012Trend - HPC-29mai2012
Trend - HPC-29mai2012
 
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...
Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Ha...
 
Nextserver Evo
Nextserver EvoNextserver Evo
Nextserver Evo
 
Nextserver Evo
Nextserver EvoNextserver Evo
Nextserver Evo
 
Exaflop In 2018 Hardware
Exaflop In 2018   HardwareExaflop In 2018   Hardware
Exaflop In 2018 Hardware
 
Argonne's Theta Supercomputer Architecture
Argonne's Theta Supercomputer ArchitectureArgonne's Theta Supercomputer Architecture
Argonne's Theta Supercomputer Architecture
 
Exadata x2 ext
Exadata x2 extExadata x2 ext
Exadata x2 ext
 
LUG 2014
LUG 2014LUG 2014
LUG 2014
 
Meetup Oracle Database MAD_BCN: 4 Saborea Exadata
Meetup Oracle Database MAD_BCN: 4 Saborea ExadataMeetup Oracle Database MAD_BCN: 4 Saborea Exadata
Meetup Oracle Database MAD_BCN: 4 Saborea Exadata
 
QsNetIII, An HPC Interconnect For Peta Scale Systems
QsNetIII, An HPC Interconnect For Peta Scale SystemsQsNetIII, An HPC Interconnect For Peta Scale Systems
QsNetIII, An HPC Interconnect For Peta Scale Systems
 
Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...
Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...
Maximizing Application Performance on Cray XT6 and XE6 Supercomputers DOD-MOD...
 
QCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference ArchitectureQCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference Architecture
 
QCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference ArchitectureQCT Ceph Solution - Design Consideration and Reference Architecture
QCT Ceph Solution - Design Consideration and Reference Architecture
 

Más de Isaac Christoffersen

OpenSource ToolChain for the Hybrid Cloud
OpenSource ToolChain for the Hybrid CloudOpenSource ToolChain for the Hybrid Cloud
OpenSource ToolChain for the Hybrid CloudIsaac Christoffersen
 
PaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of Choice
PaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of ChoicePaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of Choice
PaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of ChoiceIsaac Christoffersen
 
Service Delivery Assembly Line with Vagrant, Packer, and Ansible
Service Delivery Assembly Line with Vagrant, Packer, and AnsibleService Delivery Assembly Line with Vagrant, Packer, and Ansible
Service Delivery Assembly Line with Vagrant, Packer, and AnsibleIsaac Christoffersen
 
Manage Java Applications in an Open Hybrid Cloud
Manage Java Applications in an Open Hybrid CloudManage Java Applications in an Open Hybrid Cloud
Manage Java Applications in an Open Hybrid CloudIsaac Christoffersen
 
Liberate Your Files with a Private Cloud Storage Solution powered by Open Source
Liberate Your Files with a Private Cloud Storage Solution powered by Open SourceLiberate Your Files with a Private Cloud Storage Solution powered by Open Source
Liberate Your Files with a Private Cloud Storage Solution powered by Open SourceIsaac Christoffersen
 
Destination Marketing Open Source and Cloud Presentation
Destination Marketing Open Source and Cloud PresentationDestination Marketing Open Source and Cloud Presentation
Destination Marketing Open Source and Cloud PresentationIsaac Christoffersen
 

Más de Isaac Christoffersen (10)

OpenSource ToolChain for the Hybrid Cloud
OpenSource ToolChain for the Hybrid CloudOpenSource ToolChain for the Hybrid Cloud
OpenSource ToolChain for the Hybrid Cloud
 
PaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of Choice
PaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of ChoicePaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of Choice
PaaS Anywhere - Deploying an OpenShift PaaS into your Cloud Provider of Choice
 
Service Delivery Assembly Line with Vagrant, Packer, and Ansible
Service Delivery Assembly Line with Vagrant, Packer, and AnsibleService Delivery Assembly Line with Vagrant, Packer, and Ansible
Service Delivery Assembly Line with Vagrant, Packer, and Ansible
 
The CIO's alternative
The CIO's alternativeThe CIO's alternative
The CIO's alternative
 
JBoss Community vs Enterprise
JBoss Community vs EnterpriseJBoss Community vs Enterprise
JBoss Community vs Enterprise
 
Manage Java Applications in an Open Hybrid Cloud
Manage Java Applications in an Open Hybrid CloudManage Java Applications in an Open Hybrid Cloud
Manage Java Applications in an Open Hybrid Cloud
 
Liberate Your Files with a Private Cloud Storage Solution powered by Open Source
Liberate Your Files with a Private Cloud Storage Solution powered by Open SourceLiberate Your Files with a Private Cloud Storage Solution powered by Open Source
Liberate Your Files with a Private Cloud Storage Solution powered by Open Source
 
Brms road map_10-17-12
Brms road map_10-17-12Brms road map_10-17-12
Brms road map_10-17-12
 
Destination Marketing Open Source and Cloud Presentation
Destination Marketing Open Source and Cloud PresentationDestination Marketing Open Source and Cloud Presentation
Destination Marketing Open Source and Cloud Presentation
 
Seam CMJUG Presentation
Seam CMJUG PresentationSeam CMJUG Presentation
Seam CMJUG Presentation
 

Último

COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 

Último (20)

COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 

How to Modernize Your Database Platform to Realize Consolidation Savings

  • 1. Exadata Migration How to modernize your database platform to realize consolidation savings Chris Bradham
  • 2. About Applied Engineering Management Applied Engineering Management (AEM) Corporation Founded in 1986 as a 100% woman-owned business More than 25 years of profitable growth Headquartered in Chantilly, VA with offices located in major metropolitan areas including; Los Angeles, San Antonio, and Jacksonville Diversified client base including Fortune 500 and major government agencies Industry recognized awards and certifications for performance, capability and delivery
  • 3. Chris Bradham •Oracle DBA experience 1997 to present (Oracle 7 to 11.2) •Replication, Materialized Views, Data Guard, GoldenGate, Exadata, RAC •Part-time Instructor George Mason University (OCA/OCP) •Oracle Certified Exadata Implementation Specialist, Oracle Certified Professional (11g), Oracle Performance Tuning Certified(11g), ITIL Foundation, Security+ •Oracle Application Server, SAN Administration, Linux Administration, VMWare, IBM / Sun Blade Administration chris.bradham@aemcorp.com
  • 4. What’s being covered? •Technology Refresh •Legacy Environment / Options •Exadata Components •Operational Considerations •Migration Considerations •Results of Migration •Lessons Learned •References •Q & A
  • 5. Disclaimer The US Navy, Commander Navy Installations Command (CNIC), nor any related government organization in no way endorse Oracle Corporation or the Oracle Exadata Database Machine. The opinions expressed during the presentation are solely those of the presenter and in no way reflects those of the government or any government interest.
  • 6. Background Information Global multi-service DoD Web-based Housing application Over 300 schemas 750 Gb of data 4,300 Active Users 4.2 million annual log ins 4,500 Reports Generated Per Day AEM Corporation responsible for Hosting / Operations & Maintenance / Technology Refresh
  • 7. Legacy Configuration Physical Application Servers 4 Gbps Fibre Channel Clarion Disk Array (10k / 15k RPM) 5 Node RAC Servers Oracle 10gR2 RAC install
  • 8. Pre-Tech Refresh Issues Legacy hardware over six years old •Patches (5 nodes, slower machines) •Deployments, data updates time consuming •Large or complex reports often hang •Node evictions due to network / disk speed issues •Oracle 10.2.0.4 Support ended 6/31/11 Data Warehouse delay due to performance requirements (Oracle Streams attempt)
  • 9. Alternative 1 : Based on Legacy Solution Virtualized application servers Network bonding 8 Gbps Fibre Channel EMC Disk Array 5 Node RAC Servers Oracle 11gR2 RAC install
  • 10. Alternative 2 : Based on Exadata Solution  Virtualized application servers  Network bonding  40 Gbps backbone  Oracle Storage Servers  2 node Quarter Rack  Oracle 11gR2 RAC preconfigured Surprise, we chose Exadata!
  • 11. Exadata Selection Points •Licensing fees made Exadata the low cost solution •Total database hardware solution o2 nodes vs. 5 nodes oNumber of Vendors •Patch Strategy •Sizable and expandable •Oracle vested to help DoD succeed •Storage Indexes / Smart Scan / Smart Flash Cache
  • 12. Throughput Gb/Second 80.0 75 70.0 60.0 50.0 2 Gbps Fibre Channel x2 4 Gbps Fibre Channel x2 40.0 8 Gbps Fibre Channel x2 30.0 37 Exadata 1/4 - Disk 20.0 25 Exadata 1/2 - Disk 10.0 12.5 16 Exadata Full - Disk 0.4 0.8 5.4 1.6 Exadata 1/4 - Disk & Flash 0.0 Exadata 1/2 - Disk & Flash Exadata Full - Disk & Flash
  • 13. Exadata Planning/Considerations •Pre-configuration customer worksheet (DBM Configuration spreadsheet) •Initial Setup Activities •Network Configuration / Software Installation •Procurement considerations (2 Quarter Racks) •Space Choices •High Capacity (3 Tb / 7.2 K RPM) •High Performance ( 600 Gb / 15k RPM) •Space Allocation (ASM Disk Group layout) •78% DATA, 20% RECO, 2% DBFS_DG o25 Tb <- Production (Triple Mirror) o8 Tb <- Test (Mirror)
  • 14. Tech Refresh Challenges •100% hardware replacement and Data Center move •Narrow window for outage to avoid negative impact on end users •Performance of system, database growth, and network bandwidth •Exadata unproven in DoD space at the time (Security) •Upgrading Database versions (data/code/reports) Lots of change, what if issues surface???
  • 15. Summary of Choices (X2) X2-8 Full X2-2 Full X2-2 Half X2-2 Quarter Initial / Licensing Cost $$$ $$$ $$ $ Database Servers 2 8 4 2 Database Grid Cores 160 96 48 24 Database Grid Memory (GB) 4096 768 (max 1152) 384 (max 576) 192 (max 288) InfiniBand switches 3 3 3 2 Ethernet switch 1 1 1 1 KVM No Yes Yes Yes Exadata Storage Servers 14 14 7 3 Storage Grid CPU Cores 168 168 84 36 Raw Flash Capacity 5.3 TB 5.3 TB 2.6 TB 1.1 TB Raw Storage High Perf 100 TB 100 TB 50 TB 21.6 TB Capacity High Cap 504 TB 504 TB 252 TB 108 TB Usable mirrored High Perf 45 TB 45 TB 22.5 TB 9.5 TB capacity High Cap 224 TB 224 TB 112 TB 48 TB Usable Triple High Perf 30 TB 30 TB 15 TB 6.5 TB mirrored capacity High Cap 150 TB 150 TB 75 TB 32 TB
  • 16. Summary of Choices (X3) X3-8 Full X3-2 Full X3-2 Half X3-2 Quarter X3-2 Eighth Initial / Licensing Cost $$$ $$$ $$ $ $ Database Servers 2 8 4 2 2 Database Grid Cores 160 128 64 32 16 1024 (max Database Grid Memory (GB) 4096 512 (max 1024) 256 (max 512) 256 (max 512) 2048) InfiniBand switches 3 3 3 2 2 Ethernet switch 1 1 1 1 1 KVM Yes Yes Yes Yes Yes Exadata Storage Servers 14 14 7 3 3 Storage Grid CPU Cores 168 168 84 36 36 Raw Flash Capacity 22.4 TB 22.4 TB 11.2 TB 4.8 TB 2.4TB Raw Storage High Perf 100 TB 100 TB 50 TB 21.6 TB 10.8TB Capacity High Cap 504 TB 504 TB 252 TB 108 TB 54 TB Usable mirrored High Perf 45 TB 45 TB 22.5 TB 9.5 TB 4.5 TB capacity High Cap 224 TB 224 TB 112 TB 48 TB 23 TB
  • 17. Smart Flash Cache Considerations Helps with… •Write-Through cache voids caching data that will not be reused •Holds hot data, much faster than disk (small, random I/O) •Data not duplicated from cache in other Storage Servers •Reduce latency of log write by simultaneous write to flash / disk (faster writes) with minimal space (512 Mb) •Write-Back cache 11.2.0.3.9 Don’t touch except for… •Alter table <table_name> flash_cache keep; •Create Flash Disks out of the Flash Cache •Reassign portion for TEMP tablespace on index builds
  • 18. Database Node Considerations •Database Consolidation •SGA Settings •AMM Bad! ASMM Good! (set minimum values) •Huge Pages (reduce overhead) •Where’s the shared storage space? •DBFS is the answer (fix_control=8,ac_timeout=60 and SGA=2Gb) •Is everything setup correctly? •Exachk is the answer •Indexes / Hints / Compression •Large Segments <- 8 Mb Initial / Next Size with Autoallocate •TEMP <- BIGFILE, Autoextend 1 Gb, Uniform 1 Mb
  • 19. Exadata Patch Management Multiple Patches •Infiniband (once per year) •DB Nodes / Storage Server (quarterly) •Bundle Patch (BP) DB Software (quarterly) •Additional components (Ethernet switch, KVM, PDU) Bug Fixes included so important to apply One-off patches / opatch before and after patch Rolling option time a consideration
  • 20. Security •DoD 8570 Requirements •Security Technical Implementation Guide (STIG) oOracle installation not customizable oDBFS and idle_time don’t play well together oAutomatic Service Request (ASR) / Configuration Manager Limitation oGrid Control / Third Party Certificates (September release) oBanners / SQLNET.ORA settings impact on tools Don’t assume security settings will not have impact. Must TEST!!!
  • 21. Migration Strategies 10.2.0.4 to 11.2.0.x Options Considered •DBFS with external tables (5 to 7 GB/sec file system I/O throughput) •GoldenGate with datapump (near-zero downtime) •Datapump Factors •Maintenance window •Risk of data loss •Familiarity with technology Whatever the choice, perform multiple trial runs for optimal settings.
  • 22. 2011 – Technical Refresh (Data Center move) On 9/9/11 at 7pm application servers at legacy site were Turned Off: •Transferred all data to Data Center •Reloaded data for all installations •Network outage occurred during data transfer (2 hours) •On 9/10/11at 7am New System Testing was Initiated • Users were on the system by 3pm •In Future-> X3 or Storage Expansion
  • 23. Migration Timeline Text Initial 1/4 Rack Grid DB Cutover Delivered Migration Oracle Setup / STIG Prod/ Migrate Control Setup to (Test) Options Setup DBFS Test CAB Load Apply BP Exadata 1/11 2/11 3/11 4/11 5/11 6/11 7/11 8/11 9/11 Chris Initial DB STIG Apply BP Migration 1/4 Rack Migration Grid First Setup / Test Test Selection Delivered Test Control Day Load (Prod) Setup
  • 24. Post Tech Refresh Performance (in hours) Event Legacy Exadata BOR1 Process 4 hours 1 hour BOR2 Process 4 minutes 23 seconds Datamart IU 3 hours 35 minutes MV refresh 37 minutes 13 minutes
  • 25. Exadata Lessons Learned •Ensure hosting center can accommodate Exadata’s dimensions (door height) •Staff requirements (more communication necessary) •Smart Scan <- direct path reads, table access full, fast full index scans, parallel with parallel_degree_policy not auto •Chained rows / “small” tables void smart scans •Ideally 2 Exadata Database machines •EHCC 10x space and performance (DML) •Expect CPU utilization to decrease In-Memory X2-8 Massive Memory X3 2010 All I/Os to Memory 2012
  • 26. Exadata Lessons Learned (cont.) •Grid Control for monitoring / managing components •Platinum Support, major assistance •Exachk and opatch before / after patching •Standard tuning principles apply (OLTP) •Bring over OLTP database “AS-IS” •Time, Experience keys to stability
  • 27. References http://www.oracle.com/technetwork/database/options/olap/olap-exadata-x2-2- performance-1429042.pdf http://www.scribd.com/doc/57026846/Exadata-Smart-Flash-Cache-366203 http://www.oracle.com/technetwork/database/exadata/exadata-technical-whitepaper- 134575.pdf http://www.oracle.com/technetwork/server-storage/engineered- systems/exadata/exadata-storage-technical-overview-128045.pdf http://www.oracle.com/technetwork/database/features/availability/exadata-consolidation- 522500.pdf http://www.ioug.org/Portals/0/Documents/Anuj%20Mohan.pdf http://nyoug.org/Presentations/2011/March/Niemiec_Keynote_Exadata.pdf http://www.oracle.com/technetwork/articles/oem/exadata-commands-part1-402441.html http://www.centroid.com/webinars/ExadataChangestheGame.pdf http://www.centroid.com/knowledgebase/blog/using-dbfs-and-external-tables
  • 28. References (cont.) Database Machine and Exadata Storage Server (888828.1) Oracle Exadata Database Machine exachk (1070954.1) Oracle Exadata Best Practices (757552.1) Best Practices for OLTP on the Sun Oracle Database Machine (1269706.1) Best Practices for Data Warehousing on Database Machine (1297112.1) Oracle Sun Database Machine Application Best Practices for Data Warehousing (1094934.1) Oracle Sun Database Machine Diagnosability and Troubleshooting Best Practices (1274324.1) Expert Oracle Exadata (Osborne, Johnson, Poder)
  • 31. Exadata Rack Options 2 six Core Processors / 96 Gb RAM per DB node 2 six Core Processors / 24 Gb RAM per Storage Server Dual ported 40 Gb/sec InfiniBand Quarter Rack •2 DB nodes •2 Infiniband switches Half Rack •4 DB nodes •3 Infiniband switches Full Rack •8 DB nodes •3 Infiniband switches Infiniband 10x faster than Fiber Channel
  • 32. Cache Hierarchy (Full Rack X2-2) Database DRAM 768 GB Raw Capacity 100 GB / Second Flash Cache 5 TB Raw Capacity 50 GB / Second Disk 100 – 300 TB Raw Capacity 21 GB / Second
  • 33. Quarter Rack Selected •2 Xeon-based Dual-processor Database Servers (Sun Fire X4170 M2) • 24 cores (12 per server) • 192 GB memory expandable to 288 GB (96 GB per server expandable to 144 GB) • 10 GigE connectivity to Data Center • 4 x 10GbE ports (2 per server) •1.1 TB High Speed Flash •3 Exadata Storage Servers X2-2 • All with High Performance 600GB disks OR • All with High Capacity 3 TB disks •2 Sun Datacenter InfiniBand Switch • 36-port Managed QDR (40Gb/s) switch •1 “Admin” Cisco Ethernet switch •Keyboard, Video, Mouse (KVM) hardware Can Upgrade to a Half Rack •Redundant Power Distributions Units (PDUs) or just add storage
  • 34. Storage Components and Expansion (X2) -Local Storage (750 GB) -Storage Servers (12 Disks per server) Full Half Quarter InfiniBand switches 3 3 2 Ethernet switch 1 1 1 KVM Yes Yes Yes Exadata Storage Servers 18 9 4 Storage Grid CPU Cores 216 108 48 Raw Flash Capacity 6.75 TB 3.4 TB 1.5 TB Raw Storage High Perf 128 TB 64 TB 28 TB Capacity High Cap 648 TB 324 TB 144 TB Usable mirrored High Perf 58 TB 29 TB 13 TB capacity High Cap 288 TB 144 TB 64 TB Usable Triple High Perf 38 TB 19 TB 8.5TB mirrored capacity High Cap 192 TB 96 TB 43 TB