1. Oracle Exadata Management
Werner de Gruyter – Consulting Member of Technical Staff, Oracle
1 James Viscusi– Consulting Member of Technical Staff, Oracle
Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

2. Agenda
• Why do I care?
• Management Life cycle
• Oracle Solution
• What does it look like?
• How can I get started?
• What do I do to show the Exadata target?
• What Could go Wrong?
• Now what?
• …And if I have questions?
2 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

3. Exadata Management
Maintain Plan & Setup
Configuration Compliance Discovering Exadata
for monitoring
Patch Automation
ASR Monitoring the
Database machine
Manage Test
Performance Diagnostics Consolidate on Exadata
Application SQL Tuning Validate Application
Performance
3 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

4. Oracle Solution
Integrated System Management and Support
My Oracle Support
Knowledge Problem/SR Configuration
Management Management Management
Knowledge Problem/SR Configuration
Management Management Management
Performance Problem Provisioning &
Management Diagnosis Patching
Customer
Hardware Databases Middleware Applications
4 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

5. Agenda
• Why do I care?
• What does it look like?
• ASR
• Enterprise Manager
• How can I get started?
• What do I do to show the Exadata target?
• What Could go Wrong?
• Now what?
• …And if I have questions?
5 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

6. ASR Service Flow
Customer Data Center Oracle Support Services Comprehensive
FRU replaced by
H/W Fault Coverage
Field Engineer
FRU • CPU
Oracle Field
Engineer
dispatched • Disk controllers
by Support
• Disks
!
Fault occurs
Engineer
• Flash Cards
SR routed
Customer • Flash modules
to Support
SR creation email Engineer • Cards
notification to customer • Memory
ASR Fault telemetry securely ASR
• System Board
Manager transmitted to Oracle Service • Power supplies
Product’s auto-diagnosis Service Request • Fans
facility sends SNMP trap to ASR created
Manager
6 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

7. Setting up ASR
• Documentation and fault list available from www.oracle.com/asr
 Exadata specific documentation – Exadata Quick install Guide
 ASR errors and notes – by ILOM, for every supported ILOM (more than Exadata)
• One Command Integration (from 11.2.3.1 forward)
 Now works with latest version of OneCommand
 Set up the SNMP trap forwarding
 Produces the script to register with ASR Manager
• Auditing your install
 MOS 1450112.1 - download the latest version of asrexacheck
 Verifies connectivity to Oracle back end
7 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

8. Enterprise Manager Architecture
EM Users: EMCLI Repository (OMR):
Console / Reports
• Heart
Firewall • Data storage, rollup and purging
Agent Management Server (OMS):
Connectors
• Brains
• Handles management data from
Agents
• Handles administration requests
Agent from UI
Repository Management
Database Server • Sends out notifications
Agents (OMA):
Internet
• Nerve endings
Agent • Gather management information
Notifications
• Perform administration task
8 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

9. Robust and Extensible Infrastructure
Extensible Management Platform
• Target Plug-ins
 Management for new versions of targets
• Solution Plug-ins
Target
Plug-in
Solution
Plug-in … Connector  Functionality enhancements
•
•
Chargeback and Trending
Self-Service Applications
• Self-updateable entities
 Connectors
 Provisioning Bundle
 My Oracle Support UI
Enterprise Manager  VM Templates
 …
• Independent Plug-in Lifecycle
 Deploy new plug-in on an existing Enterprise
Manager
 Upgrade existing plug-in
9 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

10. Agenda
• Why do I care?
• What does it look like?
• How can I get started?
• Exakits
• Self Update
• What do I do to show the Exadata target?
• What Could go Wrong?
• Now what?
• …And if I have questions?
10 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

11. Exadata OMS kit
• Download patch 13546881 from My Oracle Support
• Installs and configures a new Enterprise Manager environment
 Includes repository database (11gR2 PSU3) and OMS
• Can be used:
 To deploy a new simple Enterprise Manager infrastructure
 Testing environment, demo, POC, …
Note: The Exadata Kits get updated after each PSU release of EM, the plug-ins and Exadata HW refreshes
Blog posting: Enterprise Manager Cloud Control 12c Setup Automation kit for Exadata
11 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

12. Installing OMS kit
• Read the README from the downloaded patch!
(Has all the steps detailed quite nicely…)
• After running the setupem.sh script:
 The Cloud Control OMS and Repository will be installed
 The Exadata plug-ins are deployed on the OMS
• To be done after the install completes:
 Update the Monitoring Configuration of the repository database
(and change the password for a more secure setup - default password is
‘welcome1’)
 Update the license agreement for the ‘emrep’ database for
‘Oracle Database Lifecycle Management Pack’
12 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

13. Exadata Agent kit
• For Agents deployment:
 Use the Agent push method from the UI (Guided new host discovery), and deploy the plug-ins
 Or use the Exadata Agent Kit (Download patch 13551607 from My Oracle Support)
• Agent kit will install and configure a new Enterprise Manager Agent
 Need to know where the OMS is, to register the Agent
 Agent will download and deploy the Exadata plug-ins
 Discover the Exadata rack and all the databases
• Can be used:
 In conjunction with the OMS kit
 Or as an ‘additional Agent install’ for an existing EM infrastructure
• Requirement:
 Version of the OMS and the OMS plug-ins has to be the same or higher then the Agent
Version information available in the header of the README file
 The Exadata configuration spreadsheet needs to be correct - Chapter 4 - Using the Oracle Exadata
Database Machine Configurator Spreadsheet from the Oracle Exadata Database Machine Owner's Guide
Note: The Exadata Kits get updated after each PSU release of EM, the plug-ins and Exadata HW refreshes
13 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

14. Installing Agent kit
• Read the README from the downloaded patch!
(Has all the steps detailed quite nicely…) em.param example file:
• After running the setupem.sh script: EM_VERSION=1.0
OMS_LOCATION=REMOTE_CORP_GC
EM_BASE=/myem/myemhome
 The Cloud Control Agent will be installed OMS_HOST=myoms.acme.com
(Using the /opt/oracle.SupportTools/onecommand/em.param file) OMS_PORT=4900
EM_USER=oracle
 The Exadata plug-ins will be deployed and ready to go EM_PASSWORD=welcome
 SSH equivalence for the Agent to the Cell nodes is setup
(Based on the Exadata configuration spreadsheet)
 Use the discovery wizard for adding the Exadata, GI and RAC targets
• To be done after the install completes:
 Add SNMP trap forwarding for Cisco, KVM and PDU
14 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

15. Plug-in Framework
Update entities:
• Download from My Oracle Support via the
Self Update feature in the UI
• Or manually upload into the repository via
EMCLI
Deploy entities:
• OMS’s side (for everyone)
• Agent side (selective)
Plug-ins for the Engineered systems:
• Exadata
• ExaCheck (Health-Check)
• Exalogic (Elastic Cloud)
15 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

16. Agenda
• Why do I care?
• What does it look like?
• How can I get started?
• What do I do to show the Exadata target?
• Target discovery
• Double checks
• What Could go Wrong?
• Now what?
• …And if I have questions?
16 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

17. Discovering Exadata System
Install Agent Assign
Launch Auto Component Monitoring
on Compute Monitoring Review
Discovery Credentials Properties
Node Agents
• Discovery Wizard (guided discovery)
• Plug-in has all the components bundled (Cell, KVM, PDU, Cisco Switch)
Exadata Cell and the Infiniband components discovered out-of-the box
• Option to discover new DB Machine or rediscover (Add DB Machine Members)
17 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

18. Demo
• Exadata discovery
18 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

19. Exadata Management
Integrated View of Hardware and Software
• Hardware view
• Schematic of cells, compute nodes and
switches
• Hardware components alerts
• Software/system view
• Performance, availability, usage by
databases, services, clusters
• Software alerts db, cluster, ASM
• Topology view of DB systems/clusters
• Configuration view
• Version summary of all components
along with patch recommendations
19 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

20. Post configuration steps
• Double check!
 Audit Script - 1473912.1: Prerequisite Script for Exadata Discovery with
Enterprise Manager 12c
• Make sure the traps are set!
 Add SNMP trap forwarding for Cisco, KVM and PDU
• Need an executive view? – Build a dashboard!
 MOS 1458346.1 Build a monitoring dashboard with EM 12c
20 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

21. Agenda
• Why do I care?
• What does it look like?
• How can I get started?
• What do I do to show the Exadata target?
• What Could go Wrong?
• Diagnosing Discovery Issues
• EMDiag
• Now what?
• …And if I have questions?
21 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

22. Diagnosing Exadata discovery
• Physical RACK configuration out of sync with logical XML representation
 After every manual change to the Exadata RACK, the databasemachine.xml file should get
regenerated. (See chapter 4 of the Database Machine owner’s guide)
• Use the Admin network hostnames for the components
 Do not use the public hostnames for the Exadata components
• SSH setup problems between the components
 Compute nodes need SSH equivalence setup with the cell monitor user on the Exadata Cell
machines, as well as access to the nm2user account on the IB network switches
• Permission problems with the software on the compute node
 Agent software owner requires read access on the databasemachine.xml file and the kfod
executable from the RDBMS database home
1437434.1: Prerequisite steps before discovering Exadata DB machine within EM12c
1473912.1: Prerequisite Script for Exadata Discovery with Enterprise Manager 12c
22 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

23. EMDIAG - Exadata Diagnostics
• Diagnostics tools for Enterprise Manager
 Tool for each tier: AGTVFY, OMSVFY, REPVFY
• Exadata specific diagnostics
 On the repository side:
$ repvfy verify exadata [-level {0-9}] [-details]
$ repvfy dump exadata –name "<db machine name>"
$ repvfy show exadata_master_agent –name "<db machine name>"
 On the Agent side:
$ agtvfy verify exadata [-level {0-9}] [-details]
$ agtvfy version exadata
421053.1 - EMDIAG Master Index
23 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

24. Agenda
• Why do I care?
• What does it look like?
• How can I get started?
• What do I do to show the Exadata target?
• What Could go Wrong?
• Now what?
• Database Monitoring
• Cell Monitoring
• Plus…
• …And if I have questions?
24 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

25. Database Performance Page Integration
• Drill down from database
Performance page
• Provides composite view
of all health indicators of
a cell or cell group
• Helps triage
 Load imbalance
 ASM related problems
 Cell software or hardware
failures
 Cell configuration issues
 Network related failures
25 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

26. Storage Cell Monitoring
• Storage Cell monitoring and
administration support
 Cell Home page and performance
pages
 Actions supported: Start/stop Cell,
verify connectivity, setup SSH
• Automatic discovery of Cells
• Management by Cell Group
 All cells used by a database
automatically placed in a group
 Cell Group level administration
operations (batch job monitoring)
26 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

27. Enterprise Manager Cloud Control 12c
Enterprise Ready
Framework
Applications Cloud
Management Management
Middleware Chargeback and
Management Capacity Planning
Exadata and
Database
Exalogic
Management
Management
Application
Configuration
Quality
Management
Management Provisioning,
Patching and
Consolidation
27 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

28. Agenda
• Why do I care?
• What does it look like?
• How can I get started?
• What do I do to show the Exadata target?
• What Could go Wrong?
• Now what?
• …And if I have questions?
28 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

29. References - EM
Oracle Website:
• Certification matrix: Oracle Enterprise Manager
(www.oracle.com/us/products/enterprise-manager)
• High-Availability: Maximum Availability Architecture (MAA)
(www.oracle.com/technetwork/database/features/availability)
• EM Blog: Oracle Enterprise Manager
(blogs.oracle.com/oem/)
My Oracle Support:
• 412431.1: Grid Control Certification Checker
• 421053.1: EMDIAG Master Index
• 822485.1: Oracle Recommended Patches - Oracle Enterprise Manager
Demos and screen watches:
• Youtube – Enterprise Manager
(www.youtube.com/playlist?list=PLF45DBCDF595F1D1D&feature=plcp)
• Youtube - Monitor an Exadata environment
(www.youtube.com/watch?v=1tYiuj5vPTw)
29 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

30. References - Exadata
Oracle Website:
• Oracle: Oracle Exadata Database Machine
(www.oracle.com/us/products/database/exadata/overview/index.html)
• Oracle: Oracle Exadata Database Machine resources
(www.oracle.com/us/products/database/exadata/resources/index.html)
My Oracle Support:
• 0757552.1: Oracle Exadata Best Practices
• 0888828.1: Database Machine and Exadata Storage Server 11gR2 Supported Versions
• 1070954.1: Database Machine exachk or HealthCheck
• 1110675.1: Database Machine Monitoring Best Practices
• 1329170.1: Master Reference Note for exachk
• ASR Exacheck note
• EM Maintenance note
30 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

31. Questions
31 Copyright © 2012, Oracle and/or its affiliates.
All rights reserved.

32. Thank You
32 Copyright © 2012, Oracle and/or its affiliates.
Oracle Highly Confidential
All rights reserved.