Más contenido relacionado La actualidad más candente (20) Similar a Golden gate11g overview - Edgars Rungis (20) Más de ORACLE USER GROUP ESTONIA (20) Golden gate11g overview - Edgars Rungis1. Oracle GoldenGate 11g Overview
Edgars Ruņģis
Technology Consultant
1 Oracle in Latvia
Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
2. Do You ...
Business Intelligence/ DWH High Availability/Disaster Recovery
Growing data volumes and shrinking batch Strict SLAs for high availability and
windows for ETL? performance?
Need fresh data 24X7 to optimize operations? Need single technology for heterogeneous
Mission-critical OLTP with performance systems?
impact? Leverage standby databases for transaction
processing?
Migration Data-based Application Integration
Want to get onto more efficient and effective Integrating today via manual code?
standard infrastructure? Looking ahead to SOA but concerned about
Can’t afford downtime? the data?
Why not fix data assets during an Need to handle large files and batch
infrastructure move? processes?
Support global operations with real-time
data?
2 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
3. Agenda
• Introduction to Oracle GoldenGate
• Technology Overview
• Use Cases and Benefits
• Summary
• Q&A
3 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
4. What is Oracle GoldenGate ?
Oracle GoldenGate provides low-impact capture, routing, transformation, and
delivery of database transactions across heterogeneous environments in real
time
Replica/ Standby
Log-based, changed data Distributed Systems
Database
Data Warehouse
4 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
5. Oracle GoldenGate Differentiators
• Sub-second latency for data movement
Performance • Low-impact capture, routing, transformation, and
delivery of transactional data
• Open, modular architecture
Flexible & Extendable • Supports heterogeneous sources and targets
• Agile and adaptable to modern data integration
architectures
Reliable • Maintains transactional integrity
• Resilient against interruptions and failures
• Fast Recovery after process interruptions.
5 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
6. Agenda
• Introduction to Oracle GoldenGate
• Technology Overview
• Use Cases and Benefits
• Summary
• Q&A
6 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
7. How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by
reading the transaction logs.
Source Target
Oracle & Non-Oracle Oracle & Non-Oracle
Database(s) Database(s)
7 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
8. How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by
reading the transaction logs.
Trail: stages and queues data for routing.
Source Target
Oracle & Non-Oracle Oracle & Non-Oracle
Database(s) Database(s)
8 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
9. How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by
reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Source Target
Oracle & Non-Oracle Oracle & Non-Oracle
Database(s) Database(s)
9 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
10. How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by
reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
Source Target
Oracle & Non-Oracle Oracle & Non-Oracle
Database(s) Database(s)
10 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
11. How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by
reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction
integrity, transforming the data as required.
Source Target
Oracle & Non-Oracle Oracle & Non-Oracle
Database(s) Database(s)
11 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
12. How Oracle GoldenGate Works
Capture: committed transactions are captured (and can be filtered) as they occur by
reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction
integrity, transforming the data as required.
Source Target
Oracle & Non-Oracle Oracle & Non-Oracle
Database(s) Bi-directional Database(s)
12 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
13. Oracle GoldenGate Differentiator: Flexibility
Unidirectional Bi-Directional Peer-to-Peer
Query Offloading Hot Standby or Load Balancing
Zero-Downtime Migration Active-Active for HA Multi-Master
Broadcast Integration/Consolidation Data Distribution
Data Distribution Data Warehouse via Messaging
BPM
BAM
CEP
13 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
14. Differentiator: Performance and Scalability
GoldenGate Capture
• Log-based change data capture
– High volume
– Low overhead
• Decoupled architecture
– Multiple capture processes may be used to scale, but generally not required
– Possible to split “hot” tables into a separate capture process
• Filtering and compression
– Unnecessary change data is discarded immediately
– Updates and deletes are “compressed” by default
14 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
15. Differentiator: Performance and Scalability
GoldenGate Delivery
• Decoupled architecture
– Multiple delivery processes may be used to scale
– Possible to split “hot” tables into a separate delivery process
– Possible for multiple delivery processes to split the work for a single table
• Transaction grouping
– Small transactions are grouped by default to reduce commit overhead
15 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
16. Differentiator: Transaction Integrity
• Transaction boundaries
– Recorded in GoldenGate trail file
– Transactions ordered in commit sequence
– Boundaries adjusted automatically due to record filtering or trail
splits
• Transaction integrity
– Checkpointing and recovery are based on transaction
boundaries
– Original commit sequence is maintained by the delivery process
16 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
17. Differentiator: Reliability
• Decoupled architecture
– Individual processes can be restarted automatically
– Tolerance to network outages (configurable)
• Recovery
– Recovery ensures that no operations are skipped or duplicated after
failure of any kind
– Recovery of the Capture process is more involved than recovery the
Delivery process
– Although GoldenGate processes are completely decoupled, the
Delivery process must be aware of a recovery performed by the
Capture process or pump
17 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
18. Oracle GoldenGate 11g Supported Platforms
Databases O/S and Platforms
Oracle GoldenGate Capture:
Oracle Linux
DB2 for v 9.7
Sun Solaris
DB2 for v 10 on z/OS
Microsoft SQL Server for 2008 R1, R2 Windows 2000, 2003, XP, 2008
Sybase ASE, 15.5 HP NonStop
Teradata
HP-UX
Enscribe
SQL/MP
IBM AIX
SQL/MX IBM z Series
MySQL zLinux
JMS message queues
Oracle GoldenGate Delivery:
All listed above, plus:
TimesTen, IBM System I, Netezza & Greenplum
ETL product
18 Copyright © 2011, Oracle and/or its affiliates. All rights 18
reserved.
19. Oracle GoldenGate Veridata – Data Comparison
without Downtime
• A high-speed, low impact data
comparison solution
• Identifies and reports data discrepancies
between heterogeneous databases
without interrupting their availability
• Benefits:
• Reduce financial/legal risk exposure
• Speed and simplify IT work in comparing
data sources
• No disruption to business systems
• Improved failover to backup systems
• Confident decision-making and reporting
19 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
20. Oracle Management Pack for OGG
Complete Visibility (1 / 2): Director
1. Oracle GoldenGate Director:
Has basic configuration,
management, monitoring, and
alerting. Based on legacy pull
infrastructure.
20 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
21. Oracle Management Pack for OGG
Complete Visibility (2 / 2): Monitor
2. Oracle GoldenGate Monitor:
Has advanced monitoring,
alerting (SNMP support), lag
graphs, and historical
repository. Based on new
agent infrastructure, which
will be the foundation for all
future integration projects.
Supports OGG 11.1.1.1.1+
21 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
22. Agenda
• Introduction to Oracle GoldenGate
• Technology Overview
• Use Cases and Benefits
• Summary
• Q&A
22 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
23. Oracle GoldenGate 11g use cases
Low-Impact Real-Time Data Integration & Transactional Replication
Zero Downtime Upgrade
& Migration
New DB/HW/OS/APP
Highly Available / Disaster
Recovery
Legacy Fully Active Distributed DB
Query Offloading, Disaster
Recovery
Log-based, Reporting Database
changed data
Real-time BI, Operational
Reporting, MDM
Database Data Integrator
Data Warehouse
ODS Data Synchronization
across the Enterprise
Global Data Centers
Message Bus Event Driven Architecture,
SOA
Message Bus
23 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
24. Eliminate All Downtime for Continuous Availability
Available – no issues
Planned outage
• Upgrade
• Migration
• Maintenance
Unplanned outage
• System failure
• Data failure
24 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
25. Oracle GoldenGate for Continuous Availability
• Zero Downtime Upgrades, Migrations and Maintenance
– Migration from non-Oracle databases to Oracle 11gR2 & Exadata
– Upgrade Oracle Database 8i, 9i, 10g to 11gR2
– Upgrade/Migrate Database Server/OS
– Perform Database Maintenance
– Application Upgrade (Siebel CRM and JD Edwards)
• Disaster Recovery for Non-Oracle Databases and Cross- Oracle Database
versions
• Continuous Availability via Active-Active Databases
26 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
26. What are Oracle Database Upgrade Options ?
• Standard:
– Database Upgrade Assistant
• Alternatives
– Export/Import
– DataPump
– Transportable Tablespaces
– Streams
– Logical Standby
– Oracle GoldenGate (zero downtime)
27 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
27. Eliminate Downtime During Upgrades to Oracle 11g R2
• Zero database
downtime for Switchover
upgrades from 8i, 9i, Application
10g to 11g
• Leverage new
features of Oracle
Database 11g without
impacting business
Oracle Oracle
operations Database Database
Failback Data Flow
• Minimize risks with 8i/9i/10g 11g Release 2
Compare & Verify
failback option With Oracle GoldenGate
Veridata
28 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
28. A Certified App Upgrade Solution for
JD Edwards and Siebel CRM
• Upgrade/migrate/main
tain database,
hardware, OS and/or Real-time changed data
application Siebel / JDE Siebel / JDE
Lower Version Higher Version
• Minimize risk with
failback option
• Improve success with Non-Oracle Oracle
Database Database
phased user migration /Server Sun Server
Failback Data Flow
31 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
29. Eliminate unplanned downtime with
Active Data Guard & GoldenGate
• Active Data Guard for
disaster recovery and Switchover
data protection for: Application
• Oracle-to-Oracle
• Oracle GoldenGate for
disaster recovery and
data protection for:
• Non-Oracle platforms Production Live Standby
Post-Switchover Data Flow
• Active-Active
Compare & Verify
• Cross-OS and Oracle With Oracle GoldenGate Can be used for
reporting &
database version Veridata
testing
requirements
32 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
30. Improve Production System Performance and
Lower Costs
• Off-load queries from
production systems in
Transaction Processing Read-Only Activity
Active-Active or
Heterogeneous
configurations Real-time changed data
• E.g. different OS,
database version,
database
• E.g. legacy system
query off-load
Production Oracle
OLTP Database
33 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
31. Increase ROI on Existing Servers & Synchronize Data
Across Globe
• Utilize secondary
systems for
transactions
Application Application
• Enable continuous
availability during
unplanned and
planned outages
Source & Source &
• Synchronize data Target Target
across data centers Region A Region B
around the globe
34 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
32. Drivers for Moving to Real-Time BI and Data
Warehouse
Traditional Data Warehouse Real-Time Data Warehouse
Transformation
ETL ELT
Real-Time
Legacy, Continuous Feeds
Packaged Enterprise
Data Legacy,
Apps, OLTP Packaged Enterprise Data Warehouse
Databases Warehouse
Apps, OLTP
• Day+ old data • Timely, relevant data – better decisions
• Batch data extracts within specified • No batch windows on OLTP
“off business hours” • Complete recoverability after
• Process interruptions impact data interruptions
recoverability
35 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
33. Next Generation Data Warehousing: Enabling Real Time BI
High Performance E-LT, Real-Time Data Warehousing
• Solution
• Using OGG for log-based capture of database
Oracle Data transactions from source to minimize overhead
Integrator
• Load to target with sub-second latency
• Transformation performed on the database
DIM DIM
using E-LT in mini-batches
Oracle • Fast ETL/E-LT handled by database processing
GoldenGate FACT
EMP DEPT DIM DIM • Benefits
• No resource / performance impact to OLTP
• Live data available for better decision making
ODS Schema DW Schema
• Get double-duty from database investment by
using it for transformations
• Maximizes availability of source systems and
DW due to smaller batch windows.
36 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
34. Real Time vs. Right Time
Capture in real time, consume in right
time
IT should not be a constraint for business:
Invest in future-ready solutions
Consider technical benefits: cost savings,
reliability and performance improvements
38 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
35. Event Driven Architecture, SOA
BPM
BAM
Message Bus SOA
40 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
36. Agenda
• Introduction to Oracle GoldenGate
• Technology Overview
• Use Cases and Benefits
• Summary
• Q&A
41 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
37. Advantages of Oracle GoldenGate 11g
Reduced Overhead and TCO
• Captures once, delivers to many targets for different uses
• Non-invasive, log-based capture
• Moves only committed data, reduces bandwidth needs
High Performance with Reliability
• Subsecond latency even with high data volumes
• Preserves transaction integrity
• Ensures data recoverability
Flexibility and Ease of Use
• Provides decoupled, modular architecture
• Supports heterogeneous sources and targets, and different latency needs
• Coexists and integrates with ELT/ETL and messaging solutions
42 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
38. GoldenGate is Oracle’s Strategic Replication Solution
• Best-in-class leader in real-time data integration solutions
• Complements existing Oracle products
• Continuous Availability for heterogeneous systems
• Real-time data access for Reporting & BI/EPM
• Zero-downtime migrations / upgrades to Oracle
Database, Hardware, and Applications
• Over 1200 customers including Fortune 500 companies,
representing Financial Services, Communications,
Healthcare, Public Sector, Retail, Utilities industries
• 4 of top 5 largest commercial banks
• 3 of top 3 busiest ATM networks
• 5 of top 5 financial data services companies
• 5 of top 5 telecommunications providers
• 3 of top 5 largest food & drug stores
43 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
39. Q&A
44 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
40. 45 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.
41. 46 Copyright © 2011, Oracle and/or its affiliates. All rights
reserved.