Fundamentals Of Transaction Systems - Part 1: Causality banishes Acausality (Clustered Database)

Valverde Computing The Fundamentals of Transaction Systems Part 1: Causality banishes Acausality (Clustered Database) C.S. Johnson <cjohnson@member.fsf.org> video: http://ValverdeComputing.Com social: http://ValverdeComputing.Ning.Com 1- The Open Source/ Systems Mainframe Architecture

1- Library = Low level communication, operating system drivers and state on Open Systems platforms Subsystems = Open Source components + middleware standards + Customer Application Cores EAI = commerce brokers, data integration & rules engines, enterprise mining, web analytics, ETL and data cleansing tools Optimal Cluster Software Architecture

1- Library = Low level communication, operating system drivers and state on Open Systems platforms State Optimally includes a proprietary layer of low level, C/C++ based drivers, yielding unparalleled transaction processing performance without the client having to deal with the underlying design architecture. These libraries provide a simple and unobstructive, yet elegant and abstract data management interface for new applications. Libraries ESS, WAN, LAN, SAN drivers and management library Global serialization library XML log records library Buffered log I/O library XML log reading library Cluster logging library Recovery library XML chains resource manager Global Transaction (IDs, handles and types) library Data management library Transaction management library XML remote scripting API library Computer, Cluster and Network management library

1- Subsystems = Open Source components + middleware standards + Customer Application Cores ,[object Object],Middleware – Open Source Disaster Recovery interface XML remote scripting XML management console Service control manager Application servers Application feeders Application extractors Application reports Application human interface Database and Recovery management interface Computer, Cluster and Network management interface Application Core

1- EAI = commerce brokers, data integration & rules engines, enterprise mining, web analytics, ETL and data cleansing tools Enterprise Application Integration Actional Control Broker Acxiom AbiliTec™ Fair Isaac Blaze Advisor Mercator Commerce Broker MicroStrategy DoubleClick Ensemble SAS Enterprise Miner ETL Tools SeeBeyond® TIBCO Trillium

1- High Speed, Minumum Latency Network or SAN “B” Cluster Redundancy Architecture High Speed, Minumum Latency Network or SAN “A” * Elements can be viewed as computers in a cluster, or as clusters in a group Fibre Channel or SAN Based Enterprise Storage Network “B” Fibre Channel or SAN Based Enterprise Storage Network “A”

4 Pillars (or Guardians or Demons) ‏ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1-

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],4 Pillars (or Guardians or Demons) ‏ 1-

[object Object],[object Object],[object Object],[object Object],[object Object],4 Pillars (or Guardians or Demons) ‏ 1-

Cluster Fundamentals ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1-

Cluster Fundamentals ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1-

1. Reliable Message-Based System serialized retries with duplicate removal ,[object Object],[object Object],[object Object],1-  TR-90.8 Guardian 90: A Distributed Operating System Optimized Simultaneously for High-Performance OLTP, Parallelized Batch/Query and Mixed Workloads <http://www.hpl.hp.com/techreports/tandem/TR-90.8.html>

[object Object],[object Object],[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1-  TR-88.4 The Cost of Messages <http://www.hpl.hp.com/techreports/tandem/TR-88.4.html>

[object Object],[object Object],[object Object],[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1-  TR-89.1 Transparency in its Place The Case Against Transparent Access to Geographically Distributed Data <http://www.hpl.hp.com/techreports/tandem/TR-89.1.html>

[object Object],[object Object],[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1-

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1-

[object Object],[object Object],[object Object],[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1-  TR-90.5 Fault Tolerance in Tandem Computer Systems <http://www.hpl.hp.com/techreports/tandem/TR-90.5.html>

[object Object],[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1-

[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1-

[object Object],[object Object],1. Reliable Message-Based System serialized retries with duplicate removal 1- <http://www.mvdirona.com/jrh/work/hpts2001/presentations/DB2%20390%20Availability.pdf>

2. Data Integrity data must be checked wherever it goes ,[object Object],[object Object],[object Object],1-

2. Data Integrity data must be checked wherever it goes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1-

3. Reliability = fail-fast + fault detection + fault tolerance + fault avoidance + proper fault containment ,[object Object],[object Object],[object Object],[object Object],1-

[object Object],[object Object],[object Object],[object Object],3. Reliability = fail-fast + fault detection + fault tolerance + fault avoidance + proper fault containment 1-

[object Object],[object Object],[object Object],3. Reliability = fail-fast + fault detection + fault tolerance + fault avoidance + proper fault containment 1-

4. Basic Parallelism if it isn’t locked, then it isn’t blocked ‏ ‏ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1-

4. Basic Parallelism if it isn’t locked, then it isn’t blocked ‏ ,[object Object],[object Object],[object Object],[object Object],1-  TR-90.8 Guardian 90: A Distributed Operating System Optimized Simultaneously for High-Performance OLTP, Parallelized Batch/Query and Mixed Workloads <http://www.hpl.hp.com/techreports/tandem/TR-90.8.html>

4. Basic Parallelism if it isn’t locked, then it isn’t blocked ‏ ,[object Object],1- <http://research.microsoft.com/~gray/HPTS99/Papers/JohnsonCharlie.doc>

4. Basic Parallelism if it isn’t locked, then it isn’t blocked ‏ ,[object Object],[object Object],1-

5. Basic Transparency when? where? how? ,[object Object],[object Object],[object Object],[object Object],1-

5. Basic Transparency when? where? how? ,[object Object],[object Object],1-

5. Basic Transparency when? where? how? ,[object Object],[object Object],[object Object],[object Object],[object Object],1-

5. Basic Transparency when? where? how? ,[object Object],[object Object],[object Object],1-

6. Basic Scalability ,[object Object],[object Object],[object Object],[object Object],1-  TR-90.9 Parallel Database Systems: The Future of Database Processing or a Passing Fad? <http://www.hpl.hp.com/techreports/tandem/TR-90.9.html>

6. Basic Scalability ,[object Object],[object Object],[object Object],1-

6. Basic Scalability ,[object Object],1-

6. Basic Scalability ,[object Object],[object Object],1-

6. Basic Scalability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1-

6. Basic Scalability ,[object Object],1-  Method for providing recovery from a failure in a system utilizing distributed audit [log records] <http://www.google.com/patents?id=L_IWAAAAEBAJ&dq=5,832,203>

6. Basic Scalability ,[object Object],[object Object],[object Object],[object Object],1-

6. Basic Scalability ,[object Object],[object Object],1-  Transaction state broadcast method using a two-stage multicast in a multiple processor cluster <http://www.google.com/patents?id=pOEIAAAAEBAJ&dq=6,247,059>

6. Basic Scalability ,[object Object],[object Object],[object Object],[object Object],[object Object],1-

6. Basic Scalability ,[object Object],[object Object],1-  TR-88.1 Group Commit Timers and High-Volume Transaction Systems <http://www.hpl.hp.com/techreports/tandem/TR-88.1.html>

6. Basic Scalability ,[object Object],[object Object],1-  Hybrid method for flushing transaction state in a fault-tolerant clustered database <http://www.google.com/patents?id=rUt4AAAAEBAJ&dq=7,028,219> Method for handling node failures and reloads in a fault tolerant clustered database supporting transaction registration and fault-in logic <http://www.google.com/patents?id=S-d3AAAAEBAJ&dq=6,990,608>

7. Basic Availability outage minutes -> zero ,[object Object],[object Object],[object Object],1-

7. Basic Availability outage minutes -> zero ,[object Object],[object Object],1-

7. Basic Availability outage minutes -> zero ,[object Object],[object Object],1-  Minimum latency reinstatement of database transaction locks <http://www.google.com/patents?id=9Lx6AAAAEBAJ&dq=7,100,076>

8. Application/Database Serialized Consistency the database must be serialized wherever it goes ‏ ,[object Object],[object Object],[object Object],[object Object],1-

[object Object],[object Object],[object Object],8. Application/Database Serialized Consistency the database must be serialized wherever it goes ‏ 1-

[object Object],[object Object],[object Object],[object Object],[object Object],8. Application/Database Serialized Consistency the database must be serialized wherever it goes ‏ 1-

[object Object],[object Object],8. Application/Database Serialized Consistency the database must be serialized wherever it goes ‏ 1-

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],8. Application/Database Serialized Consistency the database must be serialized wherever it goes ‏ 1-

[object Object],[object Object],[object Object],[object Object],8. Application/Database Serialized Consistency the database must be serialized wherever it goes ‏ 1-

[object Object],8. Application/Database Serialized Consistency the database must be serialized wherever it goes ‏ 1-

[object Object],[object Object],[object Object],9. Recovery putting it all back together again 1-

9. Recovery putting it all back together again ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1-

[object Object],[object Object],[object Object],[object Object],[object Object],9. Recovery putting it all back together again 1-

[object Object],[object Object],[object Object],[object Object],9. Recovery putting it all back together again 1-

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],9. Recovery putting it all back together again 1-

9. Recovery putting it all back together again ,[object Object],[object Object],1-

9. Recovery putting it all back together again ,[object Object],[object Object],[object Object],1-

9. Recovery putting it all back together again ,[object Object],[object Object],[object Object],[object Object],1-

Fundamentals Of Transaction Systems - Part 1: Causality banishes Acausality (Clustered Database)

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (19)

Destacado

Destacado (9)

Similar a Fundamentals Of Transaction Systems - Part 1: Causality banishes Acausality (Clustered Database)

Similar a Fundamentals Of Transaction Systems - Part 1: Causality banishes Acausality (Clustered Database) (20)

Último

Último (20)

Fundamentals Of Transaction Systems - Part 1: Causality banishes Acausality (Clustered Database)