Clustered Architecture Patterns Delivering Scalability And Availability

Clustered Architecture Patterns: Delivering Scalability and Availability Qcon San Francisco, 2007 Ari Zilka

This Session ,[object Object],[object Object],[object Object]

Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Clustering Patterns ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Changing the Assumptions: JVM-level Clustering

JVM-level Clustering Addresses the Patterns ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],“ILITIES” Scale Out Model

The foundation for all this thinking… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The precarious path: These are common-place tools ,[object Object],[object Object],[object Object],[object Object],[object Object]

Large publisher gets caught down the path with Oracle Scaling Out or Up?

Breaking the pattern without leaving “Load-Balanced” world ,[object Object],[object Object],[object Object]

Counter Examples ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Stateless By Hand is Cumbersome and Inefficient ,[object Object],[object Object],[object Object],[object Object],User Conversation

So We Add Hibernate ,[object Object],[object Object],[object Object],[object Object],[object Object],User Conversation

Then We Turn on Caching Serialization is required BLOB Replication requirements are heavy User Conversation ,[object Object],[object Object],[object Object]

So We Disconnect But Lose Availability ,[object Object],[object Object],[object Object],Can lose state in case of failure! Replication is expensive Hibernate says to keep graphs small User Conversation

JVM-Level Clustering + Hibernate Together ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Demonstration Application ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Performance Tests ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Results: Hibernate vs. Detached POJOs ~ 500,000 ops / sec Terracotta Read ~ 1800 ops / sec Hibernate + 2nd Level Cache Read ~ 1000 ops / sec Hibernate Read Results Type Operation Results Type Operation ~ 7000 ops / sec Terracotta Update ~ 1800 ops / sec Hibernate + 2nd Level Cache Update ~ 1000 ops / sec Hibernate Update

User Was Happy ,[object Object],[object Object],[object Object]

Example Caching Service ,[object Object],[object Object],[object Object],[object Object],[object Object]

BU #1 BU #2 BU #3 BU #4 Data center Websphere MQ Series - MOM Messaging Infrastructure (JMS Topics) Caching Layer SoR MQ API MQ API Existing MQ Cache Node 1 Cache Node 27 Terracotta Server Terracotta Server . . . SoR API single pair

BU #1 BU #2 BU #3 BU #4 Data center Websphere MQ Series - MOM Messaging Infrastructure (JMS Topics) Caching Layer SoR MQ API MQ API Existing MQ Cache Node 1 Cache Node 27 Cache Node 14 Terracotta Server Terracotta Server Terracotta Server Terracotta Server Cache Node 15 . . . SoR API . . .

BU #1 BU #2 BU #3 BU #4 Data center Websphere MQ Series - MOM Messaging Infrastructure (JMS Topics) Caching Layer SoR MQ API MQ API Existing MQ Cache Node 1 Cache Node 27 Cache Node 14 Terracotta Server Terracotta Server Terracotta Server Terracotta Server Cache Node 15 . . . . . . SoR API Stateless Software Load Balancer

User Was Unhappy ,[object Object],[object Object],[object Object]

Lessons Learned: Scalability + Availability + Simplicity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Load-balanced Scale Out ,[object Object],[object Object],[object Object]

Partitioned Scale Out ,[object Object],[object Object],[object Object],[object Object],[object Object]

Clustered Architecture Patterns Delivering Scalability And Availability

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Clustered Architecture Patterns Delivering Scalability And Availability

Similar to Clustered Architecture Patterns Delivering Scalability And Availability (20)

More from ConSanFrancisco123

More from ConSanFrancisco123 (20)

Recently uploaded

Recently uploaded (20)

Clustered Architecture Patterns Delivering Scalability And Availability