SlideShare una empresa de Scribd logo
1 de 53
Ultra-Scalable and Blazing-Fast: The Sun Fire x4450-Intel 7460-XAP GigaSpaces Platform Scaling up with Commodity HW® Scale up  Benchmark Report Shay Hassidim Deputy CTO GigaSpaces January 2009
Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Scaling up with commodity HW ®  - Benchmark Target ,[object Object],[object Object]
Scale up Benchmark Results Highlights - Throughput ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Scale up Benchmark Results Highlights - Latency ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Scale up Benchmark Results Highlights ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Servers Used Since we are running Scale up Benchmark we have fixed amount of machines - mySQL Database - Apache  Load-Balancer 3.16GHz 4 2 (2 cores each) Intel Xeon 16 G RAM Sun Fire X4150 2 socket Sun 4 GigaSpaces Clients 2.66GHz 24 4 (6 cores each) Intel Dunnington X7460 32 G RAM 4 socket Intel White box 3 GigaSpaces 2.66GHz 24 4 (6 cores each) Intel Dunnington X7460 32 G RAM Sun Fire X4450 4 socket Sun 2 GigaSpaces 2.66GHz 24 4 (6 cores each) Intel Dunnington X7460 32 G RAM Sun Fire X4450 4 socket Sun 1 Running Clock speed # of Cores # of CPU CPU Type and Memory Model Vendor Server ID
Technology Stack under Test Ethernet (1gE) Sun Fire x4450 Intel Dunnington X7460 4 CPUs (6 cores each) Sun Solaris update 6 GigaSpaces XAP 6.2.2 Sun mySQL 5 Apache LB 2.2.9 Sun JDK 1.6
Sun Fire x4450 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Intel® Xeon® Processor 7400 Series Benefit Feature ,[object Object],Intel® 64 architecture ,[object Object],1066 MHz Dedicated High-Speed Interconnects (DHSI) ,[object Object],[object Object],[object Object],Intel® Virtualization Technology 3 ,[object Object],[object Object],[object Object],[object Object],Enhanced Intel® Core™ Microarchitecture 16 MB of L3 Cache ,[object Object],[object Object],[object Object],Multi-core processing
Scale up Benchmark Goals – Measuring Performance Scalability Latency
Scale up Benchmark Goals - Measure the Platform Performance , Scalability and Latency for ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
SBA vs .TBA – Scaling vs. Latency and Costs SBA – Space Based Architecture TBA – Traditional Based Architecture
Scale up Benchmark Scenarios ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Quick Introduction to GigaSpaces
Introduction - Space Basic Runtime Modes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction - Space Basic Operations
Introduction - Basic Deployment Topologies ,[object Object],Partitioned Feeder Feeder Partitioned + Backup Feeder
Introduction Space Based Architecture – Business logic and data collocated Primary 1 Primary 2 Primary 3 Backup 3 Backup 2 Backup 1 Replication Replication Replication Pushing data into the backend system In-Memory-Data-Grid and collocated Processing units Collects results / reporting Service
[object Object]
Scale up Throughput Benchmark
Scale up Throughput Benchmark – Physical Deployment Topology ,[object Object],white box  Client X4450 GigaSpaces 4 spaces , one per GSC X4450 GigaSpaces 4 spaces , one per GSC Switched Ethernet LAN ,[object Object],X4450  Client GigaSpaces 8 spaces
Scale up Throughput Benchmark – Embedded mode 20% drop up to 16 threads hitting the system with 1.5 M read/sec 1.8 Million read sec! 1.1 Million   write/take sec!
Scale up Throughput Benchmark – Remote mode 20% drop up to 24 users hitting the system with 65,000 red/sec 90,00 read sec! 45,00 write/take sec!
Scale up Throughput Benchmark - Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object]
Scale up Latency Benchmark ,[object Object],[object Object],[object Object],[object Object],[object Object],Client Latency Measured
Scale up Latency Benchmark– Physical Deployment Topology white box  Client X4450  GigaSpaces 4 spaces , one per GSC X4450  GigaSpaces 4 spaces , one per GSC Switched Ethernet LAN
Scale up Latency Benchmark Less than 20% drop up to 20 users hitting the system with 20,000 write/sec
Scale up Latency Benchmark - Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Web Application Benchmark
Web Application Benchmark – The Pet Clinic ,[object Object],[object Object]
Architecture – Step 1- Request Submission Get request and invoke Service Data Grid Step 1 - Latency
Architecture – Step 2- Retrieve Results Page Generation Data Grid Latency measured:  Step 1 + 2 Step 2 - Latency
Web Application Benchmark – Physical Deployment Topology X4150  Apache Load Balancer mySQL X4450  GigaSpaces 4 spaces Web servers ,Services X4450  GigaSpaces 4 spaces Web servers ,Services Switched Ethernet LAN white box  Client JMeter Switched Ethernet LAN
Web Application Benchmark Results – Latency , Scalability Only 20% drop up to 20 users hitting the system with 7000 requests/sec having 2.8 ms latency
Web Application Benchmark Results - Capacity The Users factor is 50 - Every LAN based user equals 50s WAN based users due-to the inherit latency of the internet (Min latency over the WAN 100ms , over the LAN 2ms)
Web Application Benchmark - Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object]
Risk Calculation Benchmark Workers Data-Grid Submit Calculation Request
Risk Calculation Benchmark – Physical Deployment Topology X4450  GigaSpaces spaces Workers ,Services X4450  GigaSpaces spaces Workers ,Services X4150  Client Switched Ethernet LAN White box  GigaSpaces spaces Workers ,Services
Risk Calculation Benchmark Results – Calc Time , Scalability Less than 20% drop up to 32 workers
Risk Calculation Benchmark Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Special Tuning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object]
Comparing 6 core CPU with 4 Core CPU ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Comparison of 6 with 4 Core CPU (16 vs. 24 cores)  Embedded mode 20% difference with 16 threads 300,000 extra read oper/sec with 24 cores! 180,000 extra write/take oper/sec with 24 cores!
Comparing 6 core CPU with 4 Core CPU (16 vs. 24 cores)  Embedded mode Better throughput with 24 cores Better Scalability with 24 cores – 24-29% better
Comparing 6 core CPU with 4 Core CPU (16 vs. 24 cores)  Remote mode ~30% difference with 24 threads 10,000 extra read oper/sec with 24 cores! 20,000 extra write/take oper/sec with 24 cores!
Comparing 6 core CPU with 4 Core CPU (16 vs. 24 cores)  Remote mode Better throughput with 24 cores Better Scalability with 24 cores 12-33 % better
Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Special Tuning ,[object Object],[object Object]
Need help? ,[object Object],Thank You!

Más contenido relacionado

La actualidad más candente

Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...
Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...
Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...DataWorks Summit
 
Scaling Hadoop at LinkedIn
Scaling Hadoop at LinkedInScaling Hadoop at LinkedIn
Scaling Hadoop at LinkedInDataWorks Summit
 
Design, Scale and Performance of MapR's Distribution for Hadoop
Design, Scale and Performance of MapR's Distribution for HadoopDesign, Scale and Performance of MapR's Distribution for Hadoop
Design, Scale and Performance of MapR's Distribution for Hadoopmcsrivas
 
A Dataflow Processing Chip for Training Deep Neural Networks
A Dataflow Processing Chip for Training Deep Neural NetworksA Dataflow Processing Chip for Training Deep Neural Networks
A Dataflow Processing Chip for Training Deep Neural Networksinside-BigData.com
 
Using a Field Programmable Gate Array to Accelerate Application Performance
Using a Field Programmable Gate Array to Accelerate Application PerformanceUsing a Field Programmable Gate Array to Accelerate Application Performance
Using a Field Programmable Gate Array to Accelerate Application PerformanceOdinot Stanislas
 
Apache Hadoop YARN 3.x in Alibaba
Apache Hadoop YARN 3.x in AlibabaApache Hadoop YARN 3.x in Alibaba
Apache Hadoop YARN 3.x in AlibabaDataWorks Summit
 
Architectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop DistributionArchitectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop Distributionmcsrivas
 
Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...
Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...
Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...Databricks
 
Graphene – Microsoft SCOPE on Tez
Graphene – Microsoft SCOPE on Tez Graphene – Microsoft SCOPE on Tez
Graphene – Microsoft SCOPE on Tez DataWorks Summit
 
Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...
Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...
Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...DataWorks Summit/Hadoop Summit
 
How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...
How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...
How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...DataWorks Summit/Hadoop Summit
 
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu YongUnlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu YongCeph Community
 
The columnar roadmap: Apache Parquet and Apache Arrow
The columnar roadmap: Apache Parquet and Apache ArrowThe columnar roadmap: Apache Parquet and Apache Arrow
The columnar roadmap: Apache Parquet and Apache ArrowDataWorks Summit
 
Big data processing meets non-volatile memory: opportunities and challenges
Big data processing meets non-volatile memory: opportunities and challenges Big data processing meets non-volatile memory: opportunities and challenges
Big data processing meets non-volatile memory: opportunities and challenges DataWorks Summit
 
Hadoop engineering bo_f_final
Hadoop engineering bo_f_finalHadoop engineering bo_f_final
Hadoop engineering bo_f_finalRamya Sunil
 
Performance tuning your Hadoop/Spark clusters to use cloud storage
Performance tuning your Hadoop/Spark clusters to use cloud storagePerformance tuning your Hadoop/Spark clusters to use cloud storage
Performance tuning your Hadoop/Spark clusters to use cloud storageDataWorks Summit
 

La actualidad más candente (20)

Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...
Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...
Data Highway Rainbow - Petabyte Scale Event Collection, Transport & Delivery ...
 
Scaling Hadoop at LinkedIn
Scaling Hadoop at LinkedInScaling Hadoop at LinkedIn
Scaling Hadoop at LinkedIn
 
Design, Scale and Performance of MapR's Distribution for Hadoop
Design, Scale and Performance of MapR's Distribution for HadoopDesign, Scale and Performance of MapR's Distribution for Hadoop
Design, Scale and Performance of MapR's Distribution for Hadoop
 
A Dataflow Processing Chip for Training Deep Neural Networks
A Dataflow Processing Chip for Training Deep Neural NetworksA Dataflow Processing Chip for Training Deep Neural Networks
A Dataflow Processing Chip for Training Deep Neural Networks
 
Using a Field Programmable Gate Array to Accelerate Application Performance
Using a Field Programmable Gate Array to Accelerate Application PerformanceUsing a Field Programmable Gate Array to Accelerate Application Performance
Using a Field Programmable Gate Array to Accelerate Application Performance
 
Hadoop Platform at Yahoo
Hadoop Platform at YahooHadoop Platform at Yahoo
Hadoop Platform at Yahoo
 
Apache Hadoop YARN 3.x in Alibaba
Apache Hadoop YARN 3.x in AlibabaApache Hadoop YARN 3.x in Alibaba
Apache Hadoop YARN 3.x in Alibaba
 
Architectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop DistributionArchitectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop Distribution
 
Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...
Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...
Accelerating Apache Spark Shuffle for Data Analytics on the Cloud with Remote...
 
Graphene – Microsoft SCOPE on Tez
Graphene – Microsoft SCOPE on Tez Graphene – Microsoft SCOPE on Tez
Graphene – Microsoft SCOPE on Tez
 
Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...
Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...
Near Real-Time Network Anomaly Detection and Traffic Analysis using Spark bas...
 
How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...
How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...
How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...
 
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu YongUnlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
 
Node Labels in YARN
Node Labels in YARNNode Labels in YARN
Node Labels in YARN
 
The columnar roadmap: Apache Parquet and Apache Arrow
The columnar roadmap: Apache Parquet and Apache ArrowThe columnar roadmap: Apache Parquet and Apache Arrow
The columnar roadmap: Apache Parquet and Apache Arrow
 
Big data processing meets non-volatile memory: opportunities and challenges
Big data processing meets non-volatile memory: opportunities and challenges Big data processing meets non-volatile memory: opportunities and challenges
Big data processing meets non-volatile memory: opportunities and challenges
 
Apache Eagle - Monitor Hadoop in Real Time
Apache Eagle - Monitor Hadoop in Real TimeApache Eagle - Monitor Hadoop in Real Time
Apache Eagle - Monitor Hadoop in Real Time
 
Hadoop engineering bo_f_final
Hadoop engineering bo_f_finalHadoop engineering bo_f_final
Hadoop engineering bo_f_final
 
HDFS Tiered Storage: Mounting Object Stores in HDFS
HDFS Tiered Storage: Mounting Object Stores in HDFSHDFS Tiered Storage: Mounting Object Stores in HDFS
HDFS Tiered Storage: Mounting Object Stores in HDFS
 
Performance tuning your Hadoop/Spark clusters to use cloud storage
Performance tuning your Hadoop/Spark clusters to use cloud storagePerformance tuning your Hadoop/Spark clusters to use cloud storage
Performance tuning your Hadoop/Spark clusters to use cloud storage
 

Destacado

Miguel Orense Search Congress Bcn
Miguel Orense Search Congress BcnMiguel Orense Search Congress Bcn
Miguel Orense Search Congress Bcnsearch congress
 
Yahoo | Búsquedas: su uso para diseñar un mejor sitio
Yahoo | Búsquedas: su uso para diseñar un mejor sitioYahoo | Búsquedas: su uso para diseñar un mejor sitio
Yahoo | Búsquedas: su uso para diseñar un mejor sitiosearch congress
 
Teliad | Mercado de Enlaces
Teliad | Mercado de EnlacesTeliad | Mercado de Enlaces
Teliad | Mercado de Enlacessearch congress
 
Search Congress V2 Ppt Ysm Yahoo
Search Congress V2 Ppt Ysm YahooSearch Congress V2 Ppt Ysm Yahoo
Search Congress V2 Ppt Ysm Yahoosearch congress
 
Search congress lisboa 2010
Search congress lisboa 2010Search congress lisboa 2010
Search congress lisboa 2010search congress
 
Search congress lisboa 2010 ayr consulting
Search congress lisboa 2010   ayr consultingSearch congress lisboa 2010   ayr consulting
Search congress lisboa 2010 ayr consultingsearch congress
 
Yellowbird
YellowbirdYellowbird
Yellowbirdswedegis
 

Destacado (8)

Miguel Orense Search Congress Bcn
Miguel Orense Search Congress BcnMiguel Orense Search Congress Bcn
Miguel Orense Search Congress Bcn
 
Yahoo | Búsquedas: su uso para diseñar un mejor sitio
Yahoo | Búsquedas: su uso para diseñar un mejor sitioYahoo | Búsquedas: su uso para diseñar un mejor sitio
Yahoo | Búsquedas: su uso para diseñar un mejor sitio
 
Teliad | Mercado de Enlaces
Teliad | Mercado de EnlacesTeliad | Mercado de Enlaces
Teliad | Mercado de Enlaces
 
20081207
2008120720081207
20081207
 
Search Congress V2 Ppt Ysm Yahoo
Search Congress V2 Ppt Ysm YahooSearch Congress V2 Ppt Ysm Yahoo
Search Congress V2 Ppt Ysm Yahoo
 
Search congress lisboa 2010
Search congress lisboa 2010Search congress lisboa 2010
Search congress lisboa 2010
 
Search congress lisboa 2010 ayr consulting
Search congress lisboa 2010   ayr consultingSearch congress lisboa 2010   ayr consulting
Search congress lisboa 2010 ayr consulting
 
Yellowbird
YellowbirdYellowbird
Yellowbird
 

Similar a Sunx4450 Intel7460 GigaSpaces XAP Platform Benchmark

3PAR and VMWare
3PAR and VMWare3PAR and VMWare
3PAR and VMWarevmug
 
Arquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWS
Arquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWSArquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWS
Arquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWSAmazon Web Services LATAM
 
WETEC HP Integrity Servers
WETEC HP Integrity ServersWETEC HP Integrity Servers
WETEC HP Integrity ServersEddy Jennekens
 
AWS re:Invent 2016: High Performance Computing on AWS (CMP207)
AWS re:Invent 2016: High Performance Computing on AWS (CMP207)AWS re:Invent 2016: High Performance Computing on AWS (CMP207)
AWS re:Invent 2016: High Performance Computing on AWS (CMP207)Amazon Web Services
 
Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors
Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors
Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors Michelle Holley
 
Sparc t4 systems customer presentation
Sparc t4 systems customer presentationSparc t4 systems customer presentation
Sparc t4 systems customer presentationsolarisyougood
 
Boosting spark performance: An Overview of Techniques
Boosting spark performance: An Overview of TechniquesBoosting spark performance: An Overview of Techniques
Boosting spark performance: An Overview of TechniquesAhsan Javed Awan
 
IBM Power Systems: Designed for Data
IBM Power Systems: Designed for DataIBM Power Systems: Designed for Data
IBM Power Systems: Designed for DataIBM Power Systems
 
On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...Jorge E. López de Vergara Méndez
 
High Performance Communication for Oracle using InfiniBand
High Performance Communication for Oracle using InfiniBandHigh Performance Communication for Oracle using InfiniBand
High Performance Communication for Oracle using InfiniBandwebhostingguy
 
Revolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and InfrastrctureRevolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and Infrastrcturesabnees
 
Heterogeneous Computing : The Future of Systems
Heterogeneous Computing : The Future of SystemsHeterogeneous Computing : The Future of Systems
Heterogeneous Computing : The Future of SystemsAnand Haridass
 
Sharing High-Performance Interconnects Across Multiple Virtual Machines
Sharing High-Performance Interconnects Across Multiple Virtual MachinesSharing High-Performance Interconnects Across Multiple Virtual Machines
Sharing High-Performance Interconnects Across Multiple Virtual Machinesinside-BigData.com
 
Ceph Day Taipei - Accelerate Ceph via SPDK
Ceph Day Taipei - Accelerate Ceph via SPDK Ceph Day Taipei - Accelerate Ceph via SPDK
Ceph Day Taipei - Accelerate Ceph via SPDK Ceph Community
 
Infraestructura oracle
Infraestructura oracleInfraestructura oracle
Infraestructura oracleFran Navarro
 
Business in a Flash: How to increase performance and lower costs in the data...
Business in a Flash:  How to increase performance and lower costs in the data...Business in a Flash:  How to increase performance and lower costs in the data...
Business in a Flash: How to increase performance and lower costs in the data...Violin Memory
 
Hyperscan - Mohammad Abdul Awal
Hyperscan - Mohammad Abdul AwalHyperscan - Mohammad Abdul Awal
Hyperscan - Mohammad Abdul Awalharryvanhaaren
 

Similar a Sunx4450 Intel7460 GigaSpaces XAP Platform Benchmark (20)

3PAR and VMWare
3PAR and VMWare3PAR and VMWare
3PAR and VMWare
 
Arquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWS
Arquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWSArquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWS
Arquitetura Hibrida - Integrando seu Data Center com a Nuvem da AWS
 
WETEC HP Integrity Servers
WETEC HP Integrity ServersWETEC HP Integrity Servers
WETEC HP Integrity Servers
 
Hp Integrity Servers
Hp Integrity ServersHp Integrity Servers
Hp Integrity Servers
 
AWS re:Invent 2016: High Performance Computing on AWS (CMP207)
AWS re:Invent 2016: High Performance Computing on AWS (CMP207)AWS re:Invent 2016: High Performance Computing on AWS (CMP207)
AWS re:Invent 2016: High Performance Computing on AWS (CMP207)
 
Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors
Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors
Building efficient 5G NR base stations with Intel® Xeon® Scalable Processors
 
Sparc t4 systems customer presentation
Sparc t4 systems customer presentationSparc t4 systems customer presentation
Sparc t4 systems customer presentation
 
Boosting spark performance: An Overview of Techniques
Boosting spark performance: An Overview of TechniquesBoosting spark performance: An Overview of Techniques
Boosting spark performance: An Overview of Techniques
 
Demystify OpenPOWER
Demystify OpenPOWERDemystify OpenPOWER
Demystify OpenPOWER
 
IBM Power Systems: Designed for Data
IBM Power Systems: Designed for DataIBM Power Systems: Designed for Data
IBM Power Systems: Designed for Data
 
On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...
 
High Performance Communication for Oracle using InfiniBand
High Performance Communication for Oracle using InfiniBandHigh Performance Communication for Oracle using InfiniBand
High Performance Communication for Oracle using InfiniBand
 
Revolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and InfrastrctureRevolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and Infrastrcture
 
Exadata
ExadataExadata
Exadata
 
Heterogeneous Computing : The Future of Systems
Heterogeneous Computing : The Future of SystemsHeterogeneous Computing : The Future of Systems
Heterogeneous Computing : The Future of Systems
 
Sharing High-Performance Interconnects Across Multiple Virtual Machines
Sharing High-Performance Interconnects Across Multiple Virtual MachinesSharing High-Performance Interconnects Across Multiple Virtual Machines
Sharing High-Performance Interconnects Across Multiple Virtual Machines
 
Ceph Day Taipei - Accelerate Ceph via SPDK
Ceph Day Taipei - Accelerate Ceph via SPDK Ceph Day Taipei - Accelerate Ceph via SPDK
Ceph Day Taipei - Accelerate Ceph via SPDK
 
Infraestructura oracle
Infraestructura oracleInfraestructura oracle
Infraestructura oracle
 
Business in a Flash: How to increase performance and lower costs in the data...
Business in a Flash:  How to increase performance and lower costs in the data...Business in a Flash:  How to increase performance and lower costs in the data...
Business in a Flash: How to increase performance and lower costs in the data...
 
Hyperscan - Mohammad Abdul Awal
Hyperscan - Mohammad Abdul AwalHyperscan - Mohammad Abdul Awal
Hyperscan - Mohammad Abdul Awal
 

Más de Shay Hassidim

GigaSpaces Flash Memory Summit 2014
GigaSpaces Flash Memory Summit 2014GigaSpaces Flash Memory Summit 2014
GigaSpaces Flash Memory Summit 2014Shay Hassidim
 
Xap memory xtend-tutorial-2014
Xap memory xtend-tutorial-2014Xap memory xtend-tutorial-2014
Xap memory xtend-tutorial-2014Shay Hassidim
 
Telecom universal datastatesharingfabric
Telecom universal datastatesharingfabricTelecom universal datastatesharingfabric
Telecom universal datastatesharingfabricShay Hassidim
 
July NY Enterprise Technology Meetup
July NY Enterprise Technology MeetupJuly NY Enterprise Technology Meetup
July NY Enterprise Technology MeetupShay Hassidim
 
NoSQL meetup July 2011
NoSQL meetup July 2011NoSQL meetup July 2011
NoSQL meetup July 2011Shay Hassidim
 
GigaSpaces CCF Quick Tour - 2.3.6
GigaSpaces CCF Quick Tour - 2.3.6GigaSpaces CCF Quick Tour - 2.3.6
GigaSpaces CCF Quick Tour - 2.3.6Shay Hassidim
 
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2Shay Hassidim
 
GigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapGigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapShay Hassidim
 

Más de Shay Hassidim (10)

GigaSpaces Flash Memory Summit 2014
GigaSpaces Flash Memory Summit 2014GigaSpaces Flash Memory Summit 2014
GigaSpaces Flash Memory Summit 2014
 
Xap memory xtend-tutorial-2014
Xap memory xtend-tutorial-2014Xap memory xtend-tutorial-2014
Xap memory xtend-tutorial-2014
 
Telecom universal datastatesharingfabric
Telecom universal datastatesharingfabricTelecom universal datastatesharingfabric
Telecom universal datastatesharingfabric
 
GigaSpaces HA
GigaSpaces HAGigaSpaces HA
GigaSpaces HA
 
July NY Enterprise Technology Meetup
July NY Enterprise Technology MeetupJuly NY Enterprise Technology Meetup
July NY Enterprise Technology Meetup
 
NoSQL meetup July 2011
NoSQL meetup July 2011NoSQL meetup July 2011
NoSQL meetup July 2011
 
The Elastic PU
The Elastic PUThe Elastic PU
The Elastic PU
 
GigaSpaces CCF Quick Tour - 2.3.6
GigaSpaces CCF Quick Tour - 2.3.6GigaSpaces CCF Quick Tour - 2.3.6
GigaSpaces CCF Quick Tour - 2.3.6
 
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
GigaSpaces Cloud Computing Framework 4 XAP - Quick Tour - v2
 
GigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapGigaSpaces CCF 4 Xap
GigaSpaces CCF 4 Xap
 

Último

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 

Último (20)

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 

Sunx4450 Intel7460 GigaSpaces XAP Platform Benchmark

  • 1. Ultra-Scalable and Blazing-Fast: The Sun Fire x4450-Intel 7460-XAP GigaSpaces Platform Scaling up with Commodity HW® Scale up Benchmark Report Shay Hassidim Deputy CTO GigaSpaces January 2009
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7. Servers Used Since we are running Scale up Benchmark we have fixed amount of machines - mySQL Database - Apache Load-Balancer 3.16GHz 4 2 (2 cores each) Intel Xeon 16 G RAM Sun Fire X4150 2 socket Sun 4 GigaSpaces Clients 2.66GHz 24 4 (6 cores each) Intel Dunnington X7460 32 G RAM 4 socket Intel White box 3 GigaSpaces 2.66GHz 24 4 (6 cores each) Intel Dunnington X7460 32 G RAM Sun Fire X4450 4 socket Sun 2 GigaSpaces 2.66GHz 24 4 (6 cores each) Intel Dunnington X7460 32 G RAM Sun Fire X4450 4 socket Sun 1 Running Clock speed # of Cores # of CPU CPU Type and Memory Model Vendor Server ID
  • 8. Technology Stack under Test Ethernet (1gE) Sun Fire x4450 Intel Dunnington X7460 4 CPUs (6 cores each) Sun Solaris update 6 GigaSpaces XAP 6.2.2 Sun mySQL 5 Apache LB 2.2.9 Sun JDK 1.6
  • 9.
  • 10.
  • 11. Scale up Benchmark Goals – Measuring Performance Scalability Latency
  • 12.
  • 13. SBA vs .TBA – Scaling vs. Latency and Costs SBA – Space Based Architecture TBA – Traditional Based Architecture
  • 14.
  • 15. Quick Introduction to GigaSpaces
  • 16.
  • 17. Introduction - Space Basic Operations
  • 18.
  • 19. Introduction Space Based Architecture – Business logic and data collocated Primary 1 Primary 2 Primary 3 Backup 3 Backup 2 Backup 1 Replication Replication Replication Pushing data into the backend system In-Memory-Data-Grid and collocated Processing units Collects results / reporting Service
  • 20.
  • 21. Scale up Throughput Benchmark
  • 22.
  • 23. Scale up Throughput Benchmark – Embedded mode 20% drop up to 16 threads hitting the system with 1.5 M read/sec 1.8 Million read sec! 1.1 Million write/take sec!
  • 24. Scale up Throughput Benchmark – Remote mode 20% drop up to 24 users hitting the system with 65,000 red/sec 90,00 read sec! 45,00 write/take sec!
  • 25.
  • 26.
  • 27.
  • 28. Scale up Latency Benchmark– Physical Deployment Topology white box Client X4450 GigaSpaces 4 spaces , one per GSC X4450 GigaSpaces 4 spaces , one per GSC Switched Ethernet LAN
  • 29. Scale up Latency Benchmark Less than 20% drop up to 20 users hitting the system with 20,000 write/sec
  • 30.
  • 32.
  • 33. Architecture – Step 1- Request Submission Get request and invoke Service Data Grid Step 1 - Latency
  • 34. Architecture – Step 2- Retrieve Results Page Generation Data Grid Latency measured: Step 1 + 2 Step 2 - Latency
  • 35. Web Application Benchmark – Physical Deployment Topology X4150 Apache Load Balancer mySQL X4450 GigaSpaces 4 spaces Web servers ,Services X4450 GigaSpaces 4 spaces Web servers ,Services Switched Ethernet LAN white box Client JMeter Switched Ethernet LAN
  • 36. Web Application Benchmark Results – Latency , Scalability Only 20% drop up to 20 users hitting the system with 7000 requests/sec having 2.8 ms latency
  • 37. Web Application Benchmark Results - Capacity The Users factor is 50 - Every LAN based user equals 50s WAN based users due-to the inherit latency of the internet (Min latency over the WAN 100ms , over the LAN 2ms)
  • 38.
  • 39.
  • 40. Risk Calculation Benchmark Workers Data-Grid Submit Calculation Request
  • 41. Risk Calculation Benchmark – Physical Deployment Topology X4450 GigaSpaces spaces Workers ,Services X4450 GigaSpaces spaces Workers ,Services X4150 Client Switched Ethernet LAN White box GigaSpaces spaces Workers ,Services
  • 42. Risk Calculation Benchmark Results – Calc Time , Scalability Less than 20% drop up to 32 workers
  • 43.
  • 44.
  • 45.
  • 46.
  • 47. Comparison of 6 with 4 Core CPU (16 vs. 24 cores) Embedded mode 20% difference with 16 threads 300,000 extra read oper/sec with 24 cores! 180,000 extra write/take oper/sec with 24 cores!
  • 48. Comparing 6 core CPU with 4 Core CPU (16 vs. 24 cores) Embedded mode Better throughput with 24 cores Better Scalability with 24 cores – 24-29% better
  • 49. Comparing 6 core CPU with 4 Core CPU (16 vs. 24 cores) Remote mode ~30% difference with 24 threads 10,000 extra read oper/sec with 24 cores! 20,000 extra write/take oper/sec with 24 cores!
  • 50. Comparing 6 core CPU with 4 Core CPU (16 vs. 24 cores) Remote mode Better throughput with 24 cores Better Scalability with 24 cores 12-33 % better
  • 51.
  • 52.
  • 53.

Notas del editor

  1. Thanks to Massimo for the very informative presentation of the technology roadmap that awaits us. With your permission – I’d like to spend the next few minutes talking about 2 things: How we at GS see the change that our industry is going through (and no - I’m not referring to the sub-prime crisis...), How we are responding to it.