SlideShare una empresa de Scribd logo
1 de 21
Scale | Simplify | Optimize | Evolve
RESTORING DEVELOPER PRODUCTIVITY THROUGH SIMPLICTY
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 1
Industry Context
Data sizes for data under management are monotonically increasing
◦ Who wants less data?
Our appetite for analysis is monotonically increasing
◦ Do you think, or do you know?
◦ Trend toward evidence-based management
Our appetite for speed is monotonically increasing
◦ Who wants questions answered more slowly?
◦ Hence the industry interest in in-memory data management systems
Our overall ability to manage complexity is not increasing
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 2
Virtualization today:
Is about Single Node Resource Sharing
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 3
Solution scaling constrained by physical machine cost and size
Result: Finite resource pool
Scale-Out today:
An Architecture of Developer Complexity
3/21/2016
COPYRIGHT 2014 TIDALSCALE, INC. 4
Solution scaling is constrained by the programmers ability to comprehend and
navigate the architectural complexity
Result: Increased development cost
TidalScale enables:
An Architecture of Simplicity – One Operating System
3/21/2016
COPYRIGHT 2014 TIDALSCALE, INC. 5
Solution scaling enabled by aggregating hardware resources via one OS instance
Result: Lower development complexity, lower development cost
Why?
Creates a unique scalable solution experience:
User experience bare metal User experience TidalScale
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 6
Real Screen Shots
No API’s to learn – define the machine size - boot it up
Fault Tolerance
System Standby and Linux Tool Transparency
3/21/2016
COPYRIGHT 2014 TIDALSCALE, INC. 7
Active Server Standby Server
Transparent access to Linux Availability Tool Chain
TidalScale handles the underlying complexity
Result
AnyLogic™ 1 Million Agent Simulation*
Normal run time - 3 Days
TidalScale run time - 30 minutes
We changed the customers approach to using AnyLogic™
and rapid prototyping of simulations
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 8
*No code changes were required
What Kinds of Problems Benefit?
Data Mining / Finance
◦ High Data Volumes, Large Analytics, Risk Analysis, Fraud Detection, Graph Analytics using
Alternative Data Sources, Risk modeling, High Frequency trading, Complex Event Modeling
Bioinformatics
• Next Generation DNA sequencing, Meta-genomic analysis, Finite Element Brain Modeling,
Time-Series MRI Neuro-Imaging
IT / Operational Systems
◦ In-House Applications, Web Controllers & Servers, Gateways, Image serving, Ad serving, OLTP,
ERP, Business Intelligence
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 9
Data Mining: High Data Volumes
Scenario
◦ Analytic app running on popular SQL database
◦ Well established – trained users, tied to diverse apps & tools
◦ Running well on a single system, except…
Problem
◦ …Data volumes steadily growing…
◦ …Frequently upgrading hardware…
◦ …About to hit a wall
The TidalScale Solution
◦ Scale up existing application & move more data into memory cache for real time performance
◦ Avoid re-architecting DB & rewriting applications for scale out/cluster
◦ Avoid expensive maintenance cost of a cluster as shape of data changes or use cases & query types evolve
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 10
Data Mining: Large Scale Analytics
Scenario
◦ Analytic app running on popular SQL database
◦ Well established – trained users, tied to diverse apps & tools
◦ Proven, reliable application needing no changes, other than the need to increase capacity
Problem
◦ Number of users and connections is growing
◦ Each user is generating large, demanding queries
◦ Frequently upgrading hardware
◦ About to hit a wall – add a second, third copy and offload users?
◦ But then you have a copy/synch problem, especially if data ever gets updated
The TidalScale Solution
◦ Assemble a bigger computer to move more data into memory cache & take advantage of more CPUs
◦ Avoid re-architecting DB for scale out/cluster
◦ Avoid administering multiple servers & users, and copying/synching data
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 11
Data Mining: Mortgage Risk Analysis
Scenario
◦ New risk assessment tools for loans, mortgages
◦ Use of “alternative data” in addition to credit bureaus
Problem
◦ Mortgage application workload gets “peaky” as consumers react & play the interest rate game
◦ Backlogs develop during peaks, loan processing still remarkably hands-on process. When backlogs build, customers
leave
TidalScale Solution
◦ Enables a big, flexible computer that scales to handle more complex processing
◦ Supports processor intensive analytics of unstructured data, example NLP (natural language processing)
◦ Easy system expansion as data volumes grow from the addition of unstructured data
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 12
Data Mining: Fraud Detection
Scenario
◦ New types of tools to detect fraud
◦ Ex: Graph DBs to see coordinated activity from disparate data
Problem
◦ Graph databases inherently require a closely coherent (single system) view
◦ As system grows, you must either
◦ Split the graph – at the risk of losing potential connections – leaves places for bad guys to hide
◦ Reduce granularity of data – abstracting your view – loss of detail
TidalScale Solution
◦ Enable full detailed view of transactional and account data across all customers over time
◦ Run the graph in-memory for real-time performance
◦ Run system on entirely standard hardware, OS & operational infrastructure
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 13
What enables the solution?
The Memory Hierarchy in Human Terms
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 14
(.3ns = 1s)
Event Latency Scaled
1 CPU Cycle 0.3 ns 1 s
Level 1 Cache Access 0.9 ns 3 s
Level 2 Cache Access 2.8 ns 9 s
Level 3 Cache Access 12.9 ns 43 s
Main Memory Access (DRAM, from CPU) 50.0 ns 3 min
Memory over Ethernet 3.2 μs 3.2 hours
CPU Context State Transfer 6.0 μs 6.0 hours
Flash SSD (PCI-e) 4.7 ms 5 months
Rotational disk I/O 1-10 ms 1-12 months
Internet: San Francisco to New York 40 ms 4 years
Internet: San Francisco to United Kingdom 81 ms 8 years
Internet: San Francisco to Australia 183 ms 19 years
TCP packet retransmit 1-3 s 105-317 years
TidalScale
Completely Transparent - No Changes Required
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 15
…and many other applications
Hardware Example
System features
• Admin node 1
• Worker nodes 25
• Total Memory 3.2TB
• Total Cores: 150
• Network 1/10GbE
• Storage FreeNAS, xTB
Components
• 1x Admin node (A003)
• Colfax CX1260i-X6 Haswell, E5-2603V3 6C, 16GB
• 25x Worker nodes
• Colfax CX1260i-X6 Haswell, E5-2603V3 6C, 128GB
• 1x 1G switch
• 2x 10G switch (S009, S010) Mellanox
• 1x NAS
163/21/2016 COPYRIGHT 2014 TIDALSCALE, INC.
TidalScale Benefits Summary
In-Memory Performance
◦ The world wants data to be in-memory, but hasn’t been able to get it.
◦ Historically the industry has scaled applications to fit on available computer hardware. Now, for the first time, the
industry can scale the hardware to fit the application.
Linear System Scalability
◦ TidalScale makes it possible to organically grow hardware using low cost commodity servers at linear cost, as
customer needs evolve.
◦ Applications can now achieve superior in-memory performance using inexpensive unmodified hardware.
Reduced Software Development Costs
◦ TidalScale uses off-the-shelf, unmodified Linux.
◦ TidalScale requires no changes to applications or database software.
◦ Optimization happens automatically using our software, and learns over time.
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 17
Price/Performance at Scale
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 18
Scale up costs increase
rapidly after 3Tb…
Performance Scales Up
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 19
TidalScale can continue to
add cores as well as memory
(and bandwidth)
Single machine solution can
only add memory
Scale, Simplify, Optimize, Evolve
Scale:
◦ Aggregates compute resources for large scale in-memory analysis
and decision support
◦ Scales like a cluster using commodity hardware at linear cost
◦ Allow customers to grow gradually as their needs develop
Simplify:
◦ Dramatically simplifies application development
◦ No need to distribute work across servers
◦ Existing applications run as a single instance, without
modification, as if on a highly flexible mainframe
Optimize:
◦ Automatic dynamic hierarchical resource optimization
Evolve:
◦ Applicable to modern and emerging microprocessors, memories,
interconnects, persistent storage & networks
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 20
Scale | Simplify | Optimize | Evolve
RESTORING DEVELOPER PRODUCTIVITY THROUGH SIMPLICTY
3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 21

Más contenido relacionado

La actualidad más candente

Transforms Document Management at Scale with Distributed Database Solution wi...
Transforms Document Management at Scale with Distributed Database Solution wi...Transforms Document Management at Scale with Distributed Database Solution wi...
Transforms Document Management at Scale with Distributed Database Solution wi...DataStax Academy
 
Sqream DB on OpenPOWER performance
Sqream DB on OpenPOWER performanceSqream DB on OpenPOWER performance
Sqream DB on OpenPOWER performanceGanesan Narayanasamy
 
ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...
ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...
ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...DataStax Academy
 
Battery Ventures: Simulating and Visualizing Large Scale Cassandra Deployments
Battery Ventures: Simulating and Visualizing Large Scale Cassandra DeploymentsBattery Ventures: Simulating and Visualizing Large Scale Cassandra Deployments
Battery Ventures: Simulating and Visualizing Large Scale Cassandra DeploymentsDataStax Academy
 
Webinar | Introducing DataStax Enterprise 4.6
Webinar | Introducing DataStax Enterprise 4.6Webinar | Introducing DataStax Enterprise 4.6
Webinar | Introducing DataStax Enterprise 4.6DataStax
 
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...In-Memory Computing Summit
 
Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...
Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...
Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...Data Con LA
 
Explore big data at speed of thought with Spark 2.0 and Snappydata
Explore big data at speed of thought with Spark 2.0 and SnappydataExplore big data at speed of thought with Spark 2.0 and Snappydata
Explore big data at speed of thought with Spark 2.0 and SnappydataData Con LA
 
Accelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop
Accelerating the Hadoop data stack with Apache Ignite, Spark and BigtopAccelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop
Accelerating the Hadoop data stack with Apache Ignite, Spark and BigtopIn-Memory Computing Summit
 
Webinar | Building Apps with the Cassandra Python Driver
Webinar | Building Apps with the Cassandra Python DriverWebinar | Building Apps with the Cassandra Python Driver
Webinar | Building Apps with the Cassandra Python DriverDataStax Academy
 
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...Spark Summit
 
How jKool Analyzes Streaming Data in Real Time with DataStax
How jKool Analyzes Streaming Data in Real Time with DataStaxHow jKool Analyzes Streaming Data in Real Time with DataStax
How jKool Analyzes Streaming Data in Real Time with DataStaxDataStax
 
Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...
Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...
Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...Spark Summit
 
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Data Con LA
 
Building Data Quality pipelines with Apache Spark and Delta Lake
Building Data Quality pipelines with Apache Spark and Delta LakeBuilding Data Quality pipelines with Apache Spark and Delta Lake
Building Data Quality pipelines with Apache Spark and Delta LakeDatabricks
 
Spark and Couchbase– Augmenting the Operational Database with Spark
Spark and Couchbase– Augmenting the Operational Database with SparkSpark and Couchbase– Augmenting the Operational Database with Spark
Spark and Couchbase– Augmenting the Operational Database with SparkMatt Ingenthron
 
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...Spark Summit
 
Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...
Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...
Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...Databricks
 
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...Data Con LA
 

La actualidad más candente (20)

Transforms Document Management at Scale with Distributed Database Solution wi...
Transforms Document Management at Scale with Distributed Database Solution wi...Transforms Document Management at Scale with Distributed Database Solution wi...
Transforms Document Management at Scale with Distributed Database Solution wi...
 
Sqream DB on OpenPOWER performance
Sqream DB on OpenPOWER performanceSqream DB on OpenPOWER performance
Sqream DB on OpenPOWER performance
 
IoT Austin CUG talk
IoT Austin CUG talkIoT Austin CUG talk
IoT Austin CUG talk
 
ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...
ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...
ProtectWise Revolutionizes Enterprise Network Security in the Cloud with Data...
 
Battery Ventures: Simulating and Visualizing Large Scale Cassandra Deployments
Battery Ventures: Simulating and Visualizing Large Scale Cassandra DeploymentsBattery Ventures: Simulating and Visualizing Large Scale Cassandra Deployments
Battery Ventures: Simulating and Visualizing Large Scale Cassandra Deployments
 
Webinar | Introducing DataStax Enterprise 4.6
Webinar | Introducing DataStax Enterprise 4.6Webinar | Introducing DataStax Enterprise 4.6
Webinar | Introducing DataStax Enterprise 4.6
 
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...
 
Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...
Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...
Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...
 
Explore big data at speed of thought with Spark 2.0 and Snappydata
Explore big data at speed of thought with Spark 2.0 and SnappydataExplore big data at speed of thought with Spark 2.0 and Snappydata
Explore big data at speed of thought with Spark 2.0 and Snappydata
 
Accelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop
Accelerating the Hadoop data stack with Apache Ignite, Spark and BigtopAccelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop
Accelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop
 
Webinar | Building Apps with the Cassandra Python Driver
Webinar | Building Apps with the Cassandra Python DriverWebinar | Building Apps with the Cassandra Python Driver
Webinar | Building Apps with the Cassandra Python Driver
 
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
 
How jKool Analyzes Streaming Data in Real Time with DataStax
How jKool Analyzes Streaming Data in Real Time with DataStaxHow jKool Analyzes Streaming Data in Real Time with DataStax
How jKool Analyzes Streaming Data in Real Time with DataStax
 
Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...
Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...
Analytics at the Real-Time Speed of Business: Spark Summit East talk by Manis...
 
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
 
Building Data Quality pipelines with Apache Spark and Delta Lake
Building Data Quality pipelines with Apache Spark and Delta LakeBuilding Data Quality pipelines with Apache Spark and Delta Lake
Building Data Quality pipelines with Apache Spark and Delta Lake
 
Spark and Couchbase– Augmenting the Operational Database with Spark
Spark and Couchbase– Augmenting the Operational Database with SparkSpark and Couchbase– Augmenting the Operational Database with Spark
Spark and Couchbase– Augmenting the Operational Database with Spark
 
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...
Clipper: A Low-Latency Online Prediction Serving System: Spark Summit East ta...
 
Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...
Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...
Using Azure Databricks, Structured Streaming, and Deep Learning Pipelines to ...
 
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
 

Similar a TidalScale Overview

Build User-Facing Analytics Application That Scales Using StarRocks (DLH).pdf
Build User-Facing Analytics Application That Scales Using StarRocks (DLH).pdfBuild User-Facing Analytics Application That Scales Using StarRocks (DLH).pdf
Build User-Facing Analytics Application That Scales Using StarRocks (DLH).pdfAlbert Wong
 
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled ArchitectureDM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled ArchitectureDATAVERSITY
 
Data Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackData Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackAnant Corporation
 
Horses for Courses: Database Roundtable
Horses for Courses: Database RoundtableHorses for Courses: Database Roundtable
Horses for Courses: Database RoundtableEric Kavanagh
 
New Database and Application Development Technology
New Database and Application Development TechnologyNew Database and Application Development Technology
New Database and Application Development TechnologyMaurice Staal
 
How To Tell if Your Business Needs NoSQL
How To Tell if Your Business Needs NoSQLHow To Tell if Your Business Needs NoSQL
How To Tell if Your Business Needs NoSQLDataStax
 
The Growth Of Data Centers
The Growth Of Data CentersThe Growth Of Data Centers
The Growth Of Data CentersGina Buck
 
Data core overview - haluk-final
Data core overview - haluk-finalData core overview - haluk-final
Data core overview - haluk-finalHaluk Ulubay
 
Data Engineer's Lunch #60: Series - Developing Enterprise Consciousness
Data Engineer's Lunch #60: Series - Developing Enterprise ConsciousnessData Engineer's Lunch #60: Series - Developing Enterprise Consciousness
Data Engineer's Lunch #60: Series - Developing Enterprise ConsciousnessAnant Corporation
 
Real-Time Analytics With StarRocks (DWH+DL).pdf
Real-Time Analytics With StarRocks (DWH+DL).pdfReal-Time Analytics With StarRocks (DWH+DL).pdf
Real-Time Analytics With StarRocks (DWH+DL).pdfAlbert Wong
 
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Denodo
 
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Denodo
 
Big Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataMatt Stubbs
 
Big Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataMatt Stubbs
 
Simplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache KuduSimplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache KuduCloudera, Inc.
 
How to get Real-Time Value from your IoT Data - Datastax
How to get Real-Time Value from your IoT Data - DatastaxHow to get Real-Time Value from your IoT Data - Datastax
How to get Real-Time Value from your IoT Data - DatastaxDataStax
 
Chip ICT | Hgst storage brochure
Chip ICT | Hgst storage brochureChip ICT | Hgst storage brochure
Chip ICT | Hgst storage brochureMarco van der Hart
 
The new dominant companies are running on data
The new dominant companies are running on data The new dominant companies are running on data
The new dominant companies are running on data SnapLogic
 
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...exponential-inc
 

Similar a TidalScale Overview (20)

Build User-Facing Analytics Application That Scales Using StarRocks (DLH).pdf
Build User-Facing Analytics Application That Scales Using StarRocks (DLH).pdfBuild User-Facing Analytics Application That Scales Using StarRocks (DLH).pdf
Build User-Facing Analytics Application That Scales Using StarRocks (DLH).pdf
 
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled ArchitectureDM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
 
Data Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackData Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data Stack
 
Horses for Courses: Database Roundtable
Horses for Courses: Database RoundtableHorses for Courses: Database Roundtable
Horses for Courses: Database Roundtable
 
New Database and Application Development Technology
New Database and Application Development TechnologyNew Database and Application Development Technology
New Database and Application Development Technology
 
How To Tell if Your Business Needs NoSQL
How To Tell if Your Business Needs NoSQLHow To Tell if Your Business Needs NoSQL
How To Tell if Your Business Needs NoSQL
 
The Growth Of Data Centers
The Growth Of Data CentersThe Growth Of Data Centers
The Growth Of Data Centers
 
The new EDW
The new EDWThe new EDW
The new EDW
 
Data core overview - haluk-final
Data core overview - haluk-finalData core overview - haluk-final
Data core overview - haluk-final
 
Data Engineer's Lunch #60: Series - Developing Enterprise Consciousness
Data Engineer's Lunch #60: Series - Developing Enterprise ConsciousnessData Engineer's Lunch #60: Series - Developing Enterprise Consciousness
Data Engineer's Lunch #60: Series - Developing Enterprise Consciousness
 
Real-Time Analytics With StarRocks (DWH+DL).pdf
Real-Time Analytics With StarRocks (DWH+DL).pdfReal-Time Analytics With StarRocks (DWH+DL).pdf
Real-Time Analytics With StarRocks (DWH+DL).pdf
 
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
 
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
 
Big Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on Data
 
Big Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on DataBig Data LDN 2017: The New Dominant Companies Are Running on Data
Big Data LDN 2017: The New Dominant Companies Are Running on Data
 
Simplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache KuduSimplifying Real-Time Architectures for IoT with Apache Kudu
Simplifying Real-Time Architectures for IoT with Apache Kudu
 
How to get Real-Time Value from your IoT Data - Datastax
How to get Real-Time Value from your IoT Data - DatastaxHow to get Real-Time Value from your IoT Data - Datastax
How to get Real-Time Value from your IoT Data - Datastax
 
Chip ICT | Hgst storage brochure
Chip ICT | Hgst storage brochureChip ICT | Hgst storage brochure
Chip ICT | Hgst storage brochure
 
The new dominant companies are running on data
The new dominant companies are running on data The new dominant companies are running on data
The new dominant companies are running on data
 
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
 

Último

科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理e4aez8ss
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryJeremy Anderson
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一F sss
 
Learn How Data Science Changes Our World
Learn How Data Science Changes Our WorldLearn How Data Science Changes Our World
Learn How Data Science Changes Our WorldEduminds Learning
 
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI
LLMs, LMMs, their Improvement Suggestions and the Path towards AGILLMs, LMMs, their Improvement Suggestions and the Path towards AGI
LLMs, LMMs, their Improvement Suggestions and the Path towards AGIThomas Poetter
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectBoston Institute of Analytics
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfBoston Institute of Analytics
 
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Thomas Poetter
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degreeyuu sss
 
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...ssuserf63bd7
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanMYRABACSAFRA2
 
Thiophen Mechanism khhjjjjjjjhhhhhhhhhhh
Thiophen Mechanism khhjjjjjjjhhhhhhhhhhhThiophen Mechanism khhjjjjjjjhhhhhhhhhhh
Thiophen Mechanism khhjjjjjjjhhhhhhhhhhhYasamin16
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfchwongval
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...Boston Institute of Analytics
 
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...Amil Baba Dawood bangali
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfgstagge
 
Conf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming PipelinesConf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming PipelinesTimothy Spann
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...GQ Research
 

Último (20)

科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business Professionals
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data Story
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
 
Learn How Data Science Changes Our World
Learn How Data Science Changes Our WorldLearn How Data Science Changes Our World
Learn How Data Science Changes Our World
 
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI
LLMs, LMMs, their Improvement Suggestions and the Path towards AGILLMs, LMMs, their Improvement Suggestions and the Path towards AGI
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis Project
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
 
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
 
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population Mean
 
Thiophen Mechanism khhjjjjjjjhhhhhhhhhhh
Thiophen Mechanism khhjjjjjjjhhhhhhhhhhhThiophen Mechanism khhjjjjjjjhhhhhhhhhhh
Thiophen Mechanism khhjjjjjjjhhhhhhhhhhh
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdf
 
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
 
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdf
 
Conf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming PipelinesConf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
 

TidalScale Overview

  • 1. Scale | Simplify | Optimize | Evolve RESTORING DEVELOPER PRODUCTIVITY THROUGH SIMPLICTY 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 1
  • 2. Industry Context Data sizes for data under management are monotonically increasing ◦ Who wants less data? Our appetite for analysis is monotonically increasing ◦ Do you think, or do you know? ◦ Trend toward evidence-based management Our appetite for speed is monotonically increasing ◦ Who wants questions answered more slowly? ◦ Hence the industry interest in in-memory data management systems Our overall ability to manage complexity is not increasing 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 2
  • 3. Virtualization today: Is about Single Node Resource Sharing 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 3 Solution scaling constrained by physical machine cost and size Result: Finite resource pool
  • 4. Scale-Out today: An Architecture of Developer Complexity 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 4 Solution scaling is constrained by the programmers ability to comprehend and navigate the architectural complexity Result: Increased development cost
  • 5. TidalScale enables: An Architecture of Simplicity – One Operating System 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 5 Solution scaling enabled by aggregating hardware resources via one OS instance Result: Lower development complexity, lower development cost
  • 6. Why? Creates a unique scalable solution experience: User experience bare metal User experience TidalScale 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 6 Real Screen Shots No API’s to learn – define the machine size - boot it up
  • 7. Fault Tolerance System Standby and Linux Tool Transparency 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 7 Active Server Standby Server Transparent access to Linux Availability Tool Chain TidalScale handles the underlying complexity
  • 8. Result AnyLogic™ 1 Million Agent Simulation* Normal run time - 3 Days TidalScale run time - 30 minutes We changed the customers approach to using AnyLogic™ and rapid prototyping of simulations 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 8 *No code changes were required
  • 9. What Kinds of Problems Benefit? Data Mining / Finance ◦ High Data Volumes, Large Analytics, Risk Analysis, Fraud Detection, Graph Analytics using Alternative Data Sources, Risk modeling, High Frequency trading, Complex Event Modeling Bioinformatics • Next Generation DNA sequencing, Meta-genomic analysis, Finite Element Brain Modeling, Time-Series MRI Neuro-Imaging IT / Operational Systems ◦ In-House Applications, Web Controllers & Servers, Gateways, Image serving, Ad serving, OLTP, ERP, Business Intelligence 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 9
  • 10. Data Mining: High Data Volumes Scenario ◦ Analytic app running on popular SQL database ◦ Well established – trained users, tied to diverse apps & tools ◦ Running well on a single system, except… Problem ◦ …Data volumes steadily growing… ◦ …Frequently upgrading hardware… ◦ …About to hit a wall The TidalScale Solution ◦ Scale up existing application & move more data into memory cache for real time performance ◦ Avoid re-architecting DB & rewriting applications for scale out/cluster ◦ Avoid expensive maintenance cost of a cluster as shape of data changes or use cases & query types evolve 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 10
  • 11. Data Mining: Large Scale Analytics Scenario ◦ Analytic app running on popular SQL database ◦ Well established – trained users, tied to diverse apps & tools ◦ Proven, reliable application needing no changes, other than the need to increase capacity Problem ◦ Number of users and connections is growing ◦ Each user is generating large, demanding queries ◦ Frequently upgrading hardware ◦ About to hit a wall – add a second, third copy and offload users? ◦ But then you have a copy/synch problem, especially if data ever gets updated The TidalScale Solution ◦ Assemble a bigger computer to move more data into memory cache & take advantage of more CPUs ◦ Avoid re-architecting DB for scale out/cluster ◦ Avoid administering multiple servers & users, and copying/synching data 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 11
  • 12. Data Mining: Mortgage Risk Analysis Scenario ◦ New risk assessment tools for loans, mortgages ◦ Use of “alternative data” in addition to credit bureaus Problem ◦ Mortgage application workload gets “peaky” as consumers react & play the interest rate game ◦ Backlogs develop during peaks, loan processing still remarkably hands-on process. When backlogs build, customers leave TidalScale Solution ◦ Enables a big, flexible computer that scales to handle more complex processing ◦ Supports processor intensive analytics of unstructured data, example NLP (natural language processing) ◦ Easy system expansion as data volumes grow from the addition of unstructured data 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 12
  • 13. Data Mining: Fraud Detection Scenario ◦ New types of tools to detect fraud ◦ Ex: Graph DBs to see coordinated activity from disparate data Problem ◦ Graph databases inherently require a closely coherent (single system) view ◦ As system grows, you must either ◦ Split the graph – at the risk of losing potential connections – leaves places for bad guys to hide ◦ Reduce granularity of data – abstracting your view – loss of detail TidalScale Solution ◦ Enable full detailed view of transactional and account data across all customers over time ◦ Run the graph in-memory for real-time performance ◦ Run system on entirely standard hardware, OS & operational infrastructure 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 13
  • 14. What enables the solution? The Memory Hierarchy in Human Terms 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 14 (.3ns = 1s) Event Latency Scaled 1 CPU Cycle 0.3 ns 1 s Level 1 Cache Access 0.9 ns 3 s Level 2 Cache Access 2.8 ns 9 s Level 3 Cache Access 12.9 ns 43 s Main Memory Access (DRAM, from CPU) 50.0 ns 3 min Memory over Ethernet 3.2 μs 3.2 hours CPU Context State Transfer 6.0 μs 6.0 hours Flash SSD (PCI-e) 4.7 ms 5 months Rotational disk I/O 1-10 ms 1-12 months Internet: San Francisco to New York 40 ms 4 years Internet: San Francisco to United Kingdom 81 ms 8 years Internet: San Francisco to Australia 183 ms 19 years TCP packet retransmit 1-3 s 105-317 years
  • 15. TidalScale Completely Transparent - No Changes Required 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 15 …and many other applications
  • 16. Hardware Example System features • Admin node 1 • Worker nodes 25 • Total Memory 3.2TB • Total Cores: 150 • Network 1/10GbE • Storage FreeNAS, xTB Components • 1x Admin node (A003) • Colfax CX1260i-X6 Haswell, E5-2603V3 6C, 16GB • 25x Worker nodes • Colfax CX1260i-X6 Haswell, E5-2603V3 6C, 128GB • 1x 1G switch • 2x 10G switch (S009, S010) Mellanox • 1x NAS 163/21/2016 COPYRIGHT 2014 TIDALSCALE, INC.
  • 17. TidalScale Benefits Summary In-Memory Performance ◦ The world wants data to be in-memory, but hasn’t been able to get it. ◦ Historically the industry has scaled applications to fit on available computer hardware. Now, for the first time, the industry can scale the hardware to fit the application. Linear System Scalability ◦ TidalScale makes it possible to organically grow hardware using low cost commodity servers at linear cost, as customer needs evolve. ◦ Applications can now achieve superior in-memory performance using inexpensive unmodified hardware. Reduced Software Development Costs ◦ TidalScale uses off-the-shelf, unmodified Linux. ◦ TidalScale requires no changes to applications or database software. ◦ Optimization happens automatically using our software, and learns over time. 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 17
  • 18. Price/Performance at Scale 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 18 Scale up costs increase rapidly after 3Tb…
  • 19. Performance Scales Up 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 19 TidalScale can continue to add cores as well as memory (and bandwidth) Single machine solution can only add memory
  • 20. Scale, Simplify, Optimize, Evolve Scale: ◦ Aggregates compute resources for large scale in-memory analysis and decision support ◦ Scales like a cluster using commodity hardware at linear cost ◦ Allow customers to grow gradually as their needs develop Simplify: ◦ Dramatically simplifies application development ◦ No need to distribute work across servers ◦ Existing applications run as a single instance, without modification, as if on a highly flexible mainframe Optimize: ◦ Automatic dynamic hierarchical resource optimization Evolve: ◦ Applicable to modern and emerging microprocessors, memories, interconnects, persistent storage & networks 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 20
  • 21. Scale | Simplify | Optimize | Evolve RESTORING DEVELOPER PRODUCTIVITY THROUGH SIMPLICTY 3/21/2016 COPYRIGHT 2014 TIDALSCALE, INC. 21

Notas del editor

  1. First, what is TidalScale? Today’s hypervisors slice physical machines into smaller virtual machines.
  2. TidalScale's hypervisor creates a large virtual machine from multiple physical machines. These approaches are complementary and work together nicely to solve a variety of customer needs.