SlideShare a Scribd company logo
1 of 23
SOA SUCKS
FIX IT WITH “MISSIONS” AND FATDB

Justin Weiler, CTO, FatCloud
AGENDA
• Challenges of building a web scale application
• Essential ingredients of any web scale application
• Shortcomings of N-Tier and SOA and the real cost of “glue”
• “Mission” Oriented Architecture and FatDB as one solution

• Wrap-up and questions
THE PROBLEM
WHAT’S SO HARD ABOUT DOING IT RIGHT?
• Configuration and Maintenance
• Uniformity and Complexity
• Scaling, Upgrades, and Downtime
• Pivoting and Extensibility
• Latency and Performance
• Single Points of Failure and Bottlenecks
• Fault Tolerance and High Availability

• Data Consistency
• Synchronization
• Legacy Integration / SQL
• Portability and Lock-in
• Telemetry
• Security
• TCO & TTM

SingleLegacy ofConsistency
FaultUniformity & &Maintenance
Scaling, UpgradesLock-in
ConfigurationPerformance
PointsTCO & Complexity
LatencySecurity &Availability
Tolerance & HighDowntime
Pivoting& Extensibility
Portability TTM /Bottlenecks
Data &
SynchronizationSQL
Telemetry
Integration
Failure
&
THE ESSENTIAL INGREDIENTS
• Store, retrieve, cache, and query object data
• Store, retrieve, and query file data
• Host synchronous business logic
• Host asynchronous batch job business logic
• High performance, scalable, consistent,
and fault tolerant plumbing
• Comprehensive management tooling
• Full SQL integration
• Portable
• Easy to use
AN OLD ARCHITECTURE
3-Tier Monoliths and Beefy Hardware
Typically:
• Rigid and Brittle
• Hard to Scale
• High Latency and Bottlenecks
• High Hardware and Maintenance Costs
• Low learning curve

PRESENTATION

LOGIC
Relational DB
WHAT IS NOSQL?
A NoSQL (Not Only SQL) database provides a mechanism for storage and
retrieval of data that employs less constrained consistency models than
traditional relational databases. Motivations for this approach include
simplicity of design, horizontal scaling and finer control over availability.
(Source: Wikipedia)
•
•
•
•
•

Distributed computing – scale out versus scale up
Fault tolerance through mirroring/replication
Ability to be schema-less and handle unstructured data
Eventually consistent as opposed to fully consistent
Several approaches – Key Value, Document, Graph etc
NOSQL STRENGTHS AND WEAKNESSES

Strength
Multi-node scalability
Weakness
Instantaneous data consistency

Source: Data Access for Highly-Scalable Solutions:
Using SQL, NoSQL, and Polyglot Persistence
A MORE MODERN ARCHITECTURE
A-La-Carte SOA with Costly Glue
Typically:
•
•
•
•
•
•
•
•
•
•

More Scalable & Flexible
Lower Upfront Costs
Low Synergy
Still Hard to Scale
Still High Latency
Impedance Mismatches
High Integration Costs
Long Learning Curve
High Maintenance Costs
PaaS Better, but Lock-In

PRESENTATION
SERVICE 1

SERVICE 2

NoSQL

Message Q
SYSTEMS INTEGRATION PAIN: TOO MANY GUI’S
= Mongo
+ RabbitMQ
+ Hadoop
+ Cassandra
+ Memcached

Multiple GUI’s
Multiple technologies
Difficult learning curve
Linux is primary O/S
Windows is secondary
O/S if at all
RECIPE FOR EASY SCALING
• Think holistically (NoSQL is just the beginning)
• Traffic and Data analysis
• Test and meter
• Provide ALL the essentials (NoSQL, Files, Sync, Async)
–Leverage an extensible, integrated platform
–Maximize existing investments (WCF, SQL)

• Organize “missions” rather than services
• Concentrate on your business logic
FATDB PLATFORM STANDARD FEATURE SET
ASYNC WORK QUEUE & PROCESSORS
Asynchronous job processing, able to
handle “big data” problems. Utilizes your
business logic created as FatProcs
NoSQL DATABASE &
CACHE
Document or keyvalue store (standalone DB and can be
easily integrated with
SQL)
High performance inmemory distributed
cache (IMDG)

FILE MANAGEMENT SYSTEM
Flexible storage of file-based
assets across the cloud

CORE FOUNDATION
Transparently provides the
distributed plumbing for routing,
redundancy, fault tolerance, data
consistency, synchronization, and
service discovery

APPLICATIONS
Support for your custom and
community synchronous
applications or business logic
created as FatApps
THE FATDB ARCHITECTURE
Mission Oriented Architecture (MOA) on an Integrated Platform
Typically:
•
•
•
•
•
•

High Scalability
High Flexibility
High Synergy
Low Latency
Low Impedance
Low Integration Costs

GROUP 1
CONSUMERS

• Short Learning Curve
• Low Maintenance Costs
• Portable

MISSION = BUSINESS
LOGIC + RELATED DATA
MISSION = TEMPLATE
FOR EVERY SERVER

PRESENTATION
GROUP 2
PRODUCTS

GROUP 3
ORDERS
WHAT IS POLYGLOT PERSISTENCE?
Polyglot Persistence, like polyglot programming, is all about choosing the
right persistence option for the task at hand.
Scott Leberknight
Different databases are designed to solve different problems. Using a single
database engine for all of the requirements usually leads to non- performant
solutions.
Martin Fowler
Polyglot Persistence is about using hybrid storage approach (RDBMS,
NOSQL,BLOB,FILE) that allows you to use the best tool for the job versus
being locked into one approach.
FatCloud
POLYGLOT DATA STORE: SQL WITH FATDB
Data Driven Request Routing

Calls for relational and
transactional data

SQL Server

Invoice
Invoice
Invoice
024
175
832

Web / Mobile or
other Client app

Calls for unstructured
and scale sensitive data

FatDB Server Cluster

Invoice
Invoice
Invoice
936
492
751

Invoice
Invoice
Invoice
595
037
275

Invoice
Invoice
Invoice
275
Invoice
037
Invoice
936
Invoice
275
Invoice
037
Invoice
936
Invoice
275
037
936

Invoice
Invoice
Invoice
832
Invoice
492
Invoice
024
Invoice
832
Invoice
492
Invoice
024
Invoice
832
492
024

Invoice
Invoice
Invoice
751
Invoice
175
Invoice
595
Invoice
751
Invoice
175
Invoice
595
Invoice
751
175
595
POLYGLOT DATA STORE: SQL WITH FATDB
Automatic Synchronization
FatDB Server Cluster

SQL Server

Invoice
Invoice
Invoice
024
175
832

Invoice
Invoice
Invoice
936
492
751

Invoice
Invoice
Invoice
595
037
275

Automate routine
synchronization
tasks for effortless
data consistency.

SQL Write Back

Invoice
Invoice
Invoice
275
Invoice
037
Invoice
936
Invoice
275
Invoice
037
Invoice
936
Invoice
275
037
936

Invoice
Invoice
Invoice
832
Invoice
492
Invoice
024
Invoice
832
Invoice
492
Invoice
024
Invoice
832
492
024

Invoice
Invoice
Invoice
751
Invoice
175
Invoice
595
Invoice
751
Invoice
175
Invoice
595
Invoice
751
175
595

1. Changes to SQL Server automatically sent to FatDB
2. Changes to FatDB automatically sent to SQL Server
EXAMPLE OF A POLYGLOT DATA STORE
Mobile Clients

1. Legacy apps continue unchanged
updating SQL Server

2. Changes in SQL Server are
transmitted to FatDB
3. FatDB is accessed by mobile, web,
cloud clients delivering scale and
fault tolerance

3

New Web App

FatDB Server Cluster (In house or In cloud)

Invoice
Invoice
Invoice
Invoice
275
Invoice
037
Invoice
936
Invoice
275
Invoice
037
Invoice
936
275
037
936

Invoice
Invoice
Invoice
Invoice
751
Invoice
175
Invoice
595
Invoice
751
Invoice
175
Invoice
595
751
175
595

Invoice
Invoice
Invoice
832
Invoice
492
Invoice
024
Invoice
832
Invoice
492
Invoice
024
832
492
024

2

4. Updates to FatDB are transmitted
back to SQL Server

4

SQL Server
Invoice
Invoice
Invoice
024
175
832

5. BI and Reporting tools can continue
accessing SQL Server as an
accurate data repository
1

Legacy Apps

Invoice
Invoice
Invoice
936
492
751

Invoice
Invoice
Invoice
595
037
275

BI & Reporting

5
WHY FATDB OR A SIMILAR TECHNOLOGY?

Do you want this…
WHY FATDB OR A SIMILAR TECHNOLOGY?

…or this?
PRESENTATION

GROUP 1
CONSUMERS

GROUP 2
PRODUCTS

GROUP 3
ORDERS

• Reduces complexity
• Decreases risk
• Enhances flexibility and
portability
• Increases performance
• Faster TTM
• Leverages existing
investments
• Lower TCO
FATDB MANAGEMENT STUDIO: A SINGLE PANE OF GLASS

One GUI
One set of API’s
Easy learning curve
Windows based
Manage servers,
Databases, file
Systems, work
queue and apps
from one tool
KICKING THE TIRES…
• Community edition is FREE!
• Installer, tutorials, code, and whitepapers available at
www.fatcloud.com
• POC program
• justin@fatcloud.com
THANK YOU

Justin Weiler, CTO
justin@fatcloud.com
@fatcloudllc

More Related Content

Recently uploaded

DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 

Recently uploaded (20)

DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 

Featured

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

Featured (20)

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 

SOA sucks, Fix it with Missions and FatDB

  • 1. SOA SUCKS FIX IT WITH “MISSIONS” AND FATDB Justin Weiler, CTO, FatCloud
  • 2. AGENDA • Challenges of building a web scale application • Essential ingredients of any web scale application • Shortcomings of N-Tier and SOA and the real cost of “glue” • “Mission” Oriented Architecture and FatDB as one solution • Wrap-up and questions
  • 3.
  • 5. WHAT’S SO HARD ABOUT DOING IT RIGHT? • Configuration and Maintenance • Uniformity and Complexity • Scaling, Upgrades, and Downtime • Pivoting and Extensibility • Latency and Performance • Single Points of Failure and Bottlenecks • Fault Tolerance and High Availability • Data Consistency • Synchronization • Legacy Integration / SQL • Portability and Lock-in • Telemetry • Security • TCO & TTM SingleLegacy ofConsistency FaultUniformity & &Maintenance Scaling, UpgradesLock-in ConfigurationPerformance PointsTCO & Complexity LatencySecurity &Availability Tolerance & HighDowntime Pivoting& Extensibility Portability TTM /Bottlenecks Data & SynchronizationSQL Telemetry Integration Failure &
  • 6. THE ESSENTIAL INGREDIENTS • Store, retrieve, cache, and query object data • Store, retrieve, and query file data • Host synchronous business logic • Host asynchronous batch job business logic • High performance, scalable, consistent, and fault tolerant plumbing • Comprehensive management tooling • Full SQL integration • Portable • Easy to use
  • 7. AN OLD ARCHITECTURE 3-Tier Monoliths and Beefy Hardware Typically: • Rigid and Brittle • Hard to Scale • High Latency and Bottlenecks • High Hardware and Maintenance Costs • Low learning curve PRESENTATION LOGIC Relational DB
  • 8. WHAT IS NOSQL? A NoSQL (Not Only SQL) database provides a mechanism for storage and retrieval of data that employs less constrained consistency models than traditional relational databases. Motivations for this approach include simplicity of design, horizontal scaling and finer control over availability. (Source: Wikipedia) • • • • • Distributed computing – scale out versus scale up Fault tolerance through mirroring/replication Ability to be schema-less and handle unstructured data Eventually consistent as opposed to fully consistent Several approaches – Key Value, Document, Graph etc
  • 9. NOSQL STRENGTHS AND WEAKNESSES Strength Multi-node scalability Weakness Instantaneous data consistency Source: Data Access for Highly-Scalable Solutions: Using SQL, NoSQL, and Polyglot Persistence
  • 10. A MORE MODERN ARCHITECTURE A-La-Carte SOA with Costly Glue Typically: • • • • • • • • • • More Scalable & Flexible Lower Upfront Costs Low Synergy Still Hard to Scale Still High Latency Impedance Mismatches High Integration Costs Long Learning Curve High Maintenance Costs PaaS Better, but Lock-In PRESENTATION SERVICE 1 SERVICE 2 NoSQL Message Q
  • 11. SYSTEMS INTEGRATION PAIN: TOO MANY GUI’S = Mongo + RabbitMQ + Hadoop + Cassandra + Memcached Multiple GUI’s Multiple technologies Difficult learning curve Linux is primary O/S Windows is secondary O/S if at all
  • 12. RECIPE FOR EASY SCALING • Think holistically (NoSQL is just the beginning) • Traffic and Data analysis • Test and meter • Provide ALL the essentials (NoSQL, Files, Sync, Async) –Leverage an extensible, integrated platform –Maximize existing investments (WCF, SQL) • Organize “missions” rather than services • Concentrate on your business logic
  • 13. FATDB PLATFORM STANDARD FEATURE SET ASYNC WORK QUEUE & PROCESSORS Asynchronous job processing, able to handle “big data” problems. Utilizes your business logic created as FatProcs NoSQL DATABASE & CACHE Document or keyvalue store (standalone DB and can be easily integrated with SQL) High performance inmemory distributed cache (IMDG) FILE MANAGEMENT SYSTEM Flexible storage of file-based assets across the cloud CORE FOUNDATION Transparently provides the distributed plumbing for routing, redundancy, fault tolerance, data consistency, synchronization, and service discovery APPLICATIONS Support for your custom and community synchronous applications or business logic created as FatApps
  • 14. THE FATDB ARCHITECTURE Mission Oriented Architecture (MOA) on an Integrated Platform Typically: • • • • • • High Scalability High Flexibility High Synergy Low Latency Low Impedance Low Integration Costs GROUP 1 CONSUMERS • Short Learning Curve • Low Maintenance Costs • Portable MISSION = BUSINESS LOGIC + RELATED DATA MISSION = TEMPLATE FOR EVERY SERVER PRESENTATION GROUP 2 PRODUCTS GROUP 3 ORDERS
  • 15. WHAT IS POLYGLOT PERSISTENCE? Polyglot Persistence, like polyglot programming, is all about choosing the right persistence option for the task at hand. Scott Leberknight Different databases are designed to solve different problems. Using a single database engine for all of the requirements usually leads to non- performant solutions. Martin Fowler Polyglot Persistence is about using hybrid storage approach (RDBMS, NOSQL,BLOB,FILE) that allows you to use the best tool for the job versus being locked into one approach. FatCloud
  • 16. POLYGLOT DATA STORE: SQL WITH FATDB Data Driven Request Routing Calls for relational and transactional data SQL Server Invoice Invoice Invoice 024 175 832 Web / Mobile or other Client app Calls for unstructured and scale sensitive data FatDB Server Cluster Invoice Invoice Invoice 936 492 751 Invoice Invoice Invoice 595 037 275 Invoice Invoice Invoice 275 Invoice 037 Invoice 936 Invoice 275 Invoice 037 Invoice 936 Invoice 275 037 936 Invoice Invoice Invoice 832 Invoice 492 Invoice 024 Invoice 832 Invoice 492 Invoice 024 Invoice 832 492 024 Invoice Invoice Invoice 751 Invoice 175 Invoice 595 Invoice 751 Invoice 175 Invoice 595 Invoice 751 175 595
  • 17. POLYGLOT DATA STORE: SQL WITH FATDB Automatic Synchronization FatDB Server Cluster SQL Server Invoice Invoice Invoice 024 175 832 Invoice Invoice Invoice 936 492 751 Invoice Invoice Invoice 595 037 275 Automate routine synchronization tasks for effortless data consistency. SQL Write Back Invoice Invoice Invoice 275 Invoice 037 Invoice 936 Invoice 275 Invoice 037 Invoice 936 Invoice 275 037 936 Invoice Invoice Invoice 832 Invoice 492 Invoice 024 Invoice 832 Invoice 492 Invoice 024 Invoice 832 492 024 Invoice Invoice Invoice 751 Invoice 175 Invoice 595 Invoice 751 Invoice 175 Invoice 595 Invoice 751 175 595 1. Changes to SQL Server automatically sent to FatDB 2. Changes to FatDB automatically sent to SQL Server
  • 18. EXAMPLE OF A POLYGLOT DATA STORE Mobile Clients 1. Legacy apps continue unchanged updating SQL Server 2. Changes in SQL Server are transmitted to FatDB 3. FatDB is accessed by mobile, web, cloud clients delivering scale and fault tolerance 3 New Web App FatDB Server Cluster (In house or In cloud) Invoice Invoice Invoice Invoice 275 Invoice 037 Invoice 936 Invoice 275 Invoice 037 Invoice 936 275 037 936 Invoice Invoice Invoice Invoice 751 Invoice 175 Invoice 595 Invoice 751 Invoice 175 Invoice 595 751 175 595 Invoice Invoice Invoice 832 Invoice 492 Invoice 024 Invoice 832 Invoice 492 Invoice 024 832 492 024 2 4. Updates to FatDB are transmitted back to SQL Server 4 SQL Server Invoice Invoice Invoice 024 175 832 5. BI and Reporting tools can continue accessing SQL Server as an accurate data repository 1 Legacy Apps Invoice Invoice Invoice 936 492 751 Invoice Invoice Invoice 595 037 275 BI & Reporting 5
  • 19. WHY FATDB OR A SIMILAR TECHNOLOGY? Do you want this…
  • 20. WHY FATDB OR A SIMILAR TECHNOLOGY? …or this? PRESENTATION GROUP 1 CONSUMERS GROUP 2 PRODUCTS GROUP 3 ORDERS • Reduces complexity • Decreases risk • Enhances flexibility and portability • Increases performance • Faster TTM • Leverages existing investments • Lower TCO
  • 21. FATDB MANAGEMENT STUDIO: A SINGLE PANE OF GLASS One GUI One set of API’s Easy learning curve Windows based Manage servers, Databases, file Systems, work queue and apps from one tool
  • 22. KICKING THE TIRES… • Community edition is FREE! • Installer, tutorials, code, and whitepapers available at www.fatcloud.com • POC program • justin@fatcloud.com
  • 23. THANK YOU Justin Weiler, CTO justin@fatcloud.com @fatcloudllc