SlideShare una empresa de Scribd logo
1 de 23
Descargar para leer sin conexión
Your own Cassandra as a Service
with Cloud Foundry
2
About Altoros
Services
Cloud Foundry implementation services
Hadoop/NoSQL - Benchmarking, Deployment and Customization
Cluster management and optimization in private/hybrid clouds
Customers
• Infrastructure software vendors
• IaaS service providers
• Information-heavy enterprises
Focus
• Platform as a Service (Cloud Foundry implementation services)
• Data science enablement (Hadoop/NoSQL Deployment services)
• Cluster management and optimization in private/hybrid clouds
(RightScale/Chef/Puppet cloud automation template services)
Number of
Engineers/Consultants
250
Headquarters Sunnyvale, CA
Offices Location
3
About Pivotal
Cloud Storage
Virtualization
Data &
Analytics
Platform
Application
Development
Platform
Rapid
Application
Development
4
About Pivotal
Cloud Storage
Virtualization
PIVOTAL
Data &
Analytics
Platform
Application
Development
Platform
Rapid
Application
Development
5
Why Bother? TCO of stand-alone Cassandra
vs Cassandra as a Service with CloudFoundry
Stand-alone CaaS
Provisioning Days or weeks Minutes
Scalability App by app basis Provided by CaaS. Easily
add new nodes
Development
productivity
Server setup, sysops
requests, etc
Use a simple CLI:
$ cf bind service
API None. In-house? Restfull API
6
What is Cloud Foundry?
7
Cloud Foundry Architecture
8
Why BOSH?
• Open source tool chain for release engineering, deployment and
lifecycle management of large scale distributed services
• IaaS provider independency (VMware vSphere, vCloud Director,
Amazon Web Services EC2, or OpenStack)
• Fast PaaS flexible deployment (on top of private, public or hybrid IaaS
configurations) and scalability
9
BOSH architecture and topology overview
10
Cassandra Service Overview
• As many nodes as
you need
• CaaS will be aware
of provisioning
capacity, status,
availability, servers
where Cassandra
runs, etc
11
Demo Screencast
• Initial BOSH deploy of the system, including Cassandra
• Pushing an app that binds to the Cassandra service
• Updating the BOSH manifest to add another node to the Cassandra
cluster
12
Binding to Cassandra Service
OS
DEA
OS
Cassandra
Node
OS
Cassandra
Node
OS
Cassandra
Node
OS
Cassandra
Gateway
OS
Cloud
Controller
OS
Cloud
Controller
OS
NATS
(messaging)
OS
Router
OS
DEA
AppApp
13
BOSH Managed Cassandra Cluster
_node
_node
cassandra_gateway
NATS
10.13.219.151
10.13.219.152
"credentials":{
"host":"10.13.219.152",
"port":9160,
"name":"e55bbca6-a2b5-4c94-a595-
b9aa1ad180b8"}





14
BOSH Managed Cassandra Cluster
_node
_node
cassandra_gateway
NATS
10.13.219.151
10.13.219.152
"credentials":{
"host":"10.13.219.152",
"port":9160,
"name":"e55bbca6-a2b5-4c94-a595-
b9aa1ad180b8"}





_node
10.13.219.153
15
...
properties:
...
cassandra:
seeds: 10.13.219.151
port: 9160
...
...
/var/vcap/packages/cassandra/bin/cassandra 
-p $PIDFILE 
-Dcassandra.rpc_port=<%=properties.cassandra.port%> 
>>$LOG_DIR/cassandra.stdout.log 
2>>$LOG_DIR/cassandra.stderr.log
...
...
rpc_address: <%= spec.networks.default.ip %>
rpc_port: <%= properties.cassandra &&
properties.cassandra.port || 9160 %>
...
seed_provider:
- class_name:
org.apache.cassandra.locator.SimpleSeedProvider
parameters:
- seeds: <%=properties.cassandra.seeds%>
deployment-manifest.yml
cassandra_ctl (
cassandra.yaml.erb
jobs
cassandra
packages
blobs
templates
16
Cloud Foundry Cassandra Service Use Case
• SaaS solutions built with xCP for the cloud
• Cassandra
• Metadata lookup
• Which xDB server holds the metadata?
• Configuration
• Shared knowledge for all stateless data servers
• Scale out stateless data servers as CloudFoundry
applications
• Common security across all data services
• Multi-tenant provisioning
• Scale out xCP applications as CloudFoundry
applications
17
CloudFoundry Services
Cloud
Foundry
Apps
CloudFoundry Router
xCP Client
xDB cluster (metadata)
xDB
Server
xDB
Server
xDB
Server
Data
Server
Data
Server
Data
Server
Data
Server
Cassandra cluster
Cass.
Server
Cass.
Server
Cloud Blob Stores
BLOBBLOBBLOB
xCP Application xCP Application xCP Application
Base scale-out architecture
18
History of Cassandra Service for CF
• V1 Services - Present
• Temporary V2 Services without Cassandra (June-Aug 2013)
• V3 Services – Aug-Sept 2013
19
Coming up –Multi-node Cassandra on V2 Cloud Foundry, with V3
Services on AWS
20
Stand-alone Cassandra vs Cassandra as a Service with CF
• Days of installation and administration knowledge and research
capitalized in single and stable service deployments.
• Free up developers from dealing with scalability and high availability
issues
• Guarantee consistent deployments among several environment
(development, staging and production) without misconfiguration risks
that would explode in production.
• Easy to scale, vertically and horizontally
21
Stand-alone Cassandra vs Cassandra as a Service with CF
• Manage different configurations (Services Plans) depending on your
needs.
• Made a bad sizing decision? Just reconfigure your app to use a
bigger/smaller service plan
• Provisioning: from days and weeks to a couple of minutes for a tested
and stable Cassandra
22
Extending CloudFoundry: Buildpacks
• Cloudfoundry provides a convenient way of packaging framework
and/or runtime support for your application with Buildpacks
• Based on Heroku open source buildpacks model
• Can’t find one that fits? You can extend and customize one to fit your
needs.
23
Thank you!
Reach out to our teams for expert help on automated deployment, consulting
and integration of Cloud Foundry and Cassandra:
Altoros Pivotal
renat.k@altoros.com
@renatkhasanshyn
(650) 395-7002
cdavis@gopivotal.com
@cdavisafc
(805) 560-9039

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Automating the Entire PostgreSQL Lifecycle
Automating the Entire PostgreSQL Lifecycle Automating the Entire PostgreSQL Lifecycle
Automating the Entire PostgreSQL Lifecycle
 
AWS Cloud Development Kit (CDK)를 이용한 코드 기반 인프라 개발 및 배포 - 공찬호(리얼리티매직) :: AWS C...
AWS Cloud Development Kit (CDK)를 이용한 코드 기반 인프라 개발 및 배포 - 공찬호(리얼리티매직) :: AWS C...AWS Cloud Development Kit (CDK)를 이용한 코드 기반 인프라 개발 및 배포 - 공찬호(리얼리티매직) :: AWS C...
AWS Cloud Development Kit (CDK)를 이용한 코드 기반 인프라 개발 및 배포 - 공찬호(리얼리티매직) :: AWS C...
 
Introduction to Serverless
Introduction to ServerlessIntroduction to Serverless
Introduction to Serverless
 
Extending HashiCorp Nomad with Plugins
Extending HashiCorp Nomad with PluginsExtending HashiCorp Nomad with Plugins
Extending HashiCorp Nomad with Plugins
 
Multitenancy on EKS
Multitenancy on EKSMultitenancy on EKS
Multitenancy on EKS
 
Virtualized Containers - How Good is it - Ananth - Siemens - CC18
Virtualized Containers - How Good is it - Ananth - Siemens - CC18Virtualized Containers - How Good is it - Ananth - Siemens - CC18
Virtualized Containers - How Good is it - Ananth - Siemens - CC18
 
Kubernetes And Istio and Azure AKS DevOps
Kubernetes And Istio and Azure AKS DevOpsKubernetes And Istio and Azure AKS DevOps
Kubernetes And Istio and Azure AKS DevOps
 
Building a derived data store using Kafka
Building a derived data store using KafkaBuilding a derived data store using Kafka
Building a derived data store using Kafka
 
DockerCon US 2016 - Docker Practice in Alibaba Cloud
DockerCon US 2016 - Docker Practice in Alibaba CloudDockerCon US 2016 - Docker Practice in Alibaba Cloud
DockerCon US 2016 - Docker Practice in Alibaba Cloud
 
Stateless and Stateful Services in Kubernetes - Mohit Saxena - Citrix - CC18
Stateless and Stateful Services in Kubernetes - Mohit Saxena - Citrix - CC18Stateless and Stateful Services in Kubernetes - Mohit Saxena - Citrix - CC18
Stateless and Stateful Services in Kubernetes - Mohit Saxena - Citrix - CC18
 
How to improve lambda cold starts
How to improve lambda cold startsHow to improve lambda cold starts
How to improve lambda cold starts
 
Čtvrtkon #64 - AWS Serverless - Michal Haták
Čtvrtkon #64 - AWS Serverless - Michal HatákČtvrtkon #64 - AWS Serverless - Michal Haták
Čtvrtkon #64 - AWS Serverless - Michal Haták
 
Serverless Computing
Serverless Computing Serverless Computing
Serverless Computing
 
Gaming on AWS - 1. AWS로 글로벌 게임 런칭하기 - 장르별 아키텍처 중심
Gaming on AWS - 1. AWS로 글로벌 게임 런칭하기 - 장르별 아키텍처 중심Gaming on AWS - 1. AWS로 글로벌 게임 런칭하기 - 장르별 아키텍처 중심
Gaming on AWS - 1. AWS로 글로벌 게임 런칭하기 - 장르별 아키텍처 중심
 
Apache Cassandra Management
Apache Cassandra ManagementApache Cassandra Management
Apache Cassandra Management
 
Deep Dive into AWS ECS and Spot Instances at Scale
Deep Dive into AWS ECS and Spot Instances at ScaleDeep Dive into AWS ECS and Spot Instances at Scale
Deep Dive into AWS ECS and Spot Instances at Scale
 
Let's Talk About Serverless - Focusing on AWS Lambda
Let's Talk About Serverless - Focusing on AWS LambdaLet's Talk About Serverless - Focusing on AWS Lambda
Let's Talk About Serverless - Focusing on AWS Lambda
 
Understanding AWS with Terraform
Understanding AWS with TerraformUnderstanding AWS with Terraform
Understanding AWS with Terraform
 
GitOps with Amazon EKS Anywhere by Dan Budris
GitOps with Amazon EKS Anywhere by Dan BudrisGitOps with Amazon EKS Anywhere by Dan Budris
GitOps with Amazon EKS Anywhere by Dan Budris
 
Connecting Kafka Across Multiple AWS VPCs
Connecting Kafka Across Multiple AWS VPCs Connecting Kafka Across Multiple AWS VPCs
Connecting Kafka Across Multiple AWS VPCs
 

Destacado

Cloud Foundry Architecture and Overview
Cloud Foundry Architecture and OverviewCloud Foundry Architecture and Overview
Cloud Foundry Architecture and Overview
rajdeep
 
To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...
To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...
To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...
Tony Erwin
 

Destacado (6)

SAP Cloud Platform Product Overview
SAP Cloud Platform Product OverviewSAP Cloud Platform Product Overview
SAP Cloud Platform Product Overview
 
DevStackで始めるCloud FoundryとBOSH
DevStackで始めるCloud FoundryとBOSHDevStackで始めるCloud FoundryとBOSH
DevStackで始めるCloud FoundryとBOSH
 
Cloud Foundry Architecture and Overview
Cloud Foundry Architecture and OverviewCloud Foundry Architecture and Overview
Cloud Foundry Architecture and Overview
 
Meetup: Platform-as-a-Service / Cloud Foundry
Meetup: Platform-as-a-Service / Cloud FoundryMeetup: Platform-as-a-Service / Cloud Foundry
Meetup: Platform-as-a-Service / Cloud Foundry
 
To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...
To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...
To Kill a Monolith: Slaying the Demons of a Monolith with Node.js Microservic...
 
Case Study: Dell - APIs and Microservices for Cloud-Native Application Archit...
Case Study: Dell - APIs and Microservices for Cloud-Native Application Archit...Case Study: Dell - APIs and Microservices for Cloud-Native Application Archit...
Case Study: Dell - APIs and Microservices for Cloud-Native Application Archit...
 

Similar a C* Summit 2013: Cassandra on Cloud Foundry by Renat Khasanshyn and Cornelia Davis

Similar a C* Summit 2013: Cassandra on Cloud Foundry by Renat Khasanshyn and Cornelia Davis (20)

IBM - Introduction to Cloudant
IBM - Introduction to CloudantIBM - Introduction to Cloudant
IBM - Introduction to Cloudant
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
 
Basics of Java Cloud
Basics of Java CloudBasics of Java Cloud
Basics of Java Cloud
 
Perth Azure Usergroup Build 2018 updates
Perth Azure Usergroup Build 2018 updatesPerth Azure Usergroup Build 2018 updates
Perth Azure Usergroup Build 2018 updates
 
Managing Container-as-a-Service and Docker Clusters in the Cloud with RightScale
Managing Container-as-a-Service and Docker Clusters in the Cloud with RightScaleManaging Container-as-a-Service and Docker Clusters in the Cloud with RightScale
Managing Container-as-a-Service and Docker Clusters in the Cloud with RightScale
 
Community Session: Strategic Private Cloud in SKY UK
Community Session: Strategic Private Cloud in SKY UKCommunity Session: Strategic Private Cloud in SKY UK
Community Session: Strategic Private Cloud in SKY UK
 
Migrating Your Windows Datacenter to AWS
Migrating Your Windows Datacenter to AWSMigrating Your Windows Datacenter to AWS
Migrating Your Windows Datacenter to AWS
 
AWS re:Invent 2016: Workshop: Migrating Microsoft Applications to AWS (ENT216)
AWS re:Invent 2016: Workshop: Migrating Microsoft Applications to AWS (ENT216)AWS re:Invent 2016: Workshop: Migrating Microsoft Applications to AWS (ENT216)
AWS re:Invent 2016: Workshop: Migrating Microsoft Applications to AWS (ENT216)
 
Cloud Migration and Portability Best Practices
Cloud Migration and Portability Best PracticesCloud Migration and Portability Best Practices
Cloud Migration and Portability Best Practices
 
Palo Alto Networks and AWS: Streamline Your Accreditation with Superior Secur...
Palo Alto Networks and AWS: Streamline Your Accreditation with Superior Secur...Palo Alto Networks and AWS: Streamline Your Accreditation with Superior Secur...
Palo Alto Networks and AWS: Streamline Your Accreditation with Superior Secur...
 
MongoDB Europe 2016 - MongoDB Atlas
MongoDB Europe 2016 - MongoDB AtlasMongoDB Europe 2016 - MongoDB Atlas
MongoDB Europe 2016 - MongoDB Atlas
 
Microsoft Azure Explained - Hitesh D Kesharia
Microsoft Azure Explained - Hitesh D KeshariaMicrosoft Azure Explained - Hitesh D Kesharia
Microsoft Azure Explained - Hitesh D Kesharia
 
Cloud Data Strategy event London
Cloud Data Strategy event LondonCloud Data Strategy event London
Cloud Data Strategy event London
 
Confluent Operator as Cloud-Native Kafka Operator for Kubernetes
Confluent Operator as Cloud-Native Kafka Operator for KubernetesConfluent Operator as Cloud-Native Kafka Operator for Kubernetes
Confluent Operator as Cloud-Native Kafka Operator for Kubernetes
 
SharePoint on Microsoft Azure
SharePoint on Microsoft AzureSharePoint on Microsoft Azure
SharePoint on Microsoft Azure
 
Application Lifecycle Management on AWS
Application Lifecycle Management on AWSApplication Lifecycle Management on AWS
Application Lifecycle Management on AWS
 
XCloudLabs- AWS Overview
XCloudLabs- AWS Overview XCloudLabs- AWS Overview
XCloudLabs- AWS Overview
 
Cloud foundry
Cloud foundryCloud foundry
Cloud foundry
 
QSS at Cisco Live 2016 Berlin
QSS at Cisco Live 2016 BerlinQSS at Cisco Live 2016 Berlin
QSS at Cisco Live 2016 Berlin
 
Cloud computing and Service Platforms
Cloud computing and Service Platforms Cloud computing and Service Platforms
Cloud computing and Service Platforms
 

Más de DataStax Academy

Cassandra on Docker @ Walmart Labs
Cassandra on Docker @ Walmart LabsCassandra on Docker @ Walmart Labs
Cassandra on Docker @ Walmart Labs
DataStax Academy
 
Cassandra Adoption on Cisco UCS & Open stack
Cassandra Adoption on Cisco UCS & Open stackCassandra Adoption on Cisco UCS & Open stack
Cassandra Adoption on Cisco UCS & Open stack
DataStax Academy
 
Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python
Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & PythonCassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python
Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python
DataStax Academy
 
Standing Up Your First Cluster
Standing Up Your First ClusterStanding Up Your First Cluster
Standing Up Your First Cluster
DataStax Academy
 
Real Time Analytics with Dse
Real Time Analytics with DseReal Time Analytics with Dse
Real Time Analytics with Dse
DataStax Academy
 
Introduction to Data Modeling with Apache Cassandra
Introduction to Data Modeling with Apache CassandraIntroduction to Data Modeling with Apache Cassandra
Introduction to Data Modeling with Apache Cassandra
DataStax Academy
 
Enabling Search in your Cassandra Application with DataStax Enterprise
Enabling Search in your Cassandra Application with DataStax EnterpriseEnabling Search in your Cassandra Application with DataStax Enterprise
Enabling Search in your Cassandra Application with DataStax Enterprise
DataStax Academy
 
Advanced Data Modeling with Apache Cassandra
Advanced Data Modeling with Apache CassandraAdvanced Data Modeling with Apache Cassandra
Advanced Data Modeling with Apache Cassandra
DataStax Academy
 

Más de DataStax Academy (20)

Forrester CXNYC 2017 - Delivering great real-time cx is a true craft
Forrester CXNYC 2017 - Delivering great real-time cx is a true craftForrester CXNYC 2017 - Delivering great real-time cx is a true craft
Forrester CXNYC 2017 - Delivering great real-time cx is a true craft
 
Introduction to DataStax Enterprise Graph Database
Introduction to DataStax Enterprise Graph DatabaseIntroduction to DataStax Enterprise Graph Database
Introduction to DataStax Enterprise Graph Database
 
Introduction to DataStax Enterprise Advanced Replication with Apache Cassandra
Introduction to DataStax Enterprise Advanced Replication with Apache CassandraIntroduction to DataStax Enterprise Advanced Replication with Apache Cassandra
Introduction to DataStax Enterprise Advanced Replication with Apache Cassandra
 
Cassandra on Docker @ Walmart Labs
Cassandra on Docker @ Walmart LabsCassandra on Docker @ Walmart Labs
Cassandra on Docker @ Walmart Labs
 
Cassandra 3.0 Data Modeling
Cassandra 3.0 Data ModelingCassandra 3.0 Data Modeling
Cassandra 3.0 Data Modeling
 
Cassandra Adoption on Cisco UCS & Open stack
Cassandra Adoption on Cisco UCS & Open stackCassandra Adoption on Cisco UCS & Open stack
Cassandra Adoption on Cisco UCS & Open stack
 
Data Modeling for Apache Cassandra
Data Modeling for Apache CassandraData Modeling for Apache Cassandra
Data Modeling for Apache Cassandra
 
Coursera Cassandra Driver
Coursera Cassandra DriverCoursera Cassandra Driver
Coursera Cassandra Driver
 
Production Ready Cassandra
Production Ready CassandraProduction Ready Cassandra
Production Ready Cassandra
 
Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python
Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & PythonCassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python
Cassandra @ Netflix: Monitoring C* at Scale, Gossip and Tickler & Python
 
Cassandra @ Sony: The good, the bad, and the ugly part 1
Cassandra @ Sony: The good, the bad, and the ugly part 1Cassandra @ Sony: The good, the bad, and the ugly part 1
Cassandra @ Sony: The good, the bad, and the ugly part 1
 
Cassandra @ Sony: The good, the bad, and the ugly part 2
Cassandra @ Sony: The good, the bad, and the ugly part 2Cassandra @ Sony: The good, the bad, and the ugly part 2
Cassandra @ Sony: The good, the bad, and the ugly part 2
 
Standing Up Your First Cluster
Standing Up Your First ClusterStanding Up Your First Cluster
Standing Up Your First Cluster
 
Real Time Analytics with Dse
Real Time Analytics with DseReal Time Analytics with Dse
Real Time Analytics with Dse
 
Introduction to Data Modeling with Apache Cassandra
Introduction to Data Modeling with Apache CassandraIntroduction to Data Modeling with Apache Cassandra
Introduction to Data Modeling with Apache Cassandra
 
Cassandra Core Concepts
Cassandra Core ConceptsCassandra Core Concepts
Cassandra Core Concepts
 
Enabling Search in your Cassandra Application with DataStax Enterprise
Enabling Search in your Cassandra Application with DataStax EnterpriseEnabling Search in your Cassandra Application with DataStax Enterprise
Enabling Search in your Cassandra Application with DataStax Enterprise
 
Bad Habits Die Hard
Bad Habits Die Hard Bad Habits Die Hard
Bad Habits Die Hard
 
Advanced Data Modeling with Apache Cassandra
Advanced Data Modeling with Apache CassandraAdvanced Data Modeling with Apache Cassandra
Advanced Data Modeling with Apache Cassandra
 
Advanced Cassandra
Advanced CassandraAdvanced Cassandra
Advanced Cassandra
 

Último

Último (20)

Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 

C* Summit 2013: Cassandra on Cloud Foundry by Renat Khasanshyn and Cornelia Davis

  • 1. Your own Cassandra as a Service with Cloud Foundry
  • 2. 2 About Altoros Services Cloud Foundry implementation services Hadoop/NoSQL - Benchmarking, Deployment and Customization Cluster management and optimization in private/hybrid clouds Customers • Infrastructure software vendors • IaaS service providers • Information-heavy enterprises Focus • Platform as a Service (Cloud Foundry implementation services) • Data science enablement (Hadoop/NoSQL Deployment services) • Cluster management and optimization in private/hybrid clouds (RightScale/Chef/Puppet cloud automation template services) Number of Engineers/Consultants 250 Headquarters Sunnyvale, CA Offices Location
  • 3. 3 About Pivotal Cloud Storage Virtualization Data & Analytics Platform Application Development Platform Rapid Application Development
  • 4. 4 About Pivotal Cloud Storage Virtualization PIVOTAL Data & Analytics Platform Application Development Platform Rapid Application Development
  • 5. 5 Why Bother? TCO of stand-alone Cassandra vs Cassandra as a Service with CloudFoundry Stand-alone CaaS Provisioning Days or weeks Minutes Scalability App by app basis Provided by CaaS. Easily add new nodes Development productivity Server setup, sysops requests, etc Use a simple CLI: $ cf bind service API None. In-house? Restfull API
  • 6. 6 What is Cloud Foundry?
  • 8. 8 Why BOSH? • Open source tool chain for release engineering, deployment and lifecycle management of large scale distributed services • IaaS provider independency (VMware vSphere, vCloud Director, Amazon Web Services EC2, or OpenStack) • Fast PaaS flexible deployment (on top of private, public or hybrid IaaS configurations) and scalability
  • 9. 9 BOSH architecture and topology overview
  • 10. 10 Cassandra Service Overview • As many nodes as you need • CaaS will be aware of provisioning capacity, status, availability, servers where Cassandra runs, etc
  • 11. 11 Demo Screencast • Initial BOSH deploy of the system, including Cassandra • Pushing an app that binds to the Cassandra service • Updating the BOSH manifest to add another node to the Cassandra cluster
  • 12. 12 Binding to Cassandra Service OS DEA OS Cassandra Node OS Cassandra Node OS Cassandra Node OS Cassandra Gateway OS Cloud Controller OS Cloud Controller OS NATS (messaging) OS Router OS DEA AppApp
  • 13. 13 BOSH Managed Cassandra Cluster _node _node cassandra_gateway NATS 10.13.219.151 10.13.219.152 "credentials":{ "host":"10.13.219.152", "port":9160, "name":"e55bbca6-a2b5-4c94-a595- b9aa1ad180b8"}     
  • 14. 14 BOSH Managed Cassandra Cluster _node _node cassandra_gateway NATS 10.13.219.151 10.13.219.152 "credentials":{ "host":"10.13.219.152", "port":9160, "name":"e55bbca6-a2b5-4c94-a595- b9aa1ad180b8"}      _node 10.13.219.153
  • 15. 15 ... properties: ... cassandra: seeds: 10.13.219.151 port: 9160 ... ... /var/vcap/packages/cassandra/bin/cassandra -p $PIDFILE -Dcassandra.rpc_port=<%=properties.cassandra.port%> >>$LOG_DIR/cassandra.stdout.log 2>>$LOG_DIR/cassandra.stderr.log ... ... rpc_address: <%= spec.networks.default.ip %> rpc_port: <%= properties.cassandra && properties.cassandra.port || 9160 %> ... seed_provider: - class_name: org.apache.cassandra.locator.SimpleSeedProvider parameters: - seeds: <%=properties.cassandra.seeds%> deployment-manifest.yml cassandra_ctl ( cassandra.yaml.erb jobs cassandra packages blobs templates
  • 16. 16 Cloud Foundry Cassandra Service Use Case • SaaS solutions built with xCP for the cloud • Cassandra • Metadata lookup • Which xDB server holds the metadata? • Configuration • Shared knowledge for all stateless data servers • Scale out stateless data servers as CloudFoundry applications • Common security across all data services • Multi-tenant provisioning • Scale out xCP applications as CloudFoundry applications
  • 17. 17 CloudFoundry Services Cloud Foundry Apps CloudFoundry Router xCP Client xDB cluster (metadata) xDB Server xDB Server xDB Server Data Server Data Server Data Server Data Server Cassandra cluster Cass. Server Cass. Server Cloud Blob Stores BLOBBLOBBLOB xCP Application xCP Application xCP Application Base scale-out architecture
  • 18. 18 History of Cassandra Service for CF • V1 Services - Present • Temporary V2 Services without Cassandra (June-Aug 2013) • V3 Services – Aug-Sept 2013
  • 19. 19 Coming up –Multi-node Cassandra on V2 Cloud Foundry, with V3 Services on AWS
  • 20. 20 Stand-alone Cassandra vs Cassandra as a Service with CF • Days of installation and administration knowledge and research capitalized in single and stable service deployments. • Free up developers from dealing with scalability and high availability issues • Guarantee consistent deployments among several environment (development, staging and production) without misconfiguration risks that would explode in production. • Easy to scale, vertically and horizontally
  • 21. 21 Stand-alone Cassandra vs Cassandra as a Service with CF • Manage different configurations (Services Plans) depending on your needs. • Made a bad sizing decision? Just reconfigure your app to use a bigger/smaller service plan • Provisioning: from days and weeks to a couple of minutes for a tested and stable Cassandra
  • 22. 22 Extending CloudFoundry: Buildpacks • Cloudfoundry provides a convenient way of packaging framework and/or runtime support for your application with Buildpacks • Based on Heroku open source buildpacks model • Can’t find one that fits? You can extend and customize one to fit your needs.
  • 23. 23 Thank you! Reach out to our teams for expert help on automated deployment, consulting and integration of Cloud Foundry and Cassandra: Altoros Pivotal renat.k@altoros.com @renatkhasanshyn (650) 395-7002 cdavis@gopivotal.com @cdavisafc (805) 560-9039