SlideShare una empresa de Scribd logo
1 de 33
Use Cases and Reference Architectures
Laying Cinder Blocks (Volumes)
#rackstackatl
Introductions
Aaron Delp
James Ruddy
Office of the CTO
EMC
John Griffith
John Griffith
OpenStack PTL for Cinder
Solutions Architect
SolidFire
Kenneth H
Kenneth Hui
OpenStack Ambassador
Technology Evangelist
Rackspace
#rackstackatl
Agenda • Introductions
• Cinder: OpenStack Block Storage
• Cinder with Commodity Storage
• Cinder with Enterprise Storage
• SolidFire Integration
• EMC Integration
#rackstackatl
OpenStack & Storage
Cinder / Block Storage Swift / Object Storage
Objectives
• Storage for running VM disk volumes
on a host
• Ideal for performance sensitive apps
• Enables Amazon EBS-like service
• Ideal for cost effective, scale-out storage
• Fully distributed, API-accessible
• Well suited for backup, archiving, data retention
• Enables Dropbox-like service
Use Cases
• Production Applications
• Traditional IT Systems
• Database Driven Apps
• Messaging / Collaboration
• Dev / Test Systems
• VM Templates
• ISO Images
• Disk Volume Snapshots
• Backup / Archive
• Image / Video Repository
Workloads
• High Change Content
• Smaller, Random R/W
• Higher / “Bursty” IO
• Typically More Static Content
• Larger, Sequential R/W
• Lower IOPS
#rackstackatl
OpenStack
Cinder
(Block Storage)
• Architected to provide traditional block-level
storage resources to other OpenStack
services
• Presents persistent block-level storage
volumes for use with OpenStack Nova
compute instances
• Manages the creation, attaching and
detaching of these volumes between a
storage system and different host servers
#rackstackatl
Cinder Based Features
• create/delete volumes
• specify custom "types/extra-specs"
• clone
• copy image to volume and volume to image
• point in time copy (snapshots of volumes)
• create volume from snapshot
• backup volume (to Object Store, SWIFT and CEPH)
• transfer volume ownership
• customized scheduling filters
• per tenant usage quotas
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Commodity Cinder Storage Components
• Controller Nodes
• Cinder API – Accepts, authenticates, and routes requests
throughout the block storage service
• Cinder Scheduler - Schedules and routes requests to the
appropriate volume service
• Storage Networking
• iSCSI Networks required
• Redundant 10gb network connections recommended
#rackstackatl
Cinder Volume - Manages block storage devices, specifically
the back-end devices themselves
• Recommended Configuration
• 1 compute core for every 3 TBs under management
• Minimum of 2GB RAM plus an additional 250 MB RAM for every 1TB
under management
• Minimum of 6 physical drives
• Hardware RAID5 or RAID10 protection
Cinder Node and Storage Configurations
#rackstackatl
Commodity Cinder Storage Architecture
Controller 1
Nova
Horizon
Keystone
Glance
RabbitMQ
MySQL
Cinder-API
Cinder-Scheduler
Controller 2
Nova
Horizon
Keystone
Glance
RabbitMQ
MySQL
Cinder-API
Cinder-Scheduler
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Commodity Storage Advantages
• Low initial cost during exploratory phase of deployment
• Typically very little change in procurement with known vendors
• Basic storage infrastructure knowledge
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Commodity Storage Limitations
• Commodity storage does not support cinder node redundancy
• Commodity storage has limited or no capacity scaling
• By definition, commodity storage is basic block-storage that is
missing value-added services like:
• Advanced Quality of Service (QoS)
• Auto-tiering
• De-duplication/Compression
• Replication
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Multiple Cinder Nodes Architecture
Controller 1
Nova
Horizon
Keystone
Glance
RabbitMQ
MySQL
Cinder-API
Cinder-Scheduler
Controller 2
Nova
Horizon
Keystone
Glance
RabbitMQ
MySQL
Cinder-API
Cinder-Scheduler
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Multiple Cinder Nodes Capacity
Typical Rackspace Private Cloud (RPC) configuration of (8) 600 GB
15K SAS drives in RAID10 configuration (4.8 TB raw/2.3 TB usable)
MySQL database with 8TB requirement
#rackstackatl
Provides ability to choose
• Plugin architecture, multiple choices for backend
storage
• Don’t have to choose just one
• Use the storage that fits your needs
• Mix of proprietary and open-source choices
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Cinder With Enterprise Storage Architecture
Enterprise
Array
Controller 1
Nova
Horizon
Keystone
Glance
RabbitMQ
MySQL
Cinder-API
Cinder-Scheduler
Cinder-Volume
Controller 2
Nova
Horizon
Keystone
Glance
RabbitMQ
MySQL
Cinder-API
Cinder-Scheduler
Cinder-Volume
#rackstackatl
Good
#rackstackatl
Even Better
#rackstackatl
Enterprise Storage Advantages
• Simplified capacity scaling
• High Availability (HA) for increased uptime
• Storage is tested and supported in OpenStack environments
• Delivers enhanced features only provided by enterprise storage
vendors
• Repurposing of current storage investments
#rackstackatl
Proprietary/Vendors they’re not evil
• Having Vendor support in the community is good
• Choices are good
• More participation is good
• Everybody wins
• Sometimes combining Open Source and
proprietary results in best of both worlds
#rackstackatl
So how do I choose
#rackstackatl
There’s a lot to choose from
• Over two dozen backend drivers in Cinder (and
growing with each release)
• Strive for consistency (they should all work)
• Features and characteristics are what sets them
apart
#rackstackatl
Cinder Backend Devices, use what fits
#rackstackatl
Considerations Based on Experience
• High-level of integration and support with OpenStack
• Flexible scalability for ever-changing environments
• Automation integration via APIs
• Resiliency for increased reliability and uptime
• Predictable performance (not just fast)
• What will I be using it for
• What *might* I be using it for
#rackstackatl
You’re not locked in
• The intent of the Cinder design is to keep you
from being locked in
• You can easily change the backend
• Migrate the data
• Expect the same base level of functionality
#rackstackatl
SolidFire & OpenStack
"SolidFire has done a great job leading the Block Storage project in line with the OpenStack
philosophy of delivering a pluggable architecture with integration points for multiple vendors
and technologies. It's exciting to see more production implementations and configuration
options available to OpenStack users.”
Jonathan Bryce, Executive Director, OpenStack Foundation
• The industry’s most comprehensive Cinder support
• Unparalleled combination of guaranteed performance,
high-availability and scale
• Established interoperability & partnerships with
industry leaders
#rackstackatl
SolidFire &
Cinder
• Full SolidFire driver integration with latest
OpenStack software release
• Set and maintain true QoS levels on a per-
volume basis
• Create, snapshot, clone and manage SolidFire
volumes using OpenStack clients and APIs
• Bootable SolidFire Volumes
• Web-based API exposing all cluster functionality
• SolidFire integration with Cinder can be
configured in less than a minute
#rackstackatl
SolidFire & Cinder
• Demo of Integration
#rackstackatl
EMC
The role of the storage architect in Openstack
• Old School – Storage admin is the Master of his
Domain
#rackstackatl
EMC
The role of the storage architect in Openstack
• New School– Its all about the pool
#rackstackatl
Specifics on implementation
VMAX
VNX
Isilon
ScaleIO
Beta!
XtremIO
Release Protocol Vol fxns Snap fxn Vol Copy Backup
Grizzly, Havana,
IceHouse
iSCSI, FC Out of Band
Grizzly, Havana,
IceHouse
iSCSI, FC Out of Band
Havana iSCSI Out of Band
Havana SDC, SDS Out of Band
Havana, IceHouseNFS (Cinder) Out of Band
Havana, IceHouseiSCSI, FC Out of band
Beta!
Beta!
All required functions, except ‘Create Vol
from snapshot’, ‘Extend vol’
All required functions
All required functions
All required functions
All required functions
All required functions++
#rackstackatl
EMC & Cinder
• Demo of the new consumption model
#rackstackatl
Resources
• http://www.rackspace.com/cloud/private/
• www.solidfire.com/solutions/cloud-orchestration/openstack/
• http://theruddyduck.typepad.com/theruddyduck/2013/11/deploy-opensatck-cinder-
with-emc-vipr-part-1.html
• Podcasts: The Cloudcast.net https://itunes.apple.com/us/podcast/cloudcast-.net-
weekly-cloud/id417826820?mt=2
#rackstackatl
RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218
US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COM
RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN TH E UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COMRACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN TH E UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM

Más contenido relacionado

La actualidad más candente

Filesystem as a service in OpenStack
Filesystem as a service in OpenStackFilesystem as a service in OpenStack
Filesystem as a service in OpenStack
openstackindia
 
OpenStack Nova Scheduler
OpenStack Nova Scheduler OpenStack Nova Scheduler
OpenStack Nova Scheduler
Peeyush Gupta
 
Deep dive into highly available open stack architecture openstack summit va...
Deep dive into highly available open stack architecture   openstack summit va...Deep dive into highly available open stack architecture   openstack summit va...
Deep dive into highly available open stack architecture openstack summit va...
Arthur Berezin
 
Storage as a service OpenStack
Storage as a service OpenStackStorage as a service OpenStack
Storage as a service OpenStack
openstackindia
 
Introducing OpenStack for Beginners
Introducing OpenStack for Beginners Introducing OpenStack for Beginners
Introducing OpenStack for Beginners
openstackindia
 

La actualidad más candente (20)

OpenStack Cinder Overview - Havana Release
OpenStack Cinder Overview - Havana ReleaseOpenStack Cinder Overview - Havana Release
OpenStack Cinder Overview - Havana Release
 
Filesystem as a service in OpenStack
Filesystem as a service in OpenStackFilesystem as a service in OpenStack
Filesystem as a service in OpenStack
 
OpenStack Cinder
OpenStack CinderOpenStack Cinder
OpenStack Cinder
 
Using Cinder Block Storage
Using Cinder Block StorageUsing Cinder Block Storage
Using Cinder Block Storage
 
Cinder Status Openstack Shanghai
Cinder Status Openstack ShanghaiCinder Status Openstack Shanghai
Cinder Status Openstack Shanghai
 
OpenStack Best Practices and Considerations - terasky tech day
OpenStack Best Practices and Considerations  - terasky tech dayOpenStack Best Practices and Considerations  - terasky tech day
OpenStack Best Practices and Considerations - terasky tech day
 
Introduction to OpenStack Cinder
Introduction to OpenStack CinderIntroduction to OpenStack Cinder
Introduction to OpenStack Cinder
 
Kubernetes on CloudStack with coreOS
Kubernetes on CloudStack with coreOSKubernetes on CloudStack with coreOS
Kubernetes on CloudStack with coreOS
 
VMware Hybrid Cloud Service - Overview
VMware Hybrid Cloud Service - OverviewVMware Hybrid Cloud Service - Overview
VMware Hybrid Cloud Service - Overview
 
OpenStack Nova Scheduler
OpenStack Nova Scheduler OpenStack Nova Scheduler
OpenStack Nova Scheduler
 
Deep dive into highly available open stack architecture openstack summit va...
Deep dive into highly available open stack architecture   openstack summit va...Deep dive into highly available open stack architecture   openstack summit va...
Deep dive into highly available open stack architecture openstack summit va...
 
State of Containers in OpenStack
State of Containers in OpenStackState of Containers in OpenStack
State of Containers in OpenStack
 
Storage as a service OpenStack
Storage as a service OpenStackStorage as a service OpenStack
Storage as a service OpenStack
 
Introducing OpenStack for Beginners
Introducing OpenStack for Beginners Introducing OpenStack for Beginners
Introducing OpenStack for Beginners
 
Storage based on_openstack_mariocho
Storage based on_openstack_mariochoStorage based on_openstack_mariocho
Storage based on_openstack_mariocho
 
Introducing Docker Swarm - the orchestration tool by Docker
Introducing Docker Swarm - the orchestration tool by DockerIntroducing Docker Swarm - the orchestration tool by Docker
Introducing Docker Swarm - the orchestration tool by Docker
 
Guts & OpenStack migration
Guts & OpenStack migrationGuts & OpenStack migration
Guts & OpenStack migration
 
Couch to OpenStack: Cinder - August 6, 2013
Couch to OpenStack: Cinder - August 6, 2013Couch to OpenStack: Cinder - August 6, 2013
Couch to OpenStack: Cinder - August 6, 2013
 
Wanting distributed volumes - Experiences with ceph-docker
Wanting distributed volumes - Experiences with ceph-dockerWanting distributed volumes - Experiences with ceph-docker
Wanting distributed volumes - Experiences with ceph-docker
 
Building stateful applications on Kubernetes with Rook
Building stateful applications on Kubernetes with RookBuilding stateful applications on Kubernetes with Rook
Building stateful applications on Kubernetes with Rook
 

Destacado

Mirantis Folsom Meetup Intro
Mirantis Folsom Meetup IntroMirantis Folsom Meetup Intro
Mirantis Folsom Meetup Intro
Mirantis
 

Destacado (8)

Mirantis Folsom Meetup Intro
Mirantis Folsom Meetup IntroMirantis Folsom Meetup Intro
Mirantis Folsom Meetup Intro
 
OpenStack Nova Liberty Update
OpenStack Nova Liberty UpdateOpenStack Nova Liberty Update
OpenStack Nova Liberty Update
 
Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...
Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...
Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...
 
Presentazione PureStorage @ VMUGIT UserCon 2015
Presentazione PureStorage @ VMUGIT UserCon 2015Presentazione PureStorage @ VMUGIT UserCon 2015
Presentazione PureStorage @ VMUGIT UserCon 2015
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack Architecture
 
Getting Started with OpenStack and VMware vSphere
Getting Started with OpenStack and VMware vSphereGetting Started with OpenStack and VMware vSphere
Getting Started with OpenStack and VMware vSphere
 
Openstack pour les nuls
Openstack pour les nulsOpenstack pour les nuls
Openstack pour les nuls
 
Formation libre OpenStack en Français
Formation libre OpenStack en FrançaisFormation libre OpenStack en Français
Formation libre OpenStack en Français
 

Similar a Laying OpenStack Cinder Block Services

Radical Innovations In Storage for Multi-Tenant Infrastructure
Radical Innovations In Storage for Multi-Tenant InfrastructureRadical Innovations In Storage for Multi-Tenant Infrastructure
Radical Innovations In Storage for Multi-Tenant Infrastructure
NetApp
 
Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...
Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...
Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...
Citrix
 
OpenStack Block Storage 101
OpenStack Block Storage 101OpenStack Block Storage 101
OpenStack Block Storage 101
NetApp
 
Why Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT StrategyWhy Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT Strategy
andreas kuncoro
 
Why Kubernetes as a container orchestrator is a right choice for running spar...
Why Kubernetes as a container orchestrator is a right choice for running spar...Why Kubernetes as a container orchestrator is a right choice for running spar...
Why Kubernetes as a container orchestrator is a right choice for running spar...
DataWorks Summit
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
DevOps.com
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
DevOps.com
 

Similar a Laying OpenStack Cinder Block Services (20)

Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...
Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...
Percona Live 4/14/15: Leveraging open stack cinder for peak application perfo...
 
Radical Innovations In Storage for Multi-Tenant Infrastructure
Radical Innovations In Storage for Multi-Tenant InfrastructureRadical Innovations In Storage for Multi-Tenant Infrastructure
Radical Innovations In Storage for Multi-Tenant Infrastructure
 
Leveraging OpenStack Cinder for Peak Application Performance
Leveraging OpenStack Cinder for Peak Application PerformanceLeveraging OpenStack Cinder for Peak Application Performance
Leveraging OpenStack Cinder for Peak Application Performance
 
Get the most out OpenStack block storage with SolidFire
Get the most out OpenStack block storage with SolidFireGet the most out OpenStack block storage with SolidFire
Get the most out OpenStack block storage with SolidFire
 
Webinar - DreamObjects/Ceph Case Study
Webinar - DreamObjects/Ceph Case StudyWebinar - DreamObjects/Ceph Case Study
Webinar - DreamObjects/Ceph Case Study
 
Speed up Digital Transformation with Openstack Cloud & Software Defined Storage
Speed up Digital Transformation with Openstack Cloud & Software Defined StorageSpeed up Digital Transformation with Openstack Cloud & Software Defined Storage
Speed up Digital Transformation with Openstack Cloud & Software Defined Storage
 
Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...
Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...
Citrix Synergy 2014 - Syn233 Building and operating a Dev Ops cloud: best pra...
 
DevOps Supercharged with Docker on Exadata
DevOps Supercharged with Docker on ExadataDevOps Supercharged with Docker on Exadata
DevOps Supercharged with Docker on Exadata
 
OpenStack Block Storage 101
OpenStack Block Storage 101OpenStack Block Storage 101
OpenStack Block Storage 101
 
Yair Hershko - Building Software Defined Storage Cloud Using OpenStack
Yair Hershko - Building Software Defined Storage Cloud Using OpenStackYair Hershko - Building Software Defined Storage Cloud Using OpenStack
Yair Hershko - Building Software Defined Storage Cloud Using OpenStack
 
Open vStorage Road show 2015 Q1
Open vStorage Road show 2015 Q1Open vStorage Road show 2015 Q1
Open vStorage Road show 2015 Q1
 
A closer look to locaweb IaaS
A closer look to locaweb IaaSA closer look to locaweb IaaS
A closer look to locaweb IaaS
 
NAVER Ceph Storage on ssd for Container
NAVER Ceph Storage on ssd for ContainerNAVER Ceph Storage on ssd for Container
NAVER Ceph Storage on ssd for Container
 
Why Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT StrategyWhy Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT Strategy
 
Why Kubernetes as a container orchestrator is a right choice for running spar...
Why Kubernetes as a container orchestrator is a right choice for running spar...Why Kubernetes as a container orchestrator is a right choice for running spar...
Why Kubernetes as a container orchestrator is a right choice for running spar...
 
Citrix Synergy 2014: Going the CloudPlatform Way
Citrix Synergy 2014: Going the CloudPlatform WayCitrix Synergy 2014: Going the CloudPlatform Way
Citrix Synergy 2014: Going the CloudPlatform Way
 
What You Missed: OpenStack Summit Austin
What You Missed: OpenStack Summit AustinWhat You Missed: OpenStack Summit Austin
What You Missed: OpenStack Summit Austin
 
Centralizing Kubernetes and Container Operations
Centralizing Kubernetes and Container OperationsCentralizing Kubernetes and Container Operations
Centralizing Kubernetes and Container Operations
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
 

Más de Kenneth Hui

Tale Of Two Workloads - Atlanta OpenStack Summit
Tale Of Two Workloads - Atlanta OpenStack SummitTale Of Two Workloads - Atlanta OpenStack Summit
Tale Of Two Workloads - Atlanta OpenStack Summit
Kenneth Hui
 

Más de Kenneth Hui (17)

Multicloud - Understanding Benefits. Obstacles, and Best Approaches
Multicloud - Understanding Benefits. Obstacles, and Best ApproachesMulticloud - Understanding Benefits. Obstacles, and Best Approaches
Multicloud - Understanding Benefits. Obstacles, and Best Approaches
 
Lessons Learned Running The Largest OpenStack Clouds
Lessons Learned Running The Largest OpenStack CloudsLessons Learned Running The Largest OpenStack Clouds
Lessons Learned Running The Largest OpenStack Clouds
 
Why We Need An Uber For The Datacenter
Why We Need An Uber For The DatacenterWhy We Need An Uber For The Datacenter
Why We Need An Uber For The Datacenter
 
Building Next Generation Clouds With OpenStack
Building Next Generation Clouds With OpenStackBuilding Next Generation Clouds With OpenStack
Building Next Generation Clouds With OpenStack
 
Mind the Gap: VMware To OpenStack
Mind the Gap: VMware To OpenStackMind the Gap: VMware To OpenStack
Mind the Gap: VMware To OpenStack
 
Redefining The Hybrid Cloud: Rackspace And The EMC Federation
Redefining The Hybrid Cloud: Rackspace And The EMC FederationRedefining The Hybrid Cloud: Rackspace And The EMC Federation
Redefining The Hybrid Cloud: Rackspace And The EMC Federation
 
Bridging The Gap: OpenStack For VMware Administrators (Use Case)
Bridging The Gap: OpenStack For VMware Administrators (Use Case)Bridging The Gap: OpenStack For VMware Administrators (Use Case)
Bridging The Gap: OpenStack For VMware Administrators (Use Case)
 
Getting Started With OpenStack Icehouse Release
Getting Started With OpenStack Icehouse ReleaseGetting Started With OpenStack Icehouse Release
Getting Started With OpenStack Icehouse Release
 
Tale Of Two Workloads - Atlanta OpenStack Summit
Tale Of Two Workloads - Atlanta OpenStack SummitTale Of Two Workloads - Atlanta OpenStack Summit
Tale Of Two Workloads - Atlanta OpenStack Summit
 
Building A Better Cloud Community
Building A Better Cloud CommunityBuilding A Better Cloud Community
Building A Better Cloud Community
 
Tale of Two Workloads And One Cloud
Tale of Two Workloads And One CloudTale of Two Workloads And One Cloud
Tale of Two Workloads And One Cloud
 
vSphere With OpenStack
vSphere With OpenStackvSphere With OpenStack
vSphere With OpenStack
 
Crossing The Cloud Chasm In The Enterprise
Crossing The Cloud Chasm In The EnterpriseCrossing The Cloud Chasm In The Enterprise
Crossing The Cloud Chasm In The Enterprise
 
Bridging The Gap: Explaining OpenStack To VMware Administrators
Bridging The Gap: Explaining OpenStack To VMware AdministratorsBridging The Gap: Explaining OpenStack To VMware Administrators
Bridging The Gap: Explaining OpenStack To VMware Administrators
 
Cattle Wrangling For Pet Whisperers: Building A Multi-hypervisor Cloud
Cattle Wrangling For Pet Whisperers: Building A Multi-hypervisor CloudCattle Wrangling For Pet Whisperers: Building A Multi-hypervisor Cloud
Cattle Wrangling For Pet Whisperers: Building A Multi-hypervisor Cloud
 
OpenStack HA
OpenStack HAOpenStack HA
OpenStack HA
 
Getting Started With OpenStack (Havana)
Getting Started With OpenStack (Havana)Getting Started With OpenStack (Havana)
Getting Started With OpenStack (Havana)
 

Último

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Último (20)

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 

Laying OpenStack Cinder Block Services

  • 1. Use Cases and Reference Architectures Laying Cinder Blocks (Volumes)
  • 2. #rackstackatl Introductions Aaron Delp James Ruddy Office of the CTO EMC John Griffith John Griffith OpenStack PTL for Cinder Solutions Architect SolidFire Kenneth H Kenneth Hui OpenStack Ambassador Technology Evangelist Rackspace
  • 3. #rackstackatl Agenda • Introductions • Cinder: OpenStack Block Storage • Cinder with Commodity Storage • Cinder with Enterprise Storage • SolidFire Integration • EMC Integration
  • 4. #rackstackatl OpenStack & Storage Cinder / Block Storage Swift / Object Storage Objectives • Storage for running VM disk volumes on a host • Ideal for performance sensitive apps • Enables Amazon EBS-like service • Ideal for cost effective, scale-out storage • Fully distributed, API-accessible • Well suited for backup, archiving, data retention • Enables Dropbox-like service Use Cases • Production Applications • Traditional IT Systems • Database Driven Apps • Messaging / Collaboration • Dev / Test Systems • VM Templates • ISO Images • Disk Volume Snapshots • Backup / Archive • Image / Video Repository Workloads • High Change Content • Smaller, Random R/W • Higher / “Bursty” IO • Typically More Static Content • Larger, Sequential R/W • Lower IOPS
  • 5. #rackstackatl OpenStack Cinder (Block Storage) • Architected to provide traditional block-level storage resources to other OpenStack services • Presents persistent block-level storage volumes for use with OpenStack Nova compute instances • Manages the creation, attaching and detaching of these volumes between a storage system and different host servers
  • 6. #rackstackatl Cinder Based Features • create/delete volumes • specify custom "types/extra-specs" • clone • copy image to volume and volume to image • point in time copy (snapshots of volumes) • create volume from snapshot • backup volume (to Object Store, SWIFT and CEPH) • transfer volume ownership • customized scheduling filters • per tenant usage quotas
  • 7. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Commodity Cinder Storage Components • Controller Nodes • Cinder API – Accepts, authenticates, and routes requests throughout the block storage service • Cinder Scheduler - Schedules and routes requests to the appropriate volume service • Storage Networking • iSCSI Networks required • Redundant 10gb network connections recommended
  • 8. #rackstackatl Cinder Volume - Manages block storage devices, specifically the back-end devices themselves • Recommended Configuration • 1 compute core for every 3 TBs under management • Minimum of 2GB RAM plus an additional 250 MB RAM for every 1TB under management • Minimum of 6 physical drives • Hardware RAID5 or RAID10 protection Cinder Node and Storage Configurations
  • 9. #rackstackatl Commodity Cinder Storage Architecture Controller 1 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Controller 2 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler
  • 10. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Commodity Storage Advantages • Low initial cost during exploratory phase of deployment • Typically very little change in procurement with known vendors • Basic storage infrastructure knowledge
  • 11. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Commodity Storage Limitations • Commodity storage does not support cinder node redundancy • Commodity storage has limited or no capacity scaling • By definition, commodity storage is basic block-storage that is missing value-added services like: • Advanced Quality of Service (QoS) • Auto-tiering • De-duplication/Compression • Replication
  • 12. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Multiple Cinder Nodes Architecture Controller 1 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Controller 2 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler
  • 13. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Multiple Cinder Nodes Capacity Typical Rackspace Private Cloud (RPC) configuration of (8) 600 GB 15K SAS drives in RAID10 configuration (4.8 TB raw/2.3 TB usable) MySQL database with 8TB requirement
  • 14. #rackstackatl Provides ability to choose • Plugin architecture, multiple choices for backend storage • Don’t have to choose just one • Use the storage that fits your needs • Mix of proprietary and open-source choices
  • 15. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Cinder With Enterprise Storage Architecture Enterprise Array Controller 1 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Cinder-Volume Controller 2 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Cinder-Volume
  • 18. #rackstackatl Enterprise Storage Advantages • Simplified capacity scaling • High Availability (HA) for increased uptime • Storage is tested and supported in OpenStack environments • Delivers enhanced features only provided by enterprise storage vendors • Repurposing of current storage investments
  • 19. #rackstackatl Proprietary/Vendors they’re not evil • Having Vendor support in the community is good • Choices are good • More participation is good • Everybody wins • Sometimes combining Open Source and proprietary results in best of both worlds
  • 21. #rackstackatl There’s a lot to choose from • Over two dozen backend drivers in Cinder (and growing with each release) • Strive for consistency (they should all work) • Features and characteristics are what sets them apart
  • 23. #rackstackatl Considerations Based on Experience • High-level of integration and support with OpenStack • Flexible scalability for ever-changing environments • Automation integration via APIs • Resiliency for increased reliability and uptime • Predictable performance (not just fast) • What will I be using it for • What *might* I be using it for
  • 24. #rackstackatl You’re not locked in • The intent of the Cinder design is to keep you from being locked in • You can easily change the backend • Migrate the data • Expect the same base level of functionality
  • 25. #rackstackatl SolidFire & OpenStack "SolidFire has done a great job leading the Block Storage project in line with the OpenStack philosophy of delivering a pluggable architecture with integration points for multiple vendors and technologies. It's exciting to see more production implementations and configuration options available to OpenStack users.” Jonathan Bryce, Executive Director, OpenStack Foundation • The industry’s most comprehensive Cinder support • Unparalleled combination of guaranteed performance, high-availability and scale • Established interoperability & partnerships with industry leaders
  • 26. #rackstackatl SolidFire & Cinder • Full SolidFire driver integration with latest OpenStack software release • Set and maintain true QoS levels on a per- volume basis • Create, snapshot, clone and manage SolidFire volumes using OpenStack clients and APIs • Bootable SolidFire Volumes • Web-based API exposing all cluster functionality • SolidFire integration with Cinder can be configured in less than a minute
  • 28. #rackstackatl EMC The role of the storage architect in Openstack • Old School – Storage admin is the Master of his Domain
  • 29. #rackstackatl EMC The role of the storage architect in Openstack • New School– Its all about the pool
  • 30. #rackstackatl Specifics on implementation VMAX VNX Isilon ScaleIO Beta! XtremIO Release Protocol Vol fxns Snap fxn Vol Copy Backup Grizzly, Havana, IceHouse iSCSI, FC Out of Band Grizzly, Havana, IceHouse iSCSI, FC Out of Band Havana iSCSI Out of Band Havana SDC, SDS Out of Band Havana, IceHouseNFS (Cinder) Out of Band Havana, IceHouseiSCSI, FC Out of band Beta! Beta! All required functions, except ‘Create Vol from snapshot’, ‘Extend vol’ All required functions All required functions All required functions All required functions All required functions++
  • 31. #rackstackatl EMC & Cinder • Demo of the new consumption model
  • 32. #rackstackatl Resources • http://www.rackspace.com/cloud/private/ • www.solidfire.com/solutions/cloud-orchestration/openstack/ • http://theruddyduck.typepad.com/theruddyduck/2013/11/deploy-opensatck-cinder- with-emc-vipr-part-1.html • Podcasts: The Cloudcast.net https://itunes.apple.com/us/podcast/cloudcast-.net- weekly-cloud/id417826820?mt=2
  • 33. #rackstackatl RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218 US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COM RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN TH E UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COMRACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN TH E UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM