SlideShare una empresa de Scribd logo
1 de 32
Tuesday, January 2, 2018
Chris M Evans
Data Mobility in a
Multi-Cloud World
SDS Day London 2017
Chris Evans
Consultant/Blogger Architecting IT
Focus on Data
Scality Confidential 1
Data creation is more dispersed than ever before
Scality Confidential 2
• 4.9 billion mobile users (3.5 billion
actively using the Internet)*
• 1.9GB average monthly data used by
smartphones*
• 3.7 billion Internet users*
• Global e-commerce market $1.915
trillion in 2016 ($1,189 per user)*
• 225 billion emails sent per day in
2017 **
* Digital in 2017: Global Overview report
** Radicati Group Email statistics report 2015-2019)
• Mobile devices & Tablets
• Websites & Ecommerce – purchasing
behaviour, website usage
• IoT – Sensors & monitoring devices
• Healthcare (scanning, X-ray)
• Security – border control, facial
recognition, biometrics
• Video/Audio – call centres, Social Media
Data Sources
Scality Confidential 3
The Walled Garden of the data
centre has gone
• Multiple data centres
• Public cloud(s)
• Mobile devices
• At the “edge” (IoT)
We are creating many data silos
Data Silos
Scality Confidential 4
Scality Confidential 5
Goodbye Storage
Administrator
Hello Data
Manager
The Death of Traditional Storage
Scality Confidential 6
Perennial
Challenges
Scality Confidential 7
• Public cloud offers cheap compute but…
 Hard to get data in/out of the public cloud at speed
 Storage in the cloud has issues
• Businesses want to keep all their data
 No clear view on what future value of data means
 Keep everything forever as a fall-back position
• Businesses want analytics
 Generate competitive advantage
New and old problems
Scality Confidential 8
• Server virtualisation made applications more
mobile
 VM and data move as a unit
 vMotion and 3rd party tools to move data into public cloud
• Containers separate data and application
 Rapid application deployment in any location
 Data injected into the container or accessed via persistent storage
• Cloud-Native app deployment
 Cattle versus pets
Applications are more mobile
Scality Confidential 9
• Transformation to service-based private cloud
• Adoption of public cloud services (AWS/Azure)
 MSPs and bespoke services also offered – e.g. data in Switzerland
• Maturity Stage 1 – use of one cloud
 Learning how to consume and manage services
• Maturity Stage 2 – use of multiple clouds
 Use of cloud providers for specific functionality (e.g. Google for analytics)
• Maturity Stage 3 – brokerage of cloud resources
 Data and services actively balanced across multiple providers
The world is moving multi-cloud
Scality Confidential 10
• Block
 Good for OLTP and transactional workloads, low latency but not high
scalability
 Performance benefiting from the use of flash and NVMe
 No metadata or platform intelligence
• File
 Good for unstructured data and some performance workloads like HPC
 Relatively scalable, with some metadata and platform intelligence
• Object
 Very high scalability, good for capacity and non-latency sensitive workloads
 Rich metadata, good for immutable data types and large objects
 More difficult to interface with (Typically API)
Storage is moving multi-protocol
Scality Confidential 11
• Where is my data?
 Can I identify all of my data sources/resources?
• Data Protection
 Backup/restore, business continuity
• Security
 Blurred DC boundary opens risk of data breaches
 Equifax (143m), Ebay (145m), Yahoo (500m)
• Governance
 GDPR & Data Protection Directive
 Industry specific rules (finance, healthcare)
Existing data management rules still apply
Scality Confidential 12
• Cloud vendors provide no native interfaces to the
underlying storage offerings
 Can’t run AWS EFS across on/offsite for example
 Can’t replicate S3 or block storage outside of AWS
• Cloud vendors offer disparate services
 AWS S3 and Azure blob storage not compatible
 S3 is de-facto purely for AWS dominance – not a standard
• Data Mobility still needs standard features
 QoS, data protection (backup/restore)
• Mass migration of data between clouds is expensive
and time consuming
But…
Scality Confidential 13
Perfect World
Scality Confidential 14
• Single View of Data
 “Global namespace”
 Single security model
• Hardware independence
 Run on bespoke (vendor), commodity or in the cloud
• Consistency
 Real-time updates across all locations and views
• Performance
 Little or no impact from data latency and transfer
Is SDS the answer to global data visibility?
Storage (or Data) Nirvana
Scality Confidential 15
Businesses want data
mobility, but real cloud-
bursting is still a myth
Scality Confidential 16
Rethinking SDS
Scality Confidential 17
My vendor is ripping me off, I
can save on hardware and buy
cheap, commodity servers and
storage
The old view of SDS
Scality Confidential 18
• Hardware Abstraction
 Separate functionality from the physical media
• Service consistency
 Provide the same features, regardless of the deployment model
 Same features, regardless of on-premises or public cloud
• Service integration
 Use native platform services (like replication, snapshots)
Most important – single place for metadata
The new view of SDS
Scality Confidential 19
Typically, seen as a way to save on hardware costs, however
also allows:
• Deployment across multiple form factors and architectures
 Linux/Windows, x86, ARM
• Ongoing hardware optimisation
 Replace/refresh with latest components
 Use current technology without having to wait for vendor rollout
SDS - Hardware Abstraction
Scality Confidential 20
• Deliver a consistent set of features, regardless
of hardware platform
• Extend features to the public cloud
• Same operational look and feel
• Deliver a consistent performance experience
SDS – Service Consistency
Scality Confidential 21
• Use native features of the software platform,
irrespective of deployment point
• Exploit efficiency of native data services
 Replication, snapshots
 Deduplication, compression
• Standardise on APIs and Interfaces
 NFS, S3
SDS – Service Integration
Scality Confidential 22
• Caching Solutions
 NAS Caching, VM Caching, DB Caching, Storage Gateways
• Global/Scale Out Data
 Global NAS, Scale-out block, scale-out NAS
• Data Protection
 Replication, VM Backup, CDP, Database Replication
• Data Migration
 App Ingest
• Data Consolidation
 Copy Data Management, Secondary Storage
Deployment Models
Scality Confidential 23
• Good for getting a single workload into
public cloud
• Don’t always provide ”write anywhere”
capability
• Issues with consistency in multi-site
configurations
• Metadata doesn’t always follow the data
Example – Avere Systems
Caching Solutions
Scality Confidential 24
• Solutions offered for object, file and block
• Block solutions have issues with data integrity
of shared LUNs/volumes
• Metadata consistency and data sync is a
complex problem
• File solutions hard to develop
Examples, Hedvig, Portworx, Zenko, Elastifile
Global Scale-out
Scality Confidential 25
• Use data protection features to deliver data
mobility
• Vendors offer hardware/software integration
using VSAs and cloud appliances
• Data protection is point-in-time, not real-time
copying and synchronisation of data
 Usually uni-directional, usually one copy read only
 Snapshot replication is based on PiT copying
Data Protection
Scality Confidential 26
• Ingest services like AWS DMS are good for one-way
migrations
 Lots of manual work to make the import work
 Data synchronicity lost during migration (no easy way to catch up
“deltas”)
• Consolidation services like secondary storage also lose
consistency
 Typically based on PiT VM image copies, so crash consistent
 Some solutions providing app consistency
Migration & Consolidation
Scality Confidential 27
Data Mobility solutions are
like opinions – Everyone has
one…
Scality Confidential 28
Conclusion
Scality Confidential 29
• True data mobility requires data to appear to be
available “everywhere, anytime”
• Global data availability is hard due to latency,
throughput issues
• SDS points the way to implementing true data mobility
by removing hardware dependencies and supporting
cloud
• Metadata is key – must be portable and distributed
• Physical sync of data is required, but not essential
Conclusions
Scality Confidential 30
77 Geary, Fifth Floor, San Francisco, CA 94108, USA
Email: sales.us@scality.com | Telephone: +1 (650) 356-8500 | Fax: +1 (650) 356-8501 | Toll Free: +1 (855) 722-5489
scality.com
Thank You

Más contenido relacionado

La actualidad más candente

New york-breakfast-seminar
New york-breakfast-seminarNew york-breakfast-seminar
New york-breakfast-seminarNuoDB
 
Leap to Next Generation Data Management with Denodo 7.0
Leap to Next Generation Data Management with Denodo 7.0Leap to Next Generation Data Management with Denodo 7.0
Leap to Next Generation Data Management with Denodo 7.0Denodo
 
Cloud Based Disaster Recovery (DRaaS)
Cloud Based Disaster Recovery (DRaaS)Cloud Based Disaster Recovery (DRaaS)
Cloud Based Disaster Recovery (DRaaS)PT Datacomm Diangraha
 
Edge computing presentation
Edge computing presentationEdge computing presentation
Edge computing presentationFizaKhan82
 
Modernizing your organization's data protection approach, with Yamen Alahmad
Modernizing your organization's data protection approach, with Yamen AlahmadModernizing your organization's data protection approach, with Yamen Alahmad
Modernizing your organization's data protection approach, with Yamen AlahmadVeritas Technologies LLC
 
Deep Dive: What's New in NetBackup Appliances 3.1
Deep Dive: What's New in NetBackup Appliances 3.1Deep Dive: What's New in NetBackup Appliances 3.1
Deep Dive: What's New in NetBackup Appliances 3.1Veritas Technologies LLC
 
2nd Anniversary Datacomm Cloud Business-Message
2nd Anniversary Datacomm Cloud Business-Message2nd Anniversary Datacomm Cloud Business-Message
2nd Anniversary Datacomm Cloud Business-MessagePT Datacomm Diangraha
 
Test Drive: Experience Single-Click Command with the Veritas Access User Inte...
Test Drive: Experience Single-Click Command with the Veritas Access User Inte...Test Drive: Experience Single-Click Command with the Veritas Access User Inte...
Test Drive: Experience Single-Click Command with the Veritas Access User Inte...Veritas Technologies LLC
 
Predictable Business Continuity for Amazon Web Services
Predictable Business Continuity for Amazon Web ServicesPredictable Business Continuity for Amazon Web Services
Predictable Business Continuity for Amazon Web ServicesVeritas Technologies LLC
 
An overview of cloud storage providers
An overview of cloud storage providersAn overview of cloud storage providers
An overview of cloud storage providersRonit Sharma
 
Cloudciti Enterprise File Share (EFS)
Cloudciti Enterprise File Share (EFS)Cloudciti Enterprise File Share (EFS)
Cloudciti Enterprise File Share (EFS)PT Datacomm Diangraha
 
Cloud computing by G.SASHIDHAR
Cloud computing by G.SASHIDHARCloud computing by G.SASHIDHAR
Cloud computing by G.SASHIDHARsashi29
 
2nd Anniversary Datacomm Cloud Business- Azure Stack
2nd Anniversary Datacomm Cloud Business- Azure Stack2nd Anniversary Datacomm Cloud Business- Azure Stack
2nd Anniversary Datacomm Cloud Business- Azure StackPT Datacomm Diangraha
 
A futuristic look at BnR: The rise of the machine learning
A futuristic look at BnR: The rise of the machine learningA futuristic look at BnR: The rise of the machine learning
A futuristic look at BnR: The rise of the machine learningVeritas Technologies LLC
 
Concept of Cloud Computing
Concept of Cloud ComputingConcept of Cloud Computing
Concept of Cloud ComputingAnne Starr
 
Stop compromising your data in the cloud with Veritas CloudPoint
Stop compromising your data in the cloud with Veritas CloudPointStop compromising your data in the cloud with Veritas CloudPoint
Stop compromising your data in the cloud with Veritas CloudPointVeritas Technologies LLC
 
IaaS: the past, present and the future
IaaS: the past, present and the futureIaaS: the past, present and the future
IaaS: the past, present and the futureFrank Zhang
 
Benefits and Limitations of Cloud Computing
Benefits and Limitations of Cloud ComputingBenefits and Limitations of Cloud Computing
Benefits and Limitations of Cloud ComputingAnne Starr
 
SoftLayer Storage Services Overview (for Interop Las Vegas 2015)
SoftLayer Storage Services Overview (for Interop Las Vegas 2015)SoftLayer Storage Services Overview (for Interop Las Vegas 2015)
SoftLayer Storage Services Overview (for Interop Las Vegas 2015)Michael Fork
 

La actualidad más candente (20)

New york-breakfast-seminar
New york-breakfast-seminarNew york-breakfast-seminar
New york-breakfast-seminar
 
Leap to Next Generation Data Management with Denodo 7.0
Leap to Next Generation Data Management with Denodo 7.0Leap to Next Generation Data Management with Denodo 7.0
Leap to Next Generation Data Management with Denodo 7.0
 
Cloud Based Disaster Recovery (DRaaS)
Cloud Based Disaster Recovery (DRaaS)Cloud Based Disaster Recovery (DRaaS)
Cloud Based Disaster Recovery (DRaaS)
 
Edge computing presentation
Edge computing presentationEdge computing presentation
Edge computing presentation
 
Modernizing your organization's data protection approach, with Yamen Alahmad
Modernizing your organization's data protection approach, with Yamen AlahmadModernizing your organization's data protection approach, with Yamen Alahmad
Modernizing your organization's data protection approach, with Yamen Alahmad
 
Edge comp
Edge compEdge comp
Edge comp
 
Deep Dive: What's New in NetBackup Appliances 3.1
Deep Dive: What's New in NetBackup Appliances 3.1Deep Dive: What's New in NetBackup Appliances 3.1
Deep Dive: What's New in NetBackup Appliances 3.1
 
2nd Anniversary Datacomm Cloud Business-Message
2nd Anniversary Datacomm Cloud Business-Message2nd Anniversary Datacomm Cloud Business-Message
2nd Anniversary Datacomm Cloud Business-Message
 
Test Drive: Experience Single-Click Command with the Veritas Access User Inte...
Test Drive: Experience Single-Click Command with the Veritas Access User Inte...Test Drive: Experience Single-Click Command with the Veritas Access User Inte...
Test Drive: Experience Single-Click Command with the Veritas Access User Inte...
 
Predictable Business Continuity for Amazon Web Services
Predictable Business Continuity for Amazon Web ServicesPredictable Business Continuity for Amazon Web Services
Predictable Business Continuity for Amazon Web Services
 
An overview of cloud storage providers
An overview of cloud storage providersAn overview of cloud storage providers
An overview of cloud storage providers
 
Cloudciti Enterprise File Share (EFS)
Cloudciti Enterprise File Share (EFS)Cloudciti Enterprise File Share (EFS)
Cloudciti Enterprise File Share (EFS)
 
Cloud computing by G.SASHIDHAR
Cloud computing by G.SASHIDHARCloud computing by G.SASHIDHAR
Cloud computing by G.SASHIDHAR
 
2nd Anniversary Datacomm Cloud Business- Azure Stack
2nd Anniversary Datacomm Cloud Business- Azure Stack2nd Anniversary Datacomm Cloud Business- Azure Stack
2nd Anniversary Datacomm Cloud Business- Azure Stack
 
A futuristic look at BnR: The rise of the machine learning
A futuristic look at BnR: The rise of the machine learningA futuristic look at BnR: The rise of the machine learning
A futuristic look at BnR: The rise of the machine learning
 
Concept of Cloud Computing
Concept of Cloud ComputingConcept of Cloud Computing
Concept of Cloud Computing
 
Stop compromising your data in the cloud with Veritas CloudPoint
Stop compromising your data in the cloud with Veritas CloudPointStop compromising your data in the cloud with Veritas CloudPoint
Stop compromising your data in the cloud with Veritas CloudPoint
 
IaaS: the past, present and the future
IaaS: the past, present and the futureIaaS: the past, present and the future
IaaS: the past, present and the future
 
Benefits and Limitations of Cloud Computing
Benefits and Limitations of Cloud ComputingBenefits and Limitations of Cloud Computing
Benefits and Limitations of Cloud Computing
 
SoftLayer Storage Services Overview (for Interop Las Vegas 2015)
SoftLayer Storage Services Overview (for Interop Las Vegas 2015)SoftLayer Storage Services Overview (for Interop Las Vegas 2015)
SoftLayer Storage Services Overview (for Interop Las Vegas 2015)
 

Similar a Scality SDS Day, London, 20 SEP 2017

A Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data VirtualizationA Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data VirtualizationDenodo
 
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)Denodo
 
Dimension Data Cloud Business Unit - Solution Offering
Dimension Data Cloud Business Unit - Solution OfferingDimension Data Cloud Business Unit - Solution Offering
Dimension Data Cloud Business Unit - Solution OfferingRifaHaryadi
 
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...Denodo
 
An Integrated Cloud Computing Architectural Stack
An Integrated Cloud Computing Architectural Stack An Integrated Cloud Computing Architectural Stack
An Integrated Cloud Computing Architectural Stack Zara Tariq
 
How to Build Multi-disciplinary Analytics Applications on a Shared Data Platform
How to Build Multi-disciplinary Analytics Applications on a Shared Data PlatformHow to Build Multi-disciplinary Analytics Applications on a Shared Data Platform
How to Build Multi-disciplinary Analytics Applications on a Shared Data PlatformCloudera, Inc.
 
Cloud - NDT - Presentation
Cloud - NDT - PresentationCloud - NDT - Presentation
Cloud - NDT - PresentationÉric Dusablon
 
Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...
Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...
Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...Cloudera, Inc.
 
Data Virtualization to Survive a Multi and Hybrid Cloud World
Data Virtualization to Survive a Multi and Hybrid Cloud WorldData Virtualization to Survive a Multi and Hybrid Cloud World
Data Virtualization to Survive a Multi and Hybrid Cloud WorldDenodo
 
Data Orchestration for the Hybrid Cloud Era
Data Orchestration for the Hybrid Cloud EraData Orchestration for the Hybrid Cloud Era
Data Orchestration for the Hybrid Cloud EraAlluxio, Inc.
 
Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...
Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...
Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...Jürgen Ambrosi
 
Slides: Accelerating Queries on Cloud Data Lakes
Slides: Accelerating Queries on Cloud Data LakesSlides: Accelerating Queries on Cloud Data Lakes
Slides: Accelerating Queries on Cloud Data LakesDATAVERSITY
 
Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)Denodo
 
Accelerate Analytics and ML in the Hybrid Cloud Era
Accelerate Analytics and ML in the Hybrid Cloud EraAccelerate Analytics and ML in the Hybrid Cloud Era
Accelerate Analytics and ML in the Hybrid Cloud EraAlluxio, Inc.
 

Similar a Scality SDS Day, London, 20 SEP 2017 (20)

A Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data VirtualizationA Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data Virtualization
 
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)
 
IT Resilience Use Case
IT Resilience Use CaseIT Resilience Use Case
IT Resilience Use Case
 
Cloud computing
Cloud computingCloud computing
Cloud computing
 
Dimension Data Cloud Business Unit - Solution Offering
Dimension Data Cloud Business Unit - Solution OfferingDimension Data Cloud Business Unit - Solution Offering
Dimension Data Cloud Business Unit - Solution Offering
 
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
 
An Integrated Cloud Computing Architectural Stack
An Integrated Cloud Computing Architectural Stack An Integrated Cloud Computing Architectural Stack
An Integrated Cloud Computing Architectural Stack
 
How to Build Multi-disciplinary Analytics Applications on a Shared Data Platform
How to Build Multi-disciplinary Analytics Applications on a Shared Data PlatformHow to Build Multi-disciplinary Analytics Applications on a Shared Data Platform
How to Build Multi-disciplinary Analytics Applications on a Shared Data Platform
 
Cloud - NDT - Presentation
Cloud - NDT - PresentationCloud - NDT - Presentation
Cloud - NDT - Presentation
 
Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...
Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...
Multidisziplinäre Analyseanwendungen auf einer gemeinsamen Datenplattform ers...
 
Data Virtualization to Survive a Multi and Hybrid Cloud World
Data Virtualization to Survive a Multi and Hybrid Cloud WorldData Virtualization to Survive a Multi and Hybrid Cloud World
Data Virtualization to Survive a Multi and Hybrid Cloud World
 
oracle.pptx
oracle.pptxoracle.pptx
oracle.pptx
 
Data Orchestration for the Hybrid Cloud Era
Data Orchestration for the Hybrid Cloud EraData Orchestration for the Hybrid Cloud Era
Data Orchestration for the Hybrid Cloud Era
 
Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...
Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...
Webinar Fondazione CRUI Commvault:come adattare le strategie di data protecti...
 
Slides: Accelerating Queries on Cloud Data Lakes
Slides: Accelerating Queries on Cloud Data LakesSlides: Accelerating Queries on Cloud Data Lakes
Slides: Accelerating Queries on Cloud Data Lakes
 
Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)
 
lecture5_4.pptx
lecture5_4.pptxlecture5_4.pptx
lecture5_4.pptx
 
Accelerate Analytics and ML in the Hybrid Cloud Era
Accelerate Analytics and ML in the Hybrid Cloud EraAccelerate Analytics and ML in the Hybrid Cloud Era
Accelerate Analytics and ML in the Hybrid Cloud Era
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
Basics of cloud
Basics of cloudBasics of cloud
Basics of cloud
 

Último

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 

Último (20)

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 

Scality SDS Day, London, 20 SEP 2017

  • 1. Tuesday, January 2, 2018 Chris M Evans Data Mobility in a Multi-Cloud World SDS Day London 2017 Chris Evans Consultant/Blogger Architecting IT
  • 2. Focus on Data Scality Confidential 1
  • 3. Data creation is more dispersed than ever before Scality Confidential 2 • 4.9 billion mobile users (3.5 billion actively using the Internet)* • 1.9GB average monthly data used by smartphones* • 3.7 billion Internet users* • Global e-commerce market $1.915 trillion in 2016 ($1,189 per user)* • 225 billion emails sent per day in 2017 ** * Digital in 2017: Global Overview report ** Radicati Group Email statistics report 2015-2019)
  • 4. • Mobile devices & Tablets • Websites & Ecommerce – purchasing behaviour, website usage • IoT – Sensors & monitoring devices • Healthcare (scanning, X-ray) • Security – border control, facial recognition, biometrics • Video/Audio – call centres, Social Media Data Sources Scality Confidential 3
  • 5. The Walled Garden of the data centre has gone • Multiple data centres • Public cloud(s) • Mobile devices • At the “edge” (IoT) We are creating many data silos Data Silos Scality Confidential 4
  • 6. Scality Confidential 5 Goodbye Storage Administrator Hello Data Manager
  • 7. The Death of Traditional Storage Scality Confidential 6
  • 9. • Public cloud offers cheap compute but…  Hard to get data in/out of the public cloud at speed  Storage in the cloud has issues • Businesses want to keep all their data  No clear view on what future value of data means  Keep everything forever as a fall-back position • Businesses want analytics  Generate competitive advantage New and old problems Scality Confidential 8
  • 10. • Server virtualisation made applications more mobile  VM and data move as a unit  vMotion and 3rd party tools to move data into public cloud • Containers separate data and application  Rapid application deployment in any location  Data injected into the container or accessed via persistent storage • Cloud-Native app deployment  Cattle versus pets Applications are more mobile Scality Confidential 9
  • 11. • Transformation to service-based private cloud • Adoption of public cloud services (AWS/Azure)  MSPs and bespoke services also offered – e.g. data in Switzerland • Maturity Stage 1 – use of one cloud  Learning how to consume and manage services • Maturity Stage 2 – use of multiple clouds  Use of cloud providers for specific functionality (e.g. Google for analytics) • Maturity Stage 3 – brokerage of cloud resources  Data and services actively balanced across multiple providers The world is moving multi-cloud Scality Confidential 10
  • 12. • Block  Good for OLTP and transactional workloads, low latency but not high scalability  Performance benefiting from the use of flash and NVMe  No metadata or platform intelligence • File  Good for unstructured data and some performance workloads like HPC  Relatively scalable, with some metadata and platform intelligence • Object  Very high scalability, good for capacity and non-latency sensitive workloads  Rich metadata, good for immutable data types and large objects  More difficult to interface with (Typically API) Storage is moving multi-protocol Scality Confidential 11
  • 13. • Where is my data?  Can I identify all of my data sources/resources? • Data Protection  Backup/restore, business continuity • Security  Blurred DC boundary opens risk of data breaches  Equifax (143m), Ebay (145m), Yahoo (500m) • Governance  GDPR & Data Protection Directive  Industry specific rules (finance, healthcare) Existing data management rules still apply Scality Confidential 12
  • 14. • Cloud vendors provide no native interfaces to the underlying storage offerings  Can’t run AWS EFS across on/offsite for example  Can’t replicate S3 or block storage outside of AWS • Cloud vendors offer disparate services  AWS S3 and Azure blob storage not compatible  S3 is de-facto purely for AWS dominance – not a standard • Data Mobility still needs standard features  QoS, data protection (backup/restore) • Mass migration of data between clouds is expensive and time consuming But… Scality Confidential 13
  • 16. • Single View of Data  “Global namespace”  Single security model • Hardware independence  Run on bespoke (vendor), commodity or in the cloud • Consistency  Real-time updates across all locations and views • Performance  Little or no impact from data latency and transfer Is SDS the answer to global data visibility? Storage (or Data) Nirvana Scality Confidential 15
  • 17. Businesses want data mobility, but real cloud- bursting is still a myth Scality Confidential 16
  • 19. My vendor is ripping me off, I can save on hardware and buy cheap, commodity servers and storage The old view of SDS Scality Confidential 18
  • 20. • Hardware Abstraction  Separate functionality from the physical media • Service consistency  Provide the same features, regardless of the deployment model  Same features, regardless of on-premises or public cloud • Service integration  Use native platform services (like replication, snapshots) Most important – single place for metadata The new view of SDS Scality Confidential 19
  • 21. Typically, seen as a way to save on hardware costs, however also allows: • Deployment across multiple form factors and architectures  Linux/Windows, x86, ARM • Ongoing hardware optimisation  Replace/refresh with latest components  Use current technology without having to wait for vendor rollout SDS - Hardware Abstraction Scality Confidential 20
  • 22. • Deliver a consistent set of features, regardless of hardware platform • Extend features to the public cloud • Same operational look and feel • Deliver a consistent performance experience SDS – Service Consistency Scality Confidential 21
  • 23. • Use native features of the software platform, irrespective of deployment point • Exploit efficiency of native data services  Replication, snapshots  Deduplication, compression • Standardise on APIs and Interfaces  NFS, S3 SDS – Service Integration Scality Confidential 22
  • 24. • Caching Solutions  NAS Caching, VM Caching, DB Caching, Storage Gateways • Global/Scale Out Data  Global NAS, Scale-out block, scale-out NAS • Data Protection  Replication, VM Backup, CDP, Database Replication • Data Migration  App Ingest • Data Consolidation  Copy Data Management, Secondary Storage Deployment Models Scality Confidential 23
  • 25. • Good for getting a single workload into public cloud • Don’t always provide ”write anywhere” capability • Issues with consistency in multi-site configurations • Metadata doesn’t always follow the data Example – Avere Systems Caching Solutions Scality Confidential 24
  • 26. • Solutions offered for object, file and block • Block solutions have issues with data integrity of shared LUNs/volumes • Metadata consistency and data sync is a complex problem • File solutions hard to develop Examples, Hedvig, Portworx, Zenko, Elastifile Global Scale-out Scality Confidential 25
  • 27. • Use data protection features to deliver data mobility • Vendors offer hardware/software integration using VSAs and cloud appliances • Data protection is point-in-time, not real-time copying and synchronisation of data  Usually uni-directional, usually one copy read only  Snapshot replication is based on PiT copying Data Protection Scality Confidential 26
  • 28. • Ingest services like AWS DMS are good for one-way migrations  Lots of manual work to make the import work  Data synchronicity lost during migration (no easy way to catch up “deltas”) • Consolidation services like secondary storage also lose consistency  Typically based on PiT VM image copies, so crash consistent  Some solutions providing app consistency Migration & Consolidation Scality Confidential 27
  • 29. Data Mobility solutions are like opinions – Everyone has one… Scality Confidential 28
  • 31. • True data mobility requires data to appear to be available “everywhere, anytime” • Global data availability is hard due to latency, throughput issues • SDS points the way to implementing true data mobility by removing hardware dependencies and supporting cloud • Metadata is key – must be portable and distributed • Physical sync of data is required, but not essential Conclusions Scality Confidential 30
  • 32. 77 Geary, Fifth Floor, San Francisco, CA 94108, USA Email: sales.us@scality.com | Telephone: +1 (650) 356-8500 | Fax: +1 (650) 356-8501 | Toll Free: +1 (855) 722-5489 scality.com Thank You