SlideShare una empresa de Scribd logo
1 de 65
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Paul Reed, Sr. Product Manager, AWS
Peter Levett, Storage Solution Architect, AWS
January 30, 2018
Improving Backup & DR with
AWS Storage Gateway
Enabling faster recoveries in-cloud
or on-premises with Volume Gateway
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why are we here today?
This could be your datacenter, or your server, or your CFO’s file share.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Disaster
Recovery point
Data loss
Recovery time
Down time
Recovery Point and Recovery Time Objectives
Time
RPO RTO
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RPO & RTO spectrum
Backup &
Restore
Pilot light Warm standby
Hot standby
(with multi-site)
 Lower priority use
cases
 Cost: $
 Meeting lower RTO &
RPO requirements
 Core services
 Scale resources in
response to a DR event
 Cost: $$
 Apps that require RTO
& RPO in minutes
 Business critical
services
 Cost: $$$
 Auto-failover of your
environment
 Cost: $$$$
Low High
RPO/RTO:
Hours
RPO/RTO:
10s of Minutes
RPO/RTO:
Minutes
RPO/RTO:
Real-time
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RPO & RTO spectrum: Solutions
Backup &
Restore
Pilot light Warm standby
Hot standby
(with multi-site)
 Backup tools with
dedupe & unique
formats
 Data backed up on
Glacier
 AWS Storage
Gateway – VTL (Tape
Gateway)
 Point-in-time / Snapshot-based tools with
varying replication timeframes
 AWS Storage Gateway – Volume Gateway
with Snapshots & Clones
 CDP/constant block or byte-level replication
tools, often host- or app. Integrated
 For example AWS Partner tools from
CloudEndure, CloudVelox, etc.
 Automated DR tools or
scripting with data movement
tools
Low High
RPO/RTO:
Hours
RPO/RTO:
10s of Minutes
RPO/RTO:
Minutes
RPO/RTO:
Real-time
Example Solutions
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data movement
OnlineOffline
Data security
and management
AWS data building blocks
Amazon
EFS
Amazon
EBS
AWS Snow family
AWS Storage Gateway
Family
AWS Direct Connect
Amazon EFS File Sync
Amazon S3
Transfer Acceleration
Storage Partners
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams
Amazon
S3
Amazon
Glacier
AWS KMS
AWS IAM
AWS CloudWatch
AWS CloudTrail
AWS CloudFormation
AWS Lambda
Amazon Macie
AWS QuickSight
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Storage Gateway Amazon S3 Standard &
Infrequent Access
Files
(NFS v3 / v4)
Volumes
(iSCSI)
Tapes
(iSCSI VTL)
AWS Storage Gateway
Use standard storage protocols to store, protect & recover with AWS
Data stored in Amazon S3 with
• Native S3 management (File)
• Snapshots to EBS (Volume)
• Archive to Amazon Glacier (Tape)
Service accessed through VM which provides
• Protocol conversion and device emulation
• Caching (read-through / write-back)
• Optimized data transfer
HTTPS
Amazon
EC2
Amazon Glacier
Amazon EBS
snapshots
AWS Identity and Access
Management (IAM)
Amazon
CloudWatch
AWS Key Management
Service (KMS)
AWS
CloudTrail
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enabling a Spectrum of Hybrid Use Cases
Backup | DR | Archive
Enterprise Data Centers
Amazon
EBS
Amazon
S3
Amazon
Glacier
App. serversFile servers
Research Sites
AWS Storage Gateway
DevicesDatabasesMultimedia content
Analytics | File Services | Production Tiering | Data Processing
Data Distribution | Backup | DR | Archive | Migration
Amazon
EC2
AWS
Lambda
Amazon
CloudFront
Amazon
Athena
Amazon
EMR
Backup serversUsers
Remote Offices Small-Medium Businesses
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Backup to AWS via Storage Gateway
T h r e e O p t i o n s t o w r i t e o n - p r e m i s e s b a c k u p s t o AW S
Customer Premises
File S3-IA
Backup or
Application
Servers
Customer Bucket
Volume
iSCSI
Tape / VTL
Storage Gateway
S3
Storage Gateway
EBS Snapshots
S3
Standard
Glacier
GlacierS3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Tape Gateway (“VTL”) for backup & recovery
• Virtual tape storage in the cloud accessed via gateway
• Data compressed in-transit and at-rest
• Unlimited archival with 1 PB immediately accessible
• 3-5 hour tape retrieval from Amazon Glacier
• Supports leading backup applications
Media Changer
Virtual Tapes
stored in
Amazon S3
Archived Tapes in
Amazon Glacier
Backup
Server
iSCSI
Tape
Gateway
Tape Gateway VM
Tape Drive
HTTP
S
Customer Premises Region
Virtual tape storage in Amazon S3 and Amazon Glacier with VTL management
Local
Cache
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
File Gateway for Backup & Recovery
• Backup data files stored and retrieved from your S3 buckets
• One-to-one mapping from files-to-objects
• File metadata object metadata
• Bucket access managed by IAM role you own and manage
• S3 features available: Lifecycle Policies, versioning, or CRR
• Recovery in EC2 with second gateway and backup software
Customer Premises
File
Gateway
GlacierS3
Standard
S3
Standard–
IA
HTTPS
NFS
v3 / v4.1
Backup or
App. Server
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway
Cloud-backed block storage that can be presented on-premises
Snapshots and clones for flexible recoveries
Application
Server
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Gateway
VM
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Mode
In “Volume Stored” mode a full copy of the volume is stored on-premises
and in the cloud
Application
Server
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Gateway
VM
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
100% of volume stored
in AWS & on-prem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
App
Server
SAN, DAS, or NAS (any storage
that can host a virtual disk)
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
Backed by AWS S3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
On-prem writable copy of volume
and upload buffer
Cloud backed
copy of volume
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Mode
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
Cloud based
monitoring
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
Client writes to local volume
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
The write is copied to the upload
buffer
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
Write is compressed and
uploaded to the S3 backed
gateway service over HTTPS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Read Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Stored Read Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
upload
buffervolume
volume
iSCSI
100% of reads come directly from the local
volume for low latency
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Mode
In “Volume Cached” mode a full copy of the volume is stored in AWS and a
portion (hot data) is stored on-premises
Application
Server
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Stored in
Amazon S3
HTTPS
iSCS
I
Customer Premises Region
Volume Gateway VM
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Mode
In “Volume Cached” mode a full copy of the volume is stored in AWS and a
portion (hot data) is stored on-premises
Application
Server
Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Stored in
Amazon S3
HTTPS
iSCS
I
Customer Premises Region
100% of volume stored
in AWS & on-prem
Volume Gateway VM
virtual volume cache frequent accessed
blocks (reduce onsite storage)
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
volume
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
volume
Client sends the write to the gateway, which
first populates the local cache
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
volume
The write is copied to the upload
buffer
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Write Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
volume
Write is compressed and
uploaded to the S3 backed
gateway service over HTTPS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
volume
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
volume
If the block is cached locally, the read comes
directly from the gateway’s local cache
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
volume
If the block is not cached locally, the gateway requests the
block from the gateway service & populates the local cache
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – Cached Read Operations
Amazon EBS snapshots
App
Server
Amazon CloudWatch
Storage Gateway Service
Customer Premises Region
iSCSI
Storage Gateway VM
upload buffer
volume
cache
The gateway returns the read request using
the newly cached block
volume
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway + EBS Snapshots
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Volume Gateway – EBS Snapshots
Snapshots enable the ability to create point in time backups of a volume
whilst only consuming incremental capacity
Snapshot are initiated via API call or scheduled
Application
Server Amazon EBS
snapshots
Storage
Gateway
Service
Volume
Gateway
VM
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snapshot Creation
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
volume
iSCSI
volume
A B
A
Amazon EBS snapshots
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snapshot Creation
Amazon EBS snapshots
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
volume
iSCSI
volume
A B
A
When a snapshot is created gateway flushes
any outstanding writes to the cloud
B
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A B
Snapshot Creation
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
volume
iSCSI
volume
A B
A B
All consumed blocks that make up the
volume are backed up to an EBS snapshot
snap1
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snapshot Creation
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
volume
iSCSI
volume
A B
A B
C
C
New data continues to be written to
the volume
A B
snap1
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snapshot Creation
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
volume
iSCSI
volume
A B
A B
C
C
When another snapshot is created only
incremental data is backed up
A B C
snap1 snap2
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snapshot Creation
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
volume
iSCSI
volume
A B
A B
C
C
When another snapshot is created only
incremental data is backed up
D
D
A B C
snap1 snap2
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snapshot Creation
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway
VM
volume
iSCSI
volume
A B
A B
A B
C
C
When another snapshot is created only
incremental data is backed up
C
D
D
D
snap1 snap2 snap3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Recovery with Snapshots & Clones
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Flexible Recovery Targets with Snapshots & Clones
Storage Gateway
Service
Customer 2nd Site
EC2
Customer VPC
Customer Data Center
EBSGateway
Volume
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Using EBS Snapshots for recovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Restores with an EBS snapshot
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I volumeA B
A B
C
C
volume
A B C D
D
D
snap1 snap2 snap3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Restores with an EBS Snapshot – on-premises
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I volumeA B
A B
C
C
volume
A B C D
D
D
snap1 snap2 snap3
volumeA B C
1. Restore a GW
volume from a past
point in time
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Restores with an EBS Snapshots – on-premises
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I volumeA B
A B
C
C
volume
A B C D
D
D
snap1 snap2 snap3
A B C
volumeA B C
1. Restore a GW
volume from a past
point in time
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Recovery to Cloud with Snapshots to EBS/EC2
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I volumeA B
A B
C
C
volume
A B C D
D
D
snap1 snap2 snap3
A B C
volumeA B C
1. Restore a GW
volume from a past
point in time
AZ1
EBS
EC2A B
C D
2. Restore to EC2
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Copying EBS snapshot to a new region
App
Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I volumeA B
A B
C
C
volume
A B C D
D
D
snap1 snap2 snap3
A B C
volumeA B C
1. Restore a GW
volume from a past
point in time
AZ1
EBS
EC2A B
C D
2. Restore to EC2
3. Copy volume data
from one AWS Region
to another
Region #2
A B
snap1
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Using clones for on-prem. recovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Gateway Volumes – How it works
App Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Gateway Volumes – How it works
App Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
clone1A B C D
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Volumes – Recover to same Gateway
App Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
clone1A B C D
• Cloning test data
• Same site recovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Volumes – Recover to same Gateway
App Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
clone1A B C D
clone1
A B C D
• Cloning test data
• Same site recovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Gateway Volumes
App Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
clone1A B C D
clone1
A B C D
• Cloning test data
• Disaster recovery
• Same site recovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Gateway Volumes – Disaster Recovery
App Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
clone1A B C D
clone1
A B C D
clone2A B C D
• Cloning test data
• Disaster recovery
• Same site recovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Volumes – DR to 2nd Site
App Server
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
clone1A B C D
clone1
A B C D
App Server
Customer Premises
Storage Gateway VM
iSCS
I
clone2A B C D
• Cloning test data
• Disaster recovery
• Same site recovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloning Volumes – DR to 2nd Site
Storage Gateway Service
Customer Premises Region
Storage Gateway VM
volume
A B C D
volumeA B C D
clone1A B C D
clone1
A B C D
App Server
Customer Premises
Storage Gateway VM
iSCS
I
clone2
A B C D
clone2A B C D
• Cloning test data
• Disaster recovery
• Same site recovery
App Server
iSCS
I
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DEMO!
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Disaster Recovery Demo
App Server
Storage Gateway Service
San Francisco
us-east-1
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
App Server
Boston
Storage Gateway VM
iSCS
I
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Disaster Recovery Demo
App Server
Storage Gateway Service
San Francisco
us-east-1
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
App Server
Boston
Storage Gateway VM
iSCS
I
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Disaster Recovery Demo
App Server
Storage Gateway Service
San Francisco
us-east-1
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
DR_cloneA B C D
App Server
Boston
Storage Gateway VM
iSCS
I
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Disaster Recovery Demo
App Server
Storage Gateway Service
San Francisco
us-east-1
Storage Gateway VM
iSCS
I
volume
A B C D
volumeA B C D
DR_cloneA B C D
App Server
Boston
Storage Gateway VM
iSCS
I
DR_Clone
A B C D
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
THANK YOU!
Learn more at:
aws.amazon.com/storagegateway

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Amazon Elastic File System (Amazon EFS) for File Storage
Amazon Elastic File System (Amazon EFS) for File StorageAmazon Elastic File System (Amazon EFS) for File Storage
Amazon Elastic File System (Amazon EFS) for File Storage
 
Hybrid Cloud Storage for Recovery & Migration with AWS Storage Gateway (STG30...
Hybrid Cloud Storage for Recovery & Migration with AWS Storage Gateway (STG30...Hybrid Cloud Storage for Recovery & Migration with AWS Storage Gateway (STG30...
Hybrid Cloud Storage for Recovery & Migration with AWS Storage Gateway (STG30...
 
Deep Dive on Archiving and Compliance
Deep Dive on Archiving and ComplianceDeep Dive on Archiving and Compliance
Deep Dive on Archiving and Compliance
 
Disaster Recovery with AWS: Tiered Approaches to Balance Cost with Recovery O...
Disaster Recovery with AWS: Tiered Approaches to Balance Cost with Recovery O...Disaster Recovery with AWS: Tiered Approaches to Balance Cost with Recovery O...
Disaster Recovery with AWS: Tiered Approaches to Balance Cost with Recovery O...
 
Data Migration Best Practices
Data Migration Best PracticesData Migration Best Practices
Data Migration Best Practices
 
Armazenamento em Amazon Web Service para Setor Publico
 Armazenamento em Amazon Web Service para Setor Publico  Armazenamento em Amazon Web Service para Setor Publico
Armazenamento em Amazon Web Service para Setor Publico
 
STG301_Deep Dive on Amazon S3 and Glacier Architecture
STG301_Deep Dive on Amazon S3 and Glacier ArchitectureSTG301_Deep Dive on Amazon S3 and Glacier Architecture
STG301_Deep Dive on Amazon S3 and Glacier Architecture
 
Moving your File Data to Amazon EFS - AWS Online Tech Talks
Moving your File Data to Amazon EFS - AWS Online Tech TalksMoving your File Data to Amazon EFS - AWS Online Tech Talks
Moving your File Data to Amazon EFS - AWS Online Tech Talks
 
Disaster Recovery on AWS Webinar December 2017 - IL Webinar
Disaster Recovery on AWS Webinar December 2017 - IL WebinarDisaster Recovery on AWS Webinar December 2017 - IL Webinar
Disaster Recovery on AWS Webinar December 2017 - IL Webinar
 
Automate the Provisioning of Secure Developer Environments on AWS PPT
 Automate the Provisioning of Secure Developer Environments on AWS PPT Automate the Provisioning of Secure Developer Environments on AWS PPT
Automate the Provisioning of Secure Developer Environments on AWS PPT
 
Deep Dive on Backup
Deep Dive on BackupDeep Dive on Backup
Deep Dive on Backup
 
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
 
Optimising Cost and Efficiency on AWS
Optimising Cost and Efficiency on AWSOptimising Cost and Efficiency on AWS
Optimising Cost and Efficiency on AWS
 
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
 
STG203_Get Rid of Tape and Modernize Backup with AWS
STG203_Get Rid of Tape and Modernize Backup with AWSSTG203_Get Rid of Tape and Modernize Backup with AWS
STG203_Get Rid of Tape and Modernize Backup with AWS
 
EC2 and VPC Workshop
EC2 and VPC WorkshopEC2 and VPC Workshop
EC2 and VPC Workshop
 
Scaling up to Your First 10 Million Users
Scaling up to Your First 10 Million UsersScaling up to Your First 10 Million Users
Scaling up to Your First 10 Million Users
 
DEV317_Deep Dive on AWS CloudFormation
DEV317_Deep Dive on AWS CloudFormationDEV317_Deep Dive on AWS CloudFormation
DEV317_Deep Dive on AWS CloudFormation
 
NET304_Deep Dive into the New Network Load Balancer
NET304_Deep Dive into the New Network Load BalancerNET304_Deep Dive into the New Network Load Balancer
NET304_Deep Dive into the New Network Load Balancer
 
Building a Strong Foundation with AWS Storage Services
Building a Strong Foundation with AWS Storage ServicesBuilding a Strong Foundation with AWS Storage Services
Building a Strong Foundation with AWS Storage Services
 

Similar a Improving Backup & DR – AWS Storage Gateway - AWS Online Tech Talks

Similar a Improving Backup & DR – AWS Storage Gateway - AWS Online Tech Talks (20)

SRV302 Deep Dive: Hybrid Cloud Storage with AWS Storage Gateway
 SRV302 Deep Dive: Hybrid Cloud Storage with AWS Storage Gateway SRV302 Deep Dive: Hybrid Cloud Storage with AWS Storage Gateway
SRV302 Deep Dive: Hybrid Cloud Storage with AWS Storage Gateway
 
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
 
Data Migration Best Practice
Data Migration Best PracticeData Migration Best Practice
Data Migration Best Practice
 
AWS Services for Data Migration - AWS Online Tech Talks
AWS Services for Data Migration - AWS Online Tech TalksAWS Services for Data Migration - AWS Online Tech Talks
AWS Services for Data Migration - AWS Online Tech Talks
 
Hybrid and Edge Architectures.pdf
Hybrid and Edge Architectures.pdfHybrid and Edge Architectures.pdf
Hybrid and Edge Architectures.pdf
 
Files in AWS: Overcoming Storage Challenges for Common File Use Cases, with S...
Files in AWS: Overcoming Storage Challenges for Common File Use Cases, with S...Files in AWS: Overcoming Storage Challenges for Common File Use Cases, with S...
Files in AWS: Overcoming Storage Challenges for Common File Use Cases, with S...
 
Construindo Arquiteturas Híbridas de Armazenamento em Nuvem
Construindo Arquiteturas Híbridas de Armazenamento em NuvemConstruindo Arquiteturas Híbridas de Armazenamento em Nuvem
Construindo Arquiteturas Híbridas de Armazenamento em Nuvem
 
Hybrid and Edge Architectures
Hybrid and Edge ArchitecturesHybrid and Edge Architectures
Hybrid and Edge Architectures
 
Cloud Data Migration with Amazon EBS (CMP406-R2) - AWS re:Invent 2018
Cloud Data Migration with Amazon EBS (CMP406-R2) - AWS re:Invent 2018Cloud Data Migration with Amazon EBS (CMP406-R2) - AWS re:Invent 2018
Cloud Data Migration with Amazon EBS (CMP406-R2) - AWS re:Invent 2018
 
Migrating_Large_Scale_Data_Sets_to_the_Cloud
Migrating_Large_Scale_Data_Sets_to_the_CloudMigrating_Large_Scale_Data_Sets_to_the_Cloud
Migrating_Large_Scale_Data_Sets_to_the_Cloud
 
Building Hybrid Cloud Storage Architectures with AWS
Building Hybrid Cloud Storage Architectures with AWSBuilding Hybrid Cloud Storage Architectures with AWS
Building Hybrid Cloud Storage Architectures with AWS
 
ENT306 Migrating large Scale Data Sets to the Cloud
ENT306 Migrating large Scale Data Sets to the CloudENT306 Migrating large Scale Data Sets to the Cloud
ENT306 Migrating large Scale Data Sets to the Cloud
 
Building Hybrid Cloud Storage Architectures with AWS @scale
Building Hybrid Cloud Storage Architectures with AWS @scaleBuilding Hybrid Cloud Storage Architectures with AWS @scale
Building Hybrid Cloud Storage Architectures with AWS @scale
 
Soluzioni per la migrazione e gestione dei dati in Amazon Web Services
Soluzioni per la migrazione e gestione dei dati in Amazon Web ServicesSoluzioni per la migrazione e gestione dei dati in Amazon Web Services
Soluzioni per la migrazione e gestione dei dati in Amazon Web Services
 
STG305_Deep Dive on Backup to the AWS Cloud
STG305_Deep Dive on Backup to the AWS CloudSTG305_Deep Dive on Backup to the AWS Cloud
STG305_Deep Dive on Backup to the AWS Cloud
 
Deep Dive on the AWS Storage Gateway - April 2017 AWS Online Tech Talks
Deep Dive on the AWS Storage Gateway - April 2017 AWS Online Tech TalksDeep Dive on the AWS Storage Gateway - April 2017 AWS Online Tech Talks
Deep Dive on the AWS Storage Gateway - April 2017 AWS Online Tech Talks
 
Deep Dive on Cloud File System Offerings: What to Use, Where, and Why (STG392...
Deep Dive on Cloud File System Offerings: What to Use, Where, and Why (STG392...Deep Dive on Cloud File System Offerings: What to Use, Where, and Why (STG392...
Deep Dive on Cloud File System Offerings: What to Use, Where, and Why (STG392...
 
ENT306 Migrating Large Scale Data Sets to the Cloud
ENT306 Migrating Large Scale Data Sets to the CloudENT306 Migrating Large Scale Data Sets to the Cloud
ENT306 Migrating Large Scale Data Sets to the Cloud
 
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
 
Reducing Branch Office Storage with AWS Storage Gateway (STG332) - AWS re:Inv...
Reducing Branch Office Storage with AWS Storage Gateway (STG332) - AWS re:Inv...Reducing Branch Office Storage with AWS Storage Gateway (STG332) - AWS re:Inv...
Reducing Branch Office Storage with AWS Storage Gateway (STG332) - AWS re:Inv...
 

Más de Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

Más de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Improving Backup & DR – AWS Storage Gateway - AWS Online Tech Talks

  • 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Paul Reed, Sr. Product Manager, AWS Peter Levett, Storage Solution Architect, AWS January 30, 2018 Improving Backup & DR with AWS Storage Gateway Enabling faster recoveries in-cloud or on-premises with Volume Gateway
  • 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why are we here today? This could be your datacenter, or your server, or your CFO’s file share.
  • 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster Recovery point Data loss Recovery time Down time Recovery Point and Recovery Time Objectives Time RPO RTO
  • 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RPO & RTO spectrum Backup & Restore Pilot light Warm standby Hot standby (with multi-site)  Lower priority use cases  Cost: $  Meeting lower RTO & RPO requirements  Core services  Scale resources in response to a DR event  Cost: $$  Apps that require RTO & RPO in minutes  Business critical services  Cost: $$$  Auto-failover of your environment  Cost: $$$$ Low High RPO/RTO: Hours RPO/RTO: 10s of Minutes RPO/RTO: Minutes RPO/RTO: Real-time
  • 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RPO & RTO spectrum: Solutions Backup & Restore Pilot light Warm standby Hot standby (with multi-site)  Backup tools with dedupe & unique formats  Data backed up on Glacier  AWS Storage Gateway – VTL (Tape Gateway)  Point-in-time / Snapshot-based tools with varying replication timeframes  AWS Storage Gateway – Volume Gateway with Snapshots & Clones  CDP/constant block or byte-level replication tools, often host- or app. Integrated  For example AWS Partner tools from CloudEndure, CloudVelox, etc.  Automated DR tools or scripting with data movement tools Low High RPO/RTO: Hours RPO/RTO: 10s of Minutes RPO/RTO: Minutes RPO/RTO: Real-time Example Solutions
  • 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data movement OnlineOffline Data security and management AWS data building blocks Amazon EFS Amazon EBS AWS Snow family AWS Storage Gateway Family AWS Direct Connect Amazon EFS File Sync Amazon S3 Transfer Acceleration Storage Partners Amazon Kinesis Data Streams Amazon Kinesis Video Streams Amazon S3 Amazon Glacier AWS KMS AWS IAM AWS CloudWatch AWS CloudTrail AWS CloudFormation AWS Lambda Amazon Macie AWS QuickSight
  • 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Storage Gateway Amazon S3 Standard & Infrequent Access Files (NFS v3 / v4) Volumes (iSCSI) Tapes (iSCSI VTL) AWS Storage Gateway Use standard storage protocols to store, protect & recover with AWS Data stored in Amazon S3 with • Native S3 management (File) • Snapshots to EBS (Volume) • Archive to Amazon Glacier (Tape) Service accessed through VM which provides • Protocol conversion and device emulation • Caching (read-through / write-back) • Optimized data transfer HTTPS Amazon EC2 Amazon Glacier Amazon EBS snapshots AWS Identity and Access Management (IAM) Amazon CloudWatch AWS Key Management Service (KMS) AWS CloudTrail
  • 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Enabling a Spectrum of Hybrid Use Cases Backup | DR | Archive Enterprise Data Centers Amazon EBS Amazon S3 Amazon Glacier App. serversFile servers Research Sites AWS Storage Gateway DevicesDatabasesMultimedia content Analytics | File Services | Production Tiering | Data Processing Data Distribution | Backup | DR | Archive | Migration Amazon EC2 AWS Lambda Amazon CloudFront Amazon Athena Amazon EMR Backup serversUsers Remote Offices Small-Medium Businesses
  • 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Backup to AWS via Storage Gateway T h r e e O p t i o n s t o w r i t e o n - p r e m i s e s b a c k u p s t o AW S Customer Premises File S3-IA Backup or Application Servers Customer Bucket Volume iSCSI Tape / VTL Storage Gateway S3 Storage Gateway EBS Snapshots S3 Standard Glacier GlacierS3
  • 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Tape Gateway (“VTL”) for backup & recovery • Virtual tape storage in the cloud accessed via gateway • Data compressed in-transit and at-rest • Unlimited archival with 1 PB immediately accessible • 3-5 hour tape retrieval from Amazon Glacier • Supports leading backup applications Media Changer Virtual Tapes stored in Amazon S3 Archived Tapes in Amazon Glacier Backup Server iSCSI Tape Gateway Tape Gateway VM Tape Drive HTTP S Customer Premises Region Virtual tape storage in Amazon S3 and Amazon Glacier with VTL management Local Cache
  • 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. File Gateway for Backup & Recovery • Backup data files stored and retrieved from your S3 buckets • One-to-one mapping from files-to-objects • File metadata object metadata • Bucket access managed by IAM role you own and manage • S3 features available: Lifecycle Policies, versioning, or CRR • Recovery in EC2 with second gateway and backup software Customer Premises File Gateway GlacierS3 Standard S3 Standard– IA HTTPS NFS v3 / v4.1 Backup or App. Server
  • 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway Cloud-backed block storage that can be presented on-premises Snapshots and clones for flexible recoveries Application Server Amazon EBS snapshots Storage Gateway Service Volume Gateway VM Volume Stored in Amazon S3 HTTPSiSCSI Customer Premises Region
  • 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Mode In “Volume Stored” mode a full copy of the volume is stored on-premises and in the cloud Application Server Amazon EBS snapshots Storage Gateway Service Volume Gateway VM Volume Stored in Amazon S3 HTTPSiSCSI Customer Premises Region 100% of volume stored in AWS & on-prem
  • 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Mode Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI
  • 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Mode Amazon EBS snapshots App Server SAN, DAS, or NAS (any storage that can host a virtual disk) Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI Backed by AWS S3
  • 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Mode Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI On-prem writable copy of volume and upload buffer Cloud backed copy of volume
  • 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Mode Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI Cloud based monitoring
  • 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI
  • 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI Client writes to local volume
  • 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI The write is copied to the upload buffer
  • 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI Write is compressed and uploaded to the S3 backed gateway service over HTTPS
  • 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Read Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI
  • 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Stored Read Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region Storage Gateway VM upload buffervolume volume iSCSI 100% of reads come directly from the local volume for low latency
  • 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Mode In “Volume Cached” mode a full copy of the volume is stored in AWS and a portion (hot data) is stored on-premises Application Server Amazon EBS snapshots Storage Gateway Service Volume Stored in Amazon S3 HTTPS iSCS I Customer Premises Region Volume Gateway VM
  • 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Mode In “Volume Cached” mode a full copy of the volume is stored in AWS and a portion (hot data) is stored on-premises Application Server Amazon EBS snapshots Storage Gateway Service Volume Stored in Amazon S3 HTTPS iSCS I Customer Premises Region 100% of volume stored in AWS & on-prem Volume Gateway VM virtual volume cache frequent accessed blocks (reduce onsite storage)
  • 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache volume
  • 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache volume Client sends the write to the gateway, which first populates the local cache
  • 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache volume The write is copied to the upload buffer
  • 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Write Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache volume Write is compressed and uploaded to the S3 backed gateway service over HTTPS
  • 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Read Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache volume
  • 31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Read Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache volume If the block is cached locally, the read comes directly from the gateway’s local cache
  • 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Read Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache volume If the block is not cached locally, the gateway requests the block from the gateway service & populates the local cache
  • 33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – Cached Read Operations Amazon EBS snapshots App Server Amazon CloudWatch Storage Gateway Service Customer Premises Region iSCSI Storage Gateway VM upload buffer volume cache The gateway returns the read request using the newly cached block volume
  • 34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway + EBS Snapshots
  • 35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Volume Gateway – EBS Snapshots Snapshots enable the ability to create point in time backups of a volume whilst only consuming incremental capacity Snapshot are initiated via API call or scheduled Application Server Amazon EBS snapshots Storage Gateway Service Volume Gateway VM Volume Stored in Amazon S3 HTTPSiSCSI Customer Premises Region
  • 36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Snapshot Creation App Server Storage Gateway Service Customer Premises Region Storage Gateway VM volume iSCSI volume A B A Amazon EBS snapshots
  • 37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Snapshot Creation Amazon EBS snapshots App Server Storage Gateway Service Customer Premises Region Storage Gateway VM volume iSCSI volume A B A When a snapshot is created gateway flushes any outstanding writes to the cloud B
  • 38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A B Snapshot Creation App Server Storage Gateway Service Customer Premises Region Storage Gateway VM volume iSCSI volume A B A B All consumed blocks that make up the volume are backed up to an EBS snapshot snap1
  • 39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Snapshot Creation App Server Storage Gateway Service Customer Premises Region Storage Gateway VM volume iSCSI volume A B A B C C New data continues to be written to the volume A B snap1
  • 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Snapshot Creation App Server Storage Gateway Service Customer Premises Region Storage Gateway VM volume iSCSI volume A B A B C C When another snapshot is created only incremental data is backed up A B C snap1 snap2
  • 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Snapshot Creation App Server Storage Gateway Service Customer Premises Region Storage Gateway VM volume iSCSI volume A B A B C C When another snapshot is created only incremental data is backed up D D A B C snap1 snap2
  • 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Snapshot Creation App Server Storage Gateway Service Customer Premises Region Storage Gateway VM volume iSCSI volume A B A B A B C C When another snapshot is created only incremental data is backed up C D D D snap1 snap2 snap3
  • 43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Recovery with Snapshots & Clones
  • 44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Flexible Recovery Targets with Snapshots & Clones Storage Gateway Service Customer 2nd Site EC2 Customer VPC Customer Data Center EBSGateway Volume
  • 45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Using EBS Snapshots for recovery
  • 46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Restores with an EBS snapshot App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volumeA B A B C C volume A B C D D D snap1 snap2 snap3
  • 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Restores with an EBS Snapshot – on-premises App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volumeA B A B C C volume A B C D D D snap1 snap2 snap3 volumeA B C 1. Restore a GW volume from a past point in time
  • 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Restores with an EBS Snapshots – on-premises App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volumeA B A B C C volume A B C D D D snap1 snap2 snap3 A B C volumeA B C 1. Restore a GW volume from a past point in time
  • 49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Recovery to Cloud with Snapshots to EBS/EC2 App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volumeA B A B C C volume A B C D D D snap1 snap2 snap3 A B C volumeA B C 1. Restore a GW volume from a past point in time AZ1 EBS EC2A B C D 2. Restore to EC2
  • 50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Copying EBS snapshot to a new region App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volumeA B A B C C volume A B C D D D snap1 snap2 snap3 A B C volumeA B C 1. Restore a GW volume from a past point in time AZ1 EBS EC2A B C D 2. Restore to EC2 3. Copy volume data from one AWS Region to another Region #2 A B snap1
  • 51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Using clones for on-prem. recovery
  • 52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Gateway Volumes – How it works App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volume A B C D volumeA B C D
  • 53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Gateway Volumes – How it works App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volume A B C D volumeA B C D clone1A B C D
  • 54. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Volumes – Recover to same Gateway App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volume A B C D volumeA B C D clone1A B C D • Cloning test data • Same site recovery
  • 55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Volumes – Recover to same Gateway App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volume A B C D volumeA B C D clone1A B C D clone1 A B C D • Cloning test data • Same site recovery
  • 56. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Gateway Volumes App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volume A B C D volumeA B C D clone1A B C D clone1 A B C D • Cloning test data • Disaster recovery • Same site recovery
  • 57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Gateway Volumes – Disaster Recovery App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volume A B C D volumeA B C D clone1A B C D clone1 A B C D clone2A B C D • Cloning test data • Disaster recovery • Same site recovery
  • 58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Volumes – DR to 2nd Site App Server Storage Gateway Service Customer Premises Region Storage Gateway VM iSCS I volume A B C D volumeA B C D clone1A B C D clone1 A B C D App Server Customer Premises Storage Gateway VM iSCS I clone2A B C D • Cloning test data • Disaster recovery • Same site recovery
  • 59. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloning Volumes – DR to 2nd Site Storage Gateway Service Customer Premises Region Storage Gateway VM volume A B C D volumeA B C D clone1A B C D clone1 A B C D App Server Customer Premises Storage Gateway VM iSCS I clone2 A B C D clone2A B C D • Cloning test data • Disaster recovery • Same site recovery App Server iSCS I
  • 60. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DEMO!
  • 61. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster Recovery Demo App Server Storage Gateway Service San Francisco us-east-1 Storage Gateway VM iSCS I volume A B C D volumeA B C D App Server Boston Storage Gateway VM iSCS I
  • 62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster Recovery Demo App Server Storage Gateway Service San Francisco us-east-1 Storage Gateway VM iSCS I volume A B C D volumeA B C D App Server Boston Storage Gateway VM iSCS I
  • 63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster Recovery Demo App Server Storage Gateway Service San Francisco us-east-1 Storage Gateway VM iSCS I volume A B C D volumeA B C D DR_cloneA B C D App Server Boston Storage Gateway VM iSCS I
  • 64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster Recovery Demo App Server Storage Gateway Service San Francisco us-east-1 Storage Gateway VM iSCS I volume A B C D volumeA B C D DR_cloneA B C D App Server Boston Storage Gateway VM iSCS I DR_Clone A B C D
  • 65. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. THANK YOU! Learn more at: aws.amazon.com/storagegateway