1.
OIL & G S INDUSTRY DAY

2.
Cloud Data Migration
Direct ConnectSnow* data
transport family
3rd Party
Connectors
Transfer
Acceleration
Storage
Gateway
Kinesis Firehose
The AWS Storage Portfolio
Object
Amazon GlacierAmazon S3
Block
Amazon EBS
(persistent)
Amazon EC2
Instance Store
(ephemeral)
File
Amazon EFS

3.
AWS Data Transfer Services
• Moving large batches offline
• Edge computing
• Augmenting on-prem with cloud
• Using a dedicated network
• Integrating existing software
• Moving over long distances
• Streaming data
• AWS Snowball & Snowmobile
• AWS Snowball Edge
• AWS Storage Gateway
• AWS Direct Connect
• 3rd party connectors
• S3 Transfer Acceleration
• Amazon Kinesis

4.
The Snow Family:
large batches or “edge” scenarios

5.
AWS Snow Family
Snowball Snowball Edge Snowmobile
Petabyte-scale data
migration
Compute & Storage for
Hybrid/Edge workloads
Exabyte-scale data
migration

6.
AWS Snowball
Petabyte-scale data transport
• Rugged 8.5G impact case
• Rain and dust resistant
• Data encryption end-to-end
• 80 TB capacity/10G network
E-ink shipping
label

7.
AWS Snowball Edge
Petabyte-scale hybrid device with onboard compute and storage
• 100 TB local storage
• Local compute equivalent to an
Amazon EC2 m4.4xlarge instance
• 10GBase-T, 10/25Gb SFP28, and
40Gb QSFP+ copper, and optical
networking
• Ruggedized and rack-mountable

8.
How Snowball moves data
Create
a job
Connect the
Snowball
Copy data to
the Snowball
Your data moved
to Amazon S3
In transit to you Delivered to you Delivered to AWS At AWS
Job created Job completed

9.
When to use AWS Snowball
Cloud
Migration
Disaster
Recovery
Datacenter
Decommission
Content
Distribution

10.
Customer: Scripps Networks Interactive
Problem Statement:
• Need storage platform to manage active archive content
• Existing content repository too large to migrate via available
network-based ingest methods
Use of AWS:
• S3 and Snowball for massively scalable ingest
• S3 for storage, Glacier for content archive
• Snowball to securely transport existing media content from on-
premises storage and tape vault
Business Benefits:
• Petabyte-scale data transport without increased network costs
• Massive scalability and elasticity
• Lower TCO for active archive storage
Active archive transport and archival for digital content provider

11.
EFS with DirectConnect (DX):
Working over a dedicated network

12.
Access your EFS file system via AWS Direct Connect
Direct Connect EFS in your Amazon VPCOn-premises Servers

13.
Three scenarios for working with file data across
on-premises environments and EFS
Bursting
Migration
 Move entire data set permanently to EFS
 Access the data from applications running on EC2 instances
 Move data set temporarily to EFS
 Access the data from applications running on EC2 instances
 Move data back on premises once processing finishes
Backup and Disaster
Recovery
 Maintain copy of entire data set on EFS
 Restore the data to on premises storage or (for DR) access the
data from failed-over applications running on EC2 instances

14.
Amazon Kinesis:
streaming data

15.
• Kinesis Streams
• Stores data as a
continuous replayable
stream for custom
applications
• Kinesis Firehose
• Load streaming data into
Amazon S3, Amazon
Redshift, and Amazon
Elasticsearch Service
• Kinesis Analytics
• Analyze data streams
using standard SQL
queries
Amazon Kinesis

16.
Kinesis Firehose

17.
S3 Transfer Acceleration:
moving large files over long distances

18.
Amazon S3 transfer acceleration
S3 Bucket
AWS Edge
Location
Uploader
Optimized
Throughput!
Change your endpoint, not your code
Leverages 59 global edge locations
Optimized protocols
No firewall exceptions
No client software required

19.
Rio De Janeiro Warsaw New York Atlanta Madrid Virginia Melbourne Paris Los Angeles Seattle Tokyo Singapore
Time[hrs]
500 GB upload from these edge locations to a bucket in Singapore
Public Internet
How fast is S3 Transfer Acceleration?
S3 Transfer Acceleration
On average, we have seen 171%
improvement over regular S3 when
uploading over long distances

20.
Bursting
Migration
Tiering
Offline
Summary: Hybrid Cloud Storage Services
Backup
Online
Snowball,
Snowball Edge,
Snowmobile
Storage Gateway,
EFS over DX
Storage Gateway,
S3 Transfer Acceleration
Snowball Edge
Snowball
Storage Gateway,
3rd Parties, EFS over DX
Storage Gateway

21.
Partner Tiering & Migration Solutions:
working with what’s already there

22.
Storage Partner Solutions
Technology Solutions vetted by the AWS Storage Competency Program
aws.amazon.com/backup-recovery/partner-solutions/ Note: Represents a sample of storage partners
Note: Dell-EMC, IBM and Veritas have solutions and are working towards competency requirements
Backup and RecoveryPrimary Storage Archive BCDR
Solutions that leverage file, block, object,
and streamed data formats as an
extension to on-premises storage
Solutions that leverage Amazon S3 for
durable data backup
Solutions that leverage Amazon Glacier
for durable and cost-effective long-term
data backup
Solutions that utilize AWS to enable
recovery strategies focused on RTO
and RPO requirements

23.
Storage Gateway:
augmenting existing on-premises storage with AWS

24.
Storage Gateway hybrid storage solutions
Use standard storage protocols to access AWS storage services
AWS Storage
Gateway
Amazon EBS
snapshots
Amazon S3 & S3 –
Infrequent Access
Amazon Glacier
AWS Identity and Access
Management (IAM)
AWSKeyManagement
Service (KMS)
AWS CloudTrail
Amazon
CloudWatch
Files
Volumes
Tapes
On-premises
AWSCloud

25.
Storage Gateway – Files, volumes, and tapes
File gateway NFS (v3 and v4.1) interface
On-premises file storage backed by Amazon S3 objects
Tape gateway iSCSI virtual tape library interface
Virtual tape storage in Amazon S3 and Glacier with VTL management
Volume gateway iSCSI block interface
On-premises block storage backed by S3 with EBS snapshots

26.
Storage Gateway hybrid storage solutions
File
Gateway
GlacierS3 Standard S3-Infrequent
Access
HTTPS
NFS
v3 / v4.1
Application
Server
Customer Premises
Application
Server
Amazon EBS
snapshots
Amazon S3Volume
Gateway
iSCSI HTTPS
Archived Tapes
stored in
Amazon Glacier
MEDIA
CHANGER
TAPE
DRIVE
Tape
Gateway
Virtual Tapes
stored in
Amazon S3
Backup
Server
HTTPSiSCSI

27.
File Gateway Use cases
S3 Bucket
Storage
Gateway
NFS client
RefreshCache
Amazon
EMR
In-cloud workload
S3 Bucket
Amazon
Athena
Amazon
QuickSight
Snowball + Gateway
NFS
client
Storage
Gateway
RefreshCache
Storage
Gateway
S3 BucketRead-only NFS
client
Cross region
replication
File Sharing
Site A
Site B
NFS
client

28.
Datacenter SMB server with SGW backend
SMB hosted onsite, blocks stored durably in S3
Private Datacenter
Storage
Gateway
us-west-2
Amazon
S3
Storage
Gateway
Volume
Windows
Clients
Local Cache
Windows Server
HTTPSiSCSISMB

29.
Southern Oregon University Reduces Costs, Improves Disaster
Recovery by Moving Tape Backups to AWS Cloud
The university backs up to AWS
Storage Gateway, which stores
virtual tapes in Amazon S3 in AWS
US-East, and then archives them
onto Amazon Glacier as a low-cost,
long-term storage tier.
SOU’s magnetic tape libraries often
broke down, and managing physical
tapes required unpredictable
amounts of IT staff time.
Additionally, with tapes stored in
the same earthquake-prone region
as the university, it lacked
geographic separation for disaster-
recovery.
• Easy transition to cloud backup
for 30 TB per month of data
• New bi-coastal disaster recovery
protection
• Eliminated costs of physical
tapes, storage, and IT staff time
• No changes to workflow
required
”
“Using AWS Storage Gateway, we switched from physical to virtual
tape backup simply by dropping the gateway’s virtual appliance
into our existing Veeam workflow. Setting it all up took three
hours, at most. We can now provision virtual tapes on AWS with
the click of a button.”
Jesse Martinich, Network Services Manager, Southern Oregon University
Challenge Solution Benefits
About Southern Oregon University
Serving more than 6,200 students from its
campus in Ashland, Oregon, Southern
Oregon University (SOU) is a four-year public
liberal arts college providing career-focused,
comprehensive educational experiences with
an emphasis on student success and
intellectual growth.
Company: Southern Oregon University
Industry: Education
Country: United States
Employees: 1,100
Website: www2.sou.edu

30.
GlacierS3 Standard S3-Infrequent
Access
File Gateway
Application
Servers
Older hardware due for expensive refresh
Leverage economies of scale and pass-through savings to customers
FGW allows customers to self service loading of data, reducing time-to-data by days or weeks

31.
Application
Servers
LTO Libraries
Storage Arrays

32.
GlacierS3 Standard S3-Infrequent
Access
Application
Servers
LTO Libraries
Storage Arrays

33.
GlacierS3 Standard S3-Infrequent
Access
File Gateway
Application
Servers

34.
GlacierS3 Standard S3-Infrequent
Access
File Gateway
Application
Servers
LTO Libraries
Storage Arrays

35.
Thank You

36.
Application
Server
DR with AWS Storage Gateway + EBS Snapshots
Backup on-premises stored volumes to AWS and recover on AWS or locally
• Volume Gateway deployed as iSCSI block device with ‘stored volumes’
• Schedule EBS snapshots to backup on-premises volumes to AWS
• Recover locally by mounting snaps via the gateway, or mount as EBS volumes
EBS
Snapshots
Customer Premises
Volume
Gateway
iSCSI
Storage
Gateway
services
HTTPS
Customer Environment
Amazon EBS / EC2
EBS
Volumes
EC2
Instances
Stored
Volumes
Local
Storage
Recovered
Volumes

37.
Application
Server
DR with AWS Storage Gateway + EBS Snapshots
Use cached volumes to tier data to AWS and recover on AWS or locally
• Volume Gateway deployed as iSCSI block device with ‘cached volumes’ that
• Schedule EBS snapshots to backup volumes to AWS
• Recover locally by mounting snaps via the gateway, or mount as EBS volumes
EBS Snapshots
Customer Premises
Volume
Gateway
iSCSI
Storage Gateway Services
Customer Environment
Amazon EBS / EC2
EBS
Volumes
EC2
Instances
Local Storage
for cache
Gateway
Volumes
Cached part of
volumes
Recovered
Volume
HTTPS