This sessions is for architects and storage admins seeking simple and non-disruptive ways to adopt cloud platforms in their organizations. You will learn how to deliver lower costs and greater scale with nearly seamless integration into your existing Backup ad Recovery processes to achieve fast, simple wins that demonstrate the scale and flexibility of cloud services for storage. Services mentioned: S3, Glacier, Snowball, 3rd party partners, Storage Gateway, and cloud data migration services.

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Isaiah Weiner, Sr. Mgr. Solutions Architecture
December 1, 2016
Getting Started with the Hybrid Cloud:
Enterprise Backup and Recovery
ENT211

2. Why hybrid cloud for backup and restore?
- Simple way to start using the cloud
- Addresses the cost and scale problems of data retention
- Capitalizes on your investments
- Third parties with cloud connectors
- Cloud gateway: local performance with cloud scale
- Takes it to the next level
- Migrate old backups from on-premises ($$$$) to the cloud ($).
- Eliminate tapes, trucks, trucks with tapes. Be green!

3. Batches and Streams
AWS Direct
Connect
AWS Snowball,
AWS Snowball
Edge, AWS
Snowmobile
3rd-Party
Connectors
Transfer
Acceleration
Storage
Gateway
Amazon Kinesis
Firehose
File
Amazon EFS
Block
Amazon EBS
(persistent)
Object
Amazon GlacierAmazon S3 Amazon EC2
Instance Store
(ephemeral)

4. Backup and recovery before the cloud
Application
servers
Local disk
Media
server
Tape storage
Data bunker

5. Backup and recovery to the cloud
Amazon S3
Amazon
Glacier
Direct
Connect
Internet
Amazon S3-IA
Application
servers
Cloud gateway
Local disk
Media
server
Cloud gateway
Application
servers
Cloud connector
Local disk
Media server
with cloud
connector

6. Why is the data moving?

7. Why is the data moving?

8. What should I use, and when?
Economics Easy to use Reduce risk Agility, scale
 Pay as you go
 No upfront investment
 No commitment
 No risky capacity
planning
 Self-service
administration
 SDKs for simple
integration
 Durable and secure
 Avoid risks of physical
media handling
 Reduce time to market
 Focus on your business,
not your infrastructure
Amazon S3
Durable object storage
for all types of data
Amazon EBS
Block storage for use
with Amazon EC2
Amazon Glacier
Archival storage
for infrequently
accessed data
Amazon EFS
File storage for use
with Amazon EC2

9. AWS Storage Gateway hybrid storage solutions
Enables using standard storage protocols to access AWS storage services
Customer Premises
Storage
Gateway
Amazon EBS
snapshots
Amazon
S3
Amazon Glacier
AWS Identity and
Access Management
(IAM)
AWS KMS
AWS
CloudTrail
Amazon
CloudWatch
Enterprise
storage
Devices
Application
servers

10. File Gateway
On-premises file storage maintained as objects in Amazon S3
Customer Premises
File
Gateway
Data stored and retrieved from your S3 buckets
One-to-one mapping from files-to-objects
File metadata stored in object metadata
Bucket access managed by IAM role that you own and manage
Use S3 Lifecycle Policies, versioning, or CRR to manage data
Amazon
Glacier
S3
Standard
S3
Standard
–
Infrequent
Access
HTTPS
NFS
v3 / v4.1
Application
Server

11. NFS AWS Storage
Gateway VM
TARGET
Client
Users
NFS
CLIENT
Application
servers
NFS
CLIENT
NFS
Amazon S3
Customer data center
HTTPS
File Gateway Architecture
Application
servers
S3
CLIENT
S3
CLIENT

12. Application
Server
Volume Gateway
On-premises volume storage backed by Amazon S3 with EBS snapshots
Block storage in S3 accessed via the volume gateway
Compression of data in transit and at rest
Backup on-premises volumes to EBS snapshots
Create on-premises volumes from EBS snapshots
Up to 1 PB of total volume storage per gateway
Amazon
EBS
snapshots
Storage Gateway
bucket in
Amazon S3
Customer Premises
Volume
Gateway
iSCSI HTTPS

13. iSCSI AWS Storage
Gateway VM
TARGET
Client
Users
INITIATOR
Application
servers
INITIATOR
iSCSI
Amazon EBS
snapshots
AWS
Storage
Gateway service
Customer data center
HTTPS
Volume
storage backed
by Amazon S3
Volume Gateway Architecture

14. Tape Gateway
Virtual tape storage in Amazon S3 and Glacier with VTL management
Virtual tape storage in S3 and Glacier accessed via tape gateway
Compression of data in transit and at rest
Up to 1 PB total tape storage per gateway, unlimited archive capacity
Supports leading backup applications:
Archived tapes
stored in
Amazon Glacier
MEDIA
CHANGER
TAPE
DRIVE
Customer Premises
Tape
Gateway
Virtual tapes
stored in
Amazon S3
Backup
Server
HTTPSiSCSI

15. AWS Storage
Gateway VM
MEDIA
CHANGER
Backup
Server
INITIATOR
Virtual tape
shelf backed by
Amazon Glacier
AWS
Storage
Gateway service
Customer data center
HTTPS
Gateway-VTL
storage backed
by Amazon S3
TAPE
DRIVE
VTS
Virtual Tape Library Architecture

16. Cloud gateway: NetApp AltaVault
Common backup applications integrated with AltaVault:Solve backup and archive headaches with cloud-integrated
storage:
 90% reduction in time, cost, and data volumes
 Shrink recovery times from days to minutes
 85% of backup and software providers supported
On Premises
Cloud-integrated
storage appliance
NetApp AltaVault
FAS
E-Series
Non-NetApp
storage
Seamlessly integrates into
existing storage and backup
software environment
Deduplicates, compresses,
and encrypts
Caches recent backups
locally, vaults older copies to
the cloud
 NetApp SnapProtect
 Arcserve
 Commvault Simpana
 EMC NetWorker
 HP Data Protector
 IBM Tivoli
Storage Manager
 Symantec Backup
Exec
 Symantec (Veritas)
NetBackup
 Veeam
 Microsoft SQL
Server
 Oracle RMAN
AltaVault also available on Marketplace
to protect cloud-native workloads
Store data in the public or
private cloud of choice
Amazon S3
Amazon Glacier
Amazon S3-IA

17. Backup agent
Users
Master
server
MediaAgent
Amazon S3
Customer data center
AWS-ENABLED COMMCELL ARCHITECTURE
Cloud connectors: Commvault Simpana
MediaAgent
Cloud
storage
library
Amazon Glacier

18. Backup agent
Users
Master
server
Media
server
Amazon S3
Customer data center
AWS-ENABLED NETBACKUP ARCHITECTURE
Cloud connectors: Veritas NetBackup
Media
server
Cloud
storage
disk pool

19. Backup agent
Users
Master
server
Media
server
Amazon S3
Customer data center
AWS-ENABLED NETBACKUP ARCHITECTURE + AMAZON GLACIER SUPPORT
Cloud connectors: NetBackup + StorReduce
Media
server
Cloud
storage
disk pool
Amazon Glacier
StorReduce
cluster

20. MediaAgent
Amazon S3
Customer VPC
AWS-ENABLED COMMCELL ARCHITECTURE IN EC2
Cloud connectors: Commvault Simpana
MediaAgent
Cloud
storage
library
Amazon Glacier
EC2
instance
EC2
instance
Master
server

21. Media
server
Amazon S3
Customer VPC
AWS-ENABLED NETBACKUP ARCHITECTURE IN EC2
Cloud connectors: Veritas NetBackup
Media
server
Cloud
storage
disk pool
EC2
instance
EC2
instance
Master
server

22. Media
server
Amazon S3
Customer VPC
AWS-ENABLED NETBACKUP ARCHITECTURE IN EC2
Cloud connectors: Veritas NetBackup
Media
server
Cloud
storage
disk pool
Amazon Glacier
EC2
instance
EC2
instance
Master
server
StorReduce
cluster

23. Backup agent
Users
Master
server
Media
server
Amazon S3
Customer data center
AWS-ENABLED NETBACKUP ARCHITECTURE
Cloud connectors: restore options
Media
server
Cloud
connector
Media
server
Cloud
connector
Restored
EC2
instance

24. Active archive

25. What is AWS Snowball? Petabyte-scale data transport
E Ink shipping
label
Ruggedized case
“8.5G impact”
All data encrypted
end-to-end
Rain- and dust-
resistant
Tamper-resistant
case and
electronics
80 TB
10GE network

26. How it works

27. How fast is AWS Snowball?
 Less than 2 days to fill 5 Snowballs, 400 TB each, in parallel. Back to
AWS in less than 1 week, including shipping.
 Number of days to transfer 400 TB via the Internet at typical utilizations:
Internet Connection Speed
Utilization 1 Gbps 500 Mbps 300 Mbps 150 Mbps
25% 152 304 505 1011
50% 74 152 252 505
75% 51 100 168 337

28. When to use AWS Snowball
Cloud
migration
Disaster
recovery
Data center
decommission
Content
distribution

29. S3 Transfer Acceleration: up to 300% faster, one click
Automatically changes the DNS name for the bucket (Amazon Route 53)
Bucket traffic moves to Amazon’s CDN network (Amazon CloudFront)
1 2

30. AWS Snowball S3 Transfer Acceleration
When to use AWS Snowball vs. S3 Transfer Acceleration
 Supports import and export
 Currently in US West (Oregon),
US East (N. Virginia)
 Coming to US West (N.
California), GovCloud (US), Asia
Pacific (Sydney), and EU
(Ireland) regions; expected by
end of 2016
 Supports large data transfers,
from TBs to PBs
Supports accelerating transfers
into and out of S3, using AWS
edge locations:
 Checkbox WAN acceleration
 Up to 6 times faster than regular
networks
 Faster or free!
 55 AWS edge locations globally

31. Use Amazon Glacier
for lowest-cost, durable cold
storage of archival data
Use Amazon S3
for reliable, durable
primary storage
Use Amazon S3
Infrequent Access
Storage
for secondary backups
at a lower cost
S3-IA
Tiering on AWS: optimize your storage spend

32. Key prefix “logs/”
Transition objects to Amazon Glacier 30 days after creation
Delete 365 days after creation date
<LifecycleConfiguration>
<Rule>
<ID>archive-in-30-days</ID>
<Prefix>logs/</Prefix>
<Status>Enabled</Status>
<Transition>
<Days>30</Days>
<StorageClass>GLACIER</StorageClass>
</Transition>
<Expiration>
<Days>365</Days>
</Expiration>
</Rule>
</LifecycleConfiguration
S3 lifecycle policies

34. Related Sessions
STG213: Hybrid Cloud Storage Made Simple: The New
Storage Gateway File Interface and Customer Use Cases
PTS401: Using S3 Storage to Reduce Backup Costs on
AWS
STG209: Strategic Planning for Long-Term Data Archiving
with Amazon Glacier

35. Thank you!

36. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Who: Lead Software Development Engineers, Architects, and Technical PMs
Where: Storage Booth Walk-up Bar
When: Exhibit hours (Tues 5-7 PM, Wed & Thurs 10:30 AM-6:00 PM)
What: Architecture best practices, code reviews, feature requests
Storage “Office Hours”
Meet the People Who Build AWS Storage

37. Remember to complete
your evaluations!