1.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sajee Mathew
Principal Solutions Architect, AWS
SRV205
An Overview of AWS Services for Data
Storage and Migration

2.
163 ZB by 2025
- IDC
This 10x the amount of data generated in 2016.
1 Zettabyte = 1021 = 1 000 000 000 000 000 000 000 bytes
Data growth is not slowing

3.
Data in the cloud has gravity
Deliver new insights
(data lakes, analytics)
Accelerate innovation
(active archive, IoT,
Artificial Intelligence)
Realize benefits
(cost, management, scale)
Build or migrate
an application
DATA

4.
AWS storage customers

5.
Compliance
Industry
certifications
Lockable with audit
trails
Secure
Enterprise
Applications
Easier lift-and-shift
migrations
Integrated with
major vendors
Fully managed
infrastructure
Active
Archive
Media workflows
Tape replacement
Public Sector, FinServ,
Healthcare/Life
Sciences
Databases &
Analytics
Tailored database or
Hadoop workloads
Bespoke database
lift-and-shift projects
Backup &
Restore
Non-disruptive
Easy place to start
Integrated w/all
major vendors
Data Lakes
& IoT
400% faster queries
Built for
streaming data
Optional data
visualization
Common storage workloads on AWS

6.
The best reliability and
largest scale
The most complete
portfolio
The most data
movement choices
The most comprehensive
support and consulting
More than twice
the partners
The most secure,
compliant, and auditable
Why AWS Storage?

7.
- Gartner’s Magic Quadrant for Public Cloud Storage Services, Worldwide
Raj Bala, Julia Palmer, July 31, 2018
“AWS is one of the few capable providers that can
provide end-to-end solutions from edge and on-
premises enterprise data centers to public cloud
storage services without making security trade-offs.
AWS can can deliver such solutions in an integrated
experience with an overlay consisting of robust
security and performance features.”
2018 Gartner Magic Quadrant

8.
Data movement Data security
and management
File
Storage
Block
Storage
Object
Storage
Archival
Storage
Encryption
Access Controls
Monitoring and Metrics
Audit Trails
Automation
Serverless Computing
Data Discovery and
Protection
Data Visualization
Physical Appliances
Hybrid Storage
Private Networks
File Data
WAN Acceleration
Third-party Applications
Streaming Data
Complete set of building blocks

9.
Data movement Data security
and management
AWS storage services
AWS Snow Family
AWS Storage Gateway
AWS Direct Connect
Amazon EFS File Sync
Amazon S3 Transfer
Acceleration
Third-party
Applications
Amazon Kinesis Firehose
AWS KMS
AWS IAM
Amazon CloudWatch
AWS CloudTrail
AWS CloudFormation
AWS Lambda
Amazon Macie
Amazon QuickSight
Amazon
EFS
Amazon
EBS
Amazon
S3
Amazon
Glacier

10.
Getting started moving data
A private
connection
between your
data center,
office, or
colocation
environment and
AWS
AWS
Snow Family
(Snowball, Snowball
Edge, and
Snowmobile) Secure,
physical transport
appliances that can
pre-process and
move up to exabytes
of data into and out
of AWS
AWS
Storage
Gateways
Hybrid storage
that seamlessly
connects on-
premises
applications to
AWS storage.
Ideal for backup,
DR, bursting,
tiering, or
migration
Amazon
Kinesis
Firehose
Capture, trans-
form, & load
streaming data
into Amazon S3
for use with
Amazon business
intelligence and
analytics tools
Up to 5x faster file
transfers than
open-source tools.
Ideal for migrating
data into Amazon
EFS or moving
between cloud file
systems
Amazon
S3 Transfer
Acceleration
Up to 300% faster
transfers into and
out of Amazon S3.
Ideal when
working with long
geographic
distances
APN
Competency
Partners
Integrations
between third-
party vendors and
AWS services.
Ideal for
leveraging existing
software licenses
and skills
Amazon
EFS File Sync
Amazon
Direct
Connect

11.
Amazon S3
Analyze
Store
Collect
Built for
• More than a decade of experience and continuous innovation
• Only AWS has the infrastructure to place storage near workloads
• Only AWS gives storage admins granular object controls
• Only AWS moves data in so many varied ways
• Only AWS storage can help address CISO concerns
• Only AWS can analyze and recommend cost savings
• Only AWS can accelerate application performance up to 400%
• Only AWS offers inventory and visualization across entire datasets
• Only AWS supports queries across structured and unstructured data
Backup &
restore
Data lakes &
analytics
Cloud-native
applications

12.
“…AWS has made considerable efforts to make S3 smarter for analytics workloads
by building query capabilities into the storage layer itself.”
- Gartner’s Critical Capabilities for Public Cloud Storage Services, Worldwide
Raj Bala, Julie Palmer, August 27, 2018
Amazon S3 holds trillions of objects and regularly peaks at millions
of requests per second.
TIME
OBJECTS
Storage with analytics capabilities

13.
Amazon Glacier
Cost-effective
Secure
Durable
• Certifications supporting nearly any regulatory compliance program
• Locking, encryption, audit and alerting tools to prevent tampering
• Built on the most reliable global infrastructure
• Withstands multiple facility failures
• Replication options across global regions
• Designed for archives and backup
• Expedited retrievals in minutes, bulk retrievals in hours
• Opens archives to analytics applications
Built for Active
archive
Tape
replacement
Regulatory
compliance

14.
Designed for
99.999999999% durability
Glacier
S3
Standard
S3 - IA
OR
99.999% durability
99.99% durability
Traditional model with two copies on one site
Traditional model with copies on two sites
S3 & Glacier data durability
S3 One Zone
- IA

15.
“Zones”
Or worse, this:
AWS Region
This: Not this:
“Region”
Availability Zone
Availability Zone
Availability Zone
Object Storage Availability & Durability

16.
Object storage classes
S3 Standard GlacierS3 Standard -
Infrequent Access
Active data
Milliseconds
$0.023/GB/mo
Archive data
Minutes to hours
$0.004/GB/mo
Infrequently accessed data
Milliseconds
$0.0125/GB/mo
Automated Lifecycle Policies
S3 One Zone -
Infrequent Access
Infrequently accessed data
in just one AWS Region
Milliseconds
$0.01/GB/mo

17.
AWS Storage Gateway family
Cost-effective
Hybrid
Cloud
Integrated
• Connects on-premises applications to AWS storage services
• Low-latency access with local caching and cloud scalability
• Optimized, fully managed data transfer between appliance and AWS
• Standard storage protocols for file, block & tape data enable adoption
• Stores data in Amazon S3, Amazon Glacier and EBS Snapshots
• AWS-native: Simplifying management, monitoring and automation
• Reduces on-premises storage and backup systems and management
• Unlocks cloud economics for data storage, processing and recovery
Built for Backup &
Archiving
File Storage for
Apps & Content
Hybrid
workloads

18.
Canada’s largest biotech firm
Data sovereignty required local hot files
and tape archives in each of 10 global offices
• AWS Volume Gateway eliminated 50-hour
backup windows and tape archive systems
• Cut on-premises storage CAPEX 40%; dropped
RTO from 48 hours to 10 minutes
• Meets cloud strategy while retaining local
ownership and data sovereignty
• Enabled data center exit in next 12 months
“It made no sense to keep buying
big disk siloes, especially as we opened up
new global offices, and now we can
recover in the cloud from a snapshot if we
ever had to.”
- Adam Leggett
IT Manager
Hybrid Cloud Storage & Restore

19.
“The AWS solution with Storage Gateway helps us
reduce backend service costs; our estimated costs for
this new hybrid cloud service are one tenth of the
prior on-premises infrastructure costs. As we pass
those savings on to our customers, we become
significantly more competitive in the energy-
exploration and production market.”
- William Rivera
Manager Of Global Cloud Operations
Landmark provides technology solutions for oil & gas
exploration and production
Clients use Landmark to store & manage TBs of data
for energy discovery research
• Initial bulk data transfer to Amazon S3 done with
AWS Snowball
• Created hybrid storage infrastructure with AWS
Storage Gateway – File Gateway
• Automated operations on the stored data with
AWS Lambda functions
• Able to query and organize data to according to
specific file structure
Hybrid Cloud Storage & Active Archive

20.
Halliburton Landmark Use Case
Amazon
Glacier
Amazon S3
Standard
S3-Infrequent
Access
File Gateway
PetroBank
Application
ServersLTO
NAS
AWS Direct
Connect
Halliburton data center
1
2
Use AWS Snowball to ship data from on-premises offline archives1
2 Online access to all data through AWS Storage Gateway - File Gateway
Minimal on-premises storage reduces cost
Time-to-date by reduced by days or weeks
AWS Snowball

21.
Amazon EBS
Performant
Persistent
Reliable
• Dedicated, detachable volumes for EC2 instances
• Helps customers manage compute and storage separately
• Highly secure Multi-AZ design
• Built-in backup options
• Performance options to fit most workloads
• Optimized for latency, throughput, or cost
• Elastic volumes expand capacity on the fly
Built for
Hadoop/Amazon EMR,
relational and NoSQL databases,
log processing, and data warehousing

22.
Amazon EFS
Scalable
Simple
Elastic
Web serving, content management, media and
entertainment workflows, home directories, container
storage, big data, and analytics
• Share files between EC2 instances in minutes
• True file system interface with file system semantics
• Fully managed – no capacity planning surprises
• Pay-as-you-go consumption and pricing
• Automatically grows and shrinks
• Much lower TCO than DIY or third-party workarounds
• Consistent performance even as data grows
Built for

23.
Prior to Amazon EFS, we experienced timeouts for
up to 10% of uploads over 100 MB. Now, all of the
JFrog build artifacts (from infrastructure-as-code
components to Docker images) are in one place,
and we’ve increased large file transfer speeds by
38%.”
- Suresh Prem, Murty Chitti,
and Rajesh Sivaraman
System Engineers
Enterprise applications
Builds 3d digital maps relying on 28 TB of
waypoints generated daily
Unreliable on-premises repository and
high maintenance DIY cloud version
• Amazon EFS dropped infrastructure provisioning
time from 90 days to 7
• Now handling 800,000 daily file transfers up to
38% faster with zero failures
• Seamless JFrog workflow integration
• Gained high availability at no extra cost
• Also tiering JFrog backups into Amazon S3 and
Amazon Glacier

24.
AWS Snow family
Cost-effective
Secure
Portable
• Certifications supporting nearly any regulatory compliance program
• Encryption, audit and alerting tools to flag tampering
• Ruggedized for capturing data in remote locations
• Optional computing power (Snowball Edge models)
• No networking modifications required
• Automatic return shipping labels
• Integrates with existing protocols and workflows
Built for Populating
Data Lakes
Media
Migration
Edge computing

25.
Compliance
Industry
certifications
Lockable with audit
trails
Secure
Enterprise
Applications
Easier lift-and-shift
migrations
Integrated with
major vendors
Fully managed
infrastructure
Active
Archive
Media workflows
Tape replacement
Public Sector, FinServ,
Healthcare/Life
Sciences
Databases &
Analytics
Tailored database or
Hadoop workloads
Bespoke database
lift-and-shift projects
Backup &
Restore
Non-disruptive
Easy place to start
Integrated w/all
major vendors
Data Lakes
& IoT
400% faster queries
Built for
streaming data
Optional data
visualization
Let’s get started: which is top of mind?

26.
Helping organizations
adopt AWS through:
- Digital courses
- Classroom training
- Certification exams
Operation
AWS Training
Support packages for
environments that are:
- Experimental
- Production
- Business-critical
Escalation
AWS Support Plans
Supplemental, specialized
experience, & skills:
- APN Consulting Partners
- AWS ProServ
- AWS Managed Services
Customization
AWS Professional Services
Experienced training, support & consulting

27.
Enterprise ApplicationsDisaster Recovery Analytics
Primary Storage Backup & Restore Archive
Complete partner list at https://aws.amazon.com/backup-recovery/partner-solutions/
Twice as many partnerships

28.
Let’s pick a workload and get started!

29.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.