3. Data
Data in the cloud has gravity
Deliver new
insights
(data lakes, analytics)
Accelerate
innovation
(active archive, IoT,
Artificial Intelligence)
Realize benefits
(cost, management, scale)
Build or migrate
an application
4. AWS storage services
Data movement
OnlineOffline
Data security
and management
Amazon
EFS
Amazon
EBS
Amazon
S3
Amazon
Glacier
AWS KMS
AWS IAM
Amazon CloudWatch
AWS CloudTrail
AWS CloudFormation
AWS Lambda
Amazon Macie
Amazon QuickSight
AWS Snow Family
AWS Storage Gateways
AWS Direct Connect
Amazon EFS File Sync
Amazon S3 Transfer
Acceleration
Third-party
Applications
Amazon Kinesis
Firehose
5. 2017 Gartner Magic Quadrant
- Gartner Magic Quadrant for Public Cloud Storage Services, Worldwide
Raj Bala, Arun Chandrasekaran, John McArthur, July 24, 2017
“AWS sets the boundaries in the market
for public cloud storage services
by which all other vendors operate.”
6. Why AWS Storage?
The best reliability and largest scale The most complete portfolio
The most data movement choices The most comprehensive
support and consulting
More than twice the partners
The most secure,
compliant, and auditable
7. Compliance
Industry
certifications
Lockable with
audit trails
Secure
Enterprise
Applications
Easier lift-and-shift
migrations
Integrated with
major vendors
Fully managed
infrastructure
Active
Archive
Media workflows
Tape replacement
Public Sector,
FinServ,
Healthcare/Life
Sciences
Databases &
Analytics
Tailored database
or Hadoop
workloads
Bespoke database
lift-and-shift
projects
Backup and
Restore
Non-disruptive
Easy place to start
Integrated with all
major vendors
Data Lakes
& IoT
400% faster
queries
Built for
streaming data
Optional data
visualization
Common storage use cases
8. Experienced training, support, and consulting
Helping organizations
adopt AWS through:
- Digital courses
- Classroom training
- Certification exams
Operation:
AWS Training
Support packages for
environments that are:
- Experimental
- Production
- Business-critical
Escalation:
AWS Support Plans
Supplemental, specialized
experience and skills:
- APN Consulting Partners
- AWS ProServe
- AWS Managed Services
Customization:
AWS Professional Services
10. Amazon S3
Analyze
Store
Collect
Built for:
backup and restore, data lakes, analytics, cloud-native applications
• More than a decade of experience and continuous innovation
• Only AWS has the infrastructure to place storage near workloads
• Only AWS gives storage admins granular object controls
• Only AWS moves data in so many varied ways
• Only AWS storage can help address CISO concerns
• Only AWS can analyze and recommend cost savings
• Only AWS can accelerate application performance up to 400%
• Only AWS offers inventory and visualization across entire datasets
• Only AWS supports queries across structured and unstructured data
11. Getting started moving data
AWS
Direct
Connect
A private
connection
between your data
center, office, or
colocation
environment and
AWS
AWS Snow
Family
(Snowball, Snowball
Edge, Snowmobile)
Secure, physical
transport
appliances that
move up to
Exabytes of data
into and out of
AWS
AWS
Storage
Gateways
Hybrid storage that
seamlessly connects
on-premises
applications to AWS
storage. Ideal for
backup, DR,
bursting, tiering, or
migration
Amazon
Kinesis
Firehose
Capture, trans-
form, & load
streaming data
into Amazon S3
for use with
Amazon business
intelligence and
analytics tools
Amazon
EFS File
Sync
Up to 5x faster file
transfers than
open-source tools.
Ideal for migrating
data into Amazon
EFS or moving
between cloud file
systems
Amazon
S3 Transfer
Acceleration
Up to 300%
faster transfers
into and out of
Amazon S3. Ideal
when working
with long
geographic
distances
APN
Competency
Partners
Integrations
between third-party
vendors and AWS
services. Ideal for
leveraging existing
software licenses
and skills
12. Amazon Glacier
Cost-effective
Secure
Durable
Built for:
Active archive, tape replacement, regulatory compliance
• Certifications supporting nearly any regulatory compliance program
• Locking, encryption, audit and alerting tools to prevent tampering
• Built on the most reliable global infrastructure
• Withstands multiple facility failures
• Replication options across global regions
• Designed for archives and backup
• Expedited retrievals in minutes, bulk retrievals in hours
• Opens archives to analytics applications
13. Object storage classes
S3 Standard GlacierS3 Standard -
Infrequent Access
Active data
Milliseconds
$0.023/GB/mo
Archive data
Minutes to Hours
$0.004/GB/mo
Infrequently accessed data
Milliseconds
$0.0125/GB/mo
Automated Lifecycle Policies
14. Amazon Object Storage Availability and Durability
“Zones”
Or worse, this:
AWS Region
This:
Availability Zone
Availability Zone
Availability Zone
Not this:
“Region”
15. Amazon S3 and Glacier Durability
Designed for
99.999999999% durability
GlacierS3 Standard S3 - IA
OR:
99.999% durability
99.99% durability
Traditional model with two copies
on one site
Traditional model with copies on
two sites
16. Amazon EBS
Performant
Persistent
Reliable
Built for:
Hadoop/Amazon Amazon EMR, relational and NoSQL databases, log processing,
and data warehousing
• Dedicated, detachable volumes for EC2 instances
• Helps customers manage compute and storage separately
• Highly secure Multi-AZ design
• Built-in backup options
• Performance options to fit most workloads
• Optimized for latency, throughput, or cost
• Elastic volumes expand capacity on the fly
17. Amazon EFS
Scalable
Simple
Elastic
Built for:
Web serving, content management, media and entertainment workflows, home
directories, container storage, big data, and analytics
• Share files between EC2 instances in minutes
• True file system interface with file system semantics
• Fully managed – no capacity planning surprises
• Pay-as-you-go consumption and pricing
• Automatically grows and shrinks
• Much lower TCO than DIY or third-party workarounds
• Consistent performance even as data grows
19. Compliance
Industry
certifications
Lockable with
audit trails
Secure
Enterprise
Applications
Easier lift-and-shift
migrations
Integrated with
major vendors
Fully managed
infrastructure
Active
Archive
Media workflows
Tape replacement
Public Sector,
FinServ,
Healthcare/Life
Sciences
Databases &
Analytics
Tailored database
or Hadoop
workloads
Bespoke database
lift-and-shift
projects
Backup and
Restore
Non-disruptive
Easy place to start
Integrated with all
major vendors
Data Lakes
& IoT
400% faster
queries
Built for
streaming data
Optional data
visualization
Let’s get started: which is top of mind?
23. Canada’s largest biotech firm
Data sovereignty required local hot files
and tape archives in each of 10 global offices
• AWS Volume Gateway eliminated 50-hour
backup windows and tape archive systems
• Cut on-premises storage CAPEX 40%;
dropped RTO from 48 hours to 10 minutes
• Meets cloud strategy while retaining local
ownership and data sovereignty
• Enabled data center exit in next 12 months
“It made no sense to keep buying
big disk siloes, especially as we
opened up new global offices, and
now we can recover in the cloud from
a snapshot if we ever had to.”
- Adam Leggett
IT manager
Backup and restore
24. Enterprise applications
Builds 3d digital maps relying on 28 TB of
waypoints generated daily
Unreliable on-premises repository and
high maintenance DIY cloud version
• Amazon EFS dropped infrastructure provisioning
time from 90 days to 7
• Now handling 800,000 daily file transfers up to
38% faster with zero failures
• Seamless JFrog workflow integration
• Gained high availability at no extra cost
• Also tiering JFrog backups into Amazon S3 and
Amazon Glacier
Prior to Amazon EFS, we experienced
timeouts for up to 10% of uploads over
100 MB. Now, all of the JFrog build
artifacts (from infrastructure-as-code
components to Docker images) are in one
place, and we’ve increased large file
transfer speeds by 38%.”
- Suresh Prem, Murty Chitti,
and Rajesh Sivaraman
System engineers
30. Security
Performance
Monitoring & Reporting
Run Workloads in Compliance
Reliable and Tunable Performance
Effective Backup and DR Procedures
What’s going on? Insights?
Cost Control
Pillars of CCH Tagetik Cloud
Build upon
32. CCH Tagetik Cloud: Security & Compliance
Certifications & Frameworks
… don’t reinvent the wheel
Build services in Compliance
33. Dance like nobody is watching. Encrypt like EVERYONE is.
Encryption
Werner Vogels (CTO AWS)
34. CCH Tagetik Cloud: Encryption at all levels
Dance like no one is watching. Encrypt like EVERYONE is.
Encrypted Data in Flight
All services are ever supplied in HTTPS / TLS & Encrypted Channels
Encrypted Data in Database
As per GDPR compliance sensitive data needs to be encrypted
Encrypted Data at Rest
In OS Encryption
EBS / S3 / Glacier encryption
35. CCH Tagetik Cloud: Storage in Compliance
Dance like no one is watching. Encrypt like EVERYONE is.
AWS KMS
bucket
Amazon EBS
volume
snapshot AMI
S3
Easy to migrate to a full encrypted data at rest:
Available by default and cheap
No performance impact
Built-in key management solution (AWS
KMS, AWS CloudHSM)
Create value for the end customer:
Automation + KMS = BYOK
+ Amazon RDS, Amazon Redshift, AWS CloudTrail, etc… Storage Decommission in Compliance:
NIST 800-88: Guidelines for Media
Sanitization
36. Dance like nobody is watching. Encrypt like EVERYONE is.
Empire Vault Storage: again, don’t rebuild the wheel plz.
Backup
37. CCH Tagetik Cloud: Backup in Compliance
Effective Backup and DR Procedures
What’s a good backup solution for CCH Tagetik
Highest Durability / Availability
RTO / RPO defined by contract with our customers
Encrypted (media and object)
Replicated on multiple Data Centers / Providers
Customizable retention: may vary per industry / contract
38. CCH Tagetik Cloud: Backup in Compliance
Effective Backup and DR Procedures
bucket
Backup Data in S3 / Glacier
Encryption
Durability + Scalability
Bucket + IAM + Lifecycle Policy + TAG =
Build a secure, isolated, object storage with
customizable retention
Easy replica
Easy to monitor and to get insights: Amazon
Macie
…with versioning, logging, analytics,
inventory...
S3 Amazon
Glacier
41. CCH Tagetik Cloud: Storage & DR
Effective Backup and DR Procedures
Business Continuity and Disaster Recovery
Automation
Selective Rollback
Full / partial Environments rebuild
42. CCH Tagetik Cloud: Storage & DR
Effective Backup and DR Procedures
EBS
snapshot
AMI
Disaster Recovery
AMI to save infrastructure configuration
milestone
+ CloudFormation template of the current
infrastructure saved nightly
AWS
CloudFormation
=
+
Infrastructure Versioning
Rebuild portion/all infrastructure in
minutes with no manual configuration
EBS Snapshot Backup
“Hot” Snapshot, no downtime
Possibility of a fast rollback
Easy manageable snapshot lifecycle (Cloud MS,
Lambda)
44. CCH Tagetik Cloud: Storage Performance
Reliable and Tunable Performance
Performance & Storage in CCH Tagetik Cloud
Execute heavy workloads in the fastest way possible
Execute light workloads in high concurrency
Ability to scale
45. CCH Tagetik Cloud: Storage Performance
Reliable and Tunable Performance
Maximize EBS Throughput
HDD SSD
MagneticST1SC1 GP2 IO1
SLOWER FASTER
Be flexible, you can!
Switch programmatically GPS2 to IO1 when
you are approaching an usage peak
Tune Disk performance
Know Your product product & AWS platform
Monitor usage via CloudWatch
Consider migrating to faster disks… but is
not the only thing to do:
Choose VMs wisely (type/size)
EBS Optimize
CloudWatch
46. CCH Tagetik Cloud: Storage Performance
Reliable and Tunable Performance
Use Raid 0 Configuration Tune Disk performance
RAID 0 offers great performance, both in
read and write operations. There is no
overhead caused by parity controls.
All storage capacity is used, there is no
overhead.
…just remember
RAID 0 is not a fault-tolerant configuration
Hot Snapshots of Disks may not be
"application-consistent"
Disk A
Block 1
Block 5
Block 9
Disk B
Block 2
Block 6
Block 10
Disk C
Block 3
Block 7
Block 11
Disk D
Block 4
Block 8
Block 12
Striping
47. CCH Tagetik Cloud: Storage Performance
Reliable and Tunable Performance
Grafana
Monitoring
I/O Requests
I/O Bytes
Queue
…
Per Disk or Per Stripe
Platform for Monitoring and Analytics -
Aggregate data from different data
sources, such as Probes, AWS
CloudWatch metrics, erc..
49. CCH Tagetik Cloud: Storage Monitoring & Reporting
Valuable Insights & Cost Control
Trusted Advisor Cost Explorer
Underutilized / Over utilized of Amazon EBS
Volumes
Misconfigurations
Presence of Amazon EBS Snapshots
Amazon EBS Public Snapshots
Limits check on EBS / Snapshot Cost analysis
Tag! Tag! Tag! Everything, Everywhere!
50. Dedicated Team
Periodical Meetings focused on
improvement and innovation
Valuable Insights
What we are working on?
CCH Tagetik Cloud: Storage Monitoring & Reporting
Valuable Insights & Cost Control
CUR: Cost & Usage
Reports
Amazon
Redshift
… what’s next?
Amazon
QuickSight
+
With the help of
AWS Enterprise Support
52. One more thing…
We are Hiring!
DevOps
Operations
…
https://www.tagetik.com/en/about/careers
Sales Engineering
Development
Send us your coordinates, we’ll beam you
up!