Learning Objectives: - Learn how adaptive capacity and Time-To-Live (TTL) can dynamically scale your tables - Learn how to design your DynamoDB for global applications with Global Tables - Learn how to perform On-Demand Backup on your DynamoDB tables for data archival

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rick Houlihan, Senior Practice Manager - NoSQL
February 2018
Whats New for DynamoDB
Q1 2018

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon DynamoDB
F a s t a n d f l e x i b l e N o S Q L d a t a b a s e s e r v i c e f o r a n y s c a l e
Fast, consistent performanceHighly scalable Fully managed Business critical
reliability
Consistent single-digit millisecond
latency; DAX in-memory
performance reduces response
times to microseconds
Auto-scaling to hundreds of
terabytes of data, that serve
millions of requests per second
Automatic provisioning
and infrastructure
management
Data is replicated across
fault tolerant availability
zones, with fine-grained
access control

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon DynamoDB
1 0 0 , 0 0 0 + C u s t o m e r s

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“You build it,
you run it.”
-- Werner Vogels

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Developer DBA
Systems
Engineer
You
DevOps

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Security
OS Patching
DB Patching
Access Control
Audit
Encryption
Compliance
Durability
Sustain server, rack, and datacenter outages
Re-replicate data quickly upon HW failure
Manage backup & restore
Availability
High Availability Configuration
Monitoring
Cross-region Replication
Performance
Performance Tuning
Indexing
In-Memory Caching
Scalability
Capacity Planning
Host Provisioning
Host Repair & Retirement
DBA and System Engineer
Responsibilities
And need to do all of this with no downtime!

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DynamoDB handles
DevOps
So that you can focus on
DevOps

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Availability

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DynamoDB Global Tables ( G A )
F u l l y m a n a g e d , m u l t i - m a s t e r, m u l t i - r e g i o n d a t a b a s e
NEW!
Build high performance, globally distributed applications
Low latency reads & writes to locally available tables
Multi-region redundancy for DR/HA applications
Easy to setup and no application re-writes required

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Security

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Virtual Private Cloud (VPC)
Endpoints
• Access DynamoDB via secure Amazon VPC
endpoint
• Control access to tables via each VPC endpoint
with unique IAM roles and permissions
Features
Key Benefits
• Turn off access from public internet gateways
enhancing privacy and security
• Fast, secure data transfer between Amazon
VPC and DynamoDB

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon DynamoDB
E n c r y p t i o n a t r e s t
NEW!
Server-side
encryption
Support
compliance
certifications
No application
code rewrites

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Industry Standard Encryption
A E S - 2 5 6 E n v e l o p e E n c r y p t i o n
NEW!
Fully integrated with KMS
Customer Master Key for DynamoDB
Encrypt both base tables and indexes
Transparent process with minimal performance impact
No modification to application

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Performance

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Consistent, High Performance
Request Volume Latency

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DynamoDB Accelerator (DAX)
• Fully managed, highly available: handles all software management,
fault tolerant, replication across multi-AZs within a region
• DynamoDB API compatible: seamlessly caches DynamoDB API
calls, no application re-writes required
• Write-through: DAX handles caching for writes
• Flexible: Configure DAX for one table or many
• Scalable: scales-out to any workload with up to 10 read replicas
• Manageability: fully integrated AWS service: Amazon CloudWatch,
Tagging for DynamoDB, AWS Console
• Security: Amazon VPC, AWS IAM, AWS CloudTrail, AWS
Organizations
Features
DynamoDB
Your Applications
DynamoDB Accelerator
Table #1
Table #2

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DynamoDB Accelerator (DAX)
Milliseconds to
microseconds
In-Memory performance and throughput
More than an order of magnitude faster!

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Durability

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
NEW!
Point in time restore
for short term
retention and data
corruption protection
(coming soon)
Backup hundreds of
TB instantly with NO
performance impact
On-demand backups
for long-term data
archival and
compliance
Amazon DynamoDB – Backup and Restore
O n l y c l o u d d a t a b a s e t o p r o v i d e o n d e m a n d a n d c o n t i n u o u s
b a c k u p s

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo: Backup and Restore

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Scalability

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Capacity Planning Is Important (and Hard)

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adaptive Capacity
Get it right, nobody notices.
Get it wrong, everybody will.

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
T1
Server 1
A
Dynamic Scaling—Throughput and Storage
500 WCU, 150K BURST, 1K PEAK
1500 RCU, 450K BURST, 3K PEAK
Up to 5 minutes of sustained 1K WCU or 3K RCU burst
500 WCU
1500 RCU

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server 1
T1
Server 2
A B
Dynamic Scaling—Throughput and Storage
500 WCU, 150K BURST, 2K PEAK
1500 RCU, 450K BURST, 6K PEAK
250 WCU
750 RCU
250 WCU
750 RCU
Up to 100 seconds of sustained 2K WCU or 6K RCU burst
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server 1
T1
Server 2
A B
Dynamic Scaling—Throughput and Storage

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server 1
T1
Server 2 Server 3
A B C
Dynamic Scaling—Throughput and Storage
500 WCU, 150K BURST, 3K PEAK
1500 RCU, 450K BURST, 9K PEAK
250 WCU
500 RCU
125 WCU
375 RCU
125 WCU
375 RCU
Up to 1 minute of sustained 3K WCU or 9K RCU burst
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server 1
T1
Server 2 Server 3
A B C
Dynamic Scaling—Throughput and Storage

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server 1
T1
Server 4 Server 2 Server 3
A D B C
Dynamic Scaling—Throughput and Storage
500 WCU, 150K BURST, 4K PEAK
1500 RCU, 450K BURST, 12K PEAK
125 WCU
375 RCU
125 WCU
375 RCU
125 WCU
375 RCU
125 WCU
375 RCU
Up to 43 seconds of sustained 4K WCU or 12K RCU burst
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adaptive Capacity
Partition soft limits exceeded

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adaptive Throughput Kicks In
Helped more than 2,800 Amazon tables and indexes on
Prime Day!

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ID Name Size Expiry
1234 A 100 1456702305
2222 B 240 1456702400
3423 C 150 1459207905
• Automatically delete items from a table based on
expiration timestamp
• User defined TTL attribute in epoch time format
• TTL activity recorded in DynamoDB Streams
TTL Attribute
Features
Key Benefits
• Reduce costs by deleting items no longer
needed
• Optimize application performance by controlling
table size growth
• Trigger custom workflows with Streams and
Lambda
Scaling Storage: Time-to-live (TTL)

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Scaling Throughput: Auto Scaling
$$$ Savings

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Scaling Throughput: Auto Scaling
Fully-managed, automatic
Scale up when you need it
Scale down when you don’t
On by default
Scheduled Auto Scaling

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VPC
Endpoints
April 2017
Auto
Scaling
June 2017
DynamoDB
Accelerator (DAX)
April 2017
Time to
Live (TTL)
February 2017
GlobalTables
(GA)
N E W !
On-demand
Backup (GA)
N E W !
Amazon DynamoDB
2 0 1 7
Encryption at rest
(Coming Soon)
N E W !

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Single tables serving…
Millions of requests per second
Trillions of items
Hundreds of terabytes of storage

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customer Stories

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Migration from Cassandra:
Backup & restore on mobile app for 300M users
Almost 1 PB in DynamoDB, 130M daily API requests
Migrated from Cassandra to DynamoDB
Consistent performance and 70% cost savings (TCO)
DynamoDB provided consistent
high performance at a drastically
lower cost than Cassandra.”
Seongkyu Kim
Samsung
“

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Migration from MongoDB:
Stores data on over 125M patents in DynamoDB.
Benefits of migrating from MongoDB to DynamoDB:
1) Fast and stable response time with unlimited
capacity
2) Less time spent on maintenance, monitoring,
backups
3) Easy to manage scaling and security settings
4) 50% cost savings over our MongoDB cluster
Ruiying Wu
Head of Operations. PatSnap
“Thanks to DynamoDB, providing and updating 125M+
Patents from over 100+ countries requires zero effort.
DynamoDB provides very consistent performance and
scalability, thus we are capable of making search and
analysis usable and accessible to non-IP experts,
helping them innovate.

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Migration from Oracle:
Every time you buy something on amazon.com, behind-the-scenes
coordinator: Herd - supports 100s of millions of active workflows
which need to start within a couple of seconds
Migrated from Oracle to DynamoDB:
1) Workflow processing delays dropped from 1s to 100ms
2) Scaling and maintenance effort dropped 10x
3) Retired over 300 Oracle hosts
Our internal customers saw processing delays decrease
from 1 second to 100 milliseconds; those latency
reductions ultimately translate into Amazon customers
getting their orders faster. That’s really a testament to the
performance of Amazon DynamoDB. It shows how it can
serve as the foundation of a highly efficient, mission-
critical system.”
Mike Thomas
Amazon
“
Work Item Storage
Partition Assigner
Timer Router
Timer
Node
s
Timer
Node
s
Timer
Node
s
Timer
Node
s
Timer
Hosts
View Router
Timer
Node
s
Timer
Node
s
Timer
Node
s
Timer
Node
s
View
Hosts

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Migrate to DynamoDB using DMS
Minimal downtime
Secure
Replication
support
DMS
Amazon
DynamoDB
2. Relational Databases
1. Non-Relational Databases
3. Other sources
Amazon S3
DMS usage is now
free for 6 months!
For more information:
https://aws.amazon.com/dms/free-dms/
NEW!

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
No Servers
No Administration
Highly Available
All AWS Regions
Extreme Scale
Consistent Performance
AWS Lambda Integration
DynamoDB & Serverless

43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
By:ArturoPardavilaIII
https://www.flickr.com/photos/apardavila/albums/72157674624352641

44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snap’s DB writes peak
seconds after Chicago Cubs World Series win

45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Prime Day 2017:
Biggest Global Shopping Event in Amazon History
Thousands of Amazon Teams using DynamoDB
Peak @ 12.9 MM RPS to DynamoDB

47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Closing Thought…

48. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Security
OS Patching
DB Patching
Access Control
Audit
Encryption
Compliance
Durability
Sustain server, rack, and datacenter outages
Re-replicate data quickly upon HW failure
Manage backup & restore
Availability
High Availability Configuration
Monitoring
Cross-region Replication
Performance
Performance Tuning
Indexing
In-Memory Caching
Scalability
Capacity Planning
Host Provisioning
Host Repair & Retirement
Think of all the other things you can do
If you let
Manage all this for you

49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.