DynamoDB is a NoSQL database service built for fast, scalable, consistent performance. This presentation introduces DynamoDB and discusses how to get started, provision throughput, design for the DynamoDB data model, query and scan tables and scale reads and writes without downtime.

1. What’s New with
Amazon Web Services
23rd February, 2012
LO N D O N - # AW S LO N D O N

2. Hello.

3. Thank you

4. What’s New?

5. 8
/ month

6. Price drops

7. Objects in S3
Billions of objects
762B
800.000
600.000
400.000
200.000
0
Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011
500k peak transactions per second

8. New regions

10. New regions

11. Per-AZ spot pricing
S3 object expiration
ElastiCache in us-west-2 and sa-east-1
Elastic Network Interfaces
Simple Notification Service
EC2 instance status
New regions
Windows free tier
New CloudFront POPs
VPC everywhere New availability zones

12. 2.00pm Welcome
~ 2.00pm to 2.45pm Introducing DynamoDB
2.45pm to 3.30pm Analytics in the Cloud
3.30pm to 4.00pm Coffee break
4.00pm to 4.45pm Cloud Economics
4.45pm to 5.30pm Integrating Enterprise IT
5.30pm to 6.30pm Drinks and networking

13. 2.00pm Welcome
~ 2.00pm to 2.40pm Introducing DynamoDB
2.40pm to 3.10pm Analytics in the Cloud
3.10pm to 3.30pm Amazon Simple Workflow
3.30pm to 4.00pm Coffee break
4.00pm to 4.45pm Cloud Economics
4.45pm to 5.30pm Integrating Enterprise IT
5.30pm to 6.30pm Drinks and networking

15. Storage
Tools &
Compute
Support
Databases

16. Storage
Tools &
Compute
Support
Databases

17. Storage
Databases
Tools &
Compute
Support

18. Databases
Relational “NoSQL”
databases databases

19. Databases
Relational “NoSQL”
databases databases

20. Any database on Amazon EC2
MySQL, DB2, Oracle, PostgreSQL...

21. Relational Database Service
Managed MySQL and Oracle databases

22. Rapid High
provisioning availability
Scalable Scalable
storage compute
Relational Database Service
Managed MySQL and Oracle databases

23. ElastiCache
In memory, memcached compliant, caching clusters

24. High performance databases
Increase throughput
Increase availability
Reduce latency

25. High performance databases
Read replicas
Push-button
scaling Increase throughput
ElastiCache
Increase availability
Reduce latency

26. High performance databases
Increase throughput
Multi-AZ Increase availability
Reduce latency

27. High performance databases
Increase throughput
Increase availability
Reduce latency ElastiCache

28. Problem
Performance decreases at scale

29. Performance
Predictable, consistent
Scale

30. Performance
Predictable, consistent
Degraded performance
with scale
Scale

31. Performance
Predictable, consistent
Degraded performance
with scale
Scale

32. = more problems

33. Data caching
Provisioning!
Data sharding
= more problems
Cluster management
Fault management

34. Undifferentiated
heavy lifting

35. DynamoDB

36. Fully managed
NoSQL database
service

37. Extremely fast
performance

38. Consistently fast
performance

39. Seamless scalability

40. H I G H L I G H T S

41. H I G H L I G H T S
Low latency
Single digit millisecond

42. H I G H L I G H T S
Low latency
Single digit millisecond
< 5 ms reads < 10 ms writes

43. H I G H L I G H T S
SSD backed
Low latency
Single digit millisecond
< 5 ms reads < 10 ms writes

45. H I G H L I G H T S
Massive scale
No table size limits. Unlimited storage.

46. H I G H L I G H T S
Seamless scale
Live repartitioning. Zero admin.

47. H I G H L I G H T S
Predictable performance
Provisioned throughput

48. H I G H L I G H T S
Durable and available
Consistent, disk-only writes

49. H I G H L I G H T S
Zero administration

50. What is provisioned
throughput?

51. Reserve required IOPS
Per table. Set at creation. Scale via API.

52. “ProvisionedThroughput”:
{ “ReadsPerSecond” : 500 },
{ “WritesPerSecond” : 1000 }

53. Scale at any time
No downtime

54. Pay for throughput

55. Per 1kb item:
$0.01 per hour for every 10 writes/second
$0.01 per hour for every 50 strongly
consistent reads/second

56. Per 1kb item:
$0.28 per million writes
$0.056 per million strongly consistent reads

57. Pay for storage
$1.00 per Gb per month of indexed storage

58. Data model

60. “ImageID” = “1”
“Date” =
“20100915”
“Title” = “flower”
“Tags” = “flower”,
“jasmine”, “white”

61. “ImageID” = “1” “ImageID” =”2” “ImageID” =”3”
“Date” = “Date” = “Date” =
“20100915” “20100916” “20100917”
“Title” = “flower” “Title” = “ferrari” “Title” = “coffee”
“Tags” = “flower”, “Tags” = “car”, “Tags” = “drink”,
“jasmine”, “white” “italian” “delicious”

62. Primary key

63. Composite key

67. Simple API
Only 12 operations.
Atomic increment/decrement on number attributes.

68. Automatic scaling
Subscribe to SNS topic

69. $Res = $DDB->describe_table(array('TableName' => 'wsdot_images'));
$Read = (int) $Res->body->Table->ProvisionedThroughput->ReadCapacityUnits;
$Write = (int) $Res->body->Table->ProvisionedThroughput->WriteCapacityUnits;
$Read *= 2;
$Write *= 2;
$PT = array('ReadCapacityUnits' => (string) $Read,
'WriteCapacityUnits' => (string) $Write);
$Res = $ddb->update_table(array('TableName' => 'wsdot_images',
'ProvisionedThroughPut' => $PT));

70. $Res = $DDB->describe_table(array('TableName' => 'wsdot_images'));
$Read = (int) $Res->body->Table->ProvisionedThroughput->ReadCapacityUnits;
$Write = (int) $Res->body->Table->ProvisionedThroughput->WriteCapacityUnits;
$Read *= 2;
$Write *= 2;
$PT = array('ReadCapacityUnits' => (string) $Read,
'WriteCapacityUnits' => (string) $Write);
$Res = $ddb->update_table(array('TableName' => 'wsdot_images',
'ProvisionedThroughPut' => $PT));

71. $Res = $DDB->describe_table(array('TableName' => 'wsdot_images'));
$Read = (int) $Res->body->Table->ProvisionedThroughput->ReadCapacityUnits;
$Write = (int) $Res->body->Table->ProvisionedThroughput->WriteCapacityUnits;
$Read *= 2;
$Write *= 2;
$PT = array('ReadCapacityUnits' => (string) $Read,
'WriteCapacityUnits' => (string) $Write);
$Res = $ddb->update_table(array('TableName' => 'wsdot_images',
'ProvisionedThroughPut' => $PT));

72. $Res = $DDB->describe_table(array('TableName' => 'wsdot_images'));
$Read = (int) $Res->body->Table->ProvisionedThroughput->ReadCapacityUnits;
$Write = (int) $Res->body->Table->ProvisionedThroughput->WriteCapacityUnits;
$Read *= 2;
$Write *= 2;
$PT = array('ReadCapacityUnits' => (string) $Read,
'WriteCapacityUnits' => (string) $Write);
$Res = $ddb->update_table(array('TableName' => 'wsdot_images',
'ProvisionedThroughPut' => $PT));

73. $Res = $DDB->describe_table(array('TableName' => 'wsdot_images'));
$Read = (int) $Res->body->Table->ProvisionedThroughput->ReadCapacityUnits;
$Write = (int) $Res->body->Table->ProvisionedThroughput->WriteCapacityUnits;
$Read *= 2;
$Write *= 2;
$PT = array('ReadCapacityUnits' => (string) $Read,
'WriteCapacityUnits' => (string) $Write);
$Res = $ddb->update_table(array('TableName' => 'wsdot_images',
'ProvisionedThroughPut' => $PT));

74. Consistency
Writes are always consistent.
Reads are consistent or eventually consistent.

75. Durability
Writes occur to disk, not memory.
Writes are acknowledged once they have been
made in two physical data centres.

76. Availability
Region specific (not AZ)
Continuously replicated across multiple AZs

77. Considerations
Limited index and query model
Throughput is provisioned in 1K operations
Maximum 64K item size
Backup and restore via Elastic MapReduce

78. Databases
Relational “NoSQL”
databases databases

79. SimpleDB
Zero maintenance, NoSQL datastore

80. Flexible queries
10Gb / 1 billion No native
attributes per tabel data sharding
SimpleDB
Zero maintenance, NoSQL datastore

81. Choose the right tool
for the job

82. DynamoDB free tier
5 writes/second
10 consistent reads/second
100Mb storage

83. Q&A
matthew@amazon.com