1,000,000,000,000,000 bytes. On demand. Online. Live. Big doesn't quite describe this data. Amazon Web Services makes it possible to construct highly elastic computing systems, and you can further increase cost efficiency by leveraging the Spot Pricing model for Amazon EC2. We showcase elasticity by demonstrating the creation and teardown of a petabyte-scale multiregion MongoDB NoSQL database cluster, using Amazon EC2 Spot Instances, for as little as $200 in total AWS costs. Oh and it offers up four million IOPS to storage via the power of PIOPS EBS. Christopher Biow, Principal Technologist at 10gen | MongoDB covers MongoDB best practices on AWS, so you can implement this NoSQL system (perhaps at a more pedestrian hundred-terabyte scale?) confidently in the cloud. You could build a massive enterprise warehouse, process a million human genomes, or collect a staggering number of cat GIFs. The possibilities are huMONGOus.
2. Agenda
• MongoDB on AWS review
– Guidance, Storage, Architecture
• MongoDB at PetaScale on AWS
3. Tools to simplify your design
• Whitepaper
• AWS Marketplace
• AWS
CloudFormation
http://media.amazonwebservices.com/AWS_NoSQL_MongoDB.pdf
4. • Easy to start a
single node
• Correctly configured
PIOPS EBS Storage
• No extra cost
https://aws.amazon.com/marketplace/pp/B00COAAEH8/ref=srh_res_product_title?ie=UTF8&sr=0-6&qid=1383897659043
5. AWS CloudFormation
• Nested Templates
• Nodes and Storage
• Configurable Scale
• AWS CloudFormation: Your
Infrastructure belongs in your
source control
mongodb.org/display/DOCS/Automating+Deployment+with+CloudFormation
6. AWS Storage Options
EBS
PIOPS
SSD
• Amazon EBS – Provisioned IOPS volumes
•
Deliver predictable, high performance for I/O intensive workloads
•
Specify IOPS required upfront, and EBS provisions for lifetime of volume
– 4000 IOPS per volume, can stripe to get thousands of IOPS to an EC2 instance
• High IO Instances – hi1.4xlarge
•
•
For some applications that require tens of thousands of IOPS
Eliminates network latency/bandwidth as a performance constraint to storage
7. AWS Storage Options
Testing: random 4k reads
EBS
+
One Volume: ~200 MongoOPS with some variability, <1mb/s
Loaded instance: ~ 1000 MongoOPS with some variability <10mb/s
One Volume: 200
0 MongoOPS with <1% variability, 16mb/s
Loaded Instance: 16,000 MongoOPS with <1% variability, 64mb/s
PIOPS
Loaded Cluster Instance:
SSD
MongoOPS, 320mb/s
Hi1.4xlarge ephemeral: ~64,000 MongoOPS with low variability, ~245mb/s
15. MongoDB
• Document-model,
NoSQL database
• Dev adoption is
STRONG
• MongoDB Inc.
trending toward
zero h/w
• Scale-up with commodity h/w
• Scale-out with sharding
• Scale-around with replication
16. AWS
•
•
•
•
PIOPS for an IO-hungry client
40% of MongoDB customer usage
90% of MongoDB internal usage
More ports :2701[79] than :[15]521
17. PB & Chocolate
Differentiators for mutual customers
•
•
•
•
•
Fast time-to-solution
Easy global distribution
Secondary index
Geo, text, security
Fast analytic aggregation