Enviar búsqueda
Cargar
Optimizing MongoDB: Lessons Learned at Localytics
•
Descargar como PPT, PDF
•
23 recomendaciones
•
4,692 vistas
Benjamin Darfler
Seguir
MongoDB Optimizations done at Localytics to improve throughput while reducing cost.
Leer menos
Leer más
Tecnología
Educación
Denunciar
Compartir
Denunciar
Compartir
1 de 44
Descargar ahora
Recomendados
Optimizing MongoDB: Lessons Learned at Localytics
Optimizing MongoDB: Lessons Learned at Localytics
andrew311
MongoDB memory management demystified
MongoDB memory management demystified
Alon Horev
Development to Production with Sharded MongoDB Clusters
Development to Production with Sharded MongoDB Clusters
Severalnines
MongoDB Best Practices in AWS
MongoDB Best Practices in AWS
Chris Harris
Sharding Methods for MongoDB
Sharding Methods for MongoDB
MongoDB
MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...
MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...
ronwarshawsky
Introduction to Redis
Introduction to Redis
Arnab Mitra
Mongodb - Scaling write performance
Mongodb - Scaling write performance
Daum DNA
Recomendados
Optimizing MongoDB: Lessons Learned at Localytics
Optimizing MongoDB: Lessons Learned at Localytics
andrew311
MongoDB memory management demystified
MongoDB memory management demystified
Alon Horev
Development to Production with Sharded MongoDB Clusters
Development to Production with Sharded MongoDB Clusters
Severalnines
MongoDB Best Practices in AWS
MongoDB Best Practices in AWS
Chris Harris
Sharding Methods for MongoDB
Sharding Methods for MongoDB
MongoDB
MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...
MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...
ronwarshawsky
Introduction to Redis
Introduction to Redis
Arnab Mitra
Mongodb - Scaling write performance
Mongodb - Scaling write performance
Daum DNA
MongoDB Memory Management Demystified
MongoDB Memory Management Demystified
MongoDB
A New MongoDB Sharding Architecture for Higher Availability and Better Resour...
A New MongoDB Sharding Architecture for Higher Availability and Better Resour...
leifwalsh
MongoDB Auto-Sharding at Mongo Seattle
MongoDB Auto-Sharding at Mongo Seattle
MongoDB
MyRocks Deep Dive
MyRocks Deep Dive
Yoshinori Matsunobu
Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...
Ontico
Setting up mongodb sharded cluster in 30 minutes
Setting up mongodb sharded cluster in 30 minutes
Sudheer Kondla
Cassandra and Solid State Drives
Cassandra and Solid State Drives
Rick Branson
Cassandra at Instagram (August 2013)
Cassandra at Instagram (August 2013)
Rick Branson
Introduction to memcached
Introduction to memcached
Jurriaan Persyn
Breaking the Oracle Tie; High Performance OLTP and Analytics Using MongoDB
Breaking the Oracle Tie; High Performance OLTP and Analytics Using MongoDB
MongoDB
AWS Webcast - Achieving consistent high performance with Postgres on Amazon W...
AWS Webcast - Achieving consistent high performance with Postgres on Amazon W...
Amazon Web Services
Webinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica Set
MongoDB
Introduction to Sharding
Introduction to Sharding
MongoDB
MongoDB Performance Tuning and Monitoring
MongoDB Performance Tuning and Monitoring
MongoDB
MyRocks introduction and production deployment
MyRocks introduction and production deployment
Yoshinori Matsunobu
MongoDB and server performance
MongoDB and server performance
Alon Horev
Mongodb sharding
Mongodb sharding
xiangrong
Scylla Summit 2018: In-Memory Scylla - When Fast Storage is Not Fast Enough
Scylla Summit 2018: In-Memory Scylla - When Fast Storage is Not Fast Enough
ScyllaDB
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
Scott Mansfield
Sharding
Sharding
MongoDB
Mongodb in-anger-boston-rb-2011
Mongodb in-anger-boston-rb-2011
bostonrb
Spark Summit EU 2015: Lessons from 300+ production users
Spark Summit EU 2015: Lessons from 300+ production users
Databricks
Más contenido relacionado
La actualidad más candente
MongoDB Memory Management Demystified
MongoDB Memory Management Demystified
MongoDB
A New MongoDB Sharding Architecture for Higher Availability and Better Resour...
A New MongoDB Sharding Architecture for Higher Availability and Better Resour...
leifwalsh
MongoDB Auto-Sharding at Mongo Seattle
MongoDB Auto-Sharding at Mongo Seattle
MongoDB
MyRocks Deep Dive
MyRocks Deep Dive
Yoshinori Matsunobu
Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...
Ontico
Setting up mongodb sharded cluster in 30 minutes
Setting up mongodb sharded cluster in 30 minutes
Sudheer Kondla
Cassandra and Solid State Drives
Cassandra and Solid State Drives
Rick Branson
Cassandra at Instagram (August 2013)
Cassandra at Instagram (August 2013)
Rick Branson
Introduction to memcached
Introduction to memcached
Jurriaan Persyn
Breaking the Oracle Tie; High Performance OLTP and Analytics Using MongoDB
Breaking the Oracle Tie; High Performance OLTP and Analytics Using MongoDB
MongoDB
AWS Webcast - Achieving consistent high performance with Postgres on Amazon W...
AWS Webcast - Achieving consistent high performance with Postgres on Amazon W...
Amazon Web Services
Webinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica Set
MongoDB
Introduction to Sharding
Introduction to Sharding
MongoDB
MongoDB Performance Tuning and Monitoring
MongoDB Performance Tuning and Monitoring
MongoDB
MyRocks introduction and production deployment
MyRocks introduction and production deployment
Yoshinori Matsunobu
MongoDB and server performance
MongoDB and server performance
Alon Horev
Mongodb sharding
Mongodb sharding
xiangrong
Scylla Summit 2018: In-Memory Scylla - When Fast Storage is Not Fast Enough
Scylla Summit 2018: In-Memory Scylla - When Fast Storage is Not Fast Enough
ScyllaDB
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
Scott Mansfield
Sharding
Sharding
MongoDB
La actualidad más candente
(20)
MongoDB Memory Management Demystified
MongoDB Memory Management Demystified
A New MongoDB Sharding Architecture for Higher Availability and Better Resour...
A New MongoDB Sharding Architecture for Higher Availability and Better Resour...
MongoDB Auto-Sharding at Mongo Seattle
MongoDB Auto-Sharding at Mongo Seattle
MyRocks Deep Dive
MyRocks Deep Dive
Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...
Setting up mongodb sharded cluster in 30 minutes
Setting up mongodb sharded cluster in 30 minutes
Cassandra and Solid State Drives
Cassandra and Solid State Drives
Cassandra at Instagram (August 2013)
Cassandra at Instagram (August 2013)
Introduction to memcached
Introduction to memcached
Breaking the Oracle Tie; High Performance OLTP and Analytics Using MongoDB
Breaking the Oracle Tie; High Performance OLTP and Analytics Using MongoDB
AWS Webcast - Achieving consistent high performance with Postgres on Amazon W...
AWS Webcast - Achieving consistent high performance with Postgres on Amazon W...
Webinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica Set
Introduction to Sharding
Introduction to Sharding
MongoDB Performance Tuning and Monitoring
MongoDB Performance Tuning and Monitoring
MyRocks introduction and production deployment
MyRocks introduction and production deployment
MongoDB and server performance
MongoDB and server performance
Mongodb sharding
Mongodb sharding
Scylla Summit 2018: In-Memory Scylla - When Fast Storage is Not Fast Enough
Scylla Summit 2018: In-Memory Scylla - When Fast Storage is Not Fast Enough
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
EVCache: Lowering Costs for a Low Latency Cache with RocksDB
Sharding
Sharding
Similar a Optimizing MongoDB: Lessons Learned at Localytics
Mongodb in-anger-boston-rb-2011
Mongodb in-anger-boston-rb-2011
bostonrb
Spark Summit EU 2015: Lessons from 300+ production users
Spark Summit EU 2015: Lessons from 300+ production users
Databricks
Compact, Compress, De-Duplicate (DAOS)
Compact, Compress, De-Duplicate (DAOS)
Ulrich Krause
Spark SQL - 10 Things You Need to Know
Spark SQL - 10 Things You Need to Know
Kristian Alexander
Optimizing Big Data to run in the Public Cloud
Optimizing Big Data to run in the Public Cloud
Qubole
Spark to DocumentDB connector
Spark to DocumentDB connector
Denny Lee
MongoDB World 2019: Lessons Learned: Migrating Buffer's Production Database t...
MongoDB World 2019: Lessons Learned: Migrating Buffer's Production Database t...
MongoDB
Everyday I'm Shuffling - Tips for Writing Better Spark Programs, Strata San J...
Everyday I'm Shuffling - Tips for Writing Better Spark Programs, Strata San J...
Databricks
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Lviv Startup Club
Couchbase - Yet Another Introduction
Couchbase - Yet Another Introduction
Kelum Senanayake
Apidays Paris 2023 - Forget TypeScript, Choose Rust to build Robust, Fast and...
Apidays Paris 2023 - Forget TypeScript, Choose Rust to build Robust, Fast and...
apidays
Daos
Daos
Ulrich Krause
Deploying your Data Warehouse on AWS
Deploying your Data Warehouse on AWS
Amazon Web Services
CouchDB
CouchDB
codebits
[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...
[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...
Andrew Liu
Azure Data Lake Analytics Deep Dive
Azure Data Lake Analytics Deep Dive
Ilyas F ☁☁☁
Cold Storage That Isn't Glacial (Joshua Hollander, Protectwise) | Cassandra S...
Cold Storage That Isn't Glacial (Joshua Hollander, Protectwise) | Cassandra S...
DataStax
Azure Databricks is Easier Than You Think
Azure Databricks is Easier Than You Think
Ike Ellis
Running Presto and Spark on the Netflix Big Data Platform
Running Presto and Spark on the Netflix Big Data Platform
Eva Tse
Understanding and building big data Architectures - NoSQL
Understanding and building big data Architectures - NoSQL
Hyderabad Scalability Meetup
Similar a Optimizing MongoDB: Lessons Learned at Localytics
(20)
Mongodb in-anger-boston-rb-2011
Mongodb in-anger-boston-rb-2011
Spark Summit EU 2015: Lessons from 300+ production users
Spark Summit EU 2015: Lessons from 300+ production users
Compact, Compress, De-Duplicate (DAOS)
Compact, Compress, De-Duplicate (DAOS)
Spark SQL - 10 Things You Need to Know
Spark SQL - 10 Things You Need to Know
Optimizing Big Data to run in the Public Cloud
Optimizing Big Data to run in the Public Cloud
Spark to DocumentDB connector
Spark to DocumentDB connector
MongoDB World 2019: Lessons Learned: Migrating Buffer's Production Database t...
MongoDB World 2019: Lessons Learned: Migrating Buffer's Production Database t...
Everyday I'm Shuffling - Tips for Writing Better Spark Programs, Strata San J...
Everyday I'm Shuffling - Tips for Writing Better Spark Programs, Strata San J...
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Couchbase - Yet Another Introduction
Couchbase - Yet Another Introduction
Apidays Paris 2023 - Forget TypeScript, Choose Rust to build Robust, Fast and...
Apidays Paris 2023 - Forget TypeScript, Choose Rust to build Robust, Fast and...
Daos
Daos
Deploying your Data Warehouse on AWS
Deploying your Data Warehouse on AWS
CouchDB
CouchDB
[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...
[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...
Azure Data Lake Analytics Deep Dive
Azure Data Lake Analytics Deep Dive
Cold Storage That Isn't Glacial (Joshua Hollander, Protectwise) | Cassandra S...
Cold Storage That Isn't Glacial (Joshua Hollander, Protectwise) | Cassandra S...
Azure Databricks is Easier Than You Think
Azure Databricks is Easier Than You Think
Running Presto and Spark on the Netflix Big Data Platform
Running Presto and Spark on the Netflix Big Data Platform
Understanding and building big data Architectures - NoSQL
Understanding and building big data Architectures - NoSQL
Último
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
Nanddeep Nachan
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
Remote DBA Services
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Edi Saputra
presentation ICT roal in 21st century education
presentation ICT roal in 21st century education
jfdjdjcjdnsjd
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
Zilliz
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
MIND CTI
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Jeffrey Haguewood
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
Igalia
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Martijn de Jong
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
debabhi2
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
DianaGray10
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
Zilliz
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
lior mazor
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
apidays
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
sammart93
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
Khem
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
Product Anonymous
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
The Digital Insurer
Último
(20)
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
presentation ICT roal in 21st century education
presentation ICT roal in 21st century education
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
Optimizing MongoDB: Lessons Learned at Localytics
1.
Optimizing MongoDB: Lessons
Learned at Localytics Benjamin Darfler MongoBoston - September 2011
2.
3.
4.
5.
6.
Optimizing Our Data
Documents and Indexes
7.
8.
9.
10.
11.
12.
13.
14.
Optimizing Our Queries
Reading and Writing
15.
16.
17.
18.
19.
20.
Optimizing Our Disk
Fragmentation
21.
Inserts doc1 doc2
doc3 doc4 doc5
22.
Deletes doc1 doc2
doc3 doc4 doc5 doc1 doc2 doc3 doc4 doc5
23.
Updates doc1 doc2
doc3 doc4 doc5 doc1 doc2 doc3 doc4 doc5 doc3 Updates can be in place if the document doesn't grow
24.
Reclaiming Freespace doc1
doc2 doc6 doc4 doc5 doc1 doc2 doc3 doc4 doc5
25.
Memory Mapped Files
doc1 doc2 doc6 doc4 doc5 } } page page Data is mapped into memory a full page at a time
26.
27.
28.
29.
Optimizing Our Keys
Index and Shard
30.
B-Tree Indexes -
hash/uuid key Hashes/UUIDs randomly distribute across the whole b-tree
31.
B-Tree Indexes -
temporal key Keys with a temporal prefix (i.e. ObjectId) are right aligned
32.
Migrations - hash/uuid
shard key Chunk 1 k: 1 to 5 Chunk 2 k: 6 to 9 Shard 1 Shard 2 Chunk 1 k: 1 to 5 {k: 4, …} {k: 8, …} {k: 3, …} {k: 7, …} {k: 5, …} {k: 6, …} {k: 4, …} {k: 3, …} {k: 5, …}
33.
34.
Migrations - temporal
shard key Chunk 1 k: 1 to 5 Chunk 2 k: 6 to 9 Shard 1 Shard 2 Chunk 1 k: 1 to 5 {k: 3, …} {k: 4, …} {k: 5, …} {k: 6, …} {k: 7, …} {k: 8, …} {k: 3, …} {k: 4, …} {k: 5, …}
35.
36.
Optimizing Our Deployment
Hardware and Configuration
37.
38.
39.
40.
41.
42.
43.
44.
Questions? @bdarfler http://bdarfler.com
Descargar ahora