MongoDB at MercadoLibre

•

4 likes•1,490 views

Pablo Molnar

Presentation for MongoDB Buenos Aires 2012

Technology Entertainment & Humor

MongoDB
At MercadoLibre

Wh at h ave we le a rned

Overview

About MeLi

Why MongoDB?

Use cases

Lessons Learned

Wrapping Up

MeLi - Facts!
20M requests / minute
50K requests / sec (peaks)
4 Gb bandwidth / sec

MeLi - Facts!
20M requests / minute
50K requests / sec (peaks)
4 Gb bandwidth / sec

Our farm
+1000 physical server
+6000 virtual instances

MeLi - Inside

Lot of fun here playing with new stuff :P

MeLi - Inside

Lot of fun here playing with new stuff :P
Our NoSQL stack

Redis
Memcached
Hadoop

MeLi - Inside

Lot of fun here playing with new stuff :P
Our NoSQL stack

Redis
Memcached
Hadoop
.... and of course

Why MongoDB?

Horizontal Scaling

High Availability

Performance

Flexible Data!

Why MongoDB?
(... and more)

JavaScript(‘ing)

Polyglot

Open Source

Awesome Community

Support

Use Cases

DB Documents

Social +700M

Orders +23M

Feedback +3M

Emails +61M

Items +200M

Logging +332M

Use Case: Social

Store Meli’s users social data
LOT of data (friends, likes, ...)
> 500 Gb
> 700 M documents
12 shards servers : 4 replica set
Each replica set = 3 servers
80Gb per instance

Use Case: Social
Sp
ec
@T ial
ioB thk
or st
Store Meli’s users social data rac o
ho
LOT of data (friends, likes, ...)
> 500 Gb
> 700 M documents
12 shards servers : 4 replica set
Each replica set = 3 servers
80Gb per instance

Use Case: Items

1 Item!
N x N x N ... > 100k rows

Use Case: Logging
Capped Collections!
Info logs
RabbitMQ messages
Track certain use cases

Errors logs
Something bad happen...
Recuperable errors with retry handler

Lessons Learned
Storage
File System
NSF: Bad choice, Poor results
Ext4: Far much better

Mount Options
Reducing Disk IO by mounting partitions with noatime and nodiratime

Track disk performance
iostat -xm 2 (%util column < 100%)

Lessons Learned
VM’s
Shard instances
4 cores
>= 16 Gb ram

Config server
low cpu consumption
1Gb ram / 1Gb storage

Mongos
runs along with the webserver (client)
1 mongos x webserver

$Lessons Learned Monitoring Disk usage (with zenoss) Ping health check curl --connect-timeout 3 --write-out %{http_code} --silent --output /dev/null http://localhost:28017/_status$

Lessons Learned
Monitoring MMS - It’s free!

Lessons Learned
Plan your actions!
Shard key
Upgrades
Cfg Servers
+ bad decisions = Lot of rework
...

Lessons Learned
Plan your actions!
Shard key
Upgrades
Cfg Servers
+ bad decisions = Lot of rework
...

Study
Think
Plan

Hands On!

The End

Questions?

{
name : "Pablo Molnar",
title : "Software Engineer",
work : "MercadoLibre",
location : "Buenos Aires",
twitter : "@pablomolnar"
}

What's hot

NOSQL: il rinascimento dei database?

Paolo Bernardi

Шардинг в MongoDB, Henrik Ingo (MongoDB)

Ontico

MongoDB: Intro & Application for Big Data

Takahiro Inoue

Mongo db present

scottmsims

Slide NoSQL Indonesia - Redis Cache n PubSub

rifqi alfian

Barcelona MUG MongoDB + Hadoop Presentation

Norberto Leite

新浪微博开放平台中的 Redis 实践

fulin tang

Mongodb

Scott Motte

Conexión de MongoDB con Hadoop - Luis Alberto Giménez - CAPSiDE #DevOSSAzureDays

CAPSiDE

MongoDB Knowledge Shareing

Philip Zhong

What's hot (10)

NOSQL: il rinascimento dei database?

Шардинг в MongoDB, Henrik Ingo (MongoDB)

MongoDB: Intro & Application for Big Data

Mongo db present

Slide NoSQL Indonesia - Redis Cache n PubSub

Barcelona MUG MongoDB + Hadoop Presentation

新浪微博开放平台中的 Redis 实践

Mongodb

Conexión de MongoDB con Hadoop - Luis Alberto Giménez - CAPSiDE #DevOSSAzureDays

MongoDB Knowledge Shareing

Similar to MongoDB at MercadoLibre

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)

Jens Hadlich

Lessons Learned Migrating 2+ Billion Documents at Craigslist

Jeremy Zawodny

The Smug Mug Tale

MySQLConference

In May of 2012, Socialcam exploded, gaining tens of millions of new users in just a few weeks. At the time, the service ran on 15 servers in a co-location facility in San Francisco. To meet new user traffic demands and continue to deliver maximum user satisfaction, Socialcam made the move to cloud services. With only two engineers and a constant barrage of users, there was limited time for technical transition, but Socialcam endured with no significant downtime. In this technical session, Socialcam co-founders Guillaume Luccisano and Ammon Bartram talk about their experience scaling Socialcam. They present the challenges they encountered, how they addressed them, and the technologies they used in the process. They focus particularly on how they used Amazon services in conjunction with their own hardware to keep Socialcam active with no significant downtime and no costly system redesign.

STP201 Efficiency at Scale - AWS re: Invent 2012

Amazon Web Services

Future Architectures for genomics

Guy Coates

MySQL And Search At Craigslist

Jeremy Zawodny

Let’s be honest: Running a distributed stateful stream processor that is able to handle terabytes of state and tens of gigabytes of data per second while being highly available and correct (in an exactly-once sense) does not work without any planning, configuration and monitoring. While the Flink developer community tries to make everything as simple as possible, it is still important to be aware of all the requirements and implications In this talk, we will provide some insights into the greatest operations mysteries of Flink from a high-level perspective: - Capacity and resource planning: Understand the theoretical limits. - Memory and CPU configuration: Distribute resources according to your needs. - Setting up High Availability: Planning for failures. - Checkpointing and State Backends: Ensure correctness and fast recovery For each of the listed topics, we will introduce the concepts of Flink and provide some best practices we have learned over the past years supporting Flink users in production.

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...

Flink Forward

(STG403) Amazon EBS: Designing for Performance

Amazon Web Services

All About Storeconfigs

Brice Figureau

Cassandra @ Sony: The good, the bad, and the ugly part 2

DataStax Academy

Why Wordnik went non-relational

Tony Tam

Machine Learning at the Limit John Canny, UC Berkeley How fast can machine learning and graph algorithms be? In "roofline" design, every kernel is driven toward the limits imposed by CPU, memory, network etc. This can lead to dramatic improvements: BIDMach is a toolkit for machine learning that uses rooflined design and GPUs to achieve two- to three-orders of magnitude improvements over other toolkits on single machines. These speedups are larger than have been reported for *cluster* systems (e.g. Spark/MLLib, Powergraph) running on hundreds of nodes, and BIDMach with a GPU outperforms these systems for most common machine learning tasks. For algorithms (e.g. graph algorithms) which do require cluster computing, we have developed a rooflined network primitive called "Kylix". We can show that Kylix approaches the rooline limits for sparse Allreduce, and empirically holds the record for distributed Pagerank. Beyond rooflining, we believe there are great opportunities from deep algorithm/hardware codesign. Gibbs Sampling (GS) is a very general tool for inference, but is typically much slower than alternatives. SAME (State Augmentation for Marginal Estimation) is a variation of GS which was developed for marginal parameter estimation. We show that it has high parallelism, and a fast GPU implementation. Using SAME, we developed a GS implementation of Latent Dirichlet Allocation whose running time is 100x faster than other samplers, and within 3x of the fastest symbolic methods. We are extending this approach to general graphical models, an area where there is currently a void of (practically) fast tools. It seems at least plausible that a general-purpose solution based on these techniques can closely approach the performance of custom algorithms. Bio John Canny is a professor in computer science at UC Berkeley. He is an ACM dissertation award winner and a Packard Fellow. He is currently a Data Science Senior Fellow in Berkeley's new Institute for Data Science and holds a INRIA (France) International Chair. Since 2002, he has been developing and deploying large-scale behavioral modeling systems. He designed and protyped production systems for Overstock.com, Yahoo, Ebay, Quantcast and Microsoft. He currently works on several applications of data mining for human learning (MOOCs and early language learning), health and well-being, and applications in the sciences.

SF Big Analytics & SF Machine Learning Meetup: Machine Learning at the Limit ...

Chester Chen

Sizing a database cluster makes or breaks your application. Too small and you could sustain spikes in usage and recover from a node loss or an operational slowdown. Too big and your cluster will cost more and waste valuable human resources. Since different workloads have different requirements, successful sizing of your application should be optimized for both throughput and latency performance. However, in many cases, the requirements for each contradicts each other. In this webinar, we explain how to remediate the contradicting forces and build a sustainable cluster to meet both performance and resiliency requirements.

How to Build a Scylla Database Cluster that Fits Your Needs

ScyllaDB

MongoDB has taken a clear lead in adoption among the new generation of databases, including the enormous variety of NoSQL offerings. A key reason for this lead has been a unique combination of agility and scalability. Agility provides business units with a quick start and flexibility to maintain development velocity, despite changing data and requirements. Scalability maintains that flexibility while providing fast, interactive performance as data volume and usage increase. We'll address the key organizational, operational, and engineering considerations to ensure that agility and scalability stay aligned at increasing scale, from small development instances to web-scale applications. We will also survey some key examples of highly-scaled customer applications of MongoDB.

Agility and Scalability with MongoDB

MongoDB

MongoDB and AWS Best Practices

MongoDB

High Performance With Java

malduarte

The main objective of “Big Data intelligence” is to understand all of us better to predict the future. Be it 4 billion google queries a day or 1 billion FB users, we need smarter AI algorithms to learn and connect the dots from the ocean of data. With massive parallelism and Map-Reduce techniques, millions of servers take us one step closer to the “Turing’s Intelligent machine”. Near AI success stories are google, facebook, twitter, youtube and Amazon. Let's begin our journey by knowing big hype, big dreams of 50's , big laws, big growth and basic operations to extract big data intelligence.For more information on Big Data training in coimbatore, please visit https://bigzettab.wordpress.com/ . - Prof. Ashok.R, +91-9943900101, ashok@zettab.com.

BDI- The Beginning (Big data training in Coimbatore)

Ashok Rangaswamy

High Frequency Trading and NoSQL database

Peter Lawrey

How to create Great App

Yonatan Levin

Hardware Provisioning for MongoDB

MongoDB

Similar to MongoDB at MercadoLibre (20)

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)

Lessons Learned Migrating 2+ Billion Documents at Craigslist

The Smug Mug Tale

STP201 Efficiency at Scale - AWS re: Invent 2012

Future Architectures for genomics

MySQL And Search At Craigslist

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...

(STG403) Amazon EBS: Designing for Performance

All About Storeconfigs

Cassandra @ Sony: The good, the bad, and the ugly part 2

Why Wordnik went non-relational

SF Big Analytics & SF Machine Learning Meetup: Machine Learning at the Limit ...

How to Build a Scylla Database Cluster that Fits Your Needs

Agility and Scalability with MongoDB

MongoDB and AWS Best Practices

High Performance With Java

BDI- The Beginning (Big data training in Coimbatore)

High Frequency Trading and NoSQL database

How to create Great App

Hardware Provisioning for MongoDB

Recently uploaded

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

Igalia

In the thrilling conclusion to 2023, ransomware groups had a banner year, really outdoing themselves in the "make everyone's life miserable" department. LockBit 3.0 took gold in the hacking olympics, followed by the plucky upstarts Clop and ALPHV/BlackCat. Apparently, 48% of organizations were feeling left out and decided to get in on the cyber attack action. Business services won the "most likely to get digitally mugged" award, with education and retail nipping at their heels. Hackers expanded their repertoire beyond boring old encryption to the much more exciting world of extortion. The US, UK and Canada took top honors in the "countries most likely to pay up" category. Bitcoins were the currency of choice for discerning hackers, because who doesn't love untraceable money?

Ransomware_Q4_2023. The report. [EN].pdf

Overkill Security

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Modernizing Securities Finance: The cloud-native prime brokerage platform transforming capital markets. Madhu Subbu, Managing Director, Head of Securities Finance Engineering Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

apidays

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

MINDCTI Revenue Release Quarter One 2024

MIND CTI

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

A Beginners Guide to Building a RAG App Using Open Source Milvus

Zilliz

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Real Time Object Detection Using Open CV

Khem

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Recently uploaded (20)

Why Teams call analytics are critical to your entire business

Exploring the Future Potential of AI-Enabled Smartphone Processors

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

A Year of the Servo Reboot: Where Are We Now?

Ransomware_Q4_2023. The report. [EN].pdf

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

MINDCTI Revenue Release Quarter One 2024

Axa Assurance Maroc - Insurer Innovation Award 2024

Artificial Intelligence Chap.5 : Uncertainty

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

A Beginners Guide to Building a RAG App Using Open Source Milvus

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Real Time Object Detection Using Open CV

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

MS Copilot expands with MS Graph connectors

MongoDB at MercadoLibre

1. MongoDB At MercadoLibre Wh at h ave we le a rned

2. Overview About MeLi Why MongoDB? Use cases Lessons Learned Wrapping Up

3. MeLi - Platform

4. MeLi - Facts! 20M requests / minute 50K requests / sec (peaks) 4 Gb bandwidth / sec

5. MeLi - Facts! 20M requests / minute 50K requests / sec (peaks) 4 Gb bandwidth / sec Our farm +1000 physical server +6000 virtual instances

6. MeLi - Inside Lot of fun here playing with new stuff :P

7. MeLi - Inside Lot of fun here playing with new stuff :P Our NoSQL stack Redis Memcached Hadoop

8. MeLi - Inside Lot of fun here playing with new stuff :P Our NoSQL stack Redis Memcached Hadoop .... and of course

9. Why MongoDB? Horizontal Scaling High Availability Performance Flexible Data!

10. Why MongoDB? Horizontal Scaling High Availability Performance Flexible Data!

11. Why MongoDB? (... and more) JavaScript(‘ing) Polyglot Open Source Awesome Community Support

12. Support :-)

13. Use Cases DB Documents Social +700M Orders +23M Feedback +3M Emails +61M Items +200M Logging +332M

14. Use Case: Social Store Meli’s users social data LOT of data (friends, likes, ...) > 500 Gb > 700 M documents 12 shards servers : 4 replica set Each replica set = 3 servers 80Gb per instance

15. Use Case: Social Sp ec @T ial ioB thk or st Store Meli’s users social data rac o ho LOT of data (friends, likes, ...) > 500 Gb > 700 M documents 12 shards servers : 4 replica set Each replica set = 3 servers 80Gb per instance

16. Use Case: Items 1 Item!

17. Use Case: Items 1 Item!

18. Use Case: Items 1 Item!

19. Use Case: Items 1 Item! N x N x N ... > 100k rows

20. Use Case: Items 1 Item!

21. Use Case: Logging Capped Collections! Info logs RabbitMQ messages Track certain use cases Errors logs Something bad happen... Recuperable errors with retry handler

22. Lessons Learned Storage File System NSF: Bad choice, Poor results Ext4: Far much better Mount Options Reducing Disk IO by mounting partitions with noatime and nodiratime Track disk performance iostat -xm 2 (%util column < 100%)

23. Lessons Learned VM’s Shard instances 4 cores >= 16 Gb ram Config server low cpu consumption 1Gb ram / 1Gb storage Mongos runs along with the webserver (client) 1 mongos x webserver

24. Lessons Learned Monitoring Disk usage (with zenoss) Ping health check curl --connect-timeout 3 --write-out %{http_code} --silent --output /dev/null http://localhost:28017/_status

25. Lessons Learned Monitoring MMS - It’s free!

26. Lessons Learned Plan your actions! Shard key Upgrades Cfg Servers + bad decisions = Lot of rework ...

27. Lessons Learned Plan your actions! Shard key Upgrades Cfg Servers + bad decisions = Lot of rework ... Study Think Plan Hands On!

28. Wrapping Up! Meli loves MongoDB!

29. The End Questions? { name : "Pablo Molnar", title : "Software Engineer", work : "MercadoLibre", location : "Buenos Aires", twitter : "@pablomolnar" }

MongoDB at MercadoLibre

Recommended

Recommended

More Related Content

What's hot

What's hot (10)

Similar to MongoDB at MercadoLibre

Similar to MongoDB at MercadoLibre (20)

Recently uploaded

Recently uploaded (20)

MongoDB at MercadoLibre

Editor's Notes