Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Mongo db admin_20110316
1. Administration
Michael DelNegro
Principal Database Administrator
AOL
2. About Me
• DBA at AOL (Dulles) for six years
• Background in Sybase
• Now MySQL, PostgreSQL and NoSQL
• I heart Big Data
• Operations
3. MongoDB at AOL
• In use since Summer 2010
• I currently administer two applications for
MapQuest and Patch
• There are other MongoDB applications in
use throughout the company and more on
the way
4. MapQuest App
• Tracks User Profile Information
• V. 1.6.5.latest (just upgraded from 1.6.3)
• 26 Total Hosts, CentOS 5, 16GB RAM
• 300 million users, 130 million saved maps
• Replica Sets
• 3 Sharded Collections
• lookup, east coast, west coast
5. Patch App
• Tracks User Activity
• Master, 2 Slaves
• V. 1.6.3
• About 100GB of data
• Throwaway data (for now)
6. About Patch
• “HyperLocal” news sites across the
country
• Fills gap in coverage left by local
newspapers
• Currently 800 sites are live
• 1000+ by end of 2011
7. Nearby Patch Sites
• Vienna (ex. vienna.patch.com)
• Ashburn
• Reston
• McLean
• CollegePark
• GreaterAnnapolis
• 50+ in DC Area
8. Upcoming Ops Plans
• Upgrade to 1.8
• Migrate Patch to Replica Sets
• Move MapQuest to bigger hardware (16GB
-> 64GB memory)
• Add additional slaves
9. Admin Tips
• Slaves are a MUST pre1.8
• Use 64 bit version
• 32 bit version has 2.5 GB storage limit
• Use xfs or ext4
• Keep eye on oplog size
• Turn off atime & dtime
• Consider using getLastError()
10. More Admin Tips
• Increase File Descriptor Limits
• Do not use kill -9 (pre-1.8)
• Consider having a slave on replication delay
• -- slavedelay <seconds>
• db.runCommand(“logRotate”)
• Keep db.<collection>.totalIndexSize() less
than RAM
11. Even More Admin Tips
• Omit parenthesis to see command details
• 5 Primitives of Mongo
• insert, remove, update, find, getMore
• Replication is slave polling master process
• Master and slaves each have their own
oplog
• Choose shard key carefully (ex. timestamp)
12. Admin Tools
• mongodump-mongorestore
• use fsync and lock database to ensure
consistent backup
• fsync and lock are a must for file system
backups (ex LVM)
• http://localhost:28017 (server port + 1000)
• db.currentOp()
16. Even More Resources
• Follow @MongoQuestion (StackOverflow)
• MongoDB on Quora (@q_mongodb)
• 10gen Deployment Strategies Slides
• Books
• Training
• 10gen Support
17. New MongoDB Release
• 1.8 (Out Today! - March 16)
• Single server durability (journaling)
• Enhancements to sharding & replica sets
• Covered indexes
• Tab Completion
• Rename fields without pulling down
object