NoSQL Taiwan #1 Talk

1. MongoDB
Introduction
2012/02/16
Tse-Ching Ho 何澤清

2. About me
Ruby Developer Twitter: tsechingho
2011: 開始使用 NoSQL Skype: tsechingho1978
工作。
GitHub: https://
2011.9-present: github.com/tsechingho
陽明大學生物資訊所
資深工程師

3. Not Only SQL
Key V alue Store: Column Store:
Memcached, Redis, Cassandra, Hadoop/
Couchbase Server, HBase, Hypertable,
BerkeleyDB, Riak, Amazon SimpleDB
DynamoDB
Graphic Database:
Document Store: Neo4j, InfiniteGraph,
MongoDB, CouchDB, InfoGrid, A#egroGraph,
OrientDB, RavenDB HyperGraphDB

4. What & Why

5. Size matters

6. Type matters

7. Place matters

8. Time matters

9. Money matters

10. Person matters
Easy learn, Easy use, Easy design
Quick, Agile
Flexibility
Nice APIs are best &iends

11. Specification

12. MongoDB vs RDBMS

13. Features
Written in: C++ Better update-in-place than CouchDB
Main point: Retains some &iendly Uses memory mapped files for data
properties of SQL. (Query, index) storage
License: AGPL (Drivers: Apache) Performance over features
Protocol: Custom, binary (BSON) Journaling (with --journal) is best turned
Master/slave replication (auto failover on
with replica sets) On 32bit systems, limited to ~2.5Gb
Sharding built-in An empty database takes up 192Mb
Queries are javascript expressions GridFS to store big data + metadata (not
Run arbitrary javascript functions actua#y an FS)
server-side Has geospatial indexing

14. Key Points
Document based, Eventual consistency
Co#ection driven
Replication
Embeded, Referenced
Sharding
Schema &ee
pros: easy addition
Distributed
cons: fault tolerance,
Durability migration tolerance

15. Install

16. Mac
/usr/bin/ruby -e "$(curl -fsSL https://raw.github.com/
gist/323731)"
brew insta# mongodb
cp /usr/local/Ce#ar/mongodb/2.0.2-x86_64/
org.mongodb.mongod.plist ~/Library/LaunchAgents/
launchctl load -w ~/Library/LaunchAgents/
org.mongodb.mongod.plist

17. Debian
echo "deb http://downloads-distro.mongodb.org/repo/
debian-sysvinit dist 10gen" > /etc/apt/sources.list.d/
10gen.list
apt-key adv --keyserver keyserver.ubuntu.com --recv
7F0CEB10
aptitude update
aptitude insta# mongodb-10gen

18. Ruby & Mongoid
bash -s stable < <(curl -s https://raw.github.com/
wayneeseguin/rvm/master/binscripts/rvm-insta#er )
rvm insta# ruby-1.9.3
gem insta# mongoid

19. Configuration
vim $(brew --prefix mongodb)/mongod.conf
vim /etc/mongodb.conf
dbpath = /usr/local/var/mongodb
logpath = /usr/local/var/log/mongodb
bind_ip = 127.0.0.1

20. Syntax

21. BSON
{
"_id" : ObjectId("4d3ed089#60ab534684b7e9"),
"title" : "Sir",
"name" : {
"_id" : ObjectId("4d3ed089#60ab534684b7ff "),
"first_name" : "Durran"
},
"addresses" : [
{
"_id" : ObjectId("4d3ed089#60ab534684b7e0"),
"city" : "Berlin",
"country" : "Deutschland"
}
]
}

22. Database Manipulation
mongo > db.things.count()
> help > db.things.dataSize()
> show dbs > db.things.find()
> use demo > db.things.remove()
> db.things > db.dropDatabase()
> db.things.help()
> db.things.save({name:
'NoSQL Taiwan'})

23. CRUD
Create Co#ection Update Co#ection
> db.things.insert({db: > db.things.update({db:
'mongodb', type:'native'}) 'mongodb'}, {db: 'redis'})
> db.things.update({db:
Retrieve Co#ection 'redis'}, {$set: {type: 'copy'}})
> db.things.find({db:
'mongodb'}) Delete Co#ection
> db.things.find({db: > db.things.remove({db:
'mongodb'}, {type: false}) 'redis'})

24. Query
General find Conditional Operators
<, <=, >, >=
db.things.find( { x : 3, y : "foo" } );
$a#
db.things.find({j: {$ne: 3}, k: {$gt:
$exists
10} });
$mod
Regular Expressions $ne
db.customers.find( { name : $in
{ $regex : 'acme.*corp', $options: $nin
'i' } } ); $nor
$or
$and
$size
$type

25. ELSE
Index
Map / Reduce
Transaction / ACID

26. Application

27. Replica Sets
asynchronous replication
distributing read load
automatic recovery
automatic failover
auto election of primary
primary for writes replacement of master-slave

28. Demo Code
https://github.com/tsechingho/mongodb-tutorial

29. Sharding
Balancing Shards (Replica Sets)
Failover Config Server
Scaling model Mongos (Router,
Routing Processes)

30. Sharding Components

31. Servers layout

32. Sharding Architecture

33. Usage Cases
Sma# nested data set Reproducible data set
Comments, Tweets, API fetched data
SMS
Analysis data
Manipulation log
Time careless
CMS

34. Tools

35. MongoHub
Management
http://
mongohub.todayclose.co
m/

36. Mongo 3
Data manipulation
https://github.com/
derailed/mongo3

37. Thought

38. References

39. http://nosql-database.org
http://blog.nosqlfan.com
http://www.mongodb.org
http://mongoid.org/