Using MongoDB for the Art Genome Project, presented 10/3/2011 at Mongo Boston.

1. Happiness isMongoDBMonday, October 3rd, 2011 Daniel Doubrovkine (dB.)db@art.sy@dblockdotorghttp://code.dblock.org 902 Broadway, 4th Fl.New York, NY

2. Claude Monet Mark Grotjahn Demo

3. Art Genome Project - vs. - Kasimir Malevich – “Self Portrait” William Beckman – “Self Portrait”

4. Euclidean Distance 𝑑=(100−100)2+(100−50)2+…+(75−20)2 = 42

5. Fast Search in Ruby defsimilar(a1) artworks.each { |a2| [a2, euclidean(a1, a2)] }.sort_by { |a, d| d }.take(10) end

6. MySQL Prototype Schema

7. MySQL Prototype Schema Need a sorted sparse vector on boot. [ 100, 0, 20, … 60 ] 10K artworks: 5 minutes to startup 5 minutes to accomplish … nothing.

8. Genome.genes – it’s a hash! { “Portrait” => 100, …, “Conceptual” => 20 } Genome, Embedded in Artwork MonoDB “Schema”

9. Something new? Got (far too) many years of experience with *SQL / DW @harryh uses it @ 4sq @eliothorowitzlooks pretty smart db.startups.find({ location : { $near : GA }, category : ‘nosqldb vendor' } ).first = 10gen install … ? … profit available on Heroku from MongoHQ continuous deployment friendly Choosing MongoDB

10. Using MongoDB MongoDB retrieval by ID is fast, maybe faster, than Ruby Hash Using Rails + Rake and Mongo is safer than mongo shell db.collection.update({x: y}) Shared Hosting is not Rubber, You Can’t Stretch It Map/reduce for live queries really doesn’t work, no reallymongoid_fulltext Read-secondary + Map/Reduce can be fun read_secondary: <%= $rails_rake_task.nil? or !$rails_rake_task %> Collection names are limited in length if you use mongodumphttps://jira.mongodb.org/browse/SERVER-2973, fixed in 2.0.0 copyDatabaserequires administrative privilegeshttps://jira.mongodb.org/browse/SERVER-2846

11. Mongo cursors aren’t snapshotted by defaultProcessing 5183 of 4012 …http://www.mongodb.org/display/DOCS/How+to+do+Snapshotted+Queries+in+the+Mongo+Database Mongo Interest is growing, RoR + MongoId = GTDhttp://code.dblock.org/ror-win-getting-things-done-with-mongodb-mongoid Mongoid Keeps Things Entertaining, Living on the Edge Using MongoDB(continued …)

12. MongoHQ Extensions via Heroku Production Directly w/MongoHQ A Few Hundred Bucks / mo. Mongo 1.8.1 w/ replica sets, 2 DBs and 1 arbiter Different Availability Zones Dedicated RAM, separate EBS, shared CPU Early Issues, Now Very Stable Jason McCay + other folks @ MongoHQ= Awesome Mongoid2.0.2 mongoid_slug, mongoid_fulltext, mongoid_history, delayed_job_mongoid Deploying MongoDB

13. name: Daniel Doubrovkine(aka. dB.) company: http://art.sy ^work heretwitter: @dblockdotorg blog: http://code.dblock.org ^link to slides here email: dblock@dblock.org Thank you.