Multi Data Center Strategies

1. Data Center Awareness

2. @spf13 AKA Steve Francia 15+ years building the internet Father, husband, skateboarder Chief Solutions Architect @ responsible for drivers, integrations, web & docs

3. Introduction The most important feature ever... When you need it

4. Multiple Data Centers Let’s describe our scenario

5. We will Build A Social Network

6. A Global Social Network For simplicity.. let’s focus on 3 locations

7. Challenges Data Consistency Maintain good user experience Scaling

8. Single Database location DB

9. Single Database location DB Fast Slo

10. Single Write location Write DB Read DB Read DB

14. We Need More Data is localized (for the most part) Users interact local to region (mostly)

15. Goals Route data locally Minimize global failures Remote data low latency Minimize remote data access

16. MongoDB

17. Local Write Write DB Read DB ReplicaDB Read Set

18. Local Write Write DB Read DB Read DB Replica Set

19. 3 locations 3 Replica Sets Write DB Write DB Write DB Read DB Read DB Read DB Read DB Read DB Read DB Replica Set Replica Set Replica Set

20. 3 locations 3 Replica Sets Write DB Write DB Write DB Read DB Read DB Read DB Read DB Read DB Read DB Replica Set Replica Set Replica Set

21. 3 locations 3 Replica Sets Read DB Write DB Read DB Write DB Read DB Read DB Replica Set Replica Set Replica Set Read DB Read DB Write DB

25. Local Writes Local REads (w/delays) Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

29. Write Concern

30. Write Concern & If a write requires a return trip What the return trip should depend on

31. Write Concern w: the number of servers to replicate to. wtimeout: timeout in ms waiting for replication. j: wait for journal sync tags: ensure replication to certain tagged nodes

32. Write Concern Mongo mongo = new Mongo( new MongoURI("mongodb:// 127.0.0.1:27017,127.0.0.1:27018")); mongo.setWriteConcern( new WriteConcern(2, 1000));

33. Write Concern Mongo mongo = new Mongo( new MongoURI("mongodb:// 127.0.0.1:27017,127.0.0.1:27018")); DBCollection users = mongo.getDB(“myapp”).getCollection(“users”); users.insert( new DBObject("name", "Kyle"), new WriteConcern(2, 1000))

39. Issues Doesn’t work with Sharding Can’t control which node to read from App needs to be aware (at some level)

40. MongoDB

41. Upcoming Features GeoAware Sharding Read Preferences

42. Geo-Aware sharding Adding second dimension to shard key Second range can be used for locality aware sharding

43. Read Preferences Read from: Primary Secondary Primary Only Secondary Only Nearest secondary querying routed to speciﬁc tags

44. Scenarios

45. Scenarios 1. Social Network 2. Analysis 3. Establishing Auth Key 4. Administration

46. Social Network Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

50. Analysis Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

51. Analysis Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

52. Analysis Write DB Write DB Read DB Read DB Read DB Read DB Write DB ReadPref : Read DB Read DB PrimaryOnly

53. Analysis Write DB Write DB Read DB Read DB Read DB Read DB Write DB ReadPref : Read DB Read DB PrimaryOnly

54. Auth Keys Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

57. Auth Keys Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB WriteConcern w : all

58. Auth Keys Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB WriteConcern w : all

59. Administration Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

60. Administration Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

61. Administration Write DB Write DB Read DB Read DB Read DB Read DB Write DB ReadPref : Read DB Read DB PrimaryOnly

62. Administration Write DB Write DB Read DB Read DB Read DB Read DB Write DB ReadPref : Read DB Read DB PrimaryOnly WriteConcern w : all

65. Conclusion MongoDB Open source enterprise features for when you need them

66. http://spf13.com http://github.com/s @spf13 Questions? download at mongodb.org We’re hiring!! Contact us at jobs@10gen.com

Multi Data Center Strategies

Recomendados

Recomendados

Más contenido relacionado

Destacado

Destacado (16)

Similar a Multi Data Center Strategies

Similar a Multi Data Center Strategies (20)

Más de Steven Francia

Más de Steven Francia (20)

Último

Último (20)

Multi Data Center Strategies

Notas del editor