Mesos University: Introduction to Apache Mesos Architecture and Concepts
•
1 recomendación•1,075 vistas
This document summarizes a presentation on Mesos. It discusses the origins of Mesos, including the founders in 2009. It then covers Mesos concepts like resource sharing, frameworks, and the marketplace. It describes features like arbitrary resources, roles, and monitoring. The document also discusses weaknesses like the single Mesos master and how to address this through a more robust architecture with Zookeeper and standby masters and schedulers. Finally, it briefly mentions complementary systems for file storage, service discovery, and logging.
Recomendados
Recomendados
Más contenido relacionado
Más de Publicis Sapient Engineering
Más de Publicis Sapient Engineering (20)
Último
Último (20)
Mesos University: Introduction to Apache Mesos Architecture and Concepts
- 5. @XebiaFr @YesWeScale#MesosUniversity @XebiaFr @YesWeScale#MesosUniversity
- 6. @XebiaFr @YesWeScale#MesosUniversity Bonjour Mesos @XebiaFr @YesWeScale#MesosUniversity
- 9. @XebiaFr @YesWeScale#MesosUniversity Les origines Florian Leibert Benjamin Hindman 2009
- 10. @XebiaFr @YesWeScale#MesosUniversity Les origines Florian Leibert Benjamin Hindman 2010 : incubator 2009
- 11. @XebiaFr @YesWeScale#MesosUniversity Les origines Florian Leibert Benjamin Hindman 2010 : incubator 2009
- 12. @XebiaFr @YesWeScale#MesosUniversity Les origines Florian Leibert Benjamin Hindman Tobi Knaup 2010 : incubator 2009
- 13. @XebiaFr @YesWeScale#MesosUniversity Les origines Florian Leibert Benjamin Hindman Tobi Knaup 2010 : incubator 2009 2013 2013 : top-level
- 14. @XebiaFr @YesWeScale#MesosUniversity Mesos : (n. pr.)
- 15. @XebiaFr @YesWeScale#MesosUniversity Mesos : (n. pr.) • Du Grec Ancien μέσος : milieu • Clustering générique • Interface de partage de ressources • Support d’applications distribuées
- 17. @XebiaFr @YesWeScale#MesosUniversity DRY • Start-Stop • Monitor-Clean • Multi-applications
- 19. @XebiaFr @YesWeScale#MesosUniversity Cas d’usage • Toutes applications distribuées • Augmenter la densité applicative Mesos Appli distribuée
- 23. @XebiaFr @YesWeScale#MesosUniversity @XebiaFr @YesWeScale#MesosUniversity
- 25. @XebiaFr @YesWeScale#MesosUniversity Partage de ressources
- 26. @XebiaFr @YesWeScale#MesosUniversity Partage de ressources Master Slave Slave Slave Slave
- 27. @XebiaFr @YesWeScale#MesosUniversity Partage de ressources Master Slave Slave Slave Slave cpu: 2 mem: 2048 cpu: 4 mem: 16384 cpu: 2 mem: 4096 cpu: 32 mem: 131072
- 30. @XebiaFr @YesWeScale#MesosUniversity Frameworks Scheduler Lance des tâches ( ) Executor Exécute les tâches
- 31. @XebiaFr @YesWeScale#MesosUniversity Frameworks Scheduler Lance des tâches ( ) Executor Exécute les tâches Maintient le journal de ressources Relaie les tâches aux slaves Mesos Master
- 32. @XebiaFr @YesWeScale#MesosUniversity Place de marché Master Slave Slave Slave Slave
- 33. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Place de marché Master Slave Slave Slave Slave Scheduler
- 34. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Place de marché Master Slave Slave Slave Slave Scheduler Enregistrement
- 35. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Place de marché Master Slave Slave Slave Slave Scheduler Enregistrement Évènements / Offres
- 36. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Place de marché Master Slave Slave Slave Slave Scheduler Évènements / Offres
- 37. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Place de marché Master Slave Slave Slave Slave Scheduler Tâches Évènements / Offres
- 38. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Place de marché Master Slave Slave Slave Slave Scheduler Tâches Évènements / Offres
- 40. @XebiaFr @YesWeScale#MesosUniversity Problème La vie c’est pas ça :
- 41. @XebiaFr @YesWeScale#MesosUniversity Life is a biche !
- 42. @XebiaFr @YesWeScale#MesosUniversity Life is a biche !
- 44. @XebiaFr @YesWeScale#MesosUniversity Hum hum La vie c’est ça :
- 45. @XebiaFr @YesWeScale#MesosUniversity Hum hum La vie c’est ça :
- 46. @XebiaFr @YesWeScale#MesosUniversity Hum hum La vie c’est ça :
- 47. @XebiaFr @YesWeScale#MesosUniversity Hum hum La vie c’est ça :
- 48. @XebiaFr @YesWeScale#MesosUniversity Hum hum La vie c’est ça :
- 49. @XebiaFr @YesWeScale#MesosUniversity Hum hum La vie c’est ça :
- 50. @XebiaFr @YesWeScale#MesosUniversity Mesos lave plus blanc
- 51. @XebiaFr @YesWeScale#MesosUniversity Mesos lave plus blanc • Ressources arbitraires par slave • Intégrées dans les offres • Tags pour donner du contexte
- 53. @XebiaFr @YesWeScale#MesosUniversity Ressources partagées Master Slave Slave Slave Slave
- 54. @XebiaFr @YesWeScale#MesosUniversity Ressources partagées Master Slave Slave Slave Slave cpu: 2 mem: 2048 cpu: 4 mem: 16384 cpu: 2 mem: 4096 gpu: 2 cpu: 32 mem: 131072 tag:ssd
- 55. @XebiaFr @YesWeScale#MesosUniversity Ressources partagées Master Slave Slave Slave Slave cpu: 2 mem: 2048 cpu: 4 mem: 16384 cpu: 2 mem: 4096 gpu: 2 cpu: 32 mem: 131072 tag:ssd
- 56. @XebiaFr @YesWeScale#MesosUniversity Ressources partagées Master Slave Slave Slave Slave cpu: 2 mem: 2048 cpu: 4 mem: 16384 cpu: 2 mem: 4096 gpu: 2 cpu: 32 mem: 131072 tag:ssd
- 57. @XebiaFr @YesWeScale#MesosUniversity Ressources partagées Master Slave Slave Slave Slave cpu: 2 mem: 2048 cpu: 4 mem: 16384 cpu: 2 mem: 4096 gpu: 2
- 58. @XebiaFr @YesWeScale#MesosUniversity Ressources partagées Master Slave Slave Slave Slave cpu: 2 mem: 2048 cpu: 4 mem: 16384 cpu: 2 mem: 4096 gpu: 2
- 59. @XebiaFr @YesWeScale#MesosUniversity Ressources partagées Master Slave Slave Slave Slave cpu: 2 mem: 2048 cpu: 4 mem: 16384 cpu: 2 mem: 4096 gpu: 2 cpu(prod): 16 cpu(dev): 16 mem: 131072 tag:ssd
- 61. @XebiaFr @YesWeScale#MesosUniversity Roles • Partitionnement des ressources d’un slave • Nommage arbitraires • Abonnement des schedulers
- 62. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler
- 63. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler Tâches
- 64. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler Tâches
- 65. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler Tâches
- 66. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler Tâches Évènements / Offres
- 67. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler Évènements / Offres
- 68. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler Tâches Évènements / Offres
- 69. @XebiaFr @YesWeScale#MesosUniversity Executor ExecutorExecutor Monitoring Master Slave Slave Slave Slave Scheduler Tâches Évènements / Offres
- 70. @XebiaFr @YesWeScale#MesosUniversity @XebiaFr @YesWeScale#MesosUniversity
- 71. @XebiaFr @YesWeScale#MesosUniversity DevOps tu seras @XebiaFr @YesWeScale#MesosUniversity
- 73. @XebiaFr @YesWeScale#MesosUniversity • Partager • Monitorer • Maintenir 1 ou 2 challenges
- 74. @XebiaFr @YesWeScale#MesosUniversity Il y a un dev dans ton Cloud
- 75. @XebiaFr @YesWeScale#MesosUniversity Can’t stop the bot
- 76. @XebiaFr @YesWeScale#MesosUniversity Can’t stop the bot
- 77. @XebiaFr @YesWeScale#MesosUniversity @XebiaFr @YesWeScale#MesosUniversity
- 78. @XebiaFr @YesWeScale#MesosUniversity Go Prod ! @XebiaFr @YesWeScale#MesosUniversity Toile de tente ou parachute ?
- 80. @XebiaFr @YesWeScale#MesosUniversity Faiblesses • Mesos master • Scheduler
- 81. @XebiaFr @YesWeScale#MesosUniversity Single point of truth
- 82. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Slave Slave Slave Slave
- 83. @XebiaFr @YesWeScale#MesosUniversity Master Architecture pour de vrai Master Slave Slave Slave Slave Master
- 84. @XebiaFr @YesWeScale#MesosUniversity Master Architecture pour de vrai Master Slave Slave Slave Slave Master Zookeeper
- 85. @XebiaFr @YesWeScale#MesosUniversity Master Architecture pour de vrai Master Slave Slave Slave Slave Master Zookeeper
- 86. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby
- 87. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby
- 88. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby
- 89. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby
- 90. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby
- 91. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby
- 92. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby Scheduler
- 93. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby SchedulerScheduler Scheduler
- 94. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby SchedulerScheduler Scheduler
- 95. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby SchedulerScheduler Scheduler
- 96. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby SchedulerScheduler Scheduler
- 97. @XebiaFr @YesWeScale#MesosUniversity Architecture pour de vrai Master Standby Zookeeper Master Slave Slave Slave Slave Master Standby Scheduler Scheduler Standby Scheduler Standby
- 100. @XebiaFr @YesWeScale#MesosUniversity Système de fichier • HDFS • Ceph • ZFS
- 101. @XebiaFr @YesWeScale#MesosUniversity Découverte de service • DNS • Load balancing • Convention de ports
- 103. @XebiaFr @YesWeScale#MesosUniversity @XebiaFr @YesWeScale#MesosUniversity One Cluster Manager to bring them all AND in the datacenters bind them