Private Cloud Platform Mjolnirr Distributed Analytics Guide
•
0 recomendaciones•438 vistas
Mjolnirr is a private PaaS cloud platform that allows users to create their own applications and services. It features a developer API, built-in messaging, and supports third party applications. The document outlines Mjolnirr's architecture, which includes different component types, message passing functionality, and deployment methods. It also describes how Mjolnirr can be used for distributed analytics applications and the results of experiments with its parallel processing capabilities.
Recomendados
Más contenido relacionado
Similar a Private Cloud Platform Mjolnirr Distributed Analytics Guide
Similar a Private Cloud Platform Mjolnirr Distributed Analytics Guide (20)
Último
Último (20)
Private Cloud Platform Mjolnirr Distributed Analytics Guide
- 1. Mjolnirr The private cloud platform
- 2. 22.11.13 Outline ● Overview ● Architecture ● Implementation ● Getting started ● Distributed analytics with Mjolnirr ● Experiments ● Further research Mjolnirr 2
- 4. 22.11.13 What is Mjolnirr? ● Private PaaS cloud distributed platform ● Developer-friendly API ● Store ● Built-in async messaging ● JavaFX-based browser ● Third-party application support Mjolnirr 4
- 5. 22.11.13 How can I use it? ● You can create: – Your own private DropBox – Enterprise Service Desk application – Distributed analytics application – etc Mjolnirr 5
- 6. 22.11.13 Private PaaS ● Storing enterprise data in a public cloud is a definitely bad idea – – ...or stolen... – ● It can be lost... ...and you even cannot control it! Want some privacy? DIY! Mjolnirr 6
- 7. 22.11.13 Features ● JavaFX FXML layouts ● Jade language support ● CSS + ZUSS (like LESS/SASS but ZUSS) ● Can work on any computer (including PC) ● Built-in async requests system – Direct component request (by name) – Broadcat interface request (any implentation of target interface in current Mjolnirr installation) Mjolnirr 7
- 8. 22.11.13 Developer API ● Different types of components – Application – Module ● Maven plugins ● SDK ● IDE integration – Intellij IDEA Mjolnirr 8
- 10. 22.11.13 Store ● ● Store is the third-party components onlineshop For business – ● Setup your IT infrastructure fast & cheap For software companies – Expand your market share Mjolnirr 10
- 11. 22.11.13 For developers ● You can use Mjolnirr as infrastructure solution – ● If you have no enterprise clients – ● Write once — sell to anyone Use the Store to enter B2B market Feel free to fork Mjolnirr — it's open source Mjolnirr 11
- 12. 22.11.13 For business ● Easy-to-deploy infrastructure solution ● Lots of components in Store ● ● Extensible architecture — add components when you need it Integration — Mjolnirr will be integrated with SAP, PSI, Oracle, MS Dynamics etc. Mjolnirr 12
- 13. 22.11.13 Competitors ● Yandex Cocaine ● OpenStack ● VMWare Private Cloud Mjolnirr 13
- 14. 22.11.13 Yandex Cocaine ● Heroku-like PaaS ● Supports lots of languages ● ● Doesn't support application migration and container autodeployment Doesn't provide message subsystem Mjolnirr 14
- 15. 22.11.13 OpenStack ● IaaS ● Requires several servers to deploy on ● ● Works with virtual machines and, therefore, requires some software for hosting etc Doesn't provide message subsystem Mjolnirr 15
- 16. 22.11.13 VMWare Private Cloud ● ● ● Commercial IaaS Works with virtual machines and, therefore, requires some software for hosting etc Doesn't provide message subsystem Mjolnirr 16
- 19. 22.11.13 Component types ● Application – – ● Provides interface, static files and some logic [MVC] Controller + views Module – Encapsulates one entity logic – [MVC] Model Mjolnirr 19
- 24. 22.11.13 Technologies ● JavaFX ● GSON ● Guice ● HornetQ & Netty ● Maven ● Apache Commons Mjolnirr 24
- 27. 22.11.13 Sample project creation ● Mjolnirr maven archetype mvn archetype:generate -DarchetypeCatalog=http://mjolnirr.com/ archiva/repository/mjolnirr Mjolnirr 27
- 28. 22.11.13 Component POM.xml <pluginRepositories> <pluginRepository> <id>mjolnirr</id> <name>Maven Plugin Repository</name> <url> http://mjolnirr.com/archiva/repository/mjolnirr </url> </pluginRepository> </pluginRepositories> Mjolnirr 28
- 30. 22.11.13 Main component class public class Calculator extends AbstractApplication { @Override public void initialize(ComponentContext c) { this.context = c; } public String calculate(String exp) { return magic(exp); } } Mjolnirr 30
- 31. 22.11.13 Message passing Communicator communicator = new HornetCommunicator(); communicator.sendSync(context, «component», «method», args, String.class); communicator.send(context, «component», «method», args, new CallbackA()); Mjolnirr 31
- 35. 22.11.13 Analytics application ● Web pages crawling and analytics – N crawler nodes – M analytics nodes – 1 portal to represent the data Mjolnirr 35
- 37. 22.11.13 Traditional approach ● Self-written protocol or external library ● Self-written scheduling or external library ● Stand-alone applications ● Reference storage for all of the modules Mjolnirr 37
- 39. 22.11.13 Mjolnirr approach ● Automatic serialization, predefined communication protocol ● Built-in Quartz scheduling ● Automatic components management ● Automatic load balancing Mjolnirr 39
- 41. 22.11.13 Serial execution ● ● Request passed through the chain of N proxy nodes N = 10..100 Mjolnirr 41
- 42. 22.11.13 Serial execution Time in milliseconds 3000 2500 2000 1500 1000 500 0 10 25 50 100 Nodes count Mjolnirr 42
- 43. 22.11.13 Parallel execution ● N requests sent simultaneously ● Each module does some work for 10 seconds Mjolnirr 43
- 44. 22.11.13 Parallel execution 1800 Time in milliseconds 1600 1400 1200 1000 800 600 400 200 0 1 10 25 50 100 Request count Mjolnirr 44
- 46. 22.11.13 Further directions ● Application-level migration – ● Fault tolerance – ● Moving the running component instance from one container to another Automatic component distribution, state saving and resuming Better integration – Eclipse, Visual Studio Mjolnirr 46
- 47. 22.11.13 Currently implemented ● Current version is 0.2 – FXML browser – Container without application moving feature – Proxy and static file hosting – Sync and async messaging – Jade and ZUSS support Mjolnirr 47
- 48. 22.11.13 Roadmap ● 0.3 – Administrator interface – Nodes monitoring and container autodeployment – Template support – Custom classes in browser JavaScript – Netty + Protobuf – Database unified access module Mjolnirr 48
- 49. 22.11.13 Roadmap ● 0.4 – Browser plugins support – Custom FXML elements – Controller state saving Mjolnirr 49
- 50. 22.11.13 Thanks! Dmitry Savchenko, cofounder dmitry@mjolnirr.com Prokhor Mihailov, cofounder prokhor@mjolnirr.com Support: support@mjolnirr.com Project homepage: http://mjolnirr.com Mjolnirr 50