1. MassiveSolutions
Virtual Supercomputer (VSC)
Erlang Solutions Ltd. & Massive Solutions Ltd.

2. What is VSC?
© 2011 Massive Solutions, Erlang Solutions Ltd

3. What is VSC?
Virtual Supercomputer
© 2011 Massive Solutions, Erlang Solutions Ltd

4. What is VSC?
Virtual Supercomputer
User-oriented
© 2011 Massive Solutions, Erlang Solutions Ltd

5. What is VSC?
Virtual Supercomputer
User-oriented
Accounting
© 2011 Massive Solutions, Erlang Solutions Ltd

6. What is VSC?
Virtual Supercomputer
User-oriented
Accounting
Management
© 2011 Massive Solutions, Erlang Solutions Ltd

7. What is VSC?
Virtual Supercomputer
User-oriented
Accounting
Safety
Management
© 2011 Massive Solutions, Erlang Solutions Ltd

8. What is VSC?
Virtual Supercomputer
User-oriented
Accounting
Safety
Management
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

9. Who needs VSC?
Virtual Supercomputer
User-oriented
Accounting
Safety
Management
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

10. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
Accounting
Safety
Management
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

11. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting
Safety
Management
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

12. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety
Management
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

13. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

14. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

15. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
© 2011 Massive Solutions, Erlang Solutions Ltd

16. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Cluster owners
© 2011 Massive Solutions, Erlang Solutions Ltd

17. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Cluster owners
• Use resources efficiently
© 2011 Massive Solutions, Erlang Solutions Ltd

18. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Cluster owners
• Use resources efficiently
• Attract more users
© 2011 Massive Solutions, Erlang Solutions Ltd

19. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Cluster owners
• Use resources efficiently
• Attract more users
• Improve the investment appeal of HPC
© 2011 Massive Solutions, Erlang Solutions Ltd

20. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Application software developers Cluster owners
• Use resources efficiently
• Attract more users
• Improve the investment appeal of HPC
© 2011 Massive Solutions, Erlang Solutions Ltd

21. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Application software developers Cluster owners
• Get a wider circle of customers • Use resources efficiently
• Attract more users
• Improve the investment appeal of HPC
© 2011 Massive Solutions, Erlang Solutions Ltd

22. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Application software developers Cluster owners
• Get a wider circle of customers • Use resources efficiently
• Get a feedback from real users • Attract more users
• Improve the investment appeal of HPC
© 2011 Massive Solutions, Erlang Solutions Ltd

23. Who needs VSC?
Virtual Supercomputer
User-oriented End Users
• Start quickly and easily
Accounting • Access resources promptly
Safety • Save money
Management • Keep data safe
• Keep computation going robustly
Monitoring
Application software developers Cluster owners
• Get a wider circle of customers • Use resources efficiently
• Get a feedback from real users • Attract more users
• Cultivate a lively marketplace • Improve the investment appeal of HPC
© 2011 Massive Solutions, Erlang Solutions Ltd

24. What VSC is set up for?
The VSC platform is a replacement for personal and small-
scale computing clusters, which helps utilise idle resources
of large-scale ones.
A university or another owner of a computing cluster
connects to the VSC platform via a hardware and software
suite VSC.appliance which does all the job of integration.
The VSC platform provides the computing resource lease
service in the models of SaaS, PaaS and IaaS.
© 2011 Massive Solutions, Erlang Solutions Ltd

25. How does VSC work?
© 2011 Massive Solutions, Erlang Solutions Ltd

26. How does VSC work?
A computing resource becomes available to
the user through their account within their
currently assigned permissions.
© 2011 Massive Solutions, Erlang Solutions Ltd

27. How does VSC work?
© 2011 Massive Solutions, Erlang Solutions Ltd

28. How does VSC work?
User
© 2011 Massive Solutions, Erlang Solutions Ltd

29. How does VSC work?
User
• Chooses application software and computing
resources required by their job
© 2011 Massive Solutions, Erlang Solutions Ltd

30. How does VSC work?
User
• Chooses application software and computing
resources required by their job
• Sets parameters for the job through a user-
friendly and intuitive interface
© 2011 Massive Solutions, Erlang Solutions Ltd

31. How does VSC work?
User
• Chooses application software and computing
resources required by their job
• Sets parameters for the job through a user-
friendly and intuitive interface
• Sends their data out to VSC for processing
© 2011 Massive Solutions, Erlang Solutions Ltd

32. How does VSC work?
© 2011 Massive Solutions, Erlang Solutions Ltd

33. How does VSC work?
VSC
© 2011 Massive Solutions, Erlang Solutions Ltd

34. How does VSC work?
VSC
• Allocates resources on one or more connected
computing clusters
© 2011 Massive Solutions, Erlang Solutions Ltd

35. How does VSC work?
VSC
• Allocates resources on one or more connected
computing clusters
• Delivers an operating environment and software
to the allocated compute nodes
© 2011 Massive Solutions, Erlang Solutions Ltd

36. How does VSC work?
VSC
• Allocates resources on one or more connected
computing clusters
• Delivers an operating environment and software
to the allocated compute nodes
• Schedules the job for execution
© 2011 Massive Solutions, Erlang Solutions Ltd

37. How does VSC work?
VSC
• Allocates resources on one or more connected
computing clusters
• Delivers an operating environment and software
to the allocated compute nodes
• Schedules the job for execution
• Monitors the whole computation process
© 2011 Massive Solutions, Erlang Solutions Ltd

38. How does VSC work?
VSC
• Allocates resources on one or more connected
computing clusters
• Delivers an operating environment and software
to the allocated compute nodes
• Schedules the job for execution
• Monitors the whole computation process
• Returns the results
© 2011 Massive Solutions, Erlang Solutions Ltd

39. How does VSC work?
© 2011 Massive Solutions, Erlang Solutions Ltd

40. How does VSC work?
The user is provided with tools to monitor
and control their job during its execution.
© 2011 Massive Solutions, Erlang Solutions Ltd

41. How does VSC work?
The user is provided with tools to monitor
and control their job during its execution.
After the job is done, the user will get the
result and performance statistics.
© 2011 Massive Solutions, Erlang Solutions Ltd

42. How does VSC work?
The user is provided with tools to monitor
and control their job during its execution.
After the job is done, the user will get the
result and performance statistics.
If payment is involved (a computing resource and/or an
application software suite are being leased), then VSC
makes a money transfer from the user for the service
provided and provides detailed financial and resource
usage statistics.
© 2011 Massive Solutions, Erlang Solutions Ltd

43. Structural design of VSC
© 2011 Massive Solutions, Erlang Solutions Ltd

44. VSC components
© 2011 Massive Solutions, Erlang Solutions Ltd

45. VSC components Bundle
A bundle is an image that contains an operating
system and a preinstalled/preconfigured suite of
software, which is loaded onto a compute node
via the PXE protocol.
© 2011 Massive Solutions, Erlang Solutions Ltd

46. VSC components Bundle
A bundle is an image that contains an operating
system and a preinstalled/preconfigured suite of
software, which is loaded onto a compute node
via the PXE protocol.
Generally, a bundle is named after the software suite
installed in it, such as Gromacs or Gaussian.
© 2011 Massive Solutions, Erlang Solutions Ltd

47. VSC components Bundle
A bundle is an image that contains an operating
system and a preinstalled/preconfigured suite of
software, which is loaded onto a compute node
via the PXE protocol.
Generally, a bundle is named after the software suite
installed in it, such as Gromacs or Gaussian.
Multiple bundles may be combined into one meta
bundle. For example, the Gromacs meta bundle may
include the bundles for X86_64, PPC/CELL, and
X86_64+CUDA.
© 2011 Massive Solutions, Erlang Solutions Ltd

48. VSC components
© 2011 Massive Solutions, Erlang Solutions Ltd

49. VSC components VSC.core
The VSC platform core is a distributed suite of services
that makes up the functionality of the system and
creates a basis for customer service provision.
© 2011 Massive Solutions, Erlang Solutions Ltd

50. VSC components VSC.core
The VSC platform core is a distributed suite of services
that makes up the functionality of the system and
creates a basis for customer service provision.
It includes:
• A repository of bundles with commercial and free software
• Failsafe storage for user data
• A global resource manager
• A global monitoring functionality
• Billing
© 2011 Massive Solutions, Erlang Solutions Ltd

51. VSC.core
© 2011 Massive Solutions, Erlang Solutions Ltd

52. VSC.core — User Interfaces
VSC user
• Handles personal data
• Gets a bundle-related information and
guidelines on launching jobs with it
• Controls the job queue
• Gets statistics
Computing resource owner
(IHV)
• Handles personal data
• Gets statistics on the computing
resource usage
• Gets a financial report
© 2011 Massive Solutions, Erlang Solutions Ltd

53. VSC.core — User Interfaces
© 2011 Massive Solutions, Erlang Solutions Ltd

54. VSC.core — User Interfaces
VSC management
• User management Software (bundle) owner (ISV)
• VSC platform management • Personal data management
(registration of bundles &
computing resources)
• Application suite usage statistics
• Financial monitoring
• Financial reporting
• Job queue management
• Monitoring/statistic data analysis
• Technical monitoring of the VSC platform
• Content management
• Help Desk
© 2011 Massive Solutions, Erlang Solutions Ltd

55. VSC components
© 2011 Massive Solutions, Erlang Solutions Ltd

56. VSC components VSC.appliance
VSC.appliance is installed on a cluster site (at IHV)
and provides:
© 2011 Massive Solutions, Erlang Solutions Ltd

57. VSC components VSC.appliance
VSC.appliance is installed on a cluster site (at IHV)
and provides:
• Interaction with IHV services (network & boot
management) in order to make VSC resources
available
© 2011 Massive Solutions, Erlang Solutions Ltd

58. VSC components VSC.appliance
VSC.appliance is installed on a cluster site (at IHV)
and provides:
• Interaction with IHV services (network & boot
management) in order to make VSC resources
available
• IHV monitoring data (raw), VSC.appliance
configuration tools
© 2011 Massive Solutions, Erlang Solutions Ltd

59. VSC components VSC.appliance
VSC.appliance is installed on a cluster site (at IHV)
and provides:
• Interaction with IHV services (network & boot
management) in order to make VSC resources
available
• IHV monitoring data (raw), VSC.appliance
configuration tools
• Monitoring of computing resources
© 2011 Massive Solutions, Erlang Solutions Ltd

60. VSC components VSC.appliance
VSC.appliance is installed on a cluster site (at IHV)
and provides:
• Interaction with IHV services (network & boot
management) in order to make VSC resources
available
• IHV monitoring data (raw), VSC.appliance
configuration tools
• Monitoring of computing resources
• A data storage on demand (a data storage of IHV
can be used)
© 2011 Massive Solutions, Erlang Solutions Ltd

61. VSC Workflow
© 2011 Massive Solutions, Erlang Solutions Ltd

62. Interaction between VSC.Appliance and a cluster
© 2011 Massive Solutions, Erlang Solutions Ltd