The Contrail Virtual Execution Platform (VEP) allows Cloud administrators to manage data centers and monitor the usage of resources. Users can manage their distributed applications on IaaS Cloud providers under the control of Service Level Agreements (SLA). VEP applications are packaged in the standard OVF format and they are deployed inside Constrained Execution Environments (CEE) derived from the SLA, to support the specification of SLA contracts between users and providers.
These CEE environments allow to define constraints concerning virtual hardware performance, localization and affinity allowing the administrator to configure the monitoring system in order to feed external SLA enforcement services. VEP integrates elasticity management capabilities which can be controlled by external SLA enforcement services. A resource allocator service is integrated to dispatch the virtual components on the physical resources of the provider in accordance with the SLA terms.
The first version of VEP is currently implemented on OpenNebula. This talk presents the implementation of VEP on OpenNebula and discusses some implementation choices such as the resource allocator.
Bio:
Yvon Jegou got his engineering degree from Institut National des Sciences Appliquées (INSA) of Rennes (France) and then his PhD degree from the University of Rennes in 1979. He is full time Inria researcher and he is working in the Myriads project of Inria in Rennes. His research activities are centered on architecture, operating systems and compilation techniques for parallel and distributed computing. In the recent past, he has participated to many european reseach project: the IST POP project on the implementation of an OpenMP runtime system for clusters using distributed shared memories, the XtreemOS IP project on the implementation of the XtreemOS Grid operating system. He is currently deeply involved in the Contrail IP project (Open Computing Infrastructures for Elastic Services) targeting Cloud federations, coordinated by Christine Morin at INRIA-Rennes.
OpenNebulaConf 2013 - Contrail Virtual Execution Platform by Yvon Jegou
1. Contrail Virtual Execution Platform
Yvon Jegou
September 25th 2013
Myriads Research Team
INRIA Rennes Bretagne-Atlantique
France
OpenNebula Conf 2013, 24-26 September in Berlin
2. Outline
Context: the Contrail project
Contrail Virtual Execution Platform
Service Level Agreements and derived execution environments
VEP and OpenNebula
Contrail VEP/1 contrail-project.eu
3. Context: Contrail Project
Open Computing Infrastructures for Elastic Services
Contrail project objectives
Development of an integrated approach to virtualization oering
services for federating IaaS clouds and PaaS services on top of
federated clouds
Challenges
Integration of resources from multiple IaaS providers
Trust, service level agreements (SLA)
Elasticity (pay-as-you-go)
Scalability
Portability, interoperability
Security
Contrail VEP/2 contrail-project.eu
4. VEP in the Contrail Software Stack
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
Contrail VEP/3 contrail-project.eu
5. VEP in the Contrail Software Stack
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
VEP: Virtual Execution Platform
VEP sits between the
infrastructure and higher-level
layers: federation and SLA
management
VEP provides a high level
interface for application
management on heterogeneous
providers
VEP integrates SLA support
Contrail VEP/3 contrail-project.eu
6. VEP and Contrail Federation Layer
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
Contrail VEP/4 contrail-project.eu
7. VEP and Contrail Federation Layer
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
Each VEP is in charge of
managing applications on an
IaaS oer on behalf of the
federation
Provides a high level uniform
view of the infrastructure to the
federation
deployment
elasticity management
snapshot
Participates to provider selection
by the federation
Monitors the application on the
infrastructure
Contrail VEP/4 contrail-project.eu
8. VEP and Service Level Agreements
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
Contrail VEP/5 contrail-project.eu
9. VEP and Service Level Agreements
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
VEP provides support for SLA
negotiation: terms which can be
enforced, guarantees about
resource availability, ...
VEP allocates resources in-line
with agreed SLA terms
(localization, anity,
performance, ...)
VEP in charge of the monitoring
conguration
Negotiated SLAs translated in
VEP using Constrained
Execution Environments
Contrail VEP/5 contrail-project.eu
10. VEP as an Independent Service
VEP can be exploited as an independent service
RESTful API
can be exploited using a web browser
VEP manages applications as a whole
not just VMs
VEP application packaging: OVF format
OVF: Open Virtualization Format, a DMTF standard
Distributed applications made of virtual machines (or containers),
storage and networks
OVF integrates
conguration and deployment rules
means to contextualize virtual machines
VEP can exploit OVF application marketplaces
Contrail VEP/6 contrail-project.eu
11. VEP as an Independent Component (2)
Typical lifecycle of a VEP application
Virtual system disk image handling, external les
Application conguration
Execution environment specication
Resource need evaluation
Resource allocation (constraint-aware)
Contextualization
Deployment
Elasticity management
Checkpointing (potentially in OVF format)
Advance reservation of resources
Contrail VEP/7 contrail-project.eu
12. VEP as an Independent Component (2)
Typical lifecycle of a VEP application
Virtual system disk image handling, external les
Application conguration
Execution environment specication
Resource need evaluation
Resource allocation (constraint-aware)
Contextualization
Deployment
Elasticity management
Checkpointing (potentially in OVF format)
Advance reservation of resources
Performance management and resource allocation constraints
VEP Constrained Execution Environments
Contrail VEP/7 contrail-project.eu
13. CEE: Constrained Execution Environment
A CEE denes a virtual infrastructure integrating:
resource templates for computation, storage and networking
constraints on resource allocation
localization
anity
protection, security
performance
OVF applications are deployed inside CEEs
OVF virtual resources mapped on CEE resource templates and
allocated in accordance with associated constraints
CEE denition
Ready-to-use CEEs can be exported by IaaS providers
ie. A golden VM cluster with high performance interconnect
Users can denes their own CEEs
Contrail project: CEEs are derived from negotiated SLAs
Contrail VEP/8 contrail-project.eu
15. network
NFS server
mySQL server
load balancer
Apache server
L2net
largeVolume
smallVM
largeVM
sameCluster
10 Gb
CEE Constraints Resource Handlers OVF Descriptor
CEE handlers
Contrail VEP/9 contrail-project.eu
16. network
NFS server
mySQL server
load balancer
Apache server
net
NFS
mySQL
lbal
HTTP1
HTTP2
HTTP3
L2net
largeVolume
smallVM
largeVM
sameCluster
10 Gb
CEE Constraints Resource Handlers Virtual Resources OVF Descriptor
CEE handlers VEP Application
Contrail VEP/9 contrail-project.eu
17. network
NFS server
mySQL server
load balancer
Apache server
net
NFS
mySQL
lbal
HTTP1
HTTP2
HTTP3
slot
slot
slot
slot
slot
slot
slot
L2net
largeVolume
smallVM
largeVM
sameCluster
10 Gb
CEE Constraints Resource Handlers Virtual Resources OVF Descriptor
CEE handlers VEP Application
Contrail VEP/9 contrail-project.eu
18. VEP and OpenNebula
The current implementation of VEP in Contrail project targets
OpenNebula
From OVF description
disk sections ⇒ VM images
virtual systems ⇒ VM templates
product sections ⇒ contextualization
Resource allocation
VEP needs a constraint-aware resource allocator
not integrated to OpenNebula
developed as an external service
Monitoring
monitoring data for SLA enforcement and federation management
external monitoring service to export OpenNebula monitoring data
Contrail VEP/10 contrail-project.eu
19. Improvement Expected: VM Image Management
File references inside OVF disk sections
on the web
ie. OpenNebula marketplace
on image repository
on IaaS image store
OVF supports disk delta
Application snapshots (in the future)
Need for close interaction with OpenNebula implementation to reduce
image management cost
Contrail VEP/11 contrail-project.eu
20. Contrail VEP and standards
OVF (Open Virtualization Format) from DMTF: application
description
no extension to OVF
CIMI (Cloud Infrastructure Management Interface) from DMTF
VEP API based on CIMI
Future: VEP server interoperable with standard CIMI clients
In the future
OCCI (Open Cloud Computing Interface) from OGF
to support other IaaS oers
EGI
CDMI (Cloud Data Management Interface) from SNIA
for image management
Contrail VEP/12 contrail-project.eu
21. Contrail VEP Software
First version May 2012
Current release (2.1): September 2013
integrating CEE support
RESTful API (DMTF CIMI style)
Full support of CIMI planned for the nal release (2014)
VEP software: http://vep.gforge.inria.fr/index.php
Contrail VEP/13 contrail-project.eu
24. www.contrail-project.eu
Contrail is co-funded by the
EC 7th Framework Programme
Funded under: FP7 (Seventh Framework Programme)
Area: Internet of Services, Software Virtualization
(ICT-2009.1.2)
Project reference: 257438
Total cost: 11,29 million Euro
EU contribution: 8,3 million Euro
Execution: From 2010-10-01 till 2013-09-30
Duration: 36 months
Contract type: Collaborative project (generic)