SlideShare una empresa de Scribd logo
1 de 11
Descargar para leer sin conexión
“The ELASTIC project has received funding from the European Union's Horizon 2020
research and innovation programme under the grant agreement No 825473”
The ELASTIC Project
LEGaTO Final Event: Low-Energy Heterogeneous Computing Workshop
Eduardo Quiñones
eduardo.quinones@bsc.es
9/9/20
General Information
9/9/20 2
§ ELASTIC: a software architecture for Extreme-scaLe big-data
AnalyticS in fog compuTIng eCosystems
§ Under the scope of the H2020 call ICT-12-2018-2020: Big Data technologies
and extreme-scale analytics
§ 36 month project (starting Dec 2018); 6 million € budget
Motivation: The Importance of ELASTIC
9/9/20 3
1. Geographically distributed data
sources and data analytics
requirements, e.g., smart cities
2. The fulfillment of non-functional
properties inherited from the
domain: real-time, energy,
communications and security
3. Constant increment of volume,
variety and velocity of data-sets
Data sources
Large
data-sets
Edge computing
- Data collection and
transfer
- Limited computation
capabilities
Cloud computing
- Data storage
- High computation
capabilities Data
Centers
Data Analytics
Network
Latent
Data-at-rest
analytics
Reactive
data-in-motion
analytics
ComputeContinuum
A coordination of edge and
cloud resources is needed!
ELASTIC’s Vision
9/9/20 4
Cloud
Computing
ComputeContinuum
Data sources
Data analytics across the
compute continuum
1. Significantly increase the capabilities of
the data analytics
2. Integrate both responsive data-in-motion
and latent data-at-rest analytics
3. Fulfill the non-functional properties
inherit from the domain
EdgeComputing
Large data-sets
Network
ELASTIC’s Main Contribution
9/9/20 5
Productivity
A novel software architecture capable of:
1. Efficiently distribute analytics workloads
2. Combine responsive data-in-motion and
latent data-at-rest analytics
3. Fulfill the real-time, energy-efficiency,
quality of communications and security
properties
4. Use advance parallel and energy-efficiency
embedded platforms at edge side
+ Programmability
+ Portability/Scalability
+ Performance
Cloud
Computing
ComputeContinuum
Data sources
EdgeComputing
Large data-sets
Network
Data analytics across the
compute continuum
Druid dataClayKafka
Security
Time/
energy
Comm.
DeploymentScheduler
Nuvla
NuvlaBox KonnektBox MQTTCloud (Swarm/K8S)
DDAP
Fog Platform
NFR COMPSs
ELASTIC Software Architecture
9/9/20 6
Converging multiple computing areas
1. SoA data-in-motion and data-at-rest analytics
solutions supported with a Distributed Data
platform (DDAP)
2. Advanced orchestraction methods for
complex data-analytics workflow scheduling
and deployment
3. Non-functional analysis inherited from the
cyber-physical domain to monitor the
execution of workflows
4. Fog-based platforms including
§ Cloud-based Container as a Service (Caas)
technologies for resource auto-scaling
§ IoT cyber-secured communication and
network protocols
§ Advanced highly parallel and energy-
efficiency embedded platforms
Smart Mobility Use-Case
9/9/20 7
§ Test and highlight the benefits of
the ELASTIC Software architecture
§ Deployed on the Florence tramway
network (Italy)
§ Tram vehicles equipped with
§ Advanced parallel embedded processor
architectures
§ V2X communication
§ Variety of sensors (cameras,
radars/LIDAR, IMU, etc.)
ELASTIC-825473 - page 15 of 78
tional
analysis tools
Cloud and
edge run-time
services
sions (GNU)
the SCHED_PREEMPT or the SCHED_DEADLINE ad-
dressing timing or the Energy-Aware Scheduling (EAS)
framework addressing energy properties.
SteelskinPEP
(FIWARE)
Open-source
(GNU)
A XACML Policy Enforcement Point (PEP) to work along
with Keypass to restrict the access to the Platform
Keypass
(FIWARE)
Open-source
(Apache)
A flexible multi-tenant XACML server with PAP (Policy
Administration Point) and PDP (Policy Detention Point) ca-
pabilities, to manage roles and permissions in the platform I
Keystone
SCIM
Open-source
(Apache)
An identity service (OpenStack Identity API) that provides
Single Sign On (SSO) capabilities, covering both Authenti-
cation (AuthN) and RBAC Authorisation (AuthZ).
From lab to market: ELASTIC applied to the Florence tramway network
We have carefully selected a realistic use-case
from the smart mobility domain, upon which the
ELASTIC software architecture capabilities will
be tested and evaluated.
Concretely, ELASTIC use case aims to enhance
the Florence tramway network as well as its inter-
action with the private vehicle transportation in the
area of the Metropolitan City of Florence (Italy).
To do so, ELASTIC will efficiently process multi-
ple and heterogeneous streams of data coming
from multiple IoT sensors located along the three
lines of the tramway network, and the tram vehi-
cles, to extract valuable knowledge with extreme-
scale analytics, while fulfilling non-functional
properties inherited by the tramway system, i.e. Figure 4. Florence tramway networkFlorence Tramway network
Tram vehicle from the Florence
Tramway network
City of Florence
9/9/20 8
12
Figure 5: Core components of the public access Wi-Fi network are hosted
the control centre.
2.1.2 Backbone network
The backbone network relies on a fibre optics ring, connecting the core a
installed at each stop. The backbone network features a fail-safe configur
currently operated at 1 Gbps. The layout of the backbone network is show
Figure 6: A fibre optics ring connects the control centre and the sto
2.1.3 Access network
The Wi-Fi access network supports the 802.11a/b/g/n protocols
connection of common user devices; to this end, a public SSID is publishe
gain access to the Internet through a captive portal. Moreover, hidde
configured on the network. A typical configuration of the access network
one or more access points connected to the LAN switch installed in the ca
tramway stop. The typical layout of the access network at a single sto
below.
Porta
al Prato
Field cabinet
(e.g. pole / semaphore / other)
wireless
bridge
V2X
station
edge
computer
traffic control
device(s)
3
nected to the LAN switch at each stop.
nt possible locations for edge and/or fog
lights (figure (a)), lighting poles (figure (b))
(b)
ext to the traffic lights; (b) a lighting pole
a video camera; (c) cabinet at a stop.
er LAN port with PoE output, enabling
sors, cameras, etc.) – this could ease the
d for the implementation of the ELASTIC use
V2X
station
edge
computer
traffic control
device(s)
camera
Track cabinet
(at stops)
13
Figure 7: Wi-Fi access points are connected to the LAN switch at each stop.
The following pictures show the different possible locations for edge and/or fog
devices, such as cabinets next to traffic lights (figure (a)), lighting poles (figure (b))
and cabinets at stops (figure (c)).
(a) (b)
(c)
Figure 8: (a) Cabinet hosting devices next to the traffic lights; (b) a lighting pole
hosting a Wi-Fi access point and a video camera; (c) cabinet at a stop.
Access points feature a 1 Gbps copper LAN port with PoE output, enabling
connection of further devices (e.g. sensors, cameras, etc.) – this could ease the
installation of additional devices required for the implementation of the ELASTIC use
cases.
Cloud
(GEST depot)
T1 Line
Wifi
edge
computers
camera
NGAP
Wifi
LTE
ELASTIC Use-Cases
9/9/20 9
1. Next Generation Autonomous Positioning (NGAP) and
Advanced Driving Assistant System (ADAS)
§ Autonomously localize tram vehicles to support ADAS functionalities
(i.e. obstacle detection and collision avoidance) based on data
fusion coming from network and vehicle sensors
2. Predictive maintenance
§ Monitor the operation of the tramway to identify failures before
they happened
§ Driving optimization based on energy consumption, acceleration and
speed
3. Interaction between the public and the private transport in
the City of Florence
§ Enhance the transportation system to better manage interactions
between different transportation networks, i.e., public and private
Conclusions
9/9/20 10
1. ELASTIC aims to increase development and deployment
productivity of systems based on data-analytics by developing
a novel software architecture capable of guaranteeing the
non-functional properties inherited from the domain
2. ELASTIC aims to increase data analytics capabilities by
efficiently combine reactive data-in-motion and latent data-
at-rest analytics
3. ELASTIC aims to apply the software architecture to develop a
distributed sensing/computing infrastructure within the
Florence tramway network for advanced urban mobility
applications
www.elastic-project.eu
@elastic_EU www.linkedin.com/company/elastic-project
Thank you
eduardo.quinones@bsc.es

Más contenido relacionado

Más de LEGATO project

LEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming ModelsLEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming ModelsLEGATO project
 
LEGaTO: Software Stack Runtimes
LEGaTO: Software Stack RuntimesLEGaTO: Software Stack Runtimes
LEGaTO: Software Stack RuntimesLEGATO project
 
LEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous HardwareLEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous HardwareLEGATO project
 
LEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing WorkshopLEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing WorkshopLEGATO project
 
TZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZoneTZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZoneLEGATO project
 
Infection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow ComputingInfection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow ComputingLEGATO project
 
Smart Home - AI at the edge
Smart Home - AI at the edgeSmart Home - AI at the edge
Smart Home - AI at the edgeLEGATO project
 
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-ResiliencyFPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-ResiliencyLEGATO project
 
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...LEGATO project
 
Scheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric EnvironmentsScheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric EnvironmentsLEGATO project
 
RECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient ComputingRECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient ComputingLEGATO project
 
Secure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGXSecure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGXLEGATO project
 
HiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat dataHiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat dataLEGATO project
 
Moldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesMoldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesLEGATO project
 
Low Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work StealingLow Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work StealingLEGATO project
 
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...LEGATO project
 
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...LEGATO project
 
SpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surfaceSpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surfaceLEGATO project
 

Más de LEGATO project (20)

LEGaTO Integration
LEGaTO IntegrationLEGaTO Integration
LEGaTO Integration
 
LEGaTO: Use cases
LEGaTO: Use casesLEGaTO: Use cases
LEGaTO: Use cases
 
LEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming ModelsLEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming Models
 
LEGaTO: Software Stack Runtimes
LEGaTO: Software Stack RuntimesLEGaTO: Software Stack Runtimes
LEGaTO: Software Stack Runtimes
 
LEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous HardwareLEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous Hardware
 
LEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing WorkshopLEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing Workshop
 
TZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZoneTZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZone
 
Infection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow ComputingInfection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow Computing
 
Smart Home - AI at the edge
Smart Home - AI at the edgeSmart Home - AI at the edge
Smart Home - AI at the edge
 
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-ResiliencyFPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
 
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
 
Scheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric EnvironmentsScheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric Environments
 
RECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient ComputingRECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
 
Secure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGXSecure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGX
 
HiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat dataHiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat data
 
Moldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesMoldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devices
 
Low Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work StealingLow Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work Stealing
 
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
 
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
 
SpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surfaceSpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surface
 

Último

Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Sérgio Sacani
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...Sérgio Sacani
 
Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |
Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |
Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |aasikanpl
 
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxSOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxkessiyaTpeter
 
Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...Nistarini College, Purulia (W.B) India
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)PraveenaKalaiselvan1
 
Botany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsBotany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsSumit Kumar yadav
 
Boyles law module in the grade 10 science
Boyles law module in the grade 10 scienceBoyles law module in the grade 10 science
Boyles law module in the grade 10 sciencefloriejanemacaya1
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxgindu3009
 
Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptxRajatChauhan518211
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfSumit Kumar yadav
 
GFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxGFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxAleenaTreesaSaji
 
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...jana861314
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Lokesh Kothari
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bSérgio Sacani
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfSumit Kumar yadav
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfSumit Kumar yadav
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfSumit Kumar yadav
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTSérgio Sacani
 

Último (20)

Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |
Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |
Call Us ≽ 9953322196 ≼ Call Girls In Mukherjee Nagar(Delhi) |
 
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxSOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
 
Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)
 
Botany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsBotany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questions
 
Boyles law module in the grade 10 science
Boyles law module in the grade 10 scienceBoyles law module in the grade 10 science
Boyles law module in the grade 10 science
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptx
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 
GFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptxGFP in rDNA Technology (Biotechnology).pptx
GFP in rDNA Technology (Biotechnology).pptx
 
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdf
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdf
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
 

A Software Architecture for Extreme-Scale Big-Data Analytics in Fog Computing Ecosystems

  • 1. “The ELASTIC project has received funding from the European Union's Horizon 2020 research and innovation programme under the grant agreement No 825473” The ELASTIC Project LEGaTO Final Event: Low-Energy Heterogeneous Computing Workshop Eduardo Quiñones eduardo.quinones@bsc.es 9/9/20
  • 2. General Information 9/9/20 2 § ELASTIC: a software architecture for Extreme-scaLe big-data AnalyticS in fog compuTIng eCosystems § Under the scope of the H2020 call ICT-12-2018-2020: Big Data technologies and extreme-scale analytics § 36 month project (starting Dec 2018); 6 million € budget
  • 3. Motivation: The Importance of ELASTIC 9/9/20 3 1. Geographically distributed data sources and data analytics requirements, e.g., smart cities 2. The fulfillment of non-functional properties inherited from the domain: real-time, energy, communications and security 3. Constant increment of volume, variety and velocity of data-sets Data sources Large data-sets Edge computing - Data collection and transfer - Limited computation capabilities Cloud computing - Data storage - High computation capabilities Data Centers Data Analytics Network Latent Data-at-rest analytics Reactive data-in-motion analytics ComputeContinuum A coordination of edge and cloud resources is needed!
  • 4. ELASTIC’s Vision 9/9/20 4 Cloud Computing ComputeContinuum Data sources Data analytics across the compute continuum 1. Significantly increase the capabilities of the data analytics 2. Integrate both responsive data-in-motion and latent data-at-rest analytics 3. Fulfill the non-functional properties inherit from the domain EdgeComputing Large data-sets Network
  • 5. ELASTIC’s Main Contribution 9/9/20 5 Productivity A novel software architecture capable of: 1. Efficiently distribute analytics workloads 2. Combine responsive data-in-motion and latent data-at-rest analytics 3. Fulfill the real-time, energy-efficiency, quality of communications and security properties 4. Use advance parallel and energy-efficiency embedded platforms at edge side + Programmability + Portability/Scalability + Performance Cloud Computing ComputeContinuum Data sources EdgeComputing Large data-sets Network Data analytics across the compute continuum
  • 6. Druid dataClayKafka Security Time/ energy Comm. DeploymentScheduler Nuvla NuvlaBox KonnektBox MQTTCloud (Swarm/K8S) DDAP Fog Platform NFR COMPSs ELASTIC Software Architecture 9/9/20 6 Converging multiple computing areas 1. SoA data-in-motion and data-at-rest analytics solutions supported with a Distributed Data platform (DDAP) 2. Advanced orchestraction methods for complex data-analytics workflow scheduling and deployment 3. Non-functional analysis inherited from the cyber-physical domain to monitor the execution of workflows 4. Fog-based platforms including § Cloud-based Container as a Service (Caas) technologies for resource auto-scaling § IoT cyber-secured communication and network protocols § Advanced highly parallel and energy- efficiency embedded platforms
  • 7. Smart Mobility Use-Case 9/9/20 7 § Test and highlight the benefits of the ELASTIC Software architecture § Deployed on the Florence tramway network (Italy) § Tram vehicles equipped with § Advanced parallel embedded processor architectures § V2X communication § Variety of sensors (cameras, radars/LIDAR, IMU, etc.) ELASTIC-825473 - page 15 of 78 tional analysis tools Cloud and edge run-time services sions (GNU) the SCHED_PREEMPT or the SCHED_DEADLINE ad- dressing timing or the Energy-Aware Scheduling (EAS) framework addressing energy properties. SteelskinPEP (FIWARE) Open-source (GNU) A XACML Policy Enforcement Point (PEP) to work along with Keypass to restrict the access to the Platform Keypass (FIWARE) Open-source (Apache) A flexible multi-tenant XACML server with PAP (Policy Administration Point) and PDP (Policy Detention Point) ca- pabilities, to manage roles and permissions in the platform I Keystone SCIM Open-source (Apache) An identity service (OpenStack Identity API) that provides Single Sign On (SSO) capabilities, covering both Authenti- cation (AuthN) and RBAC Authorisation (AuthZ). From lab to market: ELASTIC applied to the Florence tramway network We have carefully selected a realistic use-case from the smart mobility domain, upon which the ELASTIC software architecture capabilities will be tested and evaluated. Concretely, ELASTIC use case aims to enhance the Florence tramway network as well as its inter- action with the private vehicle transportation in the area of the Metropolitan City of Florence (Italy). To do so, ELASTIC will efficiently process multi- ple and heterogeneous streams of data coming from multiple IoT sensors located along the three lines of the tramway network, and the tram vehi- cles, to extract valuable knowledge with extreme- scale analytics, while fulfilling non-functional properties inherited by the tramway system, i.e. Figure 4. Florence tramway networkFlorence Tramway network Tram vehicle from the Florence Tramway network City of Florence
  • 8. 9/9/20 8 12 Figure 5: Core components of the public access Wi-Fi network are hosted the control centre. 2.1.2 Backbone network The backbone network relies on a fibre optics ring, connecting the core a installed at each stop. The backbone network features a fail-safe configur currently operated at 1 Gbps. The layout of the backbone network is show Figure 6: A fibre optics ring connects the control centre and the sto 2.1.3 Access network The Wi-Fi access network supports the 802.11a/b/g/n protocols connection of common user devices; to this end, a public SSID is publishe gain access to the Internet through a captive portal. Moreover, hidde configured on the network. A typical configuration of the access network one or more access points connected to the LAN switch installed in the ca tramway stop. The typical layout of the access network at a single sto below. Porta al Prato Field cabinet (e.g. pole / semaphore / other) wireless bridge V2X station edge computer traffic control device(s) 3 nected to the LAN switch at each stop. nt possible locations for edge and/or fog lights (figure (a)), lighting poles (figure (b)) (b) ext to the traffic lights; (b) a lighting pole a video camera; (c) cabinet at a stop. er LAN port with PoE output, enabling sors, cameras, etc.) – this could ease the d for the implementation of the ELASTIC use V2X station edge computer traffic control device(s) camera Track cabinet (at stops) 13 Figure 7: Wi-Fi access points are connected to the LAN switch at each stop. The following pictures show the different possible locations for edge and/or fog devices, such as cabinets next to traffic lights (figure (a)), lighting poles (figure (b)) and cabinets at stops (figure (c)). (a) (b) (c) Figure 8: (a) Cabinet hosting devices next to the traffic lights; (b) a lighting pole hosting a Wi-Fi access point and a video camera; (c) cabinet at a stop. Access points feature a 1 Gbps copper LAN port with PoE output, enabling connection of further devices (e.g. sensors, cameras, etc.) – this could ease the installation of additional devices required for the implementation of the ELASTIC use cases. Cloud (GEST depot) T1 Line Wifi edge computers camera NGAP Wifi LTE
  • 9. ELASTIC Use-Cases 9/9/20 9 1. Next Generation Autonomous Positioning (NGAP) and Advanced Driving Assistant System (ADAS) § Autonomously localize tram vehicles to support ADAS functionalities (i.e. obstacle detection and collision avoidance) based on data fusion coming from network and vehicle sensors 2. Predictive maintenance § Monitor the operation of the tramway to identify failures before they happened § Driving optimization based on energy consumption, acceleration and speed 3. Interaction between the public and the private transport in the City of Florence § Enhance the transportation system to better manage interactions between different transportation networks, i.e., public and private
  • 10. Conclusions 9/9/20 10 1. ELASTIC aims to increase development and deployment productivity of systems based on data-analytics by developing a novel software architecture capable of guaranteeing the non-functional properties inherited from the domain 2. ELASTIC aims to increase data analytics capabilities by efficiently combine reactive data-in-motion and latent data- at-rest analytics 3. ELASTIC aims to apply the software architecture to develop a distributed sensing/computing infrastructure within the Florence tramway network for advanced urban mobility applications