Apache edgent

Apache Edgent
Presented by: Soma Shekarchi
Supervisor: prof. Ioannis Chatzigiannakis
Course: pervasive systems
https://www.linkedin.com/in/somashekarchi/
Master of Science in Engineering in Computer Science
Why Edgent?
• Reduce Communication Cost
• React locally to events
• Collaborate with related devices
Apache Edgent
• A community for accelerating Edge Analytics
• Open Source, incubating at Apache Software
Foundation
http://edgent.incubator.apache.org/
http://wiki.apache.org/incubator/QuarksProposal
• Extensible SDK with functional flow API for streaming
analytics
Initial support for Java 8,7 & Android,
Goal is to support multiple languages with priorities
driven by the community
• A modular, lightweight and embeddable runtime
Apache Edgent
A programming model and micro-kernel style runtime that can
be embedded in gateways and small footprint edge devices
enabling local, real-time, analytics on the continuous.
streams of data coming from equipment, vehicles, systems,
appliances, devices and sensors of all kinds.
Working in conjunction with centralized analytic systems, it
provides efficient and timely analytics across the whole IoT
Ecosystem.
Streaming Analytics Paradigm
• A stream is a infinite sequence of tuples
• Events, sensor readers, location updates, …
• Everything is a stream …
•Source streams bring the raw data to be analyzed
• Functions are applied to each tuple on a stream to
produce new streams
• Filters – Only temperatures greater than 100°C
• Map – Convert a position to a distance from
another position
• Sink streams send data to external systems (e.g.
messages to a back-end)
Apache Edgent
• Analyzes data and events at the device. When we analyze on the
edge, we can:
 Reduce the amount of data transmitted to analytics servers.
 Reduce the amount of data to be stored.
• Uses analytics to determine when data needs to be sent to a back-
end system for further analysis, action, or storage.
• Shifts from sending a continuous flow of trivial data to the server to
sending only essential and meaningful data as it occurs.
History
Apache Quarks was renamed to Apache Edgent in July 2016 due to the name not being unique enough.
Feature
• Functional flow API for streaming analytics, such like Map,
Flat map, Filter, Aggregate, Split, Union, ...
• Connectors (MQTT, HTTP, Watson, JDBC, File, Kafka, Web
Socket, custom).
• Bi-directional communications with the backend.
• Web based interface to view application graph and metrics.
• Edgent uses Java Lambda expressions.
Environment
• Runs on edge device, Raspberry Pi or Android.
• Currently Java based, may support other languages as more
developers get involved.
Integration withCentralized
Deeper AnalyticalPalatforms
Integrates with centralized analytics systems
through IOT scale message hub.
 Any Hub
 Any Central System
Goal
• Edgent provides APIs and a lightweight runtime
to analyze streaming data at the edge.
Control loop through
Central Analytics
Device Model:
• Send device Events to be centrally analyzed.
• Receive device commands to alter behavior.
Simple Scenario – Single Device View
Getting started with
Apache Edgent
• Build from source to get the latest version
• Fork/Clone/download source from github.com
• Apache/incubator-edgent
• https://github.com/apache/incubator-edgent
• Download Java 8, Apache Ant, Junit, Jacoco
• Details see: DEVELOPMENT.md
• https://github.com/apache/incubator-
edgent/blob/master/DEVELOPMENT.md
• Getting started guide
• http://edgent.incubator.apache.org/docs/edgent-getting-started
Edgent Applications
Basic Edgent Applications follow a common structure:
• Get a provider
• Create the topology and compose its processing
graph
• Submit the topology for execution
Sample Application:
Temperature Sensor Application
Sample Application:
Temperature Sensor Application
Specifying a provider
Sample Application:
Temperature Sensor Application
Creating a topology
Sample Application:
Temperature Sensor Application
Sample Application:
Temperature Sensor Application
Creating a source Tstream
Sample Application:
Temperature Sensor Application
Sample Application:
Temperature Sensor Application
Sample Application:
Temperature Sensor Application
• Filtering a Tstream
• Printing to output
• Submitting my topology
After the Run
TStream<Double>filteredReadings =tempReadings.filter(reading ->reading < 50 || reading > 80);
filteredReadings.print();
dp.submit(topology);
49.904032311772596
47.97837504039084
46.59272336309031
46.681544551652934
47.400819234155236
...
Sample Application:
Temperature Sensor Application
Printing to output : we want to print results.
Sample Application:
Temperature Sensor Application
Submitting your topology :
runs a topology directly within the current virtual machine.
Sample Application:
Temperature Sensor Application
Apache edgent
1 de 27

Recomendados

Apache edgent with STM32f401 to watson iot platform por
Apache edgent with STM32f401 to watson iot platformApache edgent with STM32f401 to watson iot platform
Apache edgent with STM32f401 to watson iot platformMostafa Ramezani
81 vistas22 diapositivas
Spark Resource Manager por
Spark Resource ManagerSpark Resource Manager
Spark Resource ManagerShad Amez
75 vistas19 diapositivas
Disrupting Big Data with Apache Spark in the Cloud por
Disrupting Big Data with Apache Spark in the CloudDisrupting Big Data with Apache Spark in the Cloud
Disrupting Big Data with Apache Spark in the CloudJen Aman
1.6K vistas13 diapositivas
Shifting Data Science into High Gear por
Shifting Data Science into High GearShifting Data Science into High Gear
Shifting Data Science into High GearSpark Summit
836 vistas11 diapositivas
Data Science with Spark & Zeppelin por
Data Science with Spark & ZeppelinData Science with Spark & Zeppelin
Data Science with Spark & ZeppelinVinay Shukla
6.3K vistas15 diapositivas
Elastic APM: amplificação dos seus logs e métricas para proporcionar um panor... por
Elastic APM: amplificação dos seus logs e métricas para proporcionar um panor...Elastic APM: amplificação dos seus logs e métricas para proporcionar um panor...
Elastic APM: amplificação dos seus logs e métricas para proporcionar um panor...Elasticsearch
419 vistas21 diapositivas

Más contenido relacionado

La actualidad más candente

Apache Edgent por
Apache EdgentApache Edgent
Apache EdgentMike Frampton
38 vistas12 diapositivas
Spark Summit EU talk by Yiannis Gkoufas por
Spark Summit EU talk by Yiannis GkoufasSpark Summit EU talk by Yiannis Gkoufas
Spark Summit EU talk by Yiannis GkoufasSpark Summit
512 vistas17 diapositivas
Air Quality Data Acquisition and Management Systems for Tribes por
Air Quality Data Acquisition and Management Systems for TribesAir Quality Data Acquisition and Management Systems for Tribes
Air Quality Data Acquisition and Management Systems for TribesAgilaire LLC
408 vistas15 diapositivas
Security From The Big Data and Analytics Perspective por
Security From The Big Data and Analytics PerspectiveSecurity From The Big Data and Analytics Perspective
Security From The Big Data and Analytics PerspectiveAll Things Open
475 vistas14 diapositivas
ReactiveStream-meetup-Jan102015ppt por
ReactiveStream-meetup-Jan102015pptReactiveStream-meetup-Jan102015ppt
ReactiveStream-meetup-Jan102015pptRahul Kumar
245 vistas17 diapositivas
Internet Measurement Network por
Internet Measurement Network Internet Measurement Network
Internet Measurement Network Bangladesh Network Operators Group
657 vistas16 diapositivas

La actualidad más candente(20)

Spark Summit EU talk by Yiannis Gkoufas por Spark Summit
Spark Summit EU talk by Yiannis GkoufasSpark Summit EU talk by Yiannis Gkoufas
Spark Summit EU talk by Yiannis Gkoufas
Spark Summit512 vistas
Air Quality Data Acquisition and Management Systems for Tribes por Agilaire LLC
Air Quality Data Acquisition and Management Systems for TribesAir Quality Data Acquisition and Management Systems for Tribes
Air Quality Data Acquisition and Management Systems for Tribes
Agilaire LLC408 vistas
Security From The Big Data and Analytics Perspective por All Things Open
Security From The Big Data and Analytics PerspectiveSecurity From The Big Data and Analytics Perspective
Security From The Big Data and Analytics Perspective
All Things Open475 vistas
ReactiveStream-meetup-Jan102015ppt por Rahul Kumar
ReactiveStream-meetup-Jan102015pptReactiveStream-meetup-Jan102015ppt
ReactiveStream-meetup-Jan102015ppt
Rahul Kumar245 vistas
Spark Summit EU talk by Dean Wampler por Spark Summit
Spark Summit EU talk by Dean WamplerSpark Summit EU talk by Dean Wampler
Spark Summit EU talk by Dean Wampler
Spark Summit2.7K vistas
_Search? Made Simple: Elastic + App Search por Elasticsearch
_Search? Made Simple: Elastic + App Search_Search? Made Simple: Elastic + App Search
_Search? Made Simple: Elastic + App Search
Elasticsearch574 vistas
#GeodeSummit: Democratizing Fast Analytics with Ampool (Powered by Apache Geode) por PivotalOpenSourceHub
#GeodeSummit: Democratizing Fast Analytics with Ampool (Powered by Apache Geode)#GeodeSummit: Democratizing Fast Analytics with Ampool (Powered by Apache Geode)
#GeodeSummit: Democratizing Fast Analytics with Ampool (Powered by Apache Geode)
PivotalOpenSourceHub2.6K vistas
Building a Streaming Pipeline on Kubernetes Using Kafka Connect, KSQLDB & Apa... por HostedbyConfluent
Building a Streaming Pipeline on Kubernetes Using Kafka Connect, KSQLDB & Apa...Building a Streaming Pipeline on Kubernetes Using Kafka Connect, KSQLDB & Apa...
Building a Streaming Pipeline on Kubernetes Using Kafka Connect, KSQLDB & Apa...
HostedbyConfluent649 vistas
SparkR + Zeppelin por felixcss
SparkR + ZeppelinSparkR + Zeppelin
SparkR + Zeppelin
felixcss6.8K vistas
Nordstrom Customer Presentation por Splunk
Nordstrom Customer PresentationNordstrom Customer Presentation
Nordstrom Customer Presentation
Splunk563 vistas
Mongo DB on Apache Stratos por WSO2
Mongo DB on Apache StratosMongo DB on Apache Stratos
Mongo DB on Apache Stratos
WSO2867 vistas
JCon - Zero-Downtime-Deployment with Kubernetes, Spring Boot and Flyway por Nicolas Frankel
JCon - Zero-Downtime-Deployment with Kubernetes, Spring Boot and FlywayJCon - Zero-Downtime-Deployment with Kubernetes, Spring Boot and Flyway
JCon - Zero-Downtime-Deployment with Kubernetes, Spring Boot and Flyway
Nicolas Frankel285 vistas
VoxxedDays Cluj - Zero-downtime deployment with Kubernetes, Spring Boot and F... por Nicolas Frankel
VoxxedDays Cluj - Zero-downtime deployment with Kubernetes, Spring Boot and F...VoxxedDays Cluj - Zero-downtime deployment with Kubernetes, Spring Boot and F...
VoxxedDays Cluj - Zero-downtime deployment with Kubernetes, Spring Boot and F...
Nicolas Frankel181 vistas
LF_APIStrat17_Diving Deep into the API Ocean with Open Source Deep Learning T... por LF_APIStrat
LF_APIStrat17_Diving Deep into the API Ocean with Open Source Deep Learning T...LF_APIStrat17_Diving Deep into the API Ocean with Open Source Deep Learning T...
LF_APIStrat17_Diving Deep into the API Ocean with Open Source Deep Learning T...
LF_APIStrat104 vistas
Leveraging the power of solr with spark por jweigend
Leveraging the power of solr with sparkLeveraging the power of solr with spark
Leveraging the power of solr with spark
jweigend1.1K vistas
How Apache Spark Is Helping Tame the Wild West of Wi-Fi por Spark Summit
How Apache Spark Is Helping Tame the Wild West of Wi-FiHow Apache Spark Is Helping Tame the Wild West of Wi-Fi
How Apache Spark Is Helping Tame the Wild West of Wi-Fi
Spark Summit1.1K vistas
Anomaly Detection at Scale! por Databricks
Anomaly Detection at Scale!Anomaly Detection at Scale!
Anomaly Detection at Scale!
Databricks377 vistas
Spark at Airbnb por Hao Wang
Spark at AirbnbSpark at Airbnb
Spark at Airbnb
Hao Wang545 vistas

Similar a Apache edgent

Ultralight data movement for IoT with SDC Edge. Guglielmo Iozzia - Optum por
Ultralight data movement for IoT with SDC Edge. Guglielmo Iozzia - OptumUltralight data movement for IoT with SDC Edge. Guglielmo Iozzia - Optum
Ultralight data movement for IoT with SDC Edge. Guglielmo Iozzia - OptumData Driven Innovation
81 vistas22 diapositivas
Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline... por
Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline...Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline...
Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline...Provectus
595 vistas61 diapositivas
posterPDF por
posterPDFposterPDF
posterPDFIlisha Ramachandran
43 vistas1 diapositiva
Scalable Open-Source IoT Solutions on Microsoft Azure por
Scalable Open-Source IoT Solutions on Microsoft AzureScalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft AzureMaxim Ivannikov
749 vistas33 diapositivas
Cloud lunch and learn real-time streaming in azure por
Cloud lunch and learn real-time streaming in azureCloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azureTimothy Spann
663 vistas75 diapositivas
Introduction to Apache Apex and writing a big data streaming application por
Introduction to Apache Apex and writing a big data streaming application  Introduction to Apache Apex and writing a big data streaming application
Introduction to Apache Apex and writing a big data streaming application Apache Apex
817 vistas30 diapositivas

Similar a Apache edgent(20)

Ultralight data movement for IoT with SDC Edge. Guglielmo Iozzia - Optum por Data Driven Innovation
Ultralight data movement for IoT with SDC Edge. Guglielmo Iozzia - OptumUltralight data movement for IoT with SDC Edge. Guglielmo Iozzia - Optum
Ultralight data movement for IoT with SDC Edge. Guglielmo Iozzia - Optum
Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline... por Provectus
Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline...Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline...
Data Summer Conf 2018, “Building unified Batch and Stream processing pipeline...
Provectus595 vistas
Scalable Open-Source IoT Solutions on Microsoft Azure por Maxim Ivannikov
Scalable Open-Source IoT Solutions on Microsoft AzureScalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft Azure
Maxim Ivannikov749 vistas
Cloud lunch and learn real-time streaming in azure por Timothy Spann
Cloud lunch and learn real-time streaming in azureCloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azure
Timothy Spann663 vistas
Introduction to Apache Apex and writing a big data streaming application por Apache Apex
Introduction to Apache Apex and writing a big data streaming application  Introduction to Apache Apex and writing a big data streaming application
Introduction to Apache Apex and writing a big data streaming application
Apache Apex817 vistas
JCConf 2017 - Next Generation of Cloud Computing: Edge Computing and Apache E... por Joseph Kuo
JCConf 2017 - Next Generation of Cloud Computing: Edge Computing and Apache E...JCConf 2017 - Next Generation of Cloud Computing: Edge Computing and Apache E...
JCConf 2017 - Next Generation of Cloud Computing: Edge Computing and Apache E...
Joseph Kuo458 vistas
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ... por confluent
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
confluent1.4K vistas
Sanger, upcoming Openstack for Bio-informaticians por Peter Clapham
Sanger, upcoming Openstack for Bio-informaticiansSanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticians
Peter Clapham271 vistas
Current and Future of Apache Kafka por Joe Stein
Current and Future of Apache KafkaCurrent and Future of Apache Kafka
Current and Future of Apache Kafka
Joe Stein9K vistas
Introduction to Apache Apex por Apache Apex
Introduction to Apache ApexIntroduction to Apache Apex
Introduction to Apache Apex
Apache Apex959 vistas
Scaling out Driverless AI with IBM Spectrum Conductor - Kevin Doyle - H2O AI ... por Sri Ambati
Scaling out Driverless AI with IBM Spectrum Conductor - Kevin Doyle - H2O AI ...Scaling out Driverless AI with IBM Spectrum Conductor - Kevin Doyle - H2O AI ...
Scaling out Driverless AI with IBM Spectrum Conductor - Kevin Doyle - H2O AI ...
Sri Ambati721 vistas
Himansu-Java&BigdataDeveloper por Himansu Behera
Himansu-Java&BigdataDeveloperHimansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloper
Himansu Behera350 vistas
Netflix Cloud Architecture and Open Source por aspyker
Netflix Cloud Architecture and Open SourceNetflix Cloud Architecture and Open Source
Netflix Cloud Architecture and Open Source
aspyker7.7K vistas
Azure Monitoring Overview por gjuljo
Azure Monitoring OverviewAzure Monitoring Overview
Azure Monitoring Overview
gjuljo7K vistas
Music city data Hail Hydrate! from stream to lake por Timothy Spann
Music city data Hail Hydrate! from stream to lakeMusic city data Hail Hydrate! from stream to lake
Music city data Hail Hydrate! from stream to lake
Timothy Spann708 vistas
From Device to Data Center to Insights: Architectural Considerations for the ... por P. Taylor Goetz
From Device to Data Center to Insights: Architectural Considerations for the ...From Device to Data Center to Insights: Architectural Considerations for the ...
From Device to Data Center to Insights: Architectural Considerations for the ...
P. Taylor Goetz324 vistas

Último

Setting Up Your First CloudStack Environment with Beginners Challenges - MD R... por
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...ShapeBlue
178 vistas15 diapositivas
Transcript: Redefining the book supply chain: A glimpse into the future - Tec... por
Transcript: Redefining the book supply chain: A glimpse into the future - Tec...Transcript: Redefining the book supply chain: A glimpse into the future - Tec...
Transcript: Redefining the book supply chain: A glimpse into the future - Tec...BookNet Canada
41 vistas16 diapositivas
"Node.js Development in 2024: trends and tools", Nikita Galkin por
"Node.js Development in 2024: trends and tools", Nikita Galkin "Node.js Development in 2024: trends and tools", Nikita Galkin
"Node.js Development in 2024: trends and tools", Nikita Galkin Fwdays
33 vistas38 diapositivas
The Power of Heat Decarbonisation Plans in the Built Environment por
The Power of Heat Decarbonisation Plans in the Built EnvironmentThe Power of Heat Decarbonisation Plans in the Built Environment
The Power of Heat Decarbonisation Plans in the Built EnvironmentIES VE
84 vistas20 diapositivas
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ... por
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...ShapeBlue
120 vistas17 diapositivas
Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And... por
Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And...Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And...
Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And...ShapeBlue
108 vistas12 diapositivas

Último(20)

Setting Up Your First CloudStack Environment with Beginners Challenges - MD R... por ShapeBlue
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...
ShapeBlue178 vistas
Transcript: Redefining the book supply chain: A glimpse into the future - Tec... por BookNet Canada
Transcript: Redefining the book supply chain: A glimpse into the future - Tec...Transcript: Redefining the book supply chain: A glimpse into the future - Tec...
Transcript: Redefining the book supply chain: A glimpse into the future - Tec...
BookNet Canada41 vistas
"Node.js Development in 2024: trends and tools", Nikita Galkin por Fwdays
"Node.js Development in 2024: trends and tools", Nikita Galkin "Node.js Development in 2024: trends and tools", Nikita Galkin
"Node.js Development in 2024: trends and tools", Nikita Galkin
Fwdays33 vistas
The Power of Heat Decarbonisation Plans in the Built Environment por IES VE
The Power of Heat Decarbonisation Plans in the Built EnvironmentThe Power of Heat Decarbonisation Plans in the Built Environment
The Power of Heat Decarbonisation Plans in the Built Environment
IES VE84 vistas
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ... por ShapeBlue
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
ShapeBlue120 vistas
Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And... por ShapeBlue
Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And...Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And...
Enabling DPU Hardware Accelerators in XCP-ng Cloud Platform Environment - And...
ShapeBlue108 vistas
NTGapps NTG LowCode Platform por Mustafa Kuğu
NTGapps NTG LowCode Platform NTGapps NTG LowCode Platform
NTGapps NTG LowCode Platform
Mustafa Kuğu437 vistas
Why and How CloudStack at weSystems - Stephan Bienek - weSystems por ShapeBlue
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystems
ShapeBlue247 vistas
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue por ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlueVNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
ShapeBlue207 vistas
Ransomware is Knocking your Door_Final.pdf por Security Bootcamp
Ransomware is Knocking your Door_Final.pdfRansomware is Knocking your Door_Final.pdf
Ransomware is Knocking your Door_Final.pdf
Security Bootcamp98 vistas
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... por ShapeBlue
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
ShapeBlue141 vistas
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue por ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
ShapeBlue224 vistas
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... por TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc176 vistas
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue por ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlueCloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
ShapeBlue137 vistas
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue por ShapeBlue
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlueWhat’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue
ShapeBlue265 vistas
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue por ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
ShapeBlue152 vistas
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... por ShapeBlue
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
ShapeBlue171 vistas
Initiating and Advancing Your Strategic GIS Governance Strategy por Safe Software
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
Safe Software184 vistas

Apache edgent

  • 1. Apache Edgent Presented by: Soma Shekarchi Supervisor: prof. Ioannis Chatzigiannakis Course: pervasive systems https://www.linkedin.com/in/somashekarchi/ Master of Science in Engineering in Computer Science
  • 2. Why Edgent? • Reduce Communication Cost • React locally to events • Collaborate with related devices
  • 3. Apache Edgent • A community for accelerating Edge Analytics • Open Source, incubating at Apache Software Foundation http://edgent.incubator.apache.org/ http://wiki.apache.org/incubator/QuarksProposal • Extensible SDK with functional flow API for streaming analytics Initial support for Java 8,7 & Android, Goal is to support multiple languages with priorities driven by the community • A modular, lightweight and embeddable runtime
  • 4. Apache Edgent A programming model and micro-kernel style runtime that can be embedded in gateways and small footprint edge devices enabling local, real-time, analytics on the continuous. streams of data coming from equipment, vehicles, systems, appliances, devices and sensors of all kinds. Working in conjunction with centralized analytic systems, it provides efficient and timely analytics across the whole IoT Ecosystem.
  • 5. Streaming Analytics Paradigm • A stream is a infinite sequence of tuples • Events, sensor readers, location updates, … • Everything is a stream … •Source streams bring the raw data to be analyzed • Functions are applied to each tuple on a stream to produce new streams • Filters – Only temperatures greater than 100°C • Map – Convert a position to a distance from another position • Sink streams send data to external systems (e.g. messages to a back-end)
  • 6. Apache Edgent • Analyzes data and events at the device. When we analyze on the edge, we can:  Reduce the amount of data transmitted to analytics servers.  Reduce the amount of data to be stored. • Uses analytics to determine when data needs to be sent to a back- end system for further analysis, action, or storage. • Shifts from sending a continuous flow of trivial data to the server to sending only essential and meaningful data as it occurs.
  • 7. History Apache Quarks was renamed to Apache Edgent in July 2016 due to the name not being unique enough.
  • 8. Feature • Functional flow API for streaming analytics, such like Map, Flat map, Filter, Aggregate, Split, Union, ... • Connectors (MQTT, HTTP, Watson, JDBC, File, Kafka, Web Socket, custom). • Bi-directional communications with the backend. • Web based interface to view application graph and metrics. • Edgent uses Java Lambda expressions.
  • 9. Environment • Runs on edge device, Raspberry Pi or Android. • Currently Java based, may support other languages as more developers get involved.
  • 10. Integration withCentralized Deeper AnalyticalPalatforms Integrates with centralized analytics systems through IOT scale message hub.  Any Hub  Any Central System
  • 11. Goal • Edgent provides APIs and a lightweight runtime to analyze streaming data at the edge.
  • 12. Control loop through Central Analytics Device Model: • Send device Events to be centrally analyzed. • Receive device commands to alter behavior.
  • 13. Simple Scenario – Single Device View
  • 14. Getting started with Apache Edgent • Build from source to get the latest version • Fork/Clone/download source from github.com • Apache/incubator-edgent • https://github.com/apache/incubator-edgent • Download Java 8, Apache Ant, Junit, Jacoco • Details see: DEVELOPMENT.md • https://github.com/apache/incubator- edgent/blob/master/DEVELOPMENT.md • Getting started guide • http://edgent.incubator.apache.org/docs/edgent-getting-started
  • 15. Edgent Applications Basic Edgent Applications follow a common structure: • Get a provider • Create the topology and compose its processing graph • Submit the topology for execution
  • 17. Sample Application: Temperature Sensor Application Specifying a provider
  • 18. Sample Application: Temperature Sensor Application Creating a topology
  • 20. Sample Application: Temperature Sensor Application Creating a source Tstream
  • 23. Sample Application: Temperature Sensor Application • Filtering a Tstream • Printing to output • Submitting my topology After the Run TStream<Double>filteredReadings =tempReadings.filter(reading ->reading < 50 || reading > 80); filteredReadings.print(); dp.submit(topology); 49.904032311772596 47.97837504039084 46.59272336309031 46.681544551652934 47.400819234155236 ...
  • 24. Sample Application: Temperature Sensor Application Printing to output : we want to print results.
  • 25. Sample Application: Temperature Sensor Application Submitting your topology : runs a topology directly within the current virtual machine.