With Internet of Things (IoT) platforms, sensors and actuators becoming more performant, smaller, and cheaper, new opportunities emerge for diverse applications in multiple domains such as smart homes and cities, industrial automation, healthcare and retail, environment and agriculture, transportation and safety, digital surveillance and security, control systems and robotics, wireless sensor networks, and many others. The IoT community is more vibrant than ever but with the incredible device diversity in this space, we also introduce a lot of complexity for the software developer. During recent years, Intel® established itself as a leader in IoT by releasing proven developer kits and software tools with select partners for a broad range of developer personas and skill levels. This presentation focuses primarily on the MRAA and UPM middleware projects which have been a part of the Intel IoT Developer Kits since day 1 and are now proudly joining the Eclipse IoT community. The MRAA library provides an abstraction layer for several Intel and non-Intel IoT platforms, offering C/C++, Java, JavaScript, and Python bindings to the physical pins and buses. This is subsequently used by the UPM sensor library for exposing standardized APIs intended to simplify the interaction between developers and peripherals, with virtually over 400 different specialized sensors, actuators and radio modules currently supported as part of the project. //SPEAKER Tudor Panu, Intel

1. Tudor Panu
IoT Software Architect
May 2019

2. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
2
Agenda
• Introduction
• The MRAA and UPM Projects
• Deep Dive: Value Proposition, Infrastructure, Outreach Examples and more
• The Big Picture: Integrating the Tools Within the IoT Ecosystem
• Industrial Standards and Interoperability
• Future Plans

3. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
3
Why Sensor Framework?
Without Sensor Framework
Setup pinmuxes (~200 lines of code)
Interact with sensor
With Sensor Framework
(~5 lines of code)
Set Tristate
to 0
Set GPIO14
to input
Set
GPIO165 to
input
Set
GPIO236 to
output &
disable
Set
GPIO237 to
output &
disable
Set
GPIO212 to
input
Set
GPIO213 to
input
Change
pinmode
for pin 28
Change
pinmode
for pin 27
Set Tristate
to 1
Example: reading data from a typical I2C sensor
Call read
function
Call sensor
constructor
Define
smbus data
structs
Fill in
values
ioctl write
configure
sensor
Allocate
read buffer
ioctl read
• MRAA handles pinmuxing and memory
allocations
• UPM provides default configuration and
enables sensor
• Easy code portability to any MRAA
supported platform

4. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
• Standard IO Interface for all IoT Developer Kits
• Supports Intel & non-Intel (community) platforms
• Abstraction APIs:
• Open source on GitHub:
http://mraa.io
4
Eclipse MRAA - Hardware Abstraction
• GPIO
• Analog (AIO)
• PWM
• SPI
• I2C
• UART
• 1-Wire
• Firmata
• IIO
• LED APIs
Typical stack on UNIX systems:
Intel® IoT Entry,
Workstations and Servers
Aaeon* UP & UP2
UP Core Plus
and AI Plus Kits

5. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
Linux Kernel
MRAA C/C++ APIs
5
ActuatorsSensors
UPM C++ Standardized APIs
iLight iPressure iHumidity iGas iGPS iAngle
GPIO I2C SPI UART PWM
Eclipse UPM - Standardized Sensor APIs
Connectivity Industrial
ADC
iio
Libmodbus
Bacnet
Other…
…
tinyb

6. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
6
400+ specialized sensor drivers and growing, thousands of basic prototyping and
industrial sensors supported (e.g. LEDs, Switches)
• Prototype*
• Industrial*
• Connectivity*
Value Proposition

7. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
7
Distribution Channels
• Integrated with native
package managers
Ecosystem & Distribution
Multiple OS support*
Multiple language support*
IDE Integrations

8. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
8
Outreach & Adoption
Example MRAA Contributions
(code, bugfixes & samples)
• Arduino
• Siemens
• Linaro (ARM)
• Apple
• SAP, Amazon, Microsoft
Example Developer Kits with
MRAA/UPM Support
• IoT Developer Kits (with Cloud
Service partners)
• RFP Kits
• IoT reference OSs – WR Linux
and ClearLinux
Sample external usage:
• Cylon.js
• Johnny-Five
• Linaro/96 Boards Community
• Mediatek Linkit Smart
• Android Things
• STMicro
• Phytec
• ICS
• Ublox
• Technexion
• Qualcomm
• GE
• Honeywell
• Siemens
• Omron
MRAA/UPM >2K avg. clones per month
MRAA/UPM ~20K avg. monthly visitors
IoT Dev Kit >25K avg. monthly visitors
Siemens
“[…] ‘mraa’ core works flawlessly on the current generation
IoT2020”
Android Things
“I really like how so much ‘just works’ with mraa and upm”
Linaro
“Well, the first thing I like about this library (mraa) is its ability
to support many peripherals […]”

9. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
9
Authorship
Pick the FPGA class
matching requirements
Eclipse MRAA and UPM copyright ownership
74%
8%
6%
2%
2%
2%1%1%1%1%1%1%
Total
Intel Corporation
Alex Tereschenko
Linaro Ltd
Emutex Ltd
Phytec Messtechnik GmbH
Serge Vakulenko
Linaro Limited
The Regents of the University of
California
Jules Dourlens
(jdourlens@gmailcom)
TechNexion Ltd
Colin O'Flynn
Dallas Semiconductor Corporation
89%
2%
1%1%1%1%1%1%0%0%0%0%0%0%0%0%0%0%0%0%0%0%0%
Total
Intel Corporation
Nordic Semiconductor ASA
Phytec Messtechnik GmbH
Rohm Semiconductor
Daniel Mosquera
Alex Tereschenko
seeed technology inc
Adafruit Industries
Sergey Kiselev
Bosch Sensortec GmbH
SparkFun Electronics
Jun Kato
Steve Karg
The Android Open Source Project
Yannick Adam
IFE-ENS-Lyon
Mike McCauley
Juan Jose Chong
Kionix Inc
Microsoft Corporation
SEMTECH SA
MRAA Project UPM Project

10. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
10
CI and Testing Infrastructure
Pick the FPGA class
matching requirements
Both projects are setup for continuous integration as well as
static code analysis and vulnerability scans.
Builders available on DockerHub and as DockerFiles.

11. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
11
IDE Integration
IDE integration allows you to easily
discover sensors and import code
snippets to quickly develop &
prototype…

12. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
12
Sensor Catalog Template
upm.mraa.io
Discover and search the sensor library, with code snippets
and sensor datasheets…

13. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
13
Standards drive real world products and solutions.
Currently UPM supports OPC-UA using the open62541 library*. Examples
provided for both Server & Client side implementations.
Other standards considered*:
Key takeaway:
• Industry standards define data formats and protocols for compliant devices
• UPM provides implementation to data values thus complements standards
Standards Compliance

14. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
• Support for entry level generic serial/UART cameras
• UPM VCAP module provides easy integration with libjpeg for capturing snapshots from Linux
video devices
• Keeps development centered around a single set of APIs when dealing with both sensors and
cameras
• Stills can be sent for processing to the CV pipeline (training or inference)
• Vision Kits come preloaded with UPM
• UPM provides complementary libraries:
• Motor control (servo, stepper)
• Distance measurement (lidar, sonar)
• Motion detection (IR)
• Light sensors
14
Eclipse UPM and OpenVINO™ Toolkit

15. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
15
Interacting with FPGA and Vision Accelerators
• MRAA supports entry level FPGA development (Terasic DE-10 Nano)
• Easy to learn and build experience with FPGA devices
• Scale: Atom, Core or Xeon + FPGAs and/or VPUs platforms:
• Altera FPGAs available as subplatforms from the MRAA library
• Mix and match any MRAA x86 supported platform with Altera FPGA PCIe cards
• Utilize FPGAs for traditional I/O expansion or sensor fusion
• UP AI Core and Edge
• Intel® Movidius™
Pick the FPGA class
matching requirements

16. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
16
Proposed Future Development Under Eclipse
Pick the FPGA class
matching requirements
Developer Tools Launched Q1’19 Q2’19 Q3’19 Q4’19 Q1’20
 IP transfer to Eclipse
Foundation
 IEI AIoT Developer
Kits Support
MRAA
• Open Source on Github
• I/O Library
• Supports x86, ARM,
MIPS, FPGA boards and
dev kits
(v2.0) Simple I/O Protocol
Abstraction:
• GPIO, AIO, PWM, SPI,
I2C, UART, 1-Wire,
Firmata
• Portable between
supported platforms
• OSes: Linux, Android
Things, Zephyr RTOS
• Language support: C,
C++, Java, JavaScript,
Python APIs
UPM
• Open Source on Github
• Standardized sensor library
with high level APIs that make
it easy to connect and use
sensors and actuators in IOT
solutions
• Enables fast and easy
transition from prototyping to
commercial deployment
 Mock platform
improvements for
sensor virtualization
 Dev kit support for
new IoT Platforms †
(v1.7) UPM Libraries with
400+ specialized sensor
drivers
• HW agnostic across
MRAA supported
boards
• Abstracts some
industrial standards
and protocols
• OS support: Linux,
Android Things,
Zephyr RTOS
• Language support: C,
C++, Java, JavaScript,
Python APIs
 Enhance I/O support
on FPGA devices
 New I/O protocol
support: I2S
 Dev kit support for
new Client Platforms †
 2.0 Release
 IP transfer to Eclipse Foundation
 Sensor Support via TinyB
 PLC support (libplctag, Siemens* IOT2020)
 Integration with EdgeX Foundry
 ProfiBus/ProfiNet
 EtherCAT
 UPM generic interface for actuators
 Enhance OPC-UA integration
 Dev kit support for
new IoT Platforms †
 UPM generic
interface for
radios/modems
† Provided by Intel based on HW availability

17. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
17
Pick the FPGA class
matching requirements
This virtual conference offers comprehensive resources and training to help developers sharpen their
professional skills and deliver future-ready solutions. The last edition of the Intel Global IoT DevFest, held in
June 2018, delivered 75 technical sessions and attracted 28,000+ developers across 90+ countries, garnering
182,000+ unique impressions.
CHOOSE FROM 4 CONFERENCE TRACKS
 Accelerating Business Transformation with Computer Vision
 Enabling Workload Consolidation for High-Performance Industrial System
 Transforming Retail for Immersive and Personalized Experiences
 Emerging Tools and Technologies for Innovative Solutions
IMPORTANT DATES & DEADLINES
 Last date to submit abstracts: May 17, 2019
 Notification of session acceptance for speakers before: May 24, 2019
 Conference dates: June 18-19, 2019 devfest.intel.com

18. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
Legal Disclaimer & Optimization Notice
Optimization Notice
Intel’s compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors.
These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or
effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for
use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the
applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.
Notice revision #20110804
18
Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred
to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system.
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests,
such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change
to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating
your contemplated purchases, including the performance of that product when combined with other products. For more complete information
visit www.intel.com/benchmarks.
INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY
INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY
EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A
PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.
Copyright © 2018, Intel Corporation. All rights reserved. Intel, Xeon, Xeon Phi, Core, VTune, and the Intel logo are trademarks of Intel Corporation
in the U.S. and other countries.

20. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
20
 This component provides standardized, open
sourced abstraction libraries and tools
 It consists of Sensor Libraries
 And Cloud Connectors
Build Your Solution with the IoT Connection Tools
The IoT connection tools are a collection of libraries essential to any IoT solution developer.
Take advantage of tight integration with the IDE interface and project templates in Intel® System Studio.
TinyBMRAA UPM
Things
Network
Infrastructure
DataCenter/Cloud
EdgeCompute

21. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
We offer 2 projects aiming to create clean, modern and easy to use Bluetooth LE APIs.
• TinyB - exposes the BLE GATT API for C++, Java and other languages, using BlueZ over D-Bus.
• LittleB - exposes the BLE GATT API in pure C using BlueZ over SD-Bus.
• Firmata – Subplatform I/O for MCUs.
21
More on IoT Connection Tools
Serial
BLE
WiFi*
MCU
Espressif Arduino

22. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
Visualize
Learn
Build
Optimize
Deploy
Scale
22
Bridging the gap to production
• A comprehensive toolkit to
develop and deploy CV
solutions on Intel® platforms
• Harness the performance of
CV accelerators, quickly
deploy CV algorithms with
deep learning support, and
add custom kernels
Arduino Create
• Cloud based development
solution which streamlines
prototyping of commercial
based IoT solutions
• Setup made easy with
integrated Intel® based boards
• Multiple Intel® optimized
libraries available out of the box
including the IoT connection
tools
• Great for getting started and
creating proofs of concept but
can easily go beyond
• Simplifies application
deployment and device
management
• Lacks advanced debugging and
optimization features
• High performance kit
providing a clear path to
production
• Simple set up, pre-installed
Ubuntu OS, expanded, and a
means to incorporate
complex, advanced libraries
Intel® System Studio
• Easy-to-use, comprehensive
cross-platform tool suite
• Includes debuggers, analyzers
and optimization tools for IA
• Speed system and IoT device
application development, boost
performance and power
efficiency, and strengthen
system reliability
• Tight integration with the IoT
connection tools and dedicated
UI elements
• Supports C/C++ and Java
development for IoT solutions
• Steeper learning curve
Prototyping
Minimize risk by resolving unknowns
Commercial Deployment
Maximize success by optimizing solution
Project

23. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
23
Eclipse UPM and OpenVINO™ Toolkit
Static
Image
OpenCV
Process
Input Frame
FaceDetector FaceRecognizer Overlay
Status Messages → Syslog
Raw
Video
to
FFMPEG
Local
Face
DB
UPM
Selects
Input
UPM
LED
Control
MQTT
to
Web
Service
• Basic example of using UPM sensor libraries to control
the video pipeline in a Computer Vision application
• Motion sensor turns off camera when nobody is in front
of it

24. Copyright © 2018, Intel Corporation. All rights reserved.
*Other names and brands may be claimed as the property of others.
Optimization Notice
24
A Vision for the Future – AI and Sensor Fusion
Pick the FPGA class
matching requirements