IoT Edge Data Processing with NVidia Jetson Nano oct 3 2019 TensorFlow, MiNiFi, Apache NiFi, Cloudera Edge Flow Manager

1. IoT: Edge Data Processing with Jetson Nano
Meetup
3 October 2019

2. Timothy Spann
DZone Zone Leader and Big Data MVB
Princeton Future of Data Meetup
ex-Pivotal Field Engineer
@PaasDev
Author of Apache Kafka RefCard
https://github.com/tspannhw
https://community.hortonworks.com/users/9304/tspann.html
https://dzone.com/users/297029/bunkertor.html
https://community.hortonworks.com/articles/227560/real-time-stock-processing-with-apache-nifi-and-ap.html
https://www.datainmotion.dev/

3. © 2019 Cloudera, Inc. All rights reserved. 3
CDF - Apache NiFi - MiNiFi - Apache Kafka - Apache Flink - MXNet
Data Movement Streaming AnalyticsStream Processing at Scale
IOT Devices
Logs, DB, Applications etc.
Data ScienceCommon Use Cases
Data Warehouse

4. © 2019 Cloudera, Inc. All rights reserved. 4
How Does MiNiFi
Interact With NiFi?
• MiNiFi
• Receive flows
• Collect data
• Send for processing
• NiFi
• Design flows
• Aggregate data from many
sources
• Perform routing &
processing

5. © 2019 Cloudera, Inc. All rights reserved. 5
MiNiFi Agents
• C++ and Java agents
• Security & Data provenance
• Guaranteed delivery
• Data buffering, Backpressure
• Prioritized queuing, Flow QoS
• Loss tolerance
• TensorFlow support of Edge AI
• Supports IoT ecosystem
NiFi Framework
Components
MiNiFi
NiFi Framework
User Interface
Components
NiFi

6. © 2019 Cloudera, Inc. All rights reserved. 6
Cloudera Edge Management

7. © Cloudera, Inc. All rights reserved. 7
MiNiFi Agents
Choosing the right agent
MiNiFi C++
• Smaller footprint
• JNI support for all NiFi processors
• Native Python processors
• Lowest network utilization
• More performant
• More processors
• GPS, MQTT, Camera, etc
MiNiFi Java
• Fully supports all NiFi components
• JVM monitoring
• More easily deployed
• Easier to update
• Easier to develop custom features
for clients

8. © Cloudera, Inc. All rights reserved. 8
Apache NiFi - MiNiFi
Where to properly position
• IoT gateways with plethora of
interfaces
• Mission critical servers where
lightweight footprint for data
collection is needed.
• “Unclaimed environment”
• Ephemeral data collection endpoints
• Containers, cloud instances, FaaS
functions

9. © Cloudera, Inc. All rights reserved. 9
APACHE NiFi - MINIFI C++ 0.6.0
Key New Features
Feature Description Apache JIRA
NiFi JNI Bindings Ability to run any native NiFi processor via JNI. Makes all
NiFi processors available to MiNiFi C++
MINIFICPP-740
Native Python
Processors
Ability to write native MiNiFi C++ processors in Python MINIFICPP-750
PublishKafka Ability to write to secured Kafka instance MINIFICPP-731
CoAP Support Ability to communicate with EFM server over CoAP.
Drastically reduces the network impact of heartbeats
MINIFICPP-759
Windows Support Ability to install MiNiFi via a MSI MINIFICPP-700

10. © Cloudera, Inc. All rights reserved. 10
MiNiFi
Agent Bootstrapping Concerns
• Chicken and Egg problem
• To install the agent you need … ugh … well … an agent
• Partners work well here
• VMWare Pulse
• SSH based deployment automation methods
• Ansible
• Windows update methods
• You only have to get the agent on the box once. Flow configuration is handled
by EFM
• We are exploring options to make this better in the future
• This shouldn’t be a problem. Splunk customers do this today as well.

11. © 2019 Cloudera, Inc. All rights reserved. 11
Cloudera Flow Management
Enable easy ingestion, routing, management and delivery of any data anywhere (Edge, cloud,
data center) to any downstream system with built in end-to-end security and provenance
ACQUIRE PROCESS DELIVER
• Over 300 Prebuilt Processors
• Easy to build your own
• Parse, Enrich & Apply Schema
• Filter, Split, Merger & Route
• Throttle & Backpressure
• Guaranteed Delivery
• Full data provenance
• Eco-system integration
Advanced tooling to industrialize flow development
(Flow Development Life Cycle)
FTP
SFTP
HL7
UDP
XML
HTTP
EMAIL
HTML
IMAGE
SYSLOG
FTP
SFTP
HL7
UDP
XML
HTTP
EMAIL
HTML
IMAGE
SYSLOG
HASH
MERGE
EXTRACT
DUPLICATE
SPLIT
ROUTE TEXT
ROUTE CONTENT
ROUTE CONTEXT
CONTROL RATE
DISTRIBUTE LOAD
GEOENRICH
SCAN
REPLACE
TRANSLATE
CONVERT
ENCRYPT
TALL
EVALUATE
EXECUTE

12. © 2019 Cloudera, Inc. All rights reserved. 12
An overview of NiFi capabilities
Data Ingest Data Transformation Data Enrichment
HTTP
Syslog
HL7
UDP
SFTP
MQTT
WS
Hash
Compress
Merge
Duplicate
Split
Encrypt
Syslog
REST
Mapcach
Enrich IP
GeoIP
XML

13. © 2019 Cloudera, Inc. All rights reserved. 13
An overview of NiFi capabilities
Parsing Routing Data Movement
CEMEdge
Grok
Content
Regex
Attribute
HL7
NetFlow
Syslog
Partition
AttributeContent
Query
Multi-
inges
t
Multi-
inges
t
Multi-i
ngest
Merge
Priority
CDF CDF

14. © 2019 Cloudera, Inc. All rights reserved. 14
Diagram
Internet of
Things
Data
Science
Artificial Intelligence /
Machine Learning
ServerData
Preparation
Tools Person
CloudDeep
Learning

15. © 2019 Cloudera, Inc. All rights reserved. 15
Diagram

16. © 2019 Cloudera, Inc. All rights reserved. 16
Designing a Flow

17. © 2019 Cloudera, Inc. All rights reserved. 17
Designing a Flow - Configuration

18. © 2019 Cloudera, Inc. All rights reserved. 18
Designing a Flow - Reading Logs

19. © 2019 Cloudera, Inc. All rights reserved. 19
Designing a Flow - Listing Images

20. © 2019 Cloudera, Inc. All rights reserved. 20
Designing a Flow - Listing Images

21. © 2019 Cloudera, Inc. All rights reserved. 21
Google Cloud Apache NiFi Gateway

22. © 2019 Cloudera, Inc. All rights reserved. 22
Google Cloud Apache NiFi - Storage - HDFS and KUDU

23. © 2019 Cloudera, Inc. All rights reserved. 23
Google Cloud Apache NiFi - Storage - HDFS

24. © 2019 Cloudera, Inc. All rights reserved. 24
Google Cloud Apache NiFi - Storage - Apache Kudu

25. © 2019 Cloudera, Inc. All rights reserved. 25
Example JSON Data
{"uuid": "nano_uuid_kwo_20190719182103", "ipaddress": "192.168.1.254",
"top1pct": 32.6171875, "top1": "desktop computer", "cputemp": "32.5",
"gputemp": "31.5", "gputempf": "89", "cputempf": "90",
"runtime": "5", "host": "jetsonnano",
"filename": "/opt/demo/images/image_bei_20190719182103.jpg",
"imageinput": "/opt/demo/images/2019-07-19_1421.jpg",
"host_name": "jetsonnano", "macaddress": "de:07:5a:27:1e:7f", "end":
"1563560468.7867181", "te": "4.806252717971802", "systemtime":
"07/19/2019 14:21:08", "cpu": 55.8, "diskusage": "5225.1 MB",
"memory": 57.5,
"id": "20190719182103_fcaa94d4-7629-423a-b76e-714168e64677"}

26. © 2019 Cloudera, Inc. All rights reserved. 26
Example Web Camera Image

27. © 2019 Cloudera, Inc. All rights reserved. 27
Output Data to Slack

28. © 2019 Cloudera, Inc. All rights reserved. 28
Hue Data Analytics

29. © 2019 Cloudera, Inc. All rights reserved. 29
Apache MXNet YOLO DarkNet

30. © 2019 Cloudera, Inc. All rights reserved. 30
Automagic Table Creation
CREATE EXTERNAL TABLE IF NOT EXISTS hiveSensors (uuid STRING, ipaddress STRING,
top1pct DOUBLE, top1 STRING, cputemp STRING, gputemp STRING, gputempf STRING,
cputempf STRING, runtime STRING, host STRING, filename STRING, imageinput STRING,
host_name STRING, macaddress STRING, `end` STRING, te STRING, systemtime STRING,
cpu DOUBLE, diskusage STRING, memory DOUBLE, id STRING)
STORED AS ORC LOCATION '/tmp/sensors'
CREATE TABLE sensors (uuid STRING, `end` STRING, ipaddress STRING,
top1pct DOUBLE, top1 STRING, cputemp STRING, gputemp STRING, gputempf STRING, cputempf STRING, runtime
STRING, host STRING,
filename STRING, imageinput STRING, host_name STRING, macaddress STRING, te STRING, systemtime STRING, cpu
DOUBLE, diskusage STRING, memory DOUBLE, id STRING,
PRIMARY KEY (uuid, `end`)
) PARTITION BY HASH PARTITIONS 16
STORED AS KUDU TBLPROPERTIES ('kudu.num_tablet_replicas' = '1');

31. © 2019 Cloudera, Inc. All rights reserved. 31
Resources
● https://dzone.com/articles/edge-data-processing-with-jetson-nano
● https://www.datainmotion.dev/2019/07/edge-data-processing-with-jetson-nano.html
● https://www.datainmotion.dev/2019/07/edge-processing-with-jetson-nano-part-2.html
● https://www.datainmotion.dev/2019/08/edge-processing-with-jetson-nano-part-3.html
● https://www.datainmotion.dev/2019/07/powering-edge-ai-with-powerful-jetson.html
● https://dzone.com/articles/powering-edge-ai-with-the-powerful-jetson-nano
● https://github.com/tspannhw/minifi-jetson-nano

32. © Cloudera, Inc. All rights reserved. 32© Cloudera, Inc. All rights reserved.
https://www.datainmotion.dev/2019/07/edge-processing-with-jetson-nano-part-2.html

33. © 2019 Cloudera, Inc. All rights reserved. 33
Apache Hue
Visualization SQL and Query Editor & Performance Diagnostics
Tool for the Cloudera Data Platform

34. © 2019 Cloudera, Inc. All rights reserved. 34
TH N Y U

35. CONSUME AND PRODUCE KAFKA MESSAGES
https://community.cloudera.com/t5/Community-Articles/IoT-Edge-Use-Cases-with-Apache-Kafka-and-Apac
he-NiFi-MiniFi/ta-p/249232

36. © 2019 Cloudera, Inc. All rights reserved. 36
Kafka Streams Example Architecture
https://github.com/tspannhw/kstreams