In this session from IoT World 2019, we shared how AWS customers use AWS IoT to synchronize their industrial time-series data from multiple sites to the AWS Cloud, where advanced analytics and machine learning can generate valuable insights about their business.

1. © 2019, Amazon Web Services, Inc. or its Affiliates.© 2019, Amazon Web Services, Inc. or its Affiliates.
Olawale Oladehin, Worldwide Technical Leader, IoT
Distributed Solar Systems:
Revolutionizing Time-Series Predictive Analytics, IoT,
and Machine Learning with AWS
May 15, 2019

2. © 2019, Amazon Web Services, Inc. or its Affiliates.
Agenda
• Introduction
• Technical solution
• Best Practices

3. © 2019, Amazon Web Services, Inc. or its Affiliates.© 2019, Amazon Web Services, Inc. or its Affiliates.
Introduction

4. © 2019, Amazon Web Services, Inc. or its Affiliates.
Connect,
communicate,
secure
Onboard,
provision,
manage
Devices &
sensors
Connectivity &
infrastructure
Analyze,
visualize,
act
Analytics &
insights
Engage,
empower,
delight
Applications &
services
Transform,
shift culture
Change
management
IoT solutions are complex & multidimensional

5. Nobody just buys IoT technology…
they seek business outcomes

6. © 2019, Amazon Web Services, Inc. or its Affiliates.
Revenue growth
IoT data drives business growth
Operational efficiency
IoT data decreases OpEx
New services &
business models
Products that get better
with time
Better relationship
with customers
Increased
efficiency
Intelligent decision
making
Data driven
discipline
Business outcomes with IoT

7. © 2019, Amazon Web Services, Inc. or its Affiliates.

8. © 2019, Amazon Web Services, Inc. or its Affiliates.
AWS IoT architecture

9. © 2019, Amazon Web Services, Inc. or its Affiliates.
AWS IoT architecture

10. © 2019, Amazon Web Services, Inc. or its Affiliates.
How It Works

11. © 2019, Amazon Web Services, Inc. or its Affiliates.© 2019, Amazon Web Services, Inc. or its Affiliates.
Technical Solution

12. © 2019, Amazon Web Services, Inc. or its Affiliates.
EDF Renewables
+12 GW installed capacity
83%
17%
+ 13 GW under
O&M
3500 employees
1.7 GW in
construction
22 countries

13. © 2019, Amazon Web Services, Inc. or its Affiliates.
Data challenges on solar assets
An example:
Inverters
Inverters
Inverters
DC combiner boxes
DC combiner boxes
Panel temperature
sensors
MET station
Substation
Meter
Real Time Automation
Controller (RTAC)
Supervisory Control
And Data Acquisition
(SCADA)
Data historian
Modbus or
proprietary
communications
over TCP/IP or
RS485
Modbus / DNP3
Utility
DNP3
Modbus / OPC DA / DNP3
Modbus /
OPC DA /
DNP3
Trackers
Video /
camera

14. © 2019, Amazon Web Services, Inc. or its Affiliates.
Data acquisition from solar sites

15. © 2019, Amazon Web Services, Inc. or its Affiliates.
Solution overview
AWS Cloud
Solar site assets
Inverters, panel sensors, meter, met station, camera…
GridEdge
Gateway
Reporting, Analytics, Machine Learning,
Monitoring/Alerting
Solar Site (Edge) AWS Cloud
Data Consumers
Operations control center,
third parties, asset owners,
utilities…

16. © 2019, Amazon Web Services, Inc. or its Affiliates.
MQTT
High-level architecture
Solar site assets
Inverters, panel sensors, meter, met station, camera…
GridEdge Gateway
AWS CloudSolar Site (Edge)
Notifications Raw and
processed
data

17. © 2019, Amazon Web Services, Inc. or its Affiliates.
Edge detailed architecture
MQTT
Topic Structure
Shadow Sync
AWS Cloud
Shadow
Device
Registry
Greengrass
Group
Certificate
and
Policy
Device Provisioning
Site
Configuration
Solar Site (Edge)
Solar site assets
Inverters, panel sensors, meter, met station, camera…
GridEdge Gateway
Greengrass
Lambda
function
Certificate
Shadow
Modbus over TCP

18. © 2019, Amazon Web Services, Inc. or its Affiliates.
Edge configuration and IEC61850 mappings
Site layout configuration, stored in the Cloud:
{
"siteID" : "mySite01"
"points" : [
{
"modbus_start_register":"25",
"modbus_end_register":"26",
"iec_name":"INV1MMXU1.AvWPhs.mag.f",
"explanation":"active power for inverter 1",
"type":"Input Register",
"rtac_poll_frequency_ms":"1000”
}
...
]
}
Config
File
Solar Site (Edge)
Solar site assets
Inverters, panel sensors, meter, met station, camera…
GridEdge Gateway
AWS Greengrass
Lambda
function
Certificate
Modbus over TCP

19. © 2019, Amazon Web Services, Inc. or its Affiliates.
Edge data sampling and stacking
Payload:
{
"timestamp": "20181015 09:01:00",
"someField": 11
}
Time Value
09:00:10 10
09:00:20 12
09:00:30 11
09:00:40 14
09:00:50 9
09:01:00 10Config
File
Solar Site (Edge)
Solar site assets
Inverters, panel sensors, meter, met station, camera…
GridEdge Gateway
AWS Greengrass
Lambda
function
Certificate
Modbus over TCP

20. © 2019, Amazon Web Services, Inc. or its Affiliates.
Solar Site (Edge)
Edge data cleaning and tagging
Payload:
{
"timestamp": 20181015 09:01:00,
"someField ":11,
"dataQuality": {
"max": 14,
"min": 9,
"sample_count": 4,
"confidence": 0.66,
}
}
AWS Cloud
Raw Data
Raw
samples
Solar site assets
GridEdge Gateway
AWS Greengrass
Lambda
function
Certificate
Modbus over TCP
Time Value
09:00:10 10
09:00:20 NULL
09:00:30 11
Time Value
09:00:40 14
09:00:50 9
09:01:00 9999

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Edge summary
{
"timestamp": "2018-10-11 11:39:29",
"gridedgeid": "000001",
"payload": [{
"type": "SOLAR",
"name": "device.name",
"values": {
"INV6MMXU1.AvWPhs.mag.f": 809.8,
...
},
"dq": {
"INV6MMXU1.AvWPhs.mag.f": {
"max": 810.3,
"min": 809.1,
"std_deviation": 0.1678,
"sample_count": 22
},
...
}
}]
}

22. © 2019, Amazon Web Services, Inc. or its Affiliates.
Cloud - Ingestion
Solar site assets
Inverters, panel sensors, meter, met station, camera…
GridEdge
Gateway
Solar Site (Edge)
Notification
AWS Cloud
MQTT
Shadow
Rules
Engine
Reporting
EDF/3rd party integration
Datasets
Templates
and scripts
Automation

23. © 2019, Amazon Web Services, Inc. or its Affiliates.
Upcoming
Solar Site (Edge)
Solar site assets
Inverters, panel sensors, meter, met station, camera…
GridEdge Gateway
Greengrass
Certificate
Shadow
Modbus / DNP3
Raw samples Feed into ML and
complex analytics
Notification
AWS Cloud
Data Lake
Automation
Configuration
Operations
Control Center
Operators
Management and Security
Remote management
Lambda
InsightsAlerts
Detect stale data
Auto backfill data

24. © 2019, Amazon Web Services, Inc. or its Affiliates.© 2019, Amazon Web Services, Inc. or its Affiliates.
Best Practices

25. © 2019, Amazon Web Services, Inc. or its Affiliates.
Best Practices
• Start with a business outcome
• Start small but think big
• Think about infrastructure automation
• Think about data normalization

26. © 2019, Amazon Web Services, Inc. or its Affiliates.© 2019, Amazon Web Services, Inc. or its Affiliates.
Thank you!