1. IEEE San Diego
Power & Energy
And
Power Electronics
Societies
Joint Presentation
SDG&E Applications of
PMUs – Handling of Big
Data with PMU Applications
2. IEEE San Diego
Power & Energy
And
Power Electronics
Societies
Joint Presentation
Bert Taube, Ph.D.
Principal Consultant
DNV GL
December 3rd, 2014
Advanced Utility Analytics
with Object-Oriented
Database Technology
3. 3
IEEE San Diego - Power & Energy and Power Electronics Societies
Overview
• Uniqueness of Utility Big Data Context and critical Use Cases requiring
Advanced Data Management and Analytics Technologies
• Data Modelling Capabilities necessary for Advanced Utility Data
Management and Analytics
• Integrated NoSQL Data Management & Analytics Solution Development
Framework for Utilities/ISOs
• Total Cost of Ownership (TCO) and Performance: NoSQL vs. MySQL
• Examples of effective Performance of NoSQL Data Management &
Analytics Solutions for Utilities/ISOs
• PMU Data Analytics: NoSQL-Based Big Data Solutions to create Wide-
Area, Real-Time Situational Awareness
• PMU Data Analytics: NoSQL-Based Real-Time Simulation driven by
PMU Data to recognize and avoid Wide-Area Blackouts
4. 4
IEEE San Diego - Power & Energy and Power Electronics Societies
Uniqueness of Big Utility Data
Context and Critical Use Cases
describing the Need for
Advanced Utility Data
Management and Analytics
5. 5
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
Data Diversity Challenge
6. 6
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
Network Data Analytics Use Cases
7. 7
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
The Solution Development & Deployment Process
PMU
AMI
RTU
Data Science
(DNV GL)
Solution Development & Deployment
(DNV GL & Technology Partner)
Power Delivery
Infrastructure
Systems
(internal)
Systems
(external)
Data
Discovery
Discover Develop
Discovery
Platform
Discovery
Report
(Discovered
Use Cases)
Offline
Analytics
Develop.
Develop.
Platform
Data
Analytics
(Developed
Algorithms)
Offline
Solution
Develop.
Develop.
Platform
Analytics
Solution
(Developed
Software)
Offline
Develop Deploy
Solution
Deploym.
Deploym.
Platform
Deployed
Solution
(Deployed
Software)
Online
8. 8
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
Business Models
Business Model 1: Software as a Product (SaaP)
Data Science
(DNV GL)
Software Development & Deployment
(DNV GL & Software Technology Partner)
Data Discovery
Analytics
Development
Software Solution
Development
Software Solution
Deployment
Customer buys Software Product from DNV GL (Operation on Premise or in Cloud).
Customer owns, operates and maintains it. DNV GL may support operation & maintenance.
Business Model 2: Software as a Service (SaaS)
Data Science
(DNV GL)
Software Development & Deployment
(DNV GL & Software Technology Partner)
Data Discovery
Analytics
Development
Software Solution
Development
Software Solution
Deployment
Customer buys Result from running Software Product from DNV GL (Operation in Cloud or on
Premise). DNV GL owns, operates and maintains it.
9. 9
IEEE San Diego - Power & Energy and Power Electronics Societies
Integrated NoSQL Data
Management & Analytics
Solution Development
Framework for Utilities/ISOs
10. 10
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
Fundamental Dilemma of Database Software
11. 11
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
NoSQL-Based Data Solution Development Framework
12. 12
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
NoSQL-Based Data Solution Development Framework
13. 13
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
NoSQL-Based Data Integration
Utilities need Object Database Solutions to accommodate Variety of
Data Models for effective Utility Data Analytics!
14. 14
IEEE San Diego - Power & Energy and Power Electronics Societies
Utility Big Data Management & Analytics
NoSQL-Based Data Visualization and Analytics
15. 15
IEEE San Diego - Power & Energy and Power Electronics Societies
Integrated NoSQL-Based Utility Big Data Solution
Development Framework - Benefits
16. 16
IEEE San Diego - Power & Energy and Power Electronics Societies
Total Cost of Ownership and
Performance:
NoSQL vs. MySQL
17. 17
IEEE San Diego - Power & Energy and Power Electronics Societies
Total Cost of Ownership & Performance:
NoSQL vs. MySQL
18. 18
IEEE San Diego - Power & Energy and Power Electronics Societies
Total Cost of Ownership & Performance:
NoSQL vs. MySQL
19. 19
IEEE San Diego - Power & Energy and Power Electronics Societies
Total Cost of Ownership & Performance:
NoSQL vs. MySQL
21. 21
IEEE San Diego - Power & Energy and Power Electronics Societies
NoSQL-Based Big Data Solutions -
Examples for Technology Adoption by Industries
22. 22
IEEE San Diego - Power & Energy and Power Electronics Societies
NoSQL-Based Big Data Solutions -
Examples for Technology Adoption by ISOs
23. 23
IEEE San Diego - Power & Energy and Power Electronics Societies
PMU Data Analytics:
NoSQL-Based Big Data Solutions
to create Real-Time, Wide-Area
Situational Awareness
in Power Transmission
24. 24
IEEE San Diego - Power & Energy and Power Electronics Societies
Grid Analytics – PMU Data Challenge
25. 25
IEEE San Diego - Power & Energy and Power Electronics Societies
Grid Analytics – PMU Data Analytics
Wide Area Grid Measurements
(Power Transmission)
ISO Backend Information System (Control Center)
PMU/Synchrophasor
Communication
Infrastructure
PMU 1PMU
Head-
End
System
PDMS
GIS
ISO/Utility Communication Infrastructure
NoSQL
GIS
Interface
NoSQL
PDMS
Interface
NoSQL Big Data
Solution
Phase Angular
Analysis
Damping Factor
Analysis
Frequency
Analysis
Power Quality
Analysis
PMU 1000
…
Environmental Information
Communication Infrastructure
26. 26
IEEE San Diego - Power & Energy and Power Electronics Societies
PMU Data Analytics:
A NoSQL-Based Real-Time
Simulation driven by PMU Data
enabling Wide-Area Situational
Awareness to recognize and
avoid Blackouts
27. 27
IEEE San Diego - Power & Energy and Power Electronics Societies
Need for Real-Time, Wide Area Situational Awareness
driven by PMU Data – The 2003 Blackout Example
28. 28
IEEE San Diego - Power & Energy and Power Electronics Societies
Need for Real-Time, Wide Area Situational Awareness
driven by PMU Data – The 2003 Blackout Example
29. 29
IEEE San Diego - Power & Energy and Power Electronics Societies
Need for Real-Time, Wide Area Situational Awareness
driven by PMU Data – Change in Power Flow/Angular Δ
Changes in Direction of Power Flow during the Course of Blackout Events correlated with
severe Changes in Phase Angular Differences between Locations involved!
30. 30
IEEE San Diego - Power & Energy and Power Electronics Societies
Need for Real-Time, Wide Area Situational Awareness
driven by PMU Data – Effective Analytic Approach
31. 31
IEEE San Diego - Power & Energy and Power Electronics Societies
Wide-Area Real-Time PMU Analytics Demo – More
than 1 Hour prior to 2003 Blackout
32. 32
IEEE San Diego - Power & Energy and Power Electronics Societies
Wide-Area Real-Time PMU Analytics Demo – More
than 35 Minutes prior to 2003 Blackout
33. 33
IEEE San Diego - Power & Energy and Power Electronics Societies
Wide-Area Real-Time PMU Analytics Demo – More
than 8 Minutes prior to 2003 Blackout
34. 34
IEEE San Diego - Power & Energy and Power Electronics Societies
Wide-Area Real-Time PMU Analytics Demo – About
5 Minutes prior to 2003 Blackout
35. 35
IEEE San Diego - Power & Energy and Power Electronics Societies
Wide-Area Real-Time PMU Analytics Demo – More
than 2 Minutes prior to 2003 Blackout
36. 36
IEEE San Diego - Power & Energy and Power Electronics Societies
Need for Real-Time, Wide Area Situational Awareness
driven by PMU Data – Real-Time PMU Analytics Demo
37. 37
IEEE San Diego - Power & Energy and Power Electronics Societies
Need for Real-Time, Wide Area Situational Awareness
driven by PMU Data – Real-Time PMU Analytics Demo
38. 38
IEEE San Diego - Power & Energy and Power Electronics Societies
Need for Real-Time, Wide Area Situational Awareness
driven by PMU Data – Real-Time PMU Analytics Demo
39. 39
IEEE San Diego - Power & Energy and Power Electronics Societies
Thank You!