The presentation titled, "The role of semantic web technologies in smart environments" was presented by Faisal Razzak on 15/03/2013 (14:10) at DAUIN, Politecnico di Torino, Italy. The presentation provides an overview of the PhD Thesis and explores the potential role of semantic web technologies in smart/Intelligent environments. It ponders on two main contributions, i.e., User Intelligible goals and Semantic Data Exchange. Briefly talks about Domotic Effects framework (Modelling, Evaluation, Enforcement and Optimization) and Effects Ontology. It also talks about the concept of Linked Open Dynamic Data and Publisher Ontology.

1. Politecnico di Torino
Dip. Automatica e Informatica
Final PhD Presentation @ DAUIN Torino, Italy
The Role of Semantic Web Technologies
in Smart Environments
Faisal Razzak

2. My PhD work
User Intelligible Goals
• Domotic Effects
• Modeling
• Evaluation
• Enforcement
• Optimization in Energy Management domain
Semantic Data Exchange
• Linked Open Dynamic Data -- LO(D)D
• Semantic Energy Information Publishing Framework (SEIPF)
Other Works – Internet of Things
• Spamming the Internet of Things (IoT)
• Web of Domotics (WoD)
• Eye Tracking Systems (Cogain Project)
2 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

3. User Intelligible goals
3 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

4. Motivation
 Users pour their personalities in order to use and
transform their personal environments (2006).
 Resulted in “Programmable smart/ personal
environments”.
Davidoff, Scott, Min Lee, Charles Yiu, John Zimmerman, and Anind Dey. "Principles of smart home
control." UbiComp 2006: Ubiquitous Computing (2006): 19-34
4 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

5. Motivation
 IST Advisory group published a draft titled „Ambient
Intelligence: From vision to reality‟. In order to build
intelligence, we need to innovate abstract concepts and
models to address human centric expressions of
personal style. (2003)
 A series of workshops and interviews, concluded that
designers work top-down and like to start from abstract
descriptions. (2008)
 The need for abstract models to address human centric
expressions
1) Ducatel, K., M. Bogdanowicz, F. Scapolo, J. Leijten, and J. C. Burgelman. "Ambient
intelligence: From vision to reality." IST Advisory Group Draft Rep., Eur. Comm(2003).
2) van Doorn, Mark, Arjen de Vries, and Emile Aarts. "End-User Software Engineering of
Smart Retail Environments: The Intelligent Shop Window." Ambient Intelligence(2008):
157-174.
5 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

6. The Issues
 The issue of Device centric vision?
 The question of Enforcement?
 The question of Evaluation (monitoring)?
 Can there be a unified model?
6 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

7. Domotic Effects Framework
 Domotic Effects model Human
intelligible state and goal.
• It provides AMI designers with
an abstraction layer that
enables defining generic goals
inside the environment, in a
declarative way.
• The high-level nature allows
the residents to program their
personal, office or work spaces
as they see fit.
• Simple Effect (SE) and
DogEffects Ontology Complex Effect (CE)
7 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

8. Boolean Application Domain
8 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

9. Energy Application Domain
9 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

10. Example: Boolean Application Domain
10 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

11. Example: Energy Application Domain
11 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

12. How to put it simply?
Enforcement ? Evaluation
Users’ Goals Devices
Users
12 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

13. More Details
Mathematical Enforcement Evaluation
Formulation Architecture Architecture
Results
13 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

14. Enforcement
16 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

15. Evaluation – Zero Delay Simulation
17 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

16. Is it Applicable? -- Evaluation
 Evaluation
 In one experiment, results showed that for an iteration the
presence of 1500 CEs with the maximum level of 177 can
be evaluated in 118 ms (averaged over 150 times).
 In another experiment results showed that for a single
device change, the presence of 1400 CEs with the
maximum level of 272 can be evaluated in 258 ms.
 The goal was in less than 1 or 2 seconds.
18 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

17. Is it Applicable? -- Enforcement
 Six use cases
 Secure Home
 Home Illumination
 Morning Wakeup
 Isolated Kitchen
 Room Illumination
 Air Passage across Home
 All possible combination of use cases, i.e., 64
 In summary, the implemented enforcement module was able to
resolve to devices in less than 100 ms.
 The goal was in less than 1 or 2 seconds.
19 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

18. An enforcement with minimal power
consumption
Formulation
 Results
Compared against

Enumeration approach.
 For 90% of iterations the
result of power
consumption was better
or at least equal (in case
of minimal).
 The heuristic solution
time was between 1 to
2 seconds for all cases.
Even for cases with
more than 100,000
(enumerated)
20
solutions.
Presentation @DAUIN, Razzak
Politecnico di Torino, Italy

19. User Intelligible goals – Domotic Effects
(Papers)
 Published (ISI-Journal)
 Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User
Intelligible Goals in Smart Home Environments." IEEE Transactions on Smart
Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135, ISSN - 1949-3053
 Submitted (ISI-Journal)
 Fulvio Corno and Faisal Razzak: SAT Based enforcement of Domotic Effects in
Smart Environments
 Fulvio Corno and Faisal Razzak: Monitoring of Smart Environments using
Domotic Effects
 Currently Writing
 Dario Bonino, Fulvio Corno and Faisal Razzak: Modeling Intelligible Effects in
Smart Homes
22 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

20. An Alternate View
 Semantic web technologies provide both strong
structural representation and semantics.
AGAINST
 Semantic web technologies provide only strong
structural representation.
 Semantics comes from context (User and current
settings).
24 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

21. Semantic Data Exchange
25 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

22. Context
Smart Sensing and Measuring Environments
Smart Homes Sensor and
Smart Factories
Smart Grid Actuator Networks
Environment monitoring
Social mobile applications
Smart Appliances
Affordable and efficient sensors
26 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

23. Context
Smart Sensing and Measuring Environments
Smart Appliances
acceleration
acceleration compass
compass GPS
air pressure proximity
temperature microphone
energy light camera
(active, reactive, rev
BT Scan
erse, kVAr, ...)
Affordable and efficient sensors
27 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

24. Context
Smart Sensing and Measuring Environments
Smart Appliances
Affordable and efficient sensors
Motion
RFID
Smoke Pressure
Gyroscope
Proximity 2D codes
28 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

25. Motivation
 Applications need to access
information from multiple
Application Application environments
 Standard way to publish
and consume information
Environ Environ Environ  About accessible
ment ment ment environments
 About available
Applian Applian Applian
applicances, sensors and
ces ces ces their characteristics
 About the actual data
measured by sensors
sensors sensors sensors
29 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

26. Other Approaches
 Handling Temporal Data (Time Ontology)
 RDF Streaming Engines (C-SPARQL,
SPARQLStream, EP-SPARQL)
1. http://www.w3.org/TR/owl-time/
2. D. Anicic, P. Fodor, S. Rudolph, N. Stojanovic, EP-SPARQL: a unified language for event processing and stream
reasoning, in: Proceedings of the 20th international conference on World wide web, ACM, 2011, pp. 635–644.
3. D. Barbieri, D. Braga, S. Ceri, E. Della Valle, M. Grossniklaus, C-SPARQL: SPARQL for continuous querying, in:
Proceedings of the 18th international conference on World wide web, ACM, 2009, pp. 1061–1062.
4. S. Groppe, J. Groppe, D. Kukulenz, V. Linnemann, A SPARQL engine for streaming RDF data, in: Signal-Image
Technologies and Internet-Based System, 2007. Third International IEEE Conference on, IEEE, 2007, pp. 167–
174.
5. D. Le-Phuoc, M. Dao-Tran, J. Xavier Parreira, M. Hauswirth, A native and adaptive approach for unified
processing of linked streams and linked data, The Semantic Web–ISWC 2011 (2011) 370–388.
30 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

27. Approach
 Applications need to access
Adopt Semantic Web information from multiple
«Linked Open Data environments
(LOD)» approach  Standard way to publish
and consume information
Static information:  About accessible
Can be encoded in RDF environments
according to a public
 About available
Ontology
applicances, sensors and
their characteristics
Dynamic information:  About the actual data
New approach to measured by sensors
represent streams of RDF
events
31 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

28. 32 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

29. Producer Consumer
Application Application
Publisher Publishes Views & Subscribe
Compone r
nt Compone
PID
nt
Document Subscribe
s to
E Channels
E
E E
Smart Environment
E E Channel 1 E E
E E Channel2 E E
Transport Mechanism (3rd party Cloud based Service)
33 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

30. General LO(D)D Architecture
Smart Static
Environment information
Producer publishes
Application about
E sensor
streams
G monitors
F
34 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

31. General LO(D)D Architecture
Smart Static
Environment information
Producer publishes
E Application about
E F sensor
G streams
E
G monitors describes
F
E Sensor
G E
data
F channel
G Sensor
updates F
data
channel
G
Sensor
data
channel
35 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

32. General LO(D)D Architecture
Smart Static subscribes
Environment information
Producer publishes
E Application about Consumer
E F sensor E Application
G streams
E
G monitors describes
F Consumer
E
E
E Sensor Application
G E E
data
F channel
G Sensor G
Consumer
updates F Application
data F
channel receives
G G
Sensor
data
channel
36 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

33. Proposed solutions
Producer  Open source libraries and API to enable
Application
Consumer application to interact with LO(D)D data
Application
 RDF document with meta-data (PID)
Static  Publisher information
information
 List of channels, their source data, their
about
sensor datatypes, and subscription URI/key
streams  RDF «fragments» representing each event
E  Contains: event#, sensor id, timestamp,
F
G value, unit of measure
E
 Uses publish-subscribe pattern as transport
mechanism for distributing RDF fragments
Sensor
data
channel
37 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

34. Publisher Information Document (PID)
 According to lightweight «Publisher» ontology
 Contains declarations of all channels handled by this publisher
– all needed static information
 Gives information to subscribe to channels
 Created by <RDF:Description RDF:about="&Publisher;energymtr">
publisher API <publisher:Location RDF:datatype="&xsd;string">
Torino, Italia</publisher:Location>
 Published
over http <publisher:subscribekey>sub-xxxxxx-
42904d46dEEEEE
</publisher:subscribekey>
<publisher:channelName>Energy Meters
</publisher:channelName>
<RDF:type RDF:resource="&Publisher;Channel"/>
</RDF:Description>
38 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

35. Event data fragments
 Individual data points encoded in RDF
 Self-consistent information (e.g. Unit of measure)
 Standard syntax and semantics
 Application-independent representation
 Compact
<rdf:Description RDF:about = "&publisher;emergymtrChan1">
encodings <publisher:MeterNumber RDF:datatype="&xsd;int">
231 </publisher:MeterNumber>
available
<publisher:Unit RDF:datatype="&xsd;string" >
http://purl.oclc.org/NET/muo/ucum/unit/power-level/
bel-kilowatt</publisher:Unit>
<publisher:hasTimeStamp RDF:datatype="&xsd;dateTime">
2012-02-02T13:06:41.056Z </publisher:hasTimeStamp>
<publisher:hasCurrentValue RDF:datatype ="&xsd;double">
0.3 </publisher:hasCurrentValue>
</RDF:Description>
39 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

36. Cloud based Transport mechanism
 Provides the updates to subscribers whenever
publishers update data
 New RDF fragments are sent to the cloud service
 Maintains list of subscribers
 Handles logic to provide transport from Publisher to
many Subscriber in real time
 It makes the Publisher a “light-weight component”
 Publisher is independent from the number of connected
subscribers
...and others
pubsubhubbub
40 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

37. Experiment
Building Infrastructure
Politecnico di Torino
poliEnergy
PID
Publishes C
P
P
• 126 Electrical
Meters. poliEnergy
• Take reading Aggregator
PID
every 15
minutes
• Aggregates
reading into 3
ranges.
• Publishes using 3
C channels
42 Presentation @DAUIN, Politecnico di Razzak
Torino, Italy

38. Other Works
 Spamming the Internet of Things
 Faisal Razzak "Spamming the Internet of Things: A Possibility and its
probable Solution." Procedia Computer Science 10 (2012): 658-665.
MobiWIS 2012 in Canada.
 Semantic Web Technologies‟ role in Smart Environments
 Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments."
P. Herrero et al. (Eds.): OTM 2012 Workshops, LNCS 7567, pp. 54–58,
2012.
OTM Workshops 2012 (Rome)
 Semantic Energy Information Publishing Framework
1. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine
understandable exchange of energy consumption information in intelligent
domotic environments." Energy and Buildings 43, no. 6 (2011): 1392-
1402.
 Web of Domotics
1. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart
environments through linked data." In Systems Man and Cybernetics
43 Presentation @DAUIN, Politecnico di Razzak
(SMC), 2010 IEEE International Conference on, IEEE, pp. 2922-2929.
Torino, Italy

39. Publications
International Journals
1. Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User Intelligible Goals in Smart
Home Environments." IEEE Transactions on Smart Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135,
ISSN - 1949-3053
2. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine understandable exchange of
energy consumption information in intelligent domotic environments." Energy and Buildings 43, no.
6 (2011): 1392-1402.
Proceedings
1. Fulvio Corno and Faisal Razzak. "Publishing LO (D) D: Linked Open (Dynamic) Data for Smart Sensing
and Measuring Environments." Procedia Computer Science 10 (2012): 381-388.
2. Faisal Razzak "Spamming the Internet of Things: A Possibility and its probable Solution." Procedia
Computer Science 10 (2012): 658-665.
3. Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments." P. Herrero et al. (Eds.): OTM
2012 Workshops, LNCS 7567, pp. 54–58, 2012.
4. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart environments through
linked data." In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on,
IEEE, pp. 2922-2929. 2010.
44 5. Emiliano Castellina, Faisal Razzak, and Fulvio Corno. "Environmental di
Presentation @DAUIN, Politecnico Control Application Compliant Razzak
Torino, Italy
with COGAIN Guidelines." COGAIN2009 Proceedings (2009): 31.

40. Acknowledgement
 My work in PhD (till now) would not have been possible
without the knowledge and guidance of following people:
 Prof. Fulvio Corno
 Dr. Emiliano Castellina (now with Reply)
 Dr. Dario Bonino
 Muhammad Sanaullah
 And all the teachers who taught PhD courses.
45 Razzak

41. Thank you all & Any Questions?
Reference
s
Faisal Razzak (raja.faisal@gmail.com)
Skype: faisal.razzak27
Presentations: http://www.slideshare.net/konware
Profile: http://polito.academia.edu/FaisalRazzak
LinkedIn: http://it.linkedin.com/pub/faisal-razzak/50/511/421/