1. 1
TCS Research Scholar Program
Topic - Intelligent Infrastructure: Applications and Technology
Speaker -Arpan Pal (Head, Innovation Lab, Kolkota)
4th May 2012
HOTEL TAJ PALACE, NEW DELHI

2. Theme Outline

3. 3
Intelligent Infrastructure
Sense
Extract
Analyze
Respond
Learn
Monitor
• Transportation
• Electricity / Water
• Buildings / Home / Campus / Store
• Automotive
• Agriculture
• Healthcare
• Government
• Sensor Signal Processing and Informatics
• M2M Communication
• Cyber-physical Systems Modeling
• Analytics
• Platform Performance and Scalability
• Service Level APIs and SDK
• Integration Interfaces
• Development Framework
Intelligent
Infra
@Home
@Building
@Vehicle
@Utility
@Mobile
@Store
@Road
“Intelligent” “Infrastructure”
APPLICATION SERVICES
BACK-END PLATFORM
INTERNET
GATEWAY

4. 4
Integrated Platform for Intelligent Infrastructure
People Feedback & Emotions
Social Media
Integrated Services
Sensors & IoT
Platform
Traditional Monitoring & Control
Systems
Citizen Data
Smart Integration Platform
Transportation Healthcare Electricity
WaterPublic Safety Tourism
Smart Integrated Services
Sense
Analyze
Extract
Respond
Intelligence
Smart Domain Services
Community
etc.
Sense: People Activity, Appliances, Vehicles , Road, Home/Bldg, Utility
Infrastructure
Detect gas leakage/water contamination :
mobilize rescue team, suggest optimum route
Divert Road Traffic in case of
Water Pipeline Burst
Correlate Electricity/Water
/Gas consumption patterns
Intelligent Integration Platform
Integrated Intelligent Services

5. Research Focus

6. 6
Research Areas
• Modeling of Cyber physical
Systems
• Back-end Analytics Toolbox
• Web as a Soft Sensor for
Intelligence
Communication
AnalyticsData Collection
• Protocols
• Identity Mgmt.
• M2M Comm.
• Security and Privacy
• Device Management &
Monitoring
• Sensor Observation,
Event and Management
Services
• Sensor Signal Processing
and Informatics
Storage & Systems
• Low-cost Storage
• Distributed Query
Processing
• Big Data Support
• Object Store
Middleware
Modeling and AnalyticsPerformance and ScalabilityContext Extraction

7. 7
Research Challenges
Challenges
• Reducing the cost of Communication
• Preserving the Battery power
• Extracting information from ambient-noise-corrupted sensor data
• Multi-sensor fusion and analytics, sometimes in real-time
• Preserving the Privacy
Solution Approach
• Edge processing (sensor, audio, image, video) for context extraction
 addresses the information extraction, cost of communication, privacy and
battery power preservation issue
• Lightweight communication protocols over Internet
 addresses the cost of communication and battery power preservation issue
• Algorithms for real-time analytics
 addresses the real-time multi-sensor fusion and analytics issue
• Privacy framework for sensor data with access control and authentication
 addresses the security and privacy issue

8. 8
Research Focus – Sensor Data Collection
• Partner with established players providing sensors and
gateways
• Open-Geospatial Consortium (OGC) based sensor
data acquisition, storage and management
• Sensor Observation Service (SOS)
• Sensor Event Service (SES)
• Sensor Planning Service (SPS)
• Device Management – Integrate sensor provider
solutions
• Sensor Signal Processing and Informatics
• Sensor / microphone / camera / biosensor processing for
constrained platforms
• Intelligent Sensing
• Sensing for Human-centric Computing
• Signal Source Separation and data disaggregation

9. 9
Research Focus – Storage and Systems
• Large-scale Sensor Data Storage
• Affordable yet reliable
• Open source based Q0S controlled solution
• Distributed Query Processing
• Handling large and complex queries
• Big Data Support
• Hadoop – Map-reduce
• Efficient Databases 0 RDBMS and Key-value Stores
• Object Store
• Efficient Storage Blobs for large files
• Linked to Metadata for efficient query

10. 10
Research Focus – Analytics
• Back-end Analytics
• Streams Processing, Complex Event Processing and
Streams Reasoning
• Hierarchical Task Network based Planning
• Non-parametric Statistical Data Processing
• Modeling of Cyber-physical Systems
• Model-driven Sensor Data Interpretation and
Analytics
• Model-driven design space exploration for Sensors
• Web as a Soft Sensor for Intelligence
• Sensor-assisted Social Network and Web mining for
Intelligence (Optra and Listening Platform)
• Using Social Network Structure for Co-operative
Sensing
• Television-Web Mash-ups

11. 11
Research Focus – Communication
• Protocols
• Lightweight yet Reliable Protocols for delivery over Internet
• Identity Management
• Ubiquitous Identity of Things
• M2M Communications
• Error-control Coding for Robustness
• Secure M2M
• Upper-audio band Communication
• Privacy Preservation
• Access-Control Framework
• Data Masking (Safemask)

12. Platform

13. 13
Platform Architectural Layers
Internet
End Users &
Renderers
Administrators
Device Integration & Management Services
Analytics Services
Application Services
Storage
Messaging & Event Distribution Services
ApplicationServices
Presentation Services
Application Support Services
OS & Device Drivers
Edge Middleware
Analytics Persistence
Application Services
Middleware(Security/PrivacyandProtocols)
Gateway
Sensors
Internet
Back-end
RIPSAC – Real-time Integrated Platform for Services & Analytics in Cars / Cities

14. 14
Platform Use Cases
Internet
Internet
Sensor
Services
Analytics
Storage
Services
RIPSAC Platform
App Developers
PaaS Provider
End User
Sensors
Sensor Providers

15. Use Cases, Demonstrators and Customer
Case Studies

16. 16
Intelligent Campus – Bus Fleet, Night Car Fleet, Parking Lot
Sensor Interface
Services
Storage & Database
Services
Analytics Services
RIPSAC + Apps
iDigi M2m
Cloud
Bus Tracking System
Parking Management
Cab & Passenger Tracking
Reports & Alerts
Location ( GPS), Speed,
Accelerometer, Passenger Ids
Valid passenger
lists, Route Info
Images / video
feeds of entry &
exit ramps of
underground
parking lots
Images of cab
registration
number,
Passenger Ids
Being deployed in TCS Campus at Siruseri, Chennai
that houses 25000 people
Project Partners:
 Sensor Gateways – Digi

17. 17
Intelligent Transportation – Vehicle Model Driven
Sensor Data Analysis
KNOWN PARAMETERS EFFECTS TARGET INDUSTRY
Vehicle Type & Driving Behavior Road Condition Monitoring City Municipality
Road Condition & Driving Behavior Car Prognosis Automotive
Road Condition & Vehicle Type Driving Behavior Analysis Insurance
Acceleration a(t) = f (H(t), v(t), R(t), D(t))
H(t)
• Demo available for road condition monitoring on RIPSAC

18. 18
Intent-based Social Network Formation
• Social sub-graph formation between ride-
givers and ride-takers
• Real-time decision system based on
instantaneous location and route matching
• Trust model based on “Friend-of-Friends”
kind of relationship
• Reduction of search complexity
Intelligent Transportation – Share-a-Ride
• Demo available

19. 19
Intelligent Healthcare – Remote Medical Consultation
ECG
Body Fat Analyzer
Blood Pressure
Monitor
Pulse OxyMeter
Mobile gateway
433MHz Wireless
gateway
• Demo available – possible pilot in a China City
• Integration planned with TCS Clinical Decision Support System
Patient
Records
Health Center / Home
Expert Doctor

20. 20
Intelligent Energy: Home Utility Management Solution (HUMS)
• Multi-protocol Gateway compliant to multiple standards
• Integrated with Utility Back-end (MDM)
• Appliance Identification from aggregated meter data using source separation
• Demand-response and load-scheduling
• Carbon-footprint Analytics
• Demo available
• Pilot with a Green Utility Company in
Netherlands on Appliance
Identification from Meter Data using
Source Separation
Utility
Appliances Smart
Plugs
Intelligent
Gateway
Smart
Meter
Demand Forecasting
Demand Response
Appliance Management
Consumption View
Appliance Scheduling
On-off Control
Social Network
Integration
Consumer Home
Analytics

21. 21
Intelligent Store – Indoor Localization
Upper Audio Band Communication in Mobiles
• Complete baseband communication chain
design using upper audio band (16 to 22
KHz) carrier
• Low computational complexity to preserve
battery power
• Novel waveform design for fast detection
time (less than 1 second)
• Programmable range (1 m to 8 m) through
power control
• Error Control Coding for Robustness
• Demo available
• Customer traction in Retail Stores and Airports

22. 22
Safe City - Multimodal Surveillance and Response
Planning
• Filter with city soundscape info
• Heat-map based on participatory sensing
• Categorize Crowd, Traffic or Explosion
• Filter with social network analysis
• NLP and Semantic analysis of geo-tagged social
n/w tweets
Filter with local participatory surveillance
- Event triggered participatory sensing
- Low complexity Compression
Events with
reduced false alarm
Events from video
surveillance system
Fusion of information HTN based Response
Planning

23. 23
Intelligent Compliance – Insurance Claim Automation
• Mobile phone based design
• Uses Mobile Camera Image of VIN / Number
Plate and Mobile mic. based Voice-assist
• Low Complexity Noise cleaning, pre-processing
and OCR
• Vehicle Contour based Damage Estimation
based on Template matching for Insurance
• Under Development
• Interest from Insurance Companies

24. 24
Intelligent Home and Office – People Counting and
Identification
Indoor People Counting for TV Viewership
• Multi-algorithm fusion to improve
detection probability
• Face Detection, Body Posture Detection
and Background Modeling are combined
to improve the detection above 92 % from
75 %
• Customer – A large TV viewership rating
company in USA
People Identification
• Gesture sensing through Kinect –
Multimodal sensing through Camera and
Audio
• Identification through Gesture / Gait
modeling

25. 25
Intelligent Agriculture – Mobile Agro-advisory System
Power-efficient Wireless Mesh Network
• Real-time sending of Soil Temperature,
Soil Moisture, Atmospheric Temperature
and Atmospheric Humidity
• Cellular Backhaul
• Zigbee based wireless mesh network
• Power-efficient sleep mode design
• Demo available
• Integrated with mKrishi – TCS mobile agro-advisory
solution

26. 26
Alliances
Industry
• Digi (Energy, Transportation, Environment Monitoring)
• Mobile Devices (Car Telematics)
• ETComm (Medical)
• Intel / TI (Edge Platform)
• IBM (CEP Platform)
Academic
• Singapore Management University (iCity Platform)
• Indian Statistical Institute (Privacy, Image / Video
Processing)
• IIT Kharagpur (Analytics, Personal Context Extraction)
• IIT Bombay, IIT Madras, IISc Bangalore – in pipeline

27. 27
Thank You

28. TCS Research Scholar Program