Axa Assurance Maroc - Insurer Innovation Award 2024
Real time control and communication ( Robots , Machines , IOT )
1. Real Time Control and
Communication for IOT
ALTANAI BISHT & DEEPAK AAGRI
tara181989@gmail.com
http://altanaitelecom.wordpress.com
2. Who am I ?
4 Years in Telecom Industry
Frequently write , discuss and contribute to
Open source software
Website : http://altanaitelecom.wordpress.com
Author of WebRTC Integrator’s Guide
2
3. 1. Remote Machine Control
2. M2M WebRTC
3. Robot navigation
4. Robot Live Streaming via CDN
3Altanai Bisht ( http://altanaitelecom.wordpress.com )
6. Components
Server side
PHP Web-pages
Javascript
Web Server
MySQL
Communication Medium
Wireless ( 3G ) dongle
6Altanai Bisht ( http://altanaitelecom.wordpress.com )
Machine endpoint
Rpi
ECU
Power Mgmt
Motor
Noise Filtration
SPI
7. 7
Raspberry Pi
7Altanai Bisht ( http://altanaitelecom.wordpress.com )
The Raspberry Pi is a series of credit card–sized single-board computers
developed in the UK by the Raspberry Pi Foundation
11. Media - WebRTC
WebRTC offers real time communication natively from browsers.
It is essentially just a media engine without control protocol
Bodies behind standardization
No plugins
Supported browsers
Supported Mobile platforms
11Altanai Bisht ( http://altanaitelecom.wordpress.com )
12. How does WebRTC work ?
12Altanai Bisht ( http://altanaitelecom.wordpress.com )
Signal
● Web Server/service based signaling
brokering
● Offer/Answer JSEP ( Java Session
Establishment Protocol ) model with
SDP ( Session Description Protocol )
● protocol NOT defined
Media
● Peer to peer media flow
● SRTP/RTCP
Firewall
● Uses ICE for STUN / TURN mechanism
14. Components for WebRTC M2M communication
Server side
Javascript
Web Server
WebRTC browser
Communication Medium
3G ( min > 2Mbps)
14Altanai Bisht ( http://altanaitelecom.wordpress.com )
Machine endpoint
Rpi
Iceweasel browser
Webcam
Speaker
Mic
Display
WebRTC Comm Network
TURN
Nodejs
Socketio
19. Components for WebRTC M2M communication
Server side
Javascript
Web Server
WebRTC browser
PHP Web-pages
MySQL
Communication Medium
3G ( min > 2Mbps)
19Altanai Bisht ( http://altanaitelecom.wordpress.com )
Machine endpoint
Rpi
Iceweasel
Webcam
Speaker
Mic
Display
WebRTC Comm Network
TURN
Nodejs
Socketio
Robot
4 wheeler
ECU
Al base
Sensor
Gear Motor
21. 21Altanai Bisht ( http://altanaitelecom.wordpress.com )
Standing robot view View from robot moving towards right
22. Robot Live Streaming via CDN
Capturing the web stream as robot moves and live streaming
via CDN
23. 23
1. WebRTC
multi peers
2. Torrent based
WebRTC chain 3. WebRTC Relay
nodes for multiple
peers
4. WebRTC
Chunk recorder to
Wowza Media
Server
Scalable Broadcasting and Live streaming
alternatives
Altanai Bisht ( http://altanaitelecom.wordpress.com )
26. 26
1 : n Live streaming end-end solution
WebRTC on Robot -> WebRTC peer on Server -> Whammy
Recorder -> Wowza Transcoder +Streaming Server -> Amazon
Cloudfront -> Multi players
4. WebRTC Chunk recorder to Wowza Media Server
Altanai Bisht ( http://altanaitelecom.wordpress.com )
27. 27
WebRTC -> vp8/webm -> live stream
Note : This method only provides the video . It doent not have audio .
28. Features
● Cheap and more customised solution to specific
use cases
● Recycled components
● No patented or proprietary protocols
● Easy person-to-machine and machine-to-
machine comm.
● Can be integrated with other modules like
Recording , Multiplexing , transcoding .
28Altanai Bisht ( http://altanaitelecom.wordpress.com )
Roadmap
Sensor’s triggering Real Time comm.
Solid Real Time Analytics
Machine Learning
Augmented Reality in flowing Media
Integration to IOT frameworks