SlideShare una empresa de Scribd logo
1 de 29
Using WebSockets and Android
 to control robots in real-time
        Sudar Muthu (@sudarmuthu)
          http://hardwarefun.com
          http://github.com/sudar
Who am I?


             Research Engineer by profession
             Create robots as hobby
             Uses an Android phone
             Why not combine both of them?
             Has spoken in 6+ hasgeek events 




http://hardwarefun.com
Android and Arduino


          There are at least half dozen ways to do it and I am not
                     going to talk about each of them.




         http://sudarmuthu.com/blog/building-robots-using-
         arduino-and-android-at-droidcon


http://hardwarefun.com
So today…


            WebSockets in Android
         How to use it to control robots



http://hardwarefun.com
Why hardware for a software hacker?




                         Fun!

http://hardwarefun.com
Let’s start with a demo



                                Demo
                         http://hardwarefun.com/projects/asimijs




http://hardwarefun.com
Participate in the demo 


                               Visit
                         http://hardwarefun.com:3000




http://hardwarefun.com
Control the bot at stage
                           http://hardwarefun.com/projects/asimijs




              #asimijs @hardwarefun
http://hardwarefun.com
Now let’s see how I built it




http://hardwarefun.com
What is WebSockets?


             Full-duplex over a single TCP connection
             Provides push support
             Designed to work inside browsers
             Works on port 80




http://hardwarefun.com
WebSockets vs HTTP




http://hardwarefun.com
http://hardwarefun.com
HTTP (Pull)


                         Is there an update?



                                               No


                         Is there an update?


                                                No

                         Is there an update?

                                               Yes


http://hardwarefun.com
WebSockets (Push)


                          Tell me when you have an update



                                               Ok




                          Here is the update




http://hardwarefun.com
Why use WebSockets in Android


             Firewall friendly
             No need to reinvent protocol
             Real-time communication
             Easy to setup server




http://hardwarefun.com
Remember, I am not talking about
          using WebSockets inside an
               Android browser



http://hardwarefun.com
WebSocket implementation for
                       Android


              There are lot of options, but I choose Socket.IO
          implementation by Kaushik Dutta (Rom Manager fame)



                  https://github.com/koush/android-websockets




http://hardwarefun.com
Why Socket.IO?


       You should have attended jsFoo
                     ;)



http://hardwarefun.com
Why Socket.IO


             Additional features on top of WebSockets
             Node.js based server
             Has support for maximum no: of browsers
             Has clients in lot of languages




http://hardwarefun.com
and ….


        I had the server already written
                       



http://hardwarefun.com
Let’s see some code




http://hardwarefun.com
In Android, create a socket
    client = new SocketIOClient(URI.create(
   ”http://hardwarefun.com:3000"),new SocketIOClient.Handler() {
         @Override
         public void onConnect() {
            Log.d(TAG, "Connected!");
         }

         @Override
         public void on(String event, JSONArray arguments) {
           Log.d(TAG, "Got event);
         }

         @Override
         public void onDisconnect(int code, String reason) {
           Log.d(TAG, "Disconnected!);
         }
   });
http://hardwarefun.com
Send data through socket


         client.connect();

         JSONArray arguments = new JSONArray();
         arguments.put("first argument");
         JSONObject second = new JSONObject();
         second.put("dictionary", true);
         arguments.put(second)
         client.emit("hello", arguments);

         client.disconnect();
http://hardwarefun.com
In node.js side


         var io = require('socket.io').listen(80);

         io.sockets.on('connection', function (socket) {
           socket.emit('news', { hello: 'world' });
           socket.on(’my other event', function (data) {
             console.log(data);
           });
         });




http://hardwarefun.com
Checkout the full source code
                        at
                         http://hardwarefun.com/projects/asimijs




http://hardwarefun.com
So…


                     How the demo worked?




http://hardwarefun.com
Node.js Server




                                              Android Client

                Admin page



                Web Socket     User page          Asimi (Bot)
                                User page
                 ADK             User page



http://hardwarefun.com
Links

             AsimiJS – The demo that I showed initially
             http://hardwarefun.com/projects/asimijs
             Android websockets - https://github.com/koush/android-
             websockets
             Getting started with hardware programming
             http://hardwarefun.com/tutorials/getting-started-with-hardware-
             programming
             Getting started with Arduino
             http://hardwarefun.com/tutorials/getting-started-with-arduino-
             and-avr
             Android and Arduino - http://sudarmuthu.com/blog/building-
             robots-using-arduino-and-android-at-droidcon
             Arduino Workshop - http://hardwarefun.com/arduino-workshop
http://hardwarefun.com
Thank you
      Sudar Muthu
http://hardwarefun.com
http://github.com/sudar

Más contenido relacionado

Más de Sudar Muthu

Capabilities of Arduino (including Due)
Capabilities of Arduino (including Due)Capabilities of Arduino (including Due)
Capabilities of Arduino (including Due)
Sudar Muthu
 

Más de Sudar Muthu (20)

A quick preview of WP CLI - Chennai WordPress Meetup
A quick preview of WP CLI - Chennai WordPress MeetupA quick preview of WP CLI - Chennai WordPress Meetup
A quick preview of WP CLI - Chennai WordPress Meetup
 
WordPress Developer tools
WordPress Developer toolsWordPress Developer tools
WordPress Developer tools
 
WordPress Developer Tools to increase productivity
WordPress Developer Tools to increase productivityWordPress Developer Tools to increase productivity
WordPress Developer Tools to increase productivity
 
Unit testing for WordPress
Unit testing for WordPressUnit testing for WordPress
Unit testing for WordPress
 
Unit testing in php
Unit testing in phpUnit testing in php
Unit testing in php
 
How arduino helped me in life
How arduino helped me in lifeHow arduino helped me in life
How arduino helped me in life
 
Having fun with hardware
Having fun with hardwareHaving fun with hardware
Having fun with hardware
 
Getting started with arduino workshop
Getting started with arduino workshopGetting started with arduino workshop
Getting started with arduino workshop
 
Python in raspberry pi
Python in raspberry piPython in raspberry pi
Python in raspberry pi
 
Hack 101 at IIT Kanpur
Hack 101 at IIT KanpurHack 101 at IIT Kanpur
Hack 101 at IIT Kanpur
 
PureCSS open hack 2013
PureCSS open hack 2013PureCSS open hack 2013
PureCSS open hack 2013
 
Pig workshop
Pig workshopPig workshop
Pig workshop
 
Arduino Robotics workshop day2
Arduino Robotics workshop day2Arduino Robotics workshop day2
Arduino Robotics workshop day2
 
Arduino Robotics workshop Day1
Arduino Robotics workshop Day1Arduino Robotics workshop Day1
Arduino Robotics workshop Day1
 
Lets make robots
Lets make robotsLets make robots
Lets make robots
 
Capabilities of Arduino (including Due)
Capabilities of Arduino (including Due)Capabilities of Arduino (including Due)
Capabilities of Arduino (including Due)
 
Picture perfect hacks with flickr API
Picture perfect hacks with flickr APIPicture perfect hacks with flickr API
Picture perfect hacks with flickr API
 
Hacking 101
Hacking 101Hacking 101
Hacking 101
 
Capabilities of Arduino
Capabilities of ArduinoCapabilities of Arduino
Capabilities of Arduino
 
Introduction to node.js GDD
Introduction to node.js GDDIntroduction to node.js GDD
Introduction to node.js GDD
 

Último

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Último (20)

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 

Using websockets and android to control robots in realtime

  • 1. Using WebSockets and Android to control robots in real-time Sudar Muthu (@sudarmuthu) http://hardwarefun.com http://github.com/sudar
  • 2. Who am I? Research Engineer by profession Create robots as hobby Uses an Android phone Why not combine both of them? Has spoken in 6+ hasgeek events  http://hardwarefun.com
  • 3. Android and Arduino There are at least half dozen ways to do it and I am not going to talk about each of them. http://sudarmuthu.com/blog/building-robots-using- arduino-and-android-at-droidcon http://hardwarefun.com
  • 4. So today… WebSockets in Android How to use it to control robots http://hardwarefun.com
  • 5. Why hardware for a software hacker? Fun! http://hardwarefun.com
  • 6. Let’s start with a demo Demo http://hardwarefun.com/projects/asimijs http://hardwarefun.com
  • 7. Participate in the demo  Visit http://hardwarefun.com:3000 http://hardwarefun.com
  • 8. Control the bot at stage http://hardwarefun.com/projects/asimijs #asimijs @hardwarefun http://hardwarefun.com
  • 9. Now let’s see how I built it http://hardwarefun.com
  • 10. What is WebSockets? Full-duplex over a single TCP connection Provides push support Designed to work inside browsers Works on port 80 http://hardwarefun.com
  • 13. HTTP (Pull) Is there an update? No Is there an update? No Is there an update? Yes http://hardwarefun.com
  • 14. WebSockets (Push) Tell me when you have an update Ok Here is the update http://hardwarefun.com
  • 15. Why use WebSockets in Android Firewall friendly No need to reinvent protocol Real-time communication Easy to setup server http://hardwarefun.com
  • 16. Remember, I am not talking about using WebSockets inside an Android browser http://hardwarefun.com
  • 17. WebSocket implementation for Android There are lot of options, but I choose Socket.IO implementation by Kaushik Dutta (Rom Manager fame) https://github.com/koush/android-websockets http://hardwarefun.com
  • 18. Why Socket.IO? You should have attended jsFoo ;) http://hardwarefun.com
  • 19. Why Socket.IO Additional features on top of WebSockets Node.js based server Has support for maximum no: of browsers Has clients in lot of languages http://hardwarefun.com
  • 20. and …. I had the server already written  http://hardwarefun.com
  • 21. Let’s see some code http://hardwarefun.com
  • 22. In Android, create a socket client = new SocketIOClient(URI.create( ”http://hardwarefun.com:3000"),new SocketIOClient.Handler() { @Override public void onConnect() { Log.d(TAG, "Connected!"); } @Override public void on(String event, JSONArray arguments) { Log.d(TAG, "Got event); } @Override public void onDisconnect(int code, String reason) { Log.d(TAG, "Disconnected!); } }); http://hardwarefun.com
  • 23. Send data through socket client.connect(); JSONArray arguments = new JSONArray(); arguments.put("first argument"); JSONObject second = new JSONObject(); second.put("dictionary", true); arguments.put(second) client.emit("hello", arguments); client.disconnect(); http://hardwarefun.com
  • 24. In node.js side var io = require('socket.io').listen(80); io.sockets.on('connection', function (socket) { socket.emit('news', { hello: 'world' }); socket.on(’my other event', function (data) { console.log(data); }); }); http://hardwarefun.com
  • 25. Checkout the full source code at http://hardwarefun.com/projects/asimijs http://hardwarefun.com
  • 26. So… How the demo worked? http://hardwarefun.com
  • 27. Node.js Server Android Client Admin page Web Socket User page Asimi (Bot) User page ADK User page http://hardwarefun.com
  • 28. Links AsimiJS – The demo that I showed initially http://hardwarefun.com/projects/asimijs Android websockets - https://github.com/koush/android- websockets Getting started with hardware programming http://hardwarefun.com/tutorials/getting-started-with-hardware- programming Getting started with Arduino http://hardwarefun.com/tutorials/getting-started-with-arduino- and-avr Android and Arduino - http://sudarmuthu.com/blog/building- robots-using-arduino-and-android-at-droidcon Arduino Workshop - http://hardwarefun.com/arduino-workshop http://hardwarefun.com
  • 29. Thank you Sudar Muthu http://hardwarefun.com http://github.com/sudar