AIY Vision Kit - Embedded ML for STEM and Makers (GDG Boston Tensorflow)
•Download as PPTX, PDF•
2 likes•1,103 views
I introduced Google's AIY Vision Kit at the Google Developers Group Boston Taking the Temperature of Tensorflow meetup. Google’s “AI Yourself” Vision Kit, now available at Target Stores, is a low-cost ($90), developer friendly development kit designed to make machine learning tangible for makers and STEM students. It includes pre-trained models for detecting mood, pets, meals, with the ability to load your own custom model.
Recommended
Recommended
More Related Content
Similar to AIY Vision Kit - Embedded ML for STEM and Makers (GDG Boston Tensorflow)
Similar to AIY Vision Kit - Embedded ML for STEM and Makers (GDG Boston Tensorflow) (20)
More from Chad Hart
More from Chad Hart (14)
Recently uploaded
Recently uploaded (20)
AIY Vision Kit - Embedded ML for STEM and Makers (GDG Boston Tensorflow)
- 1. AIY VISION KIT EMBEDDED ML FOR STEM AND MAKERS Chad Hart cwh.consulting
- 2. Product Consultant cwh.consulting chad@cwh.consulting A blog for WebRTC developers webrtcHacks.com @webrtcHacks WebRTC events & videos www.krankygeek.com @webrtclive AboutMe cwh.consulting @chadwallacehart chad@chadwallacehart.com
- 3. WhatistheAIY VisionKit? 5/1/2018 cwh.consulting A tiny box that let’s you do “AI Yourself” from Google. This kit is focused on Computer Vision based on Tensorflow. No internet connection is required.
- 4. WhatistheAIY VisionKit? 5/1/2018 cwh.consulting You need to assemble the kit yourself. It takes 30 to 60 minutes.
- 5. JoyDetection Demo 5/1/2018 cwh.consulting The joy detection demo loads by default. It does face detection and estimates your “Joy” score if you are smiling or frowning. The default demo will illuminate the LED button according to the average score it sees across all faces.
- 6. How doyouget one? 5/1/2018 cwh.consulting The new, 1.1 version is available for sale at Target stores.
- 7. The Kit AIY Voice Kit
- 8. What’sinthe box? 5/1/2018 cwh.consulting The new, 1.1 contains everything needed for operation except a USB power supply.
- 9. RaspberryPiZeroWH 5/1/2018 cwh.consulting It runs on a tiny Raspberry Pi Zero. GPIO headers are required and WiFi is handy, so the kit ships with the WH version of the Pi Zero.
- 10. PiCamera 5/1/2018 cwh.consulting And it includes the latest Pi Camera.
- 11. VisionBonnet 5/1/2018 cwh.consulting All of the kit’s magic is performed on the Vision Bonnet – an add on board.
- 12. IntelMovidius MA2450 Vision Processing Unit 5/1/2018 cwh.consulting The most important piece of hardware is the intel Movidius VPU chip. This is a specialized chip designed for running machine learning graphs at low power. You can also buy this check as part of a USB dongle from Intel (Intel NCS) for use with Intel’s SDK. The AIY Kit team built their own SDK and optimized it to work with Tensorflow.
- 13. Othergoodies wewon’ttalk abouttoday Button with multi-color LED Privacy LED Buzzer Micro controller chip on Bonnet with extra GPIO pins, LEDs, and button 5/1/2018 cwh.consulting The kit comes with lots of other interfaces and hardware options
- 15. Models Face / Joy detector Bounding box Joy score Dog / Cat / Human Detector Object class Confidence score Bounding box Dish Classifier Food object Confidence score Image Classifier / Google Image Classifier Image classifier (1000 classes?) Confidence score Nature Explorer Image classification of 4,080 different species 5/1/2018 cwh.consultingGoogle maintains several computer vision (CV) models that can be loaded on to the kit. Several of these were recently added and hopefully more will come soon.
- 16. Process 1. Develop the model 2. Train 3. Freeze graph & compile 4. Deploy 5/1/2018 cwh.consultingModels need to be trained outside of the kit. Then they can be compiled for the AIY Vision Kit and deployed there.
- 17. Custommodels Tensorflow Model Compiler Only works on x86 64 Ubuntu Lots of limitations on the model – specific operators and configuration require Build your own Retrain an existing model 5/1/2018 cwh.consulting ./bonnet_model_compiler.par -- frozen_graph_path=cat_detector_interference_graph_aiy/frozen_inference_graph.p b --output_graph_path=cat_detector.binaryproto --input_tensor_name="input" --output_tensor_names="concat,concat_1" --input_tensor_size=160 --debug There are caveats compiling to the AIY Vision Kit. I have not been able to get this to work (or seen someone else do this), but I think we are very close – see https://github.com/google/aiyprojects-raspbian/issues/314
- 18. Demos AIY Vision Kit 5/1/2018 cwh.consulting Cat detection using the built in cat/dog/human detector: https://youtu.be/NguWj9K1MJs Face detection: https://webrtchacks.com/wp-content/uploads/2018/02/face_detection_camera.py-preview.mp4?_=1
- 19. What does it all mean? 2 things… 5/1/2018 cwh.consulting
- 20. 5/1/2018 cwh.consulting Cloud Edge 1. Applying Machine Learning at the edge – not just the cloud
- 21. Cloudvs.Edge Privacy Latency Power Costs considerations 5/1/2018 cwh.consultingThere are several reasons why you might not want to push your machine learning to the cloud
- 22. EdgeML Examples of Computer Vision on the Movidius 5/1/2018 cwh.consulting Here are some real products that use the Movidius chip for running machine learning on-device
- 24. STEM 5/1/2018 cwh.consulting 2. The kit is designed to expose high-schoolers to using AI technologies, not for PhD’s Google is trying to make ML tangible for a large audience.
- 25. AIYLinks https://aiyprojects.withgoogle.com/vision https://github.com/google/aiyprojects-raspbian https://webrtchacks.com/aiy-vision-kit-uv4l-web-server/ 5/1/2018 cwh.consulting
Editor's Notes
- sudo systemctl stop joy_detection_demo.service sudo chown pi: /tmp/uv4l-raspidisp.socket
- sudo systemctl stop joy_detection_demo.service sudo chown pi: /tmp/uv4l-raspidisp.socket pi@100.71.52.57 https://www.youtube.com/watch?v=NguWj9K1MJs&list=PLZa3EnwUZVaLqYXFjl1jMNugsCBsbtc8x