This project describes a sign language translation glove that uses flex sensors and an accelerometer/gyroscope to detect finger movements and positions. An Arduino microcontroller collects sensor data and sends it over Bluetooth to an Android device running a neural network model to recognize signs and output text. The goal is to translate American Sign Language signs into text in real-time using open source hardware and software components like Arduino, Android ADK, and various sensors.

1. Saron Paz Zvika Markfeld
Tomer Daniel Oleg Imanilov

2. An open source software & hardware
Combining:
 Arduino
 Sensors
 Android ADK
 Android

3. A glove that translates a predefined
vocabulary of the deaf and mute sign
language into text

4. Lily-Pad Arduino samples sensors
attached to glove
ADK board relays data from the
Lily-Pad to Android
Android uses a back propagation
Neural Network to analyze data

5. Arduino compatible
microcontroller board
designed for wearables
and e-textiles

6. Flex Sensors measure
finger bending
Wii Nunchuck =
Accelerometer + Gyros
Conductive tape
detects fingers touching

7.  FlexSensor changes
resistance when bent
 Usinga voltage divider
the voltage is read by
Arduino ADC

9. Joystick
Accelerometer
(X,Y,Z)
Gyros
(Roll, Pitch)
2 Buttons
I2C & Power

11. GUI
Mini NN
Sensor
Relay Control
ADK library ADK library Serial Serial

20. Saron Zvika Tomer Oleg
Paz Markfeld Daniel Imanilov
is an is a is a is a
experience design software software
designer & freshman architect engineer &
a hopeless and an by day & a a brilliant
idealist aspiring maker by ideas
inventor night generator

21.  Show & Tell Google code project
 http://code.google.com/p/adk-sign-language-
translator-glove/
 Sensors
 Flex Sensors
 http://www.sparkfun.com/products/8606
 http://www.sparkfun.com/products/10264
 Nunchuck
 http://www.dealextreme.com/p/designer-s-nunchuck-
controller-for-wii-24529
 Arduino
 Wiichuck class
 http://www.arduino.cc/playground/Main/WiiChuckClass
 Android ADK
 http://developer.android.com/guide/topics/usb/adk.html