Few days Arduino based project to develop sound (frequency) dependent haptic interface for simulated instruments on touch-screen devices like tablets or phones. Input is simply the audio signal. Could be expanded to real instruments for the enhancement of the feeling by using a microphone.

1. TESP 2012
Haptics Summer Project
Todokoro and Konyo Lab

2. The Team
Justinas Mišeikis
ETH Zürich and CSIRO
Yeong-geol BAE
Chugnam national University, Korea
Abhinandan Tripathi
Summer Research Student, Tohoku Univ.

3. Playing Music
Sound
Music Haptic
Movement
Instrument Feeling
Emotion

4. Modern Times

5. The Problem
Sound
Music Haptic
Movement
Instrument Feeling
Emotion

6. Sensiva
An augmented haptic system

7. Simulation
INPUT
Signal
Signal
with various frequency
with various frequency
Filtering
OUTPUT
Analyzed frequency

8. Simulation - LabView
Measure Amplitude
Filter
Input Signal
Output Signal
Block diagram of simulation program

9. Simulation
Mode Selection
Input Signal Analysis
Generate Signal Output Signal
Simulation User Interface

10. The Signal Flow
63 Hz to 16 KHz
SOUND Spectrum
Analyzer ARDUINO
Actuator 1 AMP 1
(Left Hand)
Actuator 2
40 Hz to 400 HZ
Actuator 3
AMP 1
(Right Hand)
Actuator 4

11. The Circuit Setup

12. Demo
Look there!

13. Discussion
● Works well with simulated drums
● Microphone input can be used
● Portable device
● Various instruments
● Additional effects

14. Thank you!
Questions?