This document discusses Blue Eyes technology, which aims to give computational machines human-like perceptual and sensory abilities. It does this using cameras, microphones, and sensors to identify user actions, emotions, and identity. The technologies discussed that enable this include Emotion Mouse, MAGIC pointing, speech recognition, and SUITOR. Blue Eyes technology has applications in retail, automobiles, gaming, and interactive displays, and could help prevent car accidents by understanding drivers.

1. NAME: SK.YUSUF
ROLL NO: 09QH1A0440
BTECH ECE 3RD YEAR

2. WHAT IS BLUE EYES TECHNOLOGY
WHAT IS BLUE EYES TECHNOLOGY ? ?
 Aims at creating computational machines
that have perceptual and sensory ability.
 Use camera and microphone to identify
. user actions and emotions

3. NEED OF BLUE EYES TECHNOLOGY
 To built a machine that can understand your
emotions
 A pc that can listen, talk or scream
 Verify your identity, feels your presence and interact
with you.

4. THE TERM BLUE EYES:
 BLUE in the term stands for Bluetooth,
Which enables reliable wireless
Communication
 EYES,because the eye movement enables
us to obtain a lot of interesting and
important information.

5. TECHNOLGIES USED:
Emotion Mouse
Manual And Gaze Input Cascaded (MAGIC)
Artificial Intelligent Speech Recognition
Simple User Interest Tracker (SUITOR)

6. EMOTION MOUSE
Simplest way
 People spend approximately
1/3 of their total computer
time touching input device
 Physiological data is
obtained and emotional
state is determined
 A user model will be
built that reflects the
personality of user

7. EXPERIMENT
Measurement of heart rate, temperature, galvanic skin
response (GSR), general somatic activity
Heart rate was measured with chest strap sensor,
temperature with thermocouple attached to a digital
multimeter (DMM), GSR also with DMM, somatic
movement with computer mouse movements
Six basic emotions are anger, fear, sadness, disgust, joy
and surprise

9. ANALYSIS
Firstly, a multidimensional procedure was used to
determine dimensionality of data
Fit the physiological similarities and dis-similarities
into four dimensional table
Secondly, discriminant function analysis was used to
determine mathematic function that would
distinguish the six emotional state.
Suggest that all four physiological variables are
sufficient to distinguish the six states

10. MAGIC POINTING
 To dynamically redefine the home position of the pointing cursor
to be at the close vicinity of the target
 Reduce the cursor movement needed for target selection
 Click on the target with a regular manual input device
 Two magic pointing techniques
a) Liberal
b) Conservative
 Improvement over the traditional eye gaze system
 Reduce physical effort and fatigue, greater accuracy and
naturalness and faster speed than traditional eye gaze system

11. LIMITATIONS OF
TRADITIONAL EYE GAZE POINTING:
 Unnatural to overload a perceptual
channel with a motor control task
 The subconscious jittery motion of eyes
Eye, a primary perceptual device is not a
control organ
 Target not selected if not looked at for a
set threshold
 Target selected if stared at without user
intention

12. LIBERAL APPROACH
 To warp the cursor to every new object user looks at
 User take control of the target by hand near the target or ignore it
and search for next
 “Pro active” since cursor
wait on every potential
target
 “over active” when user
merely looking at the
target

13. CONSERVATIVE APPROACH
 Does not warp the cursor target until the manual input device
has been actuated
 Cursor is warped to gaze area reported by the eye tracker
 Steer the cursor towards the target to complete the target
acquisition
 Cursor position is offset
to the intersection of
manual actuation vector
and the boundary of
gaze area

14. ADVANTAGES OF
LIBERAL AND CONSERVATIVE APPROACH
•
•
•
•
•
Reduction of manual stress and fatigue
Practical accuracy level
A more natural mental model for the user
Faster than pure manual pointing
Improved subjective speed and ease of use

15. DISADVANTAGES OF LIBERAL AND
CONSERVATIVE APPROACH
• Liberal approach is distracting when the user
is trying to read
• The motor action computation cannot start
until the cursor appears
• In conservative approach, uncertainty of the
exact location prolong the target acquisition
time

16. IBM ALMADEN EYE TRACKER
 Relay on a single light source that is off or on the axis
 Illumination from an off axis source generate a dark
pupil image
 On axis generate a bright pupil image
 Use two infrared time multiplexed light sources
composed of two IR LED’s
 Pupil detection is realized by
subtracting dark pupil image
from bright pupil image
 After thresholding difference
largest connected component
is identified as pupil

17. ARTIFICIAL INTELLIGENT
SPEECH RECOGNITION
 Input words are scanned and matched against
internally stored words
 Identification causes some action to be taken
 User speaks to the computer through microphone
 Filtered and fed to ADC and then stored in RAM
 Binary representation become standard , against which
future are compared
 pattern matching is designed to look for the best fit
because of variations in loudness, pitch, frequency
difference, time gap etc.

18. APPLICATION OF ARTIFICIAL INTELLIGENT SPEECH
RECOGNITION
• To control weapons by voice commands
• Pilot give commands to computers by speaking into
microphones
• For making airline and hotel reservations
• For making reservations, canceling reservations or making
enquiries
• Can be connected to word processors and instead of writing,
simply dictate to them

19. SUITOR
• Help by fetching more information at desktop
• Notice where the user’s eyes focus on the
screen
• Fills a scrolling ticker on a computer screen
with information related to user’s task
• Ex. If reading headline ,pops up the story in
the browser window

20. APPLICATIONS
BLUE EYES technology can be used :
• In retailing record and interpret customer movements
• In automobile industry
• In video games
• To create “Face Responsive Display” and “Perceptive
Environment”

21. BLUE EYES ENABLED DEVICES
• POD
Technology used in cars
 PONG
A Robot

22. CAN BE USED
ACCIDENTS
IN CARS
TO
PREVENT

24. • Provide more delicate and user friendly
facilities in computing devices
• Gap between the electronic and physical
world is reduced
• The computers can be run using implicit
commands instead of the explicit commands