SlideShare una empresa de Scribd logo
1 de 17
Descargar para leer sin conexión
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Your Gaze Betrays Your Age!
Olivier Le Meur, Antoine Coutrot, Zhi Liu, Pia R¨am¨a,
Adrien Le Roch and Andrea Helo
IRISA - University of Rennes 1, France
olemeur@irisa.fr
September 7, 2017
1 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Motivation
Objective:
To give evidence that information derived from observers’ gaze can
be used to infer their age.
Look at the screen and I will tell you your age!
ª by using only features extracted from your
scanpaths;
ª blind to the visual content.
2 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Outline
1 Eye tracking experiment
2 Gaze-based features & Learning
3 Results
4 Discussion
3 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Eye tracking experiment (1/3)
Protocol
Helo, A., Pannasch, S., Sirri, L., & R¨am¨a, P. (2014). The maturation of
eye movement behavior: Scene viewing characteristics in children and
adults. Vision Research, 103, 83-91.
ª Eye movement data are collected from a total of 101 subjects:
23 adults and 78 children;
ª Four groups are made:
• 2 y.o. (18 participants);
• 4-6 y.o. (22 participants);
• 6-10 y.o. (38 participants);
• adults (22 participants) (agv ± std = 28 ± 4.4).
ª 30 color pictures taken from children’s books;
ª Viewing duration = 10s, recognition and free viewing task;
ª EyeLink 1000 Remote eye tracker system.
4 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Eye tracking experiment (2/3)
Some results
ª Fixation durations decrease with age (A)
ª Saccade amplitudes are reduced with age (B)
ª Center bias is less significant for young children (C)
Consistent with many studies on visual system development and
influences of aging (see paper).
5 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Eye tracking experiment (3/3)
Some results
Joint distribution of saccade amplitudes and orientations from
childhood to adulthood:
6 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Outline
1 Eye tracking experiment
2 Gaze-based features & Learning
3 Results
4 Discussion
7 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Gaze-based features & Learning
Gaze-based features (1/1)
We extracted 70 features from the 2686 scanpaths:
ª fixation durations, saccade amplitudes, saccade velocities,
saccade durations.
For each of these features, we computed median value, the mean
value, the STD value and the first derivative (⇒ 4 × 4 features).
ª center bias (mean, STD and first derivative) (⇒ 3 features).
ª covariance matrix 5 × 5, to represent the correlation among
features (⇒ 15 features).
ª histogram of saccade slopes (⇒ 36 features).
8 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Gaze-based features & Learning
Learning (1/1)
We learn a non-linear mapping of scanpath-based features to age:
ª multi-class Gentle AdaBoost algorithm.
adaptive boosting = learn several weak classifiers and combine them
to get a strong classifier.
ª the number of weak classifiers is set to 60.
ª a classification tree as a weak learner.
ª 10-fold cross validation approach.
9 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Outline
1 Eye tracking experiment
2 Gaze-based features & Learning
3 Results
4 Discussion
10 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Results
Two-class classification
ª Confusion matrix for 2 y.o vs adults (A) and chidren vs adult
(B):
• Green and red boxes show the number and percentage of correct and
incorrect classifications, respectively.
• The grey boxes provide the correct and wrong predictions per class.
11 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Results
Four-class classification
ª Confusion matrix for the four classes:
• Performances are lower
than those previously
observed.
• Best performances for 2
y.o. and adult groups.
12 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Results
More results
ª For 2 y.o. vs adults, the use of median, average, STD and first
derivative of fixation durations provides an accuracy of 86.1%
(compared to 93.4%). (4 parameters compared to 70)
ª For four-class classification, overall accuracy increases with the
number of fixations:
• First 6 fixations: 41.3%
• First 9 fixations: 41.5%
• First 12 fixations: 45%
• First 15 fixations: 46.3%
• All: 52.2%
ª For four-class classification, the use of saliency-based features
extracted from predicted/human saliency maps does not help improve
the performance.
13 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Outline
1 Eye tracking experiment
2 Gaze-based features & Learning
3 Results
4 Discussion
14 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Discussion (1/2)
A promising approach but performance needs to
be improved...
ª by using richer gaze descriptors (e.g. based on deep features,
HMM);
ª by using more sophisticated methods, such as deep learning.
ª by reconsidering the age groups, e.g. 3 classes may be sufficient.
We need more data!!
ª We can expect that the rise of low-cost eye-tracker (e.g.
webcam-based) will soon provide largescale eye-tracking
datasets.
15 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Discussion (2/2)
A side result raised by this study:
ª We need to tailor our computer vision algorithms to specific
groups of observers (age, gender, visual impaired...)
Le Meur, O. et al. (2017). Visual Attention Saccadic Models Learn to
Emulate Gaze Patterns From Childhood to Adulthood. IEEE Transactions
on Image Processing, 26(10), 4777-4789.
Krishna, O. et al. (2017). Gaze Distribution Analysis and Saliency
Prediction Across Age Groups. arXiv preprint arXiv:1705.07284.
16 / 17
Your Gaze
Betrays Your
Age!
O. Le Meur
Eye tracking
experiment
Gaze-based
features &
Learning
Results
Discussion
Thanks for your attention!
17 / 17

Más contenido relacionado

La actualidad más candente

Aspheric vs Spheric IOL
Aspheric vs Spheric IOLAspheric vs Spheric IOL
Aspheric vs Spheric IOLOlly Congga
 
Total corneal astigmatism in older adults taking into account posterior corne...
Total corneal astigmatism in older adults taking into account posterior corne...Total corneal astigmatism in older adults taking into account posterior corne...
Total corneal astigmatism in older adults taking into account posterior corne...Álvaro Rodríguez-Ratón
 
A Scan- Basics and Update
A Scan- Basics and UpdateA Scan- Basics and Update
A Scan- Basics and UpdatePravin Bhat
 
Tips and tricks in squint: Dr. Madhu Karna
Tips and tricks in squint: Dr. Madhu KarnaTips and tricks in squint: Dr. Madhu Karna
Tips and tricks in squint: Dr. Madhu KarnaMadhu Karna
 
Strategies for better toric IOL outcomes (old version, Nov 2017)
Strategies for better toric IOL outcomes (old version, Nov 2017)Strategies for better toric IOL outcomes (old version, Nov 2017)
Strategies for better toric IOL outcomes (old version, Nov 2017)Han Chieh Yu
 
Three-Years Results after Femtosecond laser-assisted Circular Keratotomy as a...
Three-Years Results after Femtosecond laser-assisted Circular Keratotomyas a...Three-Years Results after Femtosecond laser-assisted Circular Keratotomyas a...
Three-Years Results after Femtosecond laser-assisted Circular Keratotomy as a...Breyer, Kaymak & Klabe Augenchirurgie
 
Biometry instruments & equipment
Biometry instruments & equipmentBiometry instruments & equipment
Biometry instruments & equipmentDevdutta Nayak
 
Biometry immersion optical helpful tips & key points
Biometry immersion optical  helpful tips & key pointsBiometry immersion optical  helpful tips & key points
Biometry immersion optical helpful tips & key pointsDr. Anand Sudhalkar
 

La actualidad más candente (11)

Keratometry & autorefraction
Keratometry & autorefractionKeratometry & autorefraction
Keratometry & autorefraction
 
Aspheric vs Spheric IOL
Aspheric vs Spheric IOLAspheric vs Spheric IOL
Aspheric vs Spheric IOL
 
Total corneal astigmatism in older adults taking into account posterior corne...
Total corneal astigmatism in older adults taking into account posterior corne...Total corneal astigmatism in older adults taking into account posterior corne...
Total corneal astigmatism in older adults taking into account posterior corne...
 
A Scan- Basics and Update
A Scan- Basics and UpdateA Scan- Basics and Update
A Scan- Basics and Update
 
Tips and tricks in squint: Dr. Madhu Karna
Tips and tricks in squint: Dr. Madhu KarnaTips and tricks in squint: Dr. Madhu Karna
Tips and tricks in squint: Dr. Madhu Karna
 
Nidek CEM-530
Nidek CEM-530Nidek CEM-530
Nidek CEM-530
 
Orthokeratology and Its Effects on Children
Orthokeratology and Its Effects on ChildrenOrthokeratology and Its Effects on Children
Orthokeratology and Its Effects on Children
 
Strategies for better toric IOL outcomes (old version, Nov 2017)
Strategies for better toric IOL outcomes (old version, Nov 2017)Strategies for better toric IOL outcomes (old version, Nov 2017)
Strategies for better toric IOL outcomes (old version, Nov 2017)
 
Three-Years Results after Femtosecond laser-assisted Circular Keratotomy as a...
Three-Years Results after Femtosecond laser-assisted Circular Keratotomyas a...Three-Years Results after Femtosecond laser-assisted Circular Keratotomyas a...
Three-Years Results after Femtosecond laser-assisted Circular Keratotomy as a...
 
Biometry instruments & equipment
Biometry instruments & equipmentBiometry instruments & equipment
Biometry instruments & equipment
 
Biometry immersion optical helpful tips & key points
Biometry immersion optical  helpful tips & key pointsBiometry immersion optical  helpful tips & key points
Biometry immersion optical helpful tips & key points
 

Similar a Your gaze betrays your age

Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...
Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...
Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...Giacomo Veneri
 
Squint assessment
Squint assessmentSquint assessment
Squint assessmentsiraj safi
 
project report
project reportproject report
project reportWeston Wei
 
Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...
Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...
Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...Ashley Szmania
 
Visual acuity in child converted
Visual acuity in child convertedVisual acuity in child converted
Visual acuity in child convertedVinitkumar MJ
 
Real pediatric visual acuity assessment(1).pptx
Real pediatric visual acuity assessment(1).pptxReal pediatric visual acuity assessment(1).pptx
Real pediatric visual acuity assessment(1).pptxrameshbhandari32
 
Real pediatric visual acuity assessment
Real pediatric visual acuity assessmentReal pediatric visual acuity assessment
Real pediatric visual acuity assessmentBipin Koirala
 
PGI MEMORY SCALE.(PSYCHOLOGY)
PGI MEMORY SCALE.(PSYCHOLOGY)PGI MEMORY SCALE.(PSYCHOLOGY)
PGI MEMORY SCALE.(PSYCHOLOGY)MissTiwari
 
Examination of a case of squint
Examination of a case of squintExamination of a case of squint
Examination of a case of squintNisha Kumari
 
Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Jaey Jeong
 
PERIOCULAR RECOGNITION USING REDUCED FEATURES
PERIOCULAR RECOGNITION USING REDUCED FEATURESPERIOCULAR RECOGNITION USING REDUCED FEATURES
PERIOCULAR RECOGNITION USING REDUCED FEATURESijcsit
 
Animal identification using machine learning techniques
Animal identification using machine learning techniquesAnimal identification using machine learning techniques
Animal identification using machine learning techniquesAboul Ella Hassanien
 
Driver Drowsiness Detection Review
Driver Drowsiness Detection ReviewDriver Drowsiness Detection Review
Driver Drowsiness Detection ReviewAsaad Waqar
 
Relationship between binocular_vision,_visual.5
Relationship between binocular_vision,_visual.5Relationship between binocular_vision,_visual.5
Relationship between binocular_vision,_visual.5Yesenia Castillo Salinas
 
An efficient system for real time fatigue detection
An efficient system for real time fatigue detectionAn efficient system for real time fatigue detection
An efficient system for real time fatigue detectionAlexander Decker
 

Similar a Your gaze betrays your age (20)

Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...
Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...
Evaluating Human Visual Search Performance by Monte Carlo methods and Heurist...
 
Squint assessment
Squint assessmentSquint assessment
Squint assessment
 
project report
project reportproject report
project report
 
Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...
Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...
Enhancing Vision Through Screening: Improving Vision Deficit Detection Throu...
 
Visual acuity in child converted
Visual acuity in child convertedVisual acuity in child converted
Visual acuity in child converted
 
Real pediatric visual acuity assessment(1).pptx
Real pediatric visual acuity assessment(1).pptxReal pediatric visual acuity assessment(1).pptx
Real pediatric visual acuity assessment(1).pptx
 
3 Cone Drill Test
3 Cone Drill Test3 Cone Drill Test
3 Cone Drill Test
 
Real pediatric visual acuity assessment
Real pediatric visual acuity assessmentReal pediatric visual acuity assessment
Real pediatric visual acuity assessment
 
Industrial vision screening
Industrial vision screeningIndustrial vision screening
Industrial vision screening
 
PGI MEMORY SCALE.(PSYCHOLOGY)
PGI MEMORY SCALE.(PSYCHOLOGY)PGI MEMORY SCALE.(PSYCHOLOGY)
PGI MEMORY SCALE.(PSYCHOLOGY)
 
Examination of a case of squint
Examination of a case of squintExamination of a case of squint
Examination of a case of squint
 
Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...Deep learning based gaze detection system for automobile drivers using nir ca...
Deep learning based gaze detection system for automobile drivers using nir ca...
 
PERIOCULAR RECOGNITION USING REDUCED FEATURES
PERIOCULAR RECOGNITION USING REDUCED FEATURESPERIOCULAR RECOGNITION USING REDUCED FEATURES
PERIOCULAR RECOGNITION USING REDUCED FEATURES
 
Kouri
KouriKouri
Kouri
 
VISUAL FIELD - Perimetry
 VISUAL FIELD - Perimetry VISUAL FIELD - Perimetry
VISUAL FIELD - Perimetry
 
Animal identification using machine learning techniques
Animal identification using machine learning techniquesAnimal identification using machine learning techniques
Animal identification using machine learning techniques
 
Driver Drowsiness Detection Review
Driver Drowsiness Detection ReviewDriver Drowsiness Detection Review
Driver Drowsiness Detection Review
 
L_3011_62.+1908
L_3011_62.+1908L_3011_62.+1908
L_3011_62.+1908
 
Relationship between binocular_vision,_visual.5
Relationship between binocular_vision,_visual.5Relationship between binocular_vision,_visual.5
Relationship between binocular_vision,_visual.5
 
An efficient system for real time fatigue detection
An efficient system for real time fatigue detectionAn efficient system for real time fatigue detection
An efficient system for real time fatigue detection
 

Más de Olivier Le Meur

Guided tour of visual attention
Guided tour of visual attentionGuided tour of visual attention
Guided tour of visual attentionOlivier Le Meur
 
How saccadic models help predict where we look during a visual task? Applicat...
How saccadic models help predict where we look during a visual task? Applicat...How saccadic models help predict where we look during a visual task? Applicat...
How saccadic models help predict where we look during a visual task? Applicat...Olivier Le Meur
 
Introducing context-dependent and spatially-variant viewing biases in saccadi...
Introducing context-dependent and spatially-variant viewing biases in saccadi...Introducing context-dependent and spatially-variant viewing biases in saccadi...
Introducing context-dependent and spatially-variant viewing biases in saccadi...Olivier Le Meur
 
Color transfer between high-dynamic-range images
Color transfer between high-dynamic-range imagesColor transfer between high-dynamic-range images
Color transfer between high-dynamic-range imagesOlivier Le Meur
 
Style-aware robust color transfer
Style-aware robust color transferStyle-aware robust color transfer
Style-aware robust color transferOlivier Le Meur
 
Saccadic model of eye movements for free-viewing condition
Saccadic model of eye movements for free-viewing conditionSaccadic model of eye movements for free-viewing condition
Saccadic model of eye movements for free-viewing conditionOlivier Le Meur
 
Examplar-based inpainting
Examplar-based inpaintingExamplar-based inpainting
Examplar-based inpaintingOlivier Le Meur
 
Methods for comparing scanpaths and saliency maps: strengths and weaknesses
Methods for comparing scanpaths and saliency maps: strengths and weaknessesMethods for comparing scanpaths and saliency maps: strengths and weaknesses
Methods for comparing scanpaths and saliency maps: strengths and weaknessesOlivier Le Meur
 
Inter-observers congruency and memorability
Inter-observers congruency and memorabilityInter-observers congruency and memorability
Inter-observers congruency and memorabilityOlivier Le Meur
 
Visual attention: models and performance
Visual attention: models and performanceVisual attention: models and performance
Visual attention: models and performanceOlivier Le Meur
 

Más de Olivier Le Meur (10)

Guided tour of visual attention
Guided tour of visual attentionGuided tour of visual attention
Guided tour of visual attention
 
How saccadic models help predict where we look during a visual task? Applicat...
How saccadic models help predict where we look during a visual task? Applicat...How saccadic models help predict where we look during a visual task? Applicat...
How saccadic models help predict where we look during a visual task? Applicat...
 
Introducing context-dependent and spatially-variant viewing biases in saccadi...
Introducing context-dependent and spatially-variant viewing biases in saccadi...Introducing context-dependent and spatially-variant viewing biases in saccadi...
Introducing context-dependent and spatially-variant viewing biases in saccadi...
 
Color transfer between high-dynamic-range images
Color transfer between high-dynamic-range imagesColor transfer between high-dynamic-range images
Color transfer between high-dynamic-range images
 
Style-aware robust color transfer
Style-aware robust color transferStyle-aware robust color transfer
Style-aware robust color transfer
 
Saccadic model of eye movements for free-viewing condition
Saccadic model of eye movements for free-viewing conditionSaccadic model of eye movements for free-viewing condition
Saccadic model of eye movements for free-viewing condition
 
Examplar-based inpainting
Examplar-based inpaintingExamplar-based inpainting
Examplar-based inpainting
 
Methods for comparing scanpaths and saliency maps: strengths and weaknesses
Methods for comparing scanpaths and saliency maps: strengths and weaknessesMethods for comparing scanpaths and saliency maps: strengths and weaknesses
Methods for comparing scanpaths and saliency maps: strengths and weaknesses
 
Inter-observers congruency and memorability
Inter-observers congruency and memorabilityInter-observers congruency and memorability
Inter-observers congruency and memorability
 
Visual attention: models and performance
Visual attention: models and performanceVisual attention: models and performance
Visual attention: models and performance
 

Último

Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.ShwetaHattimare
 
Human brain.. It's parts and function.
Human brain.. It's parts and function. Human brain.. It's parts and function.
Human brain.. It's parts and function. MUKTA MANJARI SAHOO
 
MARSILEA notes in detail for II year Botany.ppt
MARSILEA  notes in detail for II year Botany.pptMARSILEA  notes in detail for II year Botany.ppt
MARSILEA notes in detail for II year Botany.pptaigil2
 
Application of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptxApplication of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptxRahulVishwakarma71547
 
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdfPests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdfPirithiRaju
 
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdfSUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdfsantiagojoderickdoma
 
Alternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusAlternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusPradnya Wadekar
 
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxQ3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxArdeniel
 
CW marking grid Analytical BS - M Ahmad.docx
CW  marking grid Analytical BS - M Ahmad.docxCW  marking grid Analytical BS - M Ahmad.docx
CW marking grid Analytical BS - M Ahmad.docxmarwaahmad357
 
Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...
Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...
Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...Sérgio Sacani
 
Pests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPRPests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPRPirithiRaju
 
Controlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentControlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentRahulVishwakarma71547
 
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...PirithiRaju
 
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...marwaahmad357
 
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTMARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTjipexe1248
 
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky WayShiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky WaySérgio Sacani
 
Basic Concepts in Pharmacology in molecular .pptx
Basic Concepts in Pharmacology in molecular  .pptxBasic Concepts in Pharmacology in molecular  .pptx
Basic Concepts in Pharmacology in molecular .pptxVijayaKumarR28
 
Identification of Superclusters and Their Properties in the Sloan Digital Sky...
Identification of Superclusters and Their Properties in the Sloan Digital Sky...Identification of Superclusters and Their Properties in the Sloan Digital Sky...
Identification of Superclusters and Their Properties in the Sloan Digital Sky...Sérgio Sacani
 

Último (20)

Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.
 
Data delivery from the US-EPA Center for Computational Toxicology and Exposur...
Data delivery from the US-EPA Center for Computational Toxicology and Exposur...Data delivery from the US-EPA Center for Computational Toxicology and Exposur...
Data delivery from the US-EPA Center for Computational Toxicology and Exposur...
 
Human brain.. It's parts and function.
Human brain.. It's parts and function. Human brain.. It's parts and function.
Human brain.. It's parts and function.
 
MARSILEA notes in detail for II year Botany.ppt
MARSILEA  notes in detail for II year Botany.pptMARSILEA  notes in detail for II year Botany.ppt
MARSILEA notes in detail for II year Botany.ppt
 
Application of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptxApplication of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptx
 
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdfPests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
 
Cheminformatics tools supporting dissemination of data associated with US EPA...
Cheminformatics tools supporting dissemination of data associated with US EPA...Cheminformatics tools supporting dissemination of data associated with US EPA...
Cheminformatics tools supporting dissemination of data associated with US EPA...
 
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdfSUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
 
Alternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusAlternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabus
 
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxQ3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
 
CW marking grid Analytical BS - M Ahmad.docx
CW  marking grid Analytical BS - M Ahmad.docxCW  marking grid Analytical BS - M Ahmad.docx
CW marking grid Analytical BS - M Ahmad.docx
 
Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...
Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...
Legacy Analysis of Dark Matter Annihilation from the Milky Way Dwarf Spheroid...
 
Pests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPRPests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPR
 
Controlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentControlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform Environment
 
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
 
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
 
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTMARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
 
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky WayShiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
 
Basic Concepts in Pharmacology in molecular .pptx
Basic Concepts in Pharmacology in molecular  .pptxBasic Concepts in Pharmacology in molecular  .pptx
Basic Concepts in Pharmacology in molecular .pptx
 
Identification of Superclusters and Their Properties in the Sloan Digital Sky...
Identification of Superclusters and Their Properties in the Sloan Digital Sky...Identification of Superclusters and Their Properties in the Sloan Digital Sky...
Identification of Superclusters and Their Properties in the Sloan Digital Sky...
 

Your gaze betrays your age

  • 1. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Your Gaze Betrays Your Age! Olivier Le Meur, Antoine Coutrot, Zhi Liu, Pia R¨am¨a, Adrien Le Roch and Andrea Helo IRISA - University of Rennes 1, France olemeur@irisa.fr September 7, 2017 1 / 17
  • 2. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Motivation Objective: To give evidence that information derived from observers’ gaze can be used to infer their age. Look at the screen and I will tell you your age! ª by using only features extracted from your scanpaths; ª blind to the visual content. 2 / 17
  • 3. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Outline 1 Eye tracking experiment 2 Gaze-based features & Learning 3 Results 4 Discussion 3 / 17
  • 4. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Eye tracking experiment (1/3) Protocol Helo, A., Pannasch, S., Sirri, L., & R¨am¨a, P. (2014). The maturation of eye movement behavior: Scene viewing characteristics in children and adults. Vision Research, 103, 83-91. ª Eye movement data are collected from a total of 101 subjects: 23 adults and 78 children; ª Four groups are made: • 2 y.o. (18 participants); • 4-6 y.o. (22 participants); • 6-10 y.o. (38 participants); • adults (22 participants) (agv ± std = 28 ± 4.4). ª 30 color pictures taken from children’s books; ª Viewing duration = 10s, recognition and free viewing task; ª EyeLink 1000 Remote eye tracker system. 4 / 17
  • 5. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Eye tracking experiment (2/3) Some results ª Fixation durations decrease with age (A) ª Saccade amplitudes are reduced with age (B) ª Center bias is less significant for young children (C) Consistent with many studies on visual system development and influences of aging (see paper). 5 / 17
  • 6. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Eye tracking experiment (3/3) Some results Joint distribution of saccade amplitudes and orientations from childhood to adulthood: 6 / 17
  • 7. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Outline 1 Eye tracking experiment 2 Gaze-based features & Learning 3 Results 4 Discussion 7 / 17
  • 8. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Gaze-based features & Learning Gaze-based features (1/1) We extracted 70 features from the 2686 scanpaths: ª fixation durations, saccade amplitudes, saccade velocities, saccade durations. For each of these features, we computed median value, the mean value, the STD value and the first derivative (⇒ 4 × 4 features). ª center bias (mean, STD and first derivative) (⇒ 3 features). ª covariance matrix 5 × 5, to represent the correlation among features (⇒ 15 features). ª histogram of saccade slopes (⇒ 36 features). 8 / 17
  • 9. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Gaze-based features & Learning Learning (1/1) We learn a non-linear mapping of scanpath-based features to age: ª multi-class Gentle AdaBoost algorithm. adaptive boosting = learn several weak classifiers and combine them to get a strong classifier. ª the number of weak classifiers is set to 60. ª a classification tree as a weak learner. ª 10-fold cross validation approach. 9 / 17
  • 10. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Outline 1 Eye tracking experiment 2 Gaze-based features & Learning 3 Results 4 Discussion 10 / 17
  • 11. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Results Two-class classification ª Confusion matrix for 2 y.o vs adults (A) and chidren vs adult (B): • Green and red boxes show the number and percentage of correct and incorrect classifications, respectively. • The grey boxes provide the correct and wrong predictions per class. 11 / 17
  • 12. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Results Four-class classification ª Confusion matrix for the four classes: • Performances are lower than those previously observed. • Best performances for 2 y.o. and adult groups. 12 / 17
  • 13. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Results More results ª For 2 y.o. vs adults, the use of median, average, STD and first derivative of fixation durations provides an accuracy of 86.1% (compared to 93.4%). (4 parameters compared to 70) ª For four-class classification, overall accuracy increases with the number of fixations: • First 6 fixations: 41.3% • First 9 fixations: 41.5% • First 12 fixations: 45% • First 15 fixations: 46.3% • All: 52.2% ª For four-class classification, the use of saliency-based features extracted from predicted/human saliency maps does not help improve the performance. 13 / 17
  • 14. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Outline 1 Eye tracking experiment 2 Gaze-based features & Learning 3 Results 4 Discussion 14 / 17
  • 15. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Discussion (1/2) A promising approach but performance needs to be improved... ª by using richer gaze descriptors (e.g. based on deep features, HMM); ª by using more sophisticated methods, such as deep learning. ª by reconsidering the age groups, e.g. 3 classes may be sufficient. We need more data!! ª We can expect that the rise of low-cost eye-tracker (e.g. webcam-based) will soon provide largescale eye-tracking datasets. 15 / 17
  • 16. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Discussion (2/2) A side result raised by this study: ª We need to tailor our computer vision algorithms to specific groups of observers (age, gender, visual impaired...) Le Meur, O. et al. (2017). Visual Attention Saccadic Models Learn to Emulate Gaze Patterns From Childhood to Adulthood. IEEE Transactions on Image Processing, 26(10), 4777-4789. Krishna, O. et al. (2017). Gaze Distribution Analysis and Saliency Prediction Across Age Groups. arXiv preprint arXiv:1705.07284. 16 / 17
  • 17. Your Gaze Betrays Your Age! O. Le Meur Eye tracking experiment Gaze-based features & Learning Results Discussion Thanks for your attention! 17 / 17