1. Hilbert problems and
challenges
Pietro Perona
California Institute of Technology
NSF Frontiers in Vision Workshop
Cambridge - 21-23 Aug. 2011
Friday, August 26, 2011
6. scene
vision in the loop
understanding
ease of experimentation
goal representation decision/action
active perception
other sensors
Friday, August 26, 2011
28. Action Perception
PSYCHOLOGY
interaction, cooperation,
PLANNING
group-level goals and plans
competition
SOCIAL NETWORK THEORY OF SOCIOLOGY
INDIVIDUAL
plans, goals, behavior,
individual goals and plans
relationships ...
PREFRONTAL CORTEX THEORY OF PSYCHOLOGY
pose, movemes, actions,
MOTOR
motor programs
activities, objects, scenes
SENSORY
MOTOR CORTEX RECOGNITION
sensor-based control images, trajectories
SPINAL CORD IMAGING,TRACKING
World
Friday, August 26, 2011
37. Autonomous driving
<<show movie of traffic in India>>
Friday, August 26, 2011
38. Grand challenges
• Recognition -> Visipedia
• Behavior -> Fly behavior (mouse, ...human)
• Scene understanding -> ???
• Vision for action -> Autonomous driving
(how about manipulation?)
• Sustainable economy -> ???
Friday, August 26, 2011
39. Summary
• Scene understanding vs vision-for-action
• Recognition: just started, much to be done
• Behavior: ditto
• Sharing visual knowledge with humans??
• Grand challenges: many, fun and worthwhile
Friday, August 26, 2011
