SlideShare una empresa de Scribd logo
1 de 20
THE VIRTUAL CANE    Designing for
                    the Periphery
                    & The Mobile
        ITAG 2012   Cane
ABOUT ME

 Steve n B a t te r s by

 B y D ay

       Member of ISRG
       Software Developer
       AT Developer
       NERD

 By Night

     GEEK
     Maker - Open Hardware Developer
     Robot Enthusiast

     www.isrg.org.uk
     www.dyadica.co.uk
WHAT IS
THE
VIRTUAL
CANE
It‟s NOT a Wii
Controller it‟s an
Intuitive
Interface aka a
Natural User
Interface…

Empowers those
with visual
impairment to
access 3D virtual
spaces

It‟s NOT an
application of
W i i m o t e AT ! ! ! ! ! ! ! !
THE
VIRTUAL
SPACE

C I B C l i f to n to p
floor

E x p l o r a to r y
i nv e s t i g a t i o n o f
space

Allan, where is
the fire escape
eh?
THE CANE
CLOSE UP

-    - Yaw
-    - Pitch
-    - Ro l l

S l av i n g o f r e a l
world
o r i e n t a t io n to
that of virtual
c o u n te rp a r t
2011 - NATURAL USER INTERFACE

 The ability to draw upon the investments in skill we make to
  undertake the activities of our everyday living experience, as a
  means to define methods for input modality has many
  advantages.

   This is true for all user demographics.

   Immediate familiarity with methods for interfacing, intuitively gifting
    users of the system with capability for basic interaction.

 Buxton (2010) describes such interfaces as “natural” detailing
  that an interface is natural if it “exploits skills that we have
  acquired through a lifetime of living in the world.”

 Blake (2010) furthers this definition by determining that an
  interface is natural if it is designed to utilise human behaviour
  for interacting directly with content.
WHERE WE LEFT OFF 2011
2011 – UBICOMP & THE VIRTUAL CANE

 „ T h e m o s t p r o fo u n d te c h n o l o g i e s a r e
  t h o s e t h a t d i s a p p e a r. T h ey we av e
  t h e m s e l v e s i n to t h e f a b r i c o f e v e r y d ay
  l i fe u n t i l t h ey a r e i n d i s t i n g u i s h a b l e
  from it‟

      (Weiser, 1991).

 „ J u s t a s a g o o d , we l l - b a l a n c e d h a m m e r
  “disappears” in the hands of a
  c a r p e n te r a n d a l l ow s h i m to
  c o n c e n t r a t e o n t h e b i g p i c t u r e , we h o p e
  t h a t c o m p u te r s c a n p a r t i c i p a t e i n a
  similar magic disappearing act‟

      (Weiser et al., 1999 ).

 W h a t i f w e d e f i n e d A s s i s t i v e Te c h n o l o g y
  l i ke t h i s ?

 W h a t i f w e v i ew e d Te c h n o l o g y a s a
  prosthesis of the individual ?

 Te c h n o l o g i e s t h a t e n c a l m ?
TECHNOLOGIES THAT ENCALM

 In Designing Calm Technology , Weiser and John Seely Brown
  (1996) provide warning that whilst technological infusion has
  the great potential to improve and enhance our life
  experience, it also has the potential to impede and restrict it.

   Hmmm…. 00001000001011001010010100010010010000011


 In order to address this issue they describe the ethos of
  technologies that “encalm” as a manifesto for our future
  relationships with technology.

   Must have bought a Betamax back in 80‟s?
WHAT IS
THE
PERIPHERY

Our periphery is
our
connectedness to
the world as
defined by our
skills and senses
and their
capabilities.

Or our personal
boundary of
perception made
up of detail
provided by our
senses and
experiences.

Moped 
WHY DESIGN FOR THE PERIPHERY?

 By placing technologies within the periphery we are able to
  become attuned to them, allowing them to be selectively and
  subconsciously called upon to inform detail.

 This in turn af fords us with an increased ability to attune to
  multisensory detail and thus, a greater level of knowledge to
  inform both response and our perceived locatedness”.
INFUSION OF NUI & DFP

 From the infusion of the concept of designing for the
  periphery, with that of the Natural User Interface we can
  derive a powerful and innovative means for the application
  and development of interfaces.

 Interfaces of which from the outset we are familiar, but that
  also af ford us with an enormous volume of detail.
PERIPHERY MAPPING

 “As a PE the cane enables a user with an enhanced perception of
  their environment in many ways. The most immediate and
  obvious being indication of future potential of obstacles and
  hazards that may appear within our environment, however when
  viewed in terms of the peripher y the cane also provides an
  operator with much more detail than this .

 Movement across the ground affords additional information such
  as texture via subtle nuances in vibration; this is fur ther
  enhanced via the sound transition across par ticular materials.

 Over time a DT naturally develops a database of such peripheral
  cues allowing for the identification of the construct of their
  environment as a visual non impaired user we do the same by
  also collecting cues from the peripher y .”
PERIPHERY MAPPING

 “At the same time both auditor y and touch senses provide cues
  that indicate it is raining, this is fur thered by the subtle
  reduction in friction the cane makes as it is moved across the
  surface of travel, in conjunction sound subtly dampened whilst
  also complimented by the swish made by the movement that
  experience indicates to be water.”

 “A slight change in balance indicates the possibility of an
  incline, however the canes balance in the hand during a
  concurrent sweep remains similar, a lack of additional pressure
  on both the fingers and palm indicates resulting and suggesting
  that in fact we are just on a bump in the road, differing volumes
  of pressure on the ball, arch and heel of the foot clarify this fact.
  This is fur thered by our innate proprioceptive functions that tell
  us our foot in fact parallel to the other just slightly rose in
  height.”
WHAT IS
THE
PERIPHERY

Our periphery is
our
connectedness to
the world as
defined by our
skills and senses
and their
capabilities.

Or our personal
boundary of
perception made
up of detail
provided by our
senses and
experiences.

Moped 
THE
MOBILE
CANE

Ru n n i n g o n
both PC and
M o b i le

C o m m un i c a t io n
via Multicast
OPEN HARDWARE SOLUTION[S]
BREAKOUT CANE 2012
CURRENT WORKS
FUTURE WORKS

Más contenido relacionado

Similar a The Mobile Virtual Cane

Week1 Interactivity
Week1 InteractivityWeek1 Interactivity
Week1 Interactivity
CMoz
 

Similar a The Mobile Virtual Cane (20)

Designing a Future We Want to Live In - UX STRAT USA 2017
Designing a Future We Want to Live In - UX STRAT USA 2017Designing a Future We Want to Live In - UX STRAT USA 2017
Designing a Future We Want to Live In - UX STRAT USA 2017
 
Blended Reality: superstructing reality, superstructing selves
Blended Reality:  superstructing reality, superstructing selvesBlended Reality:  superstructing reality, superstructing selves
Blended Reality: superstructing reality, superstructing selves
 
Architecting Virtual and Physical Spaces
Architecting Virtual and Physical SpacesArchitecting Virtual and Physical Spaces
Architecting Virtual and Physical Spaces
 
From Interaction to Understanding
From Interaction to UnderstandingFrom Interaction to Understanding
From Interaction to Understanding
 
Flow - Posibles Futures for Virtual and Augmented Reality
Flow - Posibles Futures for Virtual and Augmented RealityFlow - Posibles Futures for Virtual and Augmented Reality
Flow - Posibles Futures for Virtual and Augmented Reality
 
The Architecture of Understanding (World IA Day Chicago Keynote)
The Architecture of Understanding (World IA Day Chicago Keynote)The Architecture of Understanding (World IA Day Chicago Keynote)
The Architecture of Understanding (World IA Day Chicago Keynote)
 
Rewir Trend Review #03
Rewir Trend Review #03Rewir Trend Review #03
Rewir Trend Review #03
 
Rewir trendreview 03_2015
Rewir trendreview 03_2015Rewir trendreview 03_2015
Rewir trendreview 03_2015
 
skinput technology
skinput technologyskinput technology
skinput technology
 
Die Zukunft mit modernen Devices für mehr Produktivität und Mobilität - Hans ...
Die Zukunft mit modernen Devices für mehr Produktivität und Mobilität - Hans ...Die Zukunft mit modernen Devices für mehr Produktivität und Mobilität - Hans ...
Die Zukunft mit modernen Devices für mehr Produktivität und Mobilität - Hans ...
 
The Reality of Augmented Reality: Are we there yet?
The Reality of Augmented Reality: Are we there yet?The Reality of Augmented Reality: Are we there yet?
The Reality of Augmented Reality: Are we there yet?
 
3. Virtual Interface
3. Virtual Interface3. Virtual Interface
3. Virtual Interface
 
Becoming Ubiquitous
Becoming UbiquitousBecoming Ubiquitous
Becoming Ubiquitous
 
Week1 Interactivity
Week1 InteractivityWeek1 Interactivity
Week1 Interactivity
 
Revolutionary Future Trends for viewing and usage of digital images-Digi5stud...
Revolutionary Future Trends for viewing and usage of digital images-Digi5stud...Revolutionary Future Trends for viewing and usage of digital images-Digi5stud...
Revolutionary Future Trends for viewing and usage of digital images-Digi5stud...
 
Interaction as a Material
Interaction as a MaterialInteraction as a Material
Interaction as a Material
 
We Got This: Surviving and Thriving in a Deeply Weird World
We Got This: Surviving and Thriving in a Deeply Weird WorldWe Got This: Surviving and Thriving in a Deeply Weird World
We Got This: Surviving and Thriving in a Deeply Weird World
 
AR/VR and designing for human interaction
AR/VR and designing for human interactionAR/VR and designing for human interaction
AR/VR and designing for human interaction
 
The NeuroPsychology of Presence
The NeuroPsychology of PresenceThe NeuroPsychology of Presence
The NeuroPsychology of Presence
 
Chamber Music Extension Paper: COM 495
Chamber Music Extension Paper: COM 495Chamber Music Extension Paper: COM 495
Chamber Music Extension Paper: COM 495
 

Más de Interactive Technologies and Games: Education, Health and Disability

Más de Interactive Technologies and Games: Education, Health and Disability (20)

Robotics and Education – EduRob Project Results Launch
Robotics and Education – EduRob Project Results LaunchRobotics and Education – EduRob Project Results Launch
Robotics and Education – EduRob Project Results Launch
 
Educational Robotics for Students with disabilities (EDUROB) - brochure
Educational Robotics for Students with disabilities (EDUROB) - brochureEducational Robotics for Students with disabilities (EDUROB) - brochure
Educational Robotics for Students with disabilities (EDUROB) - brochure
 
Can Computer-Assisted Training of Prerequisite Motor Skills Help Enable Commu...
Can Computer-Assisted Training of Prerequisite Motor Skills Help Enable Commu...Can Computer-Assisted Training of Prerequisite Motor Skills Help Enable Commu...
Can Computer-Assisted Training of Prerequisite Motor Skills Help Enable Commu...
 
Increasing Awareness of Alzheimer’s Disease through a Mobile Game (Beverley C...
Increasing Awareness of Alzheimer’s Disease through a Mobile Game (Beverley C...Increasing Awareness of Alzheimer’s Disease through a Mobile Game (Beverley C...
Increasing Awareness of Alzheimer’s Disease through a Mobile Game (Beverley C...
 
Game features of cognitive training (Michael P. Craven and Carlo Fabricatore)
Game features of cognitive training (Michael P. Craven and Carlo Fabricatore)Game features of cognitive training (Michael P. Craven and Carlo Fabricatore)
Game features of cognitive training (Michael P. Craven and Carlo Fabricatore)
 
Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...
Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...
Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...
 
User involvement in design and application of virtual reality gamification to...
User involvement in design and application of virtual reality gamification to...User involvement in design and application of virtual reality gamification to...
User involvement in design and application of virtual reality gamification to...
 
Our virtual selves, our virtual morals – Mass Effect players’ personality and...
Our virtual selves, our virtual morals – Mass Effect players’ personality and...Our virtual selves, our virtual morals – Mass Effect players’ personality and...
Our virtual selves, our virtual morals – Mass Effect players’ personality and...
 
Support Dementia: using wearable assistive technology and analysing real-time...
Support Dementia: using wearable assistive technology and analysing real-time...Support Dementia: using wearable assistive technology and analysing real-time...
Support Dementia: using wearable assistive technology and analysing real-time...
 
Breast Cancer Diagnosis using a Hybrid Genetic Algorithm for Feature Selectio...
Breast Cancer Diagnosis using a Hybrid Genetic Algorithm for Feature Selectio...Breast Cancer Diagnosis using a Hybrid Genetic Algorithm for Feature Selectio...
Breast Cancer Diagnosis using a Hybrid Genetic Algorithm for Feature Selectio...
 
Keynote speakers – Dom Martinovs and Rachel Barrett, ‘ No One Left Behind’ pr...
Keynote speakers – Dom Martinovs and Rachel Barrett, ‘ No One Left Behind’ pr...Keynote speakers – Dom Martinovs and Rachel Barrett, ‘ No One Left Behind’ pr...
Keynote speakers – Dom Martinovs and Rachel Barrett, ‘ No One Left Behind’ pr...
 
Playing games with observation, dependency and agency in a new environment fo...
Playing games with observation, dependency and agency in a new environment fo...Playing games with observation, dependency and agency in a new environment fo...
Playing games with observation, dependency and agency in a new environment fo...
 
Me, My Game-Self, and Others: A Qualitative Exploration of the Game-Self (Nik...
Me, My Game-Self, and Others: A Qualitative Exploration of the Game-Self (Nik...Me, My Game-Self, and Others: A Qualitative Exploration of the Game-Self (Nik...
Me, My Game-Self, and Others: A Qualitative Exploration of the Game-Self (Nik...
 
A comparison of humanoid and non-humanoid robots in supporting the learning o...
A comparison of humanoid and non-humanoid robots in supporting the learning o...A comparison of humanoid and non-humanoid robots in supporting the learning o...
A comparison of humanoid and non-humanoid robots in supporting the learning o...
 
ITAG 2016 Keynote speaker - Fiorella Operto, ‘Robotics, A New Science’
ITAG 2016 Keynote speaker - Fiorella Operto, ‘Robotics, A New Science’ITAG 2016 Keynote speaker - Fiorella Operto, ‘Robotics, A New Science’
ITAG 2016 Keynote speaker - Fiorella Operto, ‘Robotics, A New Science’
 
Tell me what you want and I’ll show you what you can have: who drives design ...
Tell me what you want and I’ll show you what you can have: who drives design ...Tell me what you want and I’ll show you what you can have: who drives design ...
Tell me what you want and I’ll show you what you can have: who drives design ...
 
Using a blended pedagogical framework to guide the applications of games in n...
Using a blended pedagogical framework to guide the applications of games in n...Using a blended pedagogical framework to guide the applications of games in n...
Using a blended pedagogical framework to guide the applications of games in n...
 
Urban Games: playful storytelling experiences for city dwellers
Urban Games: playful storytelling experiences for city dwellersUrban Games: playful storytelling experiences for city dwellers
Urban Games: playful storytelling experiences for city dwellers
 
Game transfer Phenomena: the pervasiveness of sounds from video games and the...
Game transfer Phenomena: the pervasiveness of sounds from video games and the...Game transfer Phenomena: the pervasiveness of sounds from video games and the...
Game transfer Phenomena: the pervasiveness of sounds from video games and the...
 
Immersive Virtual Reality Simulation Deployment in a Lean Manufacturing Envir...
Immersive Virtual Reality Simulation Deployment in a Lean Manufacturing Envir...Immersive Virtual Reality Simulation Deployment in a Lean Manufacturing Envir...
Immersive Virtual Reality Simulation Deployment in a Lean Manufacturing Envir...
 

The Mobile Virtual Cane

  • 1. THE VIRTUAL CANE Designing for the Periphery & The Mobile ITAG 2012 Cane
  • 2. ABOUT ME  Steve n B a t te r s by  B y D ay  Member of ISRG  Software Developer  AT Developer  NERD  By Night  GEEK  Maker - Open Hardware Developer  Robot Enthusiast  www.isrg.org.uk  www.dyadica.co.uk
  • 3. WHAT IS THE VIRTUAL CANE It‟s NOT a Wii Controller it‟s an Intuitive Interface aka a Natural User Interface… Empowers those with visual impairment to access 3D virtual spaces It‟s NOT an application of W i i m o t e AT ! ! ! ! ! ! ! !
  • 4. THE VIRTUAL SPACE C I B C l i f to n to p floor E x p l o r a to r y i nv e s t i g a t i o n o f space Allan, where is the fire escape eh?
  • 5. THE CANE CLOSE UP - - Yaw - - Pitch - - Ro l l S l av i n g o f r e a l world o r i e n t a t io n to that of virtual c o u n te rp a r t
  • 6. 2011 - NATURAL USER INTERFACE  The ability to draw upon the investments in skill we make to undertake the activities of our everyday living experience, as a means to define methods for input modality has many advantages.  This is true for all user demographics.  Immediate familiarity with methods for interfacing, intuitively gifting users of the system with capability for basic interaction.  Buxton (2010) describes such interfaces as “natural” detailing that an interface is natural if it “exploits skills that we have acquired through a lifetime of living in the world.”  Blake (2010) furthers this definition by determining that an interface is natural if it is designed to utilise human behaviour for interacting directly with content.
  • 7. WHERE WE LEFT OFF 2011
  • 8. 2011 – UBICOMP & THE VIRTUAL CANE  „ T h e m o s t p r o fo u n d te c h n o l o g i e s a r e t h o s e t h a t d i s a p p e a r. T h ey we av e t h e m s e l v e s i n to t h e f a b r i c o f e v e r y d ay l i fe u n t i l t h ey a r e i n d i s t i n g u i s h a b l e from it‟  (Weiser, 1991).  „ J u s t a s a g o o d , we l l - b a l a n c e d h a m m e r “disappears” in the hands of a c a r p e n te r a n d a l l ow s h i m to c o n c e n t r a t e o n t h e b i g p i c t u r e , we h o p e t h a t c o m p u te r s c a n p a r t i c i p a t e i n a similar magic disappearing act‟  (Weiser et al., 1999 ).  W h a t i f w e d e f i n e d A s s i s t i v e Te c h n o l o g y l i ke t h i s ?  W h a t i f w e v i ew e d Te c h n o l o g y a s a prosthesis of the individual ?  Te c h n o l o g i e s t h a t e n c a l m ?
  • 9. TECHNOLOGIES THAT ENCALM  In Designing Calm Technology , Weiser and John Seely Brown (1996) provide warning that whilst technological infusion has the great potential to improve and enhance our life experience, it also has the potential to impede and restrict it.  Hmmm…. 00001000001011001010010100010010010000011  In order to address this issue they describe the ethos of technologies that “encalm” as a manifesto for our future relationships with technology.  Must have bought a Betamax back in 80‟s?
  • 10. WHAT IS THE PERIPHERY Our periphery is our connectedness to the world as defined by our skills and senses and their capabilities. Or our personal boundary of perception made up of detail provided by our senses and experiences. Moped 
  • 11. WHY DESIGN FOR THE PERIPHERY?  By placing technologies within the periphery we are able to become attuned to them, allowing them to be selectively and subconsciously called upon to inform detail.  This in turn af fords us with an increased ability to attune to multisensory detail and thus, a greater level of knowledge to inform both response and our perceived locatedness”.
  • 12. INFUSION OF NUI & DFP  From the infusion of the concept of designing for the periphery, with that of the Natural User Interface we can derive a powerful and innovative means for the application and development of interfaces.  Interfaces of which from the outset we are familiar, but that also af ford us with an enormous volume of detail.
  • 13. PERIPHERY MAPPING  “As a PE the cane enables a user with an enhanced perception of their environment in many ways. The most immediate and obvious being indication of future potential of obstacles and hazards that may appear within our environment, however when viewed in terms of the peripher y the cane also provides an operator with much more detail than this .  Movement across the ground affords additional information such as texture via subtle nuances in vibration; this is fur ther enhanced via the sound transition across par ticular materials.  Over time a DT naturally develops a database of such peripheral cues allowing for the identification of the construct of their environment as a visual non impaired user we do the same by also collecting cues from the peripher y .”
  • 14. PERIPHERY MAPPING  “At the same time both auditor y and touch senses provide cues that indicate it is raining, this is fur thered by the subtle reduction in friction the cane makes as it is moved across the surface of travel, in conjunction sound subtly dampened whilst also complimented by the swish made by the movement that experience indicates to be water.”  “A slight change in balance indicates the possibility of an incline, however the canes balance in the hand during a concurrent sweep remains similar, a lack of additional pressure on both the fingers and palm indicates resulting and suggesting that in fact we are just on a bump in the road, differing volumes of pressure on the ball, arch and heel of the foot clarify this fact. This is fur thered by our innate proprioceptive functions that tell us our foot in fact parallel to the other just slightly rose in height.”
  • 15. WHAT IS THE PERIPHERY Our periphery is our connectedness to the world as defined by our skills and senses and their capabilities. Or our personal boundary of perception made up of detail provided by our senses and experiences. Moped 
  • 16. THE MOBILE CANE Ru n n i n g o n both PC and M o b i le C o m m un i c a t io n via Multicast