SlideShare una empresa de Scribd logo
1 de 55
Descargar para leer sin conexión
This is Your Brain on Virtual Reality
Lynda Joy Gerry
21st of June 2016
Agenda:
 1. Spatial Processing and the Brain
 2. Agency and the Brain
 3. Avatar Effects
 4. First-Person POV “Embodied Experiences”
 5. Ex Nihilo: Stimulating Creativity and Empathy
 6. Future Directions: Social Interactions in VR
2
Spatial Processing and
Wayfinding in Virtual
Environments
3
Boldly Going Where No Rat Has Gone
Before… (Mayank Mehta, 2008, UCLA)
4
VR For Rats 5
Virtual Reality Affects Firing Patterns
of Brain’s GPS Cells
 Background: Selective spatial firing of neurons in the
hippocampus
 Research Question: Do virtual environments activate a mental
map in the same way as the real world?
 Findings: VR world stimulates response more like a
pedometer – the rat’s brains were tracking how many steps
they were taking, rather than incorporating multisensory cues
to integrate into a mental map
6
Measures of Presence and
Neuronal Activation
7
Presence: Definition
 Presence is the “…subjective experience of
being transiently unaware of actions and
cognitions linked to the real environment while
concurrently perceiving oneself as situated in and
perceiving action possibilities associated with the
virtual environment (VE)” (Wirth et al., 2007)
8
High Vs. Low Presence Ratings 9
Baumgartner et al., 2008
Presence and The Brain
 There are individual differences in how easily drawn into the virtual
environment a person feels (Ijsselsteijn and Riva, 2003; Wirth et
al., 2007)
 Children and adults differ in the quality and speed with which
presence is evoked by VEs (Schaik et al., 2004)
 Individual differences in susceptibility towards presence might be
modulated by the Prefrontal cortex, which is linked to executive
functions and inhibitory control over emotions and behavior (Aron
et al., 2004; Garavan et al., 1999; Koechlin et al., 2003;
Ridderinkhof et al., 2004)
10
The Amphibian SCUBA Diving Simulator
(Dhruv Jain, MIT Media Lab)
11
Body Ownership,
Agency, and Avatar
Effects
12
Is that hand my hand? 13
Body Ownership Illusions 14
Body Ownership Illusions and Agency
 Body Ownership Illusions: Paired visual-tactile
stimulation (Rubber Hand Illusion) or paired visual-
motor stimulation
 Tracked and rendered full-body motion in fully-
immersive virtual environments creates sense of
Agency
 Bottom Line: Under specific multisensory conditions,
we can experience artificial body parts, fake bodies,
or virtual bodies as our own body parts or whole
body.
15
16
Counseling Oneself: Embodying
Sigmund Freud Avatar
17
Osimo, Pizarro, Spanlang, & Slater (2015)
Avatar Effects Examples
 Embodying a body of a different race reduces implicit racial biases
(Groom, Bailenson, and Nass, 2009)
 Embodying a tall avatar increases self-confidence in negotiation tasks
(Yee and Bailenson, 2007)
 Embodying an attractive avatar increases self-disclosure
(Yee and Bailenson, 2007)
 Embodying a stressful posture in a virtual body can increase stress
even though physical body is not in that posture/position
(Bergström, Kilteni, and Slater, 2013)
 Embodying a child avatar body causes subjects to overestimate
object sizes
(Banakou et al., 2013)
18
Ahn, Bailenson, & Park (2014) 19
Ahn, Bailenson, & Park (2014) – Pro-
Environmental Self-Efficacy
 Environmental locus of control is the perception that
one’s behaviors directly impacts the wellbeing of the
environment.
 This is one of the most powerful drivers for environmental
behaviors.
20
Core Problem: Knowledge-to-Action
Gap
“the time-delayed, abstract, and often
statistical nature of the risks of global
warming does not evoke strong visceral
reactions.” – Weber (2006)
21
Promoting Helping Behavior in VR 22
Ahn et al., 2015
Benefits of Avatars
 Controlled environment + Stimuli
 Ability to have live interaction with your own and
another person’s avatar
 Why use avatars when you can use real people?
23
Agency and the Brain
24
Medial Prefrontal Cortex and Agency
(David et al., 2006)
 Distinct neural substrates underlying
representations of the self and others
 The medial prefrontal cortex is crucial for a
neural bases of the self and agency
 Perspective taking and agency represent
independent constituents of self-
consciousness
25
FPP Hand Movement in VEs
(Adamovich et al., 2009)
26
 Time-variant increase in activation in the left insular cortex during
observation of avatar hand
 Imitation of avatar showed activation in angular gyrus and
extrastriate body area
 Virtual hand avatar serves as disembodied training tools in
observation condition and as embodied “extensions” of subject’s
own body in the imitation condition
27FPP Hand Movement in VEs
(Adamovich et al., 2009)
Background: First-Person
Point-of-View “Embodied
Experiences” in VR
28
“Think about it: there is no experience you have had
that you are not the absolute center of. The world
as you experience it is there in front of YOU or
behind YOU, to the left or right of YOU, on YOUR
TV or YOUR monitor. And so on. Other people’s
thoughts and feelings have to be communicated to
you somehow, but your own are so immediate,
urgent, real.”
- David Foster Wallace, “This is Water” (2005
Kenyon Commencement Speech)
29
Machine to Be Another: Live Stream
Perspective Swapping
30
The Machine to Be Another
(MIT Media Lab)
31
THE MACHINE TO BE ANOTHER:
An Empathy Machine?
32
“Empathy is created the moment we try to put ourselves in
another person’s shoes.” – Aspen Baker, TED Radio Hour
“The machine to be another is designed to stimulate empathy
through embodied interaction between individuals.” (Bertrand et
al., 2014)
To what extent can we experience and understand what it is like
to be someone else?
Simo Ekholm: Meeting Myself from
Another Person’s Perspective
33
Makropol: “Art House” VR using POV
storytelling
34
Skammakrogen: How it Was Made 35
How to Combine These Experiences?
 Be Another Labs use live stream into the DK2
Benefit: Real-Time Interaction
Con: Low visual resolution + not stereo
 Original plan: Live Stream in Stereo – Low visual
resolution + Delay
 Used Stereo and Pre-Recorded Footage with
Binaural audio
36
Painter Project: Stereo Footage with
Binaural Audio
37
Ex Nihilo: Exploring the Stimulation of Creativity and
Empathy through Embodied Experiences in Virtual
Reality
38
Gallagher et al. (2015)
Neurophenomenology of Awe and
Wonder
39
Video of Experimental Task 40
Video of Experimental Task 41
42
43
44
45
Introducing Ex Nihilo
In The Republic, Plato asks, "Will we
say, of a painter, that he makes
something?" and answers, "Certainly
not, he merely imitates."
46
“Imitated” Paintings by Subjects 47
Subject Quote
 “It almost feels like collectively discovering
something that was in her head all along. The
experience allowed this completely different way
of connecting to someone that doesn’t rely on
facial expressions or anything.”
48
Measuring Social
Interaction in VEs
49
Measuring Social Interaction in VR
 How do you measure two people’s ability to
communicate effectively?
 What does communicating “effectively” mean?
 Suzanne Dikker – “shared semantic
understanding” and neural synchrony
50
Perceptual Crossing (Auvary et al., 2009) 51
Perceptual Crossing (Auvary et al.,2009)
 Task: Participants recognize one another while avoiding
shadow and static objects
 Mutual tactile interaction (trackball mouse and haptic
feedback)
 Static object = too stable and predictable to be human
 Shadow = too unstable since it moves but does not respond
 Other subject’s avatar can react with communicative intent
52
Froese and Di Paolo (2011)
 Hypothesized that the lack of personal recognition of the other in the
perceptual crossing paradigm was due to lack of a genuinely social
experimental task
 The mark of the social is the co-regulation of mutual interaction
53
Primary Intersubjectivity in Infants
 2-month old infants get distressed when shown a pre-recorded video of an
interaction with their mother, as opposed to a live streamed video.
 Simple recognition of a pattern of movements is not sufficient, and instead
social action perception requires an understanding of how other's
movements are related to our own.
 Infants display movement synchrony with adult speech (Condon & Sander,
1974)
 Still face studies (Toda & Fogel. 1993; Tronick, Als, Adamson., Wise. &
Brazelton, 1979)
54
Thank You!
www.khora-vr.com
lynda@khoravr.com

Más contenido relacionado

La actualidad más candente

Virtual Reality and Cognitive Immersion
Virtual Reality and Cognitive ImmersionVirtual Reality and Cognitive Immersion
Virtual Reality and Cognitive ImmersionJolanda Tromp
 
The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010Rob Manson
 
Face Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and Ava
Face Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and AvaFace Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and Ava
Face Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and AvaFACETSERC
 
Philosophy of Technology 2: Embodiment, Disembodiment and Immersion
Philosophy of Technology 2: Embodiment, Disembodiment and ImmersionPhilosophy of Technology 2: Embodiment, Disembodiment and Immersion
Philosophy of Technology 2: Embodiment, Disembodiment and ImmersionDMLab
 
Playing at the speed of thought-A Decision-Action model for soccer-pt.3
Playing at the speed of thought-A Decision-Action model for soccer-pt.3Playing at the speed of thought-A Decision-Action model for soccer-pt.3
Playing at the speed of thought-A Decision-Action model for soccer-pt.3Larry Paul
 
OUT OF THE MATRIX
OUT OF THE MATRIX  OUT OF THE MATRIX
OUT OF THE MATRIX KorteseRamey
 
Watzl inaugural lecture
Watzl inaugural lectureWatzl inaugural lecture
Watzl inaugural lecturesebastianwatzl
 
The Emergence of Positive Technology: Potential Applications - Giuseppe Riva...
The Emergence of Positive Technology:  Potential Applications - Giuseppe Riva...The Emergence of Positive Technology:  Potential Applications - Giuseppe Riva...
The Emergence of Positive Technology: Potential Applications - Giuseppe Riva...Riva Giuseppe
 
Applied Philosophy: Philosophy of Technology 1
Applied Philosophy: Philosophy of Technology 1Applied Philosophy: Philosophy of Technology 1
Applied Philosophy: Philosophy of Technology 1DMLab
 
White paper eu complexity research-an integrated approach-the peoples toolkit...
White paper eu complexity research-an integrated approach-the peoples toolkit...White paper eu complexity research-an integrated approach-the peoples toolkit...
White paper eu complexity research-an integrated approach-the peoples toolkit...Digital Business Innovation Community
 
Meaning Modes in Design - Fluxible 2016
Meaning Modes in Design - Fluxible 2016Meaning Modes in Design - Fluxible 2016
Meaning Modes in Design - Fluxible 2016Marsha Haverty
 
Acting Naturally with Information - IA Summit 2017
Acting Naturally with Information - IA Summit 2017Acting Naturally with Information - IA Summit 2017
Acting Naturally with Information - IA Summit 2017Marsha Haverty
 
What we mean by meaning: new structural properties of information architectur...
What we mean by meaning: new structural properties of information architectur...What we mean by meaning: new structural properties of information architectur...
What we mean by meaning: new structural properties of information architectur...Marsha Haverty
 
Virtual management
Virtual managementVirtual management
Virtual managementJohnny Ryser
 
Acting naturally: why design needs ecological psychology
Acting naturally: why design needs ecological psychologyActing naturally: why design needs ecological psychology
Acting naturally: why design needs ecological psychologyMarsha Haverty
 
The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...
The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...
The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...DeborahJ
 
Behavioural economics: how to turn human understanding into business advantag...
Behavioural economics: how to turn human understanding into business advantag...Behavioural economics: how to turn human understanding into business advantag...
Behavioural economics: how to turn human understanding into business advantag...SEMPL
 

La actualidad más candente (20)

Virtual Reality and Cognitive Immersion
Virtual Reality and Cognitive ImmersionVirtual Reality and Cognitive Immersion
Virtual Reality and Cognitive Immersion
 
The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010
 
Face Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and Ava
Face Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and AvaFace Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and Ava
Face Ex Machina. Demiurgical Faces from the Eye of Hal9000 to S1m0ne and Ava
 
Out of the matrix
Out of the matrixOut of the matrix
Out of the matrix
 
Philosophy of Technology 2: Embodiment, Disembodiment and Immersion
Philosophy of Technology 2: Embodiment, Disembodiment and ImmersionPhilosophy of Technology 2: Embodiment, Disembodiment and Immersion
Philosophy of Technology 2: Embodiment, Disembodiment and Immersion
 
Playing at the speed of thought-A Decision-Action model for soccer-pt.3
Playing at the speed of thought-A Decision-Action model for soccer-pt.3Playing at the speed of thought-A Decision-Action model for soccer-pt.3
Playing at the speed of thought-A Decision-Action model for soccer-pt.3
 
OUT OF THE MATRIX
OUT OF THE MATRIX  OUT OF THE MATRIX
OUT OF THE MATRIX
 
Watzl inaugural lecture
Watzl inaugural lectureWatzl inaugural lecture
Watzl inaugural lecture
 
The Emergence of Positive Technology: Potential Applications - Giuseppe Riva...
The Emergence of Positive Technology:  Potential Applications - Giuseppe Riva...The Emergence of Positive Technology:  Potential Applications - Giuseppe Riva...
The Emergence of Positive Technology: Potential Applications - Giuseppe Riva...
 
Applied Philosophy: Philosophy of Technology 1
Applied Philosophy: Philosophy of Technology 1Applied Philosophy: Philosophy of Technology 1
Applied Philosophy: Philosophy of Technology 1
 
W1 module 1
W1 module 1W1 module 1
W1 module 1
 
White paper eu complexity research-an integrated approach-the peoples toolkit...
White paper eu complexity research-an integrated approach-the peoples toolkit...White paper eu complexity research-an integrated approach-the peoples toolkit...
White paper eu complexity research-an integrated approach-the peoples toolkit...
 
Meaning Modes in Design - Fluxible 2016
Meaning Modes in Design - Fluxible 2016Meaning Modes in Design - Fluxible 2016
Meaning Modes in Design - Fluxible 2016
 
Acting Naturally with Information - IA Summit 2017
Acting Naturally with Information - IA Summit 2017Acting Naturally with Information - IA Summit 2017
Acting Naturally with Information - IA Summit 2017
 
What we mean by meaning: new structural properties of information architectur...
What we mean by meaning: new structural properties of information architectur...What we mean by meaning: new structural properties of information architectur...
What we mean by meaning: new structural properties of information architectur...
 
Ch06 Lecture Notes
Ch06 Lecture NotesCh06 Lecture Notes
Ch06 Lecture Notes
 
Virtual management
Virtual managementVirtual management
Virtual management
 
Acting naturally: why design needs ecological psychology
Acting naturally: why design needs ecological psychologyActing naturally: why design needs ecological psychology
Acting naturally: why design needs ecological psychology
 
The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...
The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...
The Future of the Image | Week 5 | The Art of Nothing: Different approaches t...
 
Behavioural economics: how to turn human understanding into business advantag...
Behavioural economics: how to turn human understanding into business advantag...Behavioural economics: how to turn human understanding into business advantag...
Behavioural economics: how to turn human understanding into business advantag...
 

Destacado

Lynda Joy Gerry (Makropol ApS) Start Up Pitch
Lynda Joy Gerry (Makropol ApS) Start Up PitchLynda Joy Gerry (Makropol ApS) Start Up Pitch
Lynda Joy Gerry (Makropol ApS) Start Up PitchAugmentedWorldExpo
 
E bootcamp right track manufacturing solutions 3 min pitch 04172013
E bootcamp right track manufacturing solutions 3 min pitch 04172013E bootcamp right track manufacturing solutions 3 min pitch 04172013
E bootcamp right track manufacturing solutions 3 min pitch 04172013Sola Lawal
 
Sugar manufacture dr vijaya shastry
Sugar manufacture dr vijaya shastrySugar manufacture dr vijaya shastry
Sugar manufacture dr vijaya shastryVijaya Shastry Ph.D
 
Virtual reality Presentation
Virtual reality PresentationVirtual reality Presentation
Virtual reality PresentationAnand Akshay
 
Pitch Deck Templates for Startups
Pitch Deck Templates for StartupsPitch Deck Templates for Startups
Pitch Deck Templates for StartupsNextView Ventures
 
Dwolla Startup Pitch Deck
Dwolla Startup Pitch DeckDwolla Startup Pitch Deck
Dwolla Startup Pitch DeckJoseph Hsieh
 
Formation pcie ppt word partie 1
Formation pcie ppt word partie 1Formation pcie ppt word partie 1
Formation pcie ppt word partie 1OneIDlille
 
Mixpanel - Our pitch deck that we used to raise $65M
Mixpanel - Our pitch deck that we used to raise $65MMixpanel - Our pitch deck that we used to raise $65M
Mixpanel - Our pitch deck that we used to raise $65MSuhail Doshi
 

Destacado (10)

Lynda Joy Gerry (Makropol ApS) Start Up Pitch
Lynda Joy Gerry (Makropol ApS) Start Up PitchLynda Joy Gerry (Makropol ApS) Start Up Pitch
Lynda Joy Gerry (Makropol ApS) Start Up Pitch
 
E bootcamp right track manufacturing solutions 3 min pitch 04172013
E bootcamp right track manufacturing solutions 3 min pitch 04172013E bootcamp right track manufacturing solutions 3 min pitch 04172013
E bootcamp right track manufacturing solutions 3 min pitch 04172013
 
Sugar manufacture dr vijaya shastry
Sugar manufacture dr vijaya shastrySugar manufacture dr vijaya shastry
Sugar manufacture dr vijaya shastry
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
 
Virtual reality Presentation
Virtual reality PresentationVirtual reality Presentation
Virtual reality Presentation
 
Pitch Deck Templates for Startups
Pitch Deck Templates for StartupsPitch Deck Templates for Startups
Pitch Deck Templates for Startups
 
Virtual Reality
Virtual RealityVirtual Reality
Virtual Reality
 
Dwolla Startup Pitch Deck
Dwolla Startup Pitch DeckDwolla Startup Pitch Deck
Dwolla Startup Pitch Deck
 
Formation pcie ppt word partie 1
Formation pcie ppt word partie 1Formation pcie ppt word partie 1
Formation pcie ppt word partie 1
 
Mixpanel - Our pitch deck that we used to raise $65M
Mixpanel - Our pitch deck that we used to raise $65MMixpanel - Our pitch deck that we used to raise $65M
Mixpanel - Our pitch deck that we used to raise $65M
 

Similar a This is Your Brain on Virtual Reality

VR in education
VR in educationVR in education
VR in educationOsku Torro
 
The Emergence of Consciousness at Lighthouse
The Emergence of Consciousness at LighthouseThe Emergence of Consciousness at Lighthouse
The Emergence of Consciousness at LighthouseAnna Dumitriu
 
Building for cooperation_ssc
Building for cooperation_sscBuilding for cooperation_ssc
Building for cooperation_sscDavid McAleavey
 
734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docx
734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docx734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docx
734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docxsleeperharwell
 
Virtual Presence - Ayelet Batist
Virtual Presence - Ayelet BatistVirtual Presence - Ayelet Batist
Virtual Presence - Ayelet BatistAyelet Batist
 
The NeuroPsychology of Presence
The NeuroPsychology of PresenceThe NeuroPsychology of Presence
The NeuroPsychology of PresenceRiva Giuseppe
 
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016Dave Mangot
 
Analysis Of Avital Cohen And Tsal Essay
Analysis Of Avital Cohen And Tsal EssayAnalysis Of Avital Cohen And Tsal Essay
Analysis Of Avital Cohen And Tsal EssayChristi Miller
 
Developing Enactive Political Gameplay in Transworld, Transmedia Genius Loci
Developing Enactive Political Gameplay in Transworld, Transmedia Genius LociDeveloping Enactive Political Gameplay in Transworld, Transmedia Genius Loci
Developing Enactive Political Gameplay in Transworld, Transmedia Genius LociPatrick John Coppock
 
COMP 4010 - Lecture 2: Presence in Virtual Reality
COMP 4010 - Lecture 2: Presence in Virtual RealityCOMP 4010 - Lecture 2: Presence in Virtual Reality
COMP 4010 - Lecture 2: Presence in Virtual RealityMark Billinghurst
 
Believable virtual social interactions 2
Believable virtual social interactions 2Believable virtual social interactions 2
Believable virtual social interactions 2UCL Interaction Centre
 
Lecture 2 Presence and Perception
Lecture 2 Presence and PerceptionLecture 2 Presence and Perception
Lecture 2 Presence and PerceptionMark Billinghurst
 
Why The Body Still Matters Presentation
Why The Body Still Matters PresentationWhy The Body Still Matters Presentation
Why The Body Still Matters Presentationsusanmort
 
Neural basis of social cognition based on fMRI studies, Yoko Mano
Neural basis of social cognition based on fMRI studies, Yoko ManoNeural basis of social cognition based on fMRI studies, Yoko Mano
Neural basis of social cognition based on fMRI studies, Yoko ManoKIT Cognitive Interaction Design
 
Empathy &Inclusion in the XR Space
Empathy &Inclusion in the XR SpaceEmpathy &Inclusion in the XR Space
Empathy &Inclusion in the XR SpaceCarly Jean Kienow
 
Examples Of The Ponzo Effect
Examples Of The Ponzo EffectExamples Of The Ponzo Effect
Examples Of The Ponzo EffectTammy Majors
 

Similar a This is Your Brain on Virtual Reality (20)

Are robots present?
Are robots present?Are robots present?
Are robots present?
 
VR in education
VR in educationVR in education
VR in education
 
Social VR
Social VRSocial VR
Social VR
 
Transformative experience design
Transformative experience designTransformative experience design
Transformative experience design
 
The Emergence of Consciousness at Lighthouse
The Emergence of Consciousness at LighthouseThe Emergence of Consciousness at Lighthouse
The Emergence of Consciousness at Lighthouse
 
Building for cooperation_ssc
Building for cooperation_sscBuilding for cooperation_ssc
Building for cooperation_ssc
 
734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docx
734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docx734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docx
734CYBERPSYCHOLOGY & BEHAVIORVolume 7, Number 6, 2004©.docx
 
Virtual Presence - Ayelet Batist
Virtual Presence - Ayelet BatistVirtual Presence - Ayelet Batist
Virtual Presence - Ayelet Batist
 
The NeuroPsychology of Presence
The NeuroPsychology of PresenceThe NeuroPsychology of Presence
The NeuroPsychology of Presence
 
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
The Cognitive Neuroscience of Empathy, DevOpsDays Austin 2016
 
Analysis Of Avital Cohen And Tsal Essay
Analysis Of Avital Cohen And Tsal EssayAnalysis Of Avital Cohen And Tsal Essay
Analysis Of Avital Cohen And Tsal Essay
 
Developing Enactive Political Gameplay in Transworld, Transmedia Genius Loci
Developing Enactive Political Gameplay in Transworld, Transmedia Genius LociDeveloping Enactive Political Gameplay in Transworld, Transmedia Genius Loci
Developing Enactive Political Gameplay in Transworld, Transmedia Genius Loci
 
COMP 4010 - Lecture 2: Presence in Virtual Reality
COMP 4010 - Lecture 2: Presence in Virtual RealityCOMP 4010 - Lecture 2: Presence in Virtual Reality
COMP 4010 - Lecture 2: Presence in Virtual Reality
 
Believable virtual social interactions 2
Believable virtual social interactions 2Believable virtual social interactions 2
Believable virtual social interactions 2
 
"Creating New Sensorial Modalities", by Alvaro Cassinelli
"Creating New Sensorial Modalities", by Alvaro Cassinelli"Creating New Sensorial Modalities", by Alvaro Cassinelli
"Creating New Sensorial Modalities", by Alvaro Cassinelli
 
Lecture 2 Presence and Perception
Lecture 2 Presence and PerceptionLecture 2 Presence and Perception
Lecture 2 Presence and Perception
 
Why The Body Still Matters Presentation
Why The Body Still Matters PresentationWhy The Body Still Matters Presentation
Why The Body Still Matters Presentation
 
Neural basis of social cognition based on fMRI studies, Yoko Mano
Neural basis of social cognition based on fMRI studies, Yoko ManoNeural basis of social cognition based on fMRI studies, Yoko Mano
Neural basis of social cognition based on fMRI studies, Yoko Mano
 
Empathy &Inclusion in the XR Space
Empathy &Inclusion in the XR SpaceEmpathy &Inclusion in the XR Space
Empathy &Inclusion in the XR Space
 
Examples Of The Ponzo Effect
Examples Of The Ponzo EffectExamples Of The Ponzo Effect
Examples Of The Ponzo Effect
 

Último

Controlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentControlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentRahulVishwakarma71547
 
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky WayShiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky WaySérgio Sacani
 
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxQ3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxArdeniel
 
Bureau of Indian Standards Specification of Shampoo.pptx
Bureau of Indian Standards Specification of Shampoo.pptxBureau of Indian Standards Specification of Shampoo.pptx
Bureau of Indian Standards Specification of Shampoo.pptxkastureyashashree
 
Gene transfer in plants agrobacterium.pdf
Gene transfer in plants agrobacterium.pdfGene transfer in plants agrobacterium.pdf
Gene transfer in plants agrobacterium.pdfNetHelix
 
Physics Serway Jewett 6th edition for Scientists and Engineers
Physics Serway Jewett 6th edition for Scientists and EngineersPhysics Serway Jewett 6th edition for Scientists and Engineers
Physics Serway Jewett 6th edition for Scientists and EngineersAndreaLucarelli
 
Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...
Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...
Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...Sérgio Sacani
 
Applied Biochemistry feedback_M Ahwad 2023.docx
Applied Biochemistry feedback_M Ahwad 2023.docxApplied Biochemistry feedback_M Ahwad 2023.docx
Applied Biochemistry feedback_M Ahwad 2023.docxmarwaahmad357
 
Krishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्रKrishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्रKrashi Coaching
 
Alternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusAlternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusPradnya Wadekar
 
Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.ShwetaHattimare
 
CW marking grid Analytical BS - M Ahmad.docx
CW  marking grid Analytical BS - M Ahmad.docxCW  marking grid Analytical BS - M Ahmad.docx
CW marking grid Analytical BS - M Ahmad.docxmarwaahmad357
 
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...marwaahmad357
 
M.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery SystemsM.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery SystemsSumathi Arumugam
 
Pests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPRPests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPRPirithiRaju
 
Basic Concepts in Pharmacology in molecular .pptx
Basic Concepts in Pharmacology in molecular  .pptxBasic Concepts in Pharmacology in molecular  .pptx
Basic Concepts in Pharmacology in molecular .pptxVijayaKumarR28
 
Application of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptxApplication of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptxRahulVishwakarma71547
 
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTMARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTjipexe1248
 
Principles & Formulation of Hair Care Products
Principles & Formulation of Hair Care  ProductsPrinciples & Formulation of Hair Care  Products
Principles & Formulation of Hair Care Productspurwaborkar@gmail.com
 

Último (20)

Controlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentControlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform Environment
 
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky WayShiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
Shiva and Shakti: Presumed Proto-Galactic Fragments in the Inner Milky Way
 
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxQ3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
 
Bureau of Indian Standards Specification of Shampoo.pptx
Bureau of Indian Standards Specification of Shampoo.pptxBureau of Indian Standards Specification of Shampoo.pptx
Bureau of Indian Standards Specification of Shampoo.pptx
 
Cheminformatics tools supporting dissemination of data associated with US EPA...
Cheminformatics tools supporting dissemination of data associated with US EPA...Cheminformatics tools supporting dissemination of data associated with US EPA...
Cheminformatics tools supporting dissemination of data associated with US EPA...
 
Gene transfer in plants agrobacterium.pdf
Gene transfer in plants agrobacterium.pdfGene transfer in plants agrobacterium.pdf
Gene transfer in plants agrobacterium.pdf
 
Physics Serway Jewett 6th edition for Scientists and Engineers
Physics Serway Jewett 6th edition for Scientists and EngineersPhysics Serway Jewett 6th edition for Scientists and Engineers
Physics Serway Jewett 6th edition for Scientists and Engineers
 
Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...
Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...
Digitized Continuous Magnetic Recordings for the August/September 1859 Storms...
 
Applied Biochemistry feedback_M Ahwad 2023.docx
Applied Biochemistry feedback_M Ahwad 2023.docxApplied Biochemistry feedback_M Ahwad 2023.docx
Applied Biochemistry feedback_M Ahwad 2023.docx
 
Krishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्रKrishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्र
 
Alternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusAlternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabus
 
Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.Role of Herbs in Cosmetics in Cosmetic Science.
Role of Herbs in Cosmetics in Cosmetic Science.
 
CW marking grid Analytical BS - M Ahmad.docx
CW  marking grid Analytical BS - M Ahmad.docxCW  marking grid Analytical BS - M Ahmad.docx
CW marking grid Analytical BS - M Ahmad.docx
 
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
 
M.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery SystemsM.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery Systems
 
Pests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPRPests of ragi_Identification, Binomics_Dr.UPR
Pests of ragi_Identification, Binomics_Dr.UPR
 
Basic Concepts in Pharmacology in molecular .pptx
Basic Concepts in Pharmacology in molecular  .pptxBasic Concepts in Pharmacology in molecular  .pptx
Basic Concepts in Pharmacology in molecular .pptx
 
Application of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptxApplication of Foraminiferal Ecology- Rahul.pptx
Application of Foraminiferal Ecology- Rahul.pptx
 
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTMARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
 
Principles & Formulation of Hair Care Products
Principles & Formulation of Hair Care  ProductsPrinciples & Formulation of Hair Care  Products
Principles & Formulation of Hair Care Products
 

This is Your Brain on Virtual Reality

  • 1. This is Your Brain on Virtual Reality Lynda Joy Gerry 21st of June 2016
  • 2. Agenda:  1. Spatial Processing and the Brain  2. Agency and the Brain  3. Avatar Effects  4. First-Person POV “Embodied Experiences”  5. Ex Nihilo: Stimulating Creativity and Empathy  6. Future Directions: Social Interactions in VR 2
  • 3. Spatial Processing and Wayfinding in Virtual Environments 3
  • 4. Boldly Going Where No Rat Has Gone Before… (Mayank Mehta, 2008, UCLA) 4
  • 6. Virtual Reality Affects Firing Patterns of Brain’s GPS Cells  Background: Selective spatial firing of neurons in the hippocampus  Research Question: Do virtual environments activate a mental map in the same way as the real world?  Findings: VR world stimulates response more like a pedometer – the rat’s brains were tracking how many steps they were taking, rather than incorporating multisensory cues to integrate into a mental map 6
  • 7. Measures of Presence and Neuronal Activation 7
  • 8. Presence: Definition  Presence is the “…subjective experience of being transiently unaware of actions and cognitions linked to the real environment while concurrently perceiving oneself as situated in and perceiving action possibilities associated with the virtual environment (VE)” (Wirth et al., 2007) 8
  • 9. High Vs. Low Presence Ratings 9 Baumgartner et al., 2008
  • 10. Presence and The Brain  There are individual differences in how easily drawn into the virtual environment a person feels (Ijsselsteijn and Riva, 2003; Wirth et al., 2007)  Children and adults differ in the quality and speed with which presence is evoked by VEs (Schaik et al., 2004)  Individual differences in susceptibility towards presence might be modulated by the Prefrontal cortex, which is linked to executive functions and inhibitory control over emotions and behavior (Aron et al., 2004; Garavan et al., 1999; Koechlin et al., 2003; Ridderinkhof et al., 2004) 10
  • 11. The Amphibian SCUBA Diving Simulator (Dhruv Jain, MIT Media Lab) 11
  • 12. Body Ownership, Agency, and Avatar Effects 12
  • 13. Is that hand my hand? 13
  • 15. Body Ownership Illusions and Agency  Body Ownership Illusions: Paired visual-tactile stimulation (Rubber Hand Illusion) or paired visual- motor stimulation  Tracked and rendered full-body motion in fully- immersive virtual environments creates sense of Agency  Bottom Line: Under specific multisensory conditions, we can experience artificial body parts, fake bodies, or virtual bodies as our own body parts or whole body. 15
  • 16. 16
  • 17. Counseling Oneself: Embodying Sigmund Freud Avatar 17 Osimo, Pizarro, Spanlang, & Slater (2015)
  • 18. Avatar Effects Examples  Embodying a body of a different race reduces implicit racial biases (Groom, Bailenson, and Nass, 2009)  Embodying a tall avatar increases self-confidence in negotiation tasks (Yee and Bailenson, 2007)  Embodying an attractive avatar increases self-disclosure (Yee and Bailenson, 2007)  Embodying a stressful posture in a virtual body can increase stress even though physical body is not in that posture/position (Bergström, Kilteni, and Slater, 2013)  Embodying a child avatar body causes subjects to overestimate object sizes (Banakou et al., 2013) 18
  • 19. Ahn, Bailenson, & Park (2014) 19
  • 20. Ahn, Bailenson, & Park (2014) – Pro- Environmental Self-Efficacy  Environmental locus of control is the perception that one’s behaviors directly impacts the wellbeing of the environment.  This is one of the most powerful drivers for environmental behaviors. 20
  • 21. Core Problem: Knowledge-to-Action Gap “the time-delayed, abstract, and often statistical nature of the risks of global warming does not evoke strong visceral reactions.” – Weber (2006) 21
  • 22. Promoting Helping Behavior in VR 22 Ahn et al., 2015
  • 23. Benefits of Avatars  Controlled environment + Stimuli  Ability to have live interaction with your own and another person’s avatar  Why use avatars when you can use real people? 23
  • 24. Agency and the Brain 24
  • 25. Medial Prefrontal Cortex and Agency (David et al., 2006)  Distinct neural substrates underlying representations of the self and others  The medial prefrontal cortex is crucial for a neural bases of the self and agency  Perspective taking and agency represent independent constituents of self- consciousness 25
  • 26. FPP Hand Movement in VEs (Adamovich et al., 2009) 26
  • 27.  Time-variant increase in activation in the left insular cortex during observation of avatar hand  Imitation of avatar showed activation in angular gyrus and extrastriate body area  Virtual hand avatar serves as disembodied training tools in observation condition and as embodied “extensions” of subject’s own body in the imitation condition 27FPP Hand Movement in VEs (Adamovich et al., 2009)
  • 29. “Think about it: there is no experience you have had that you are not the absolute center of. The world as you experience it is there in front of YOU or behind YOU, to the left or right of YOU, on YOUR TV or YOUR monitor. And so on. Other people’s thoughts and feelings have to be communicated to you somehow, but your own are so immediate, urgent, real.” - David Foster Wallace, “This is Water” (2005 Kenyon Commencement Speech) 29
  • 30. Machine to Be Another: Live Stream Perspective Swapping 30
  • 31. The Machine to Be Another (MIT Media Lab) 31
  • 32. THE MACHINE TO BE ANOTHER: An Empathy Machine? 32 “Empathy is created the moment we try to put ourselves in another person’s shoes.” – Aspen Baker, TED Radio Hour “The machine to be another is designed to stimulate empathy through embodied interaction between individuals.” (Bertrand et al., 2014) To what extent can we experience and understand what it is like to be someone else?
  • 33. Simo Ekholm: Meeting Myself from Another Person’s Perspective 33
  • 34. Makropol: “Art House” VR using POV storytelling 34
  • 35. Skammakrogen: How it Was Made 35
  • 36. How to Combine These Experiences?  Be Another Labs use live stream into the DK2 Benefit: Real-Time Interaction Con: Low visual resolution + not stereo  Original plan: Live Stream in Stereo – Low visual resolution + Delay  Used Stereo and Pre-Recorded Footage with Binaural audio 36
  • 37. Painter Project: Stereo Footage with Binaural Audio 37
  • 38. Ex Nihilo: Exploring the Stimulation of Creativity and Empathy through Embodied Experiences in Virtual Reality 38
  • 39. Gallagher et al. (2015) Neurophenomenology of Awe and Wonder 39
  • 42. 42
  • 43. 43
  • 44. 44
  • 45. 45
  • 46. Introducing Ex Nihilo In The Republic, Plato asks, "Will we say, of a painter, that he makes something?" and answers, "Certainly not, he merely imitates." 46
  • 48. Subject Quote  “It almost feels like collectively discovering something that was in her head all along. The experience allowed this completely different way of connecting to someone that doesn’t rely on facial expressions or anything.” 48
  • 50. Measuring Social Interaction in VR  How do you measure two people’s ability to communicate effectively?  What does communicating “effectively” mean?  Suzanne Dikker – “shared semantic understanding” and neural synchrony 50
  • 51. Perceptual Crossing (Auvary et al., 2009) 51
  • 52. Perceptual Crossing (Auvary et al.,2009)  Task: Participants recognize one another while avoiding shadow and static objects  Mutual tactile interaction (trackball mouse and haptic feedback)  Static object = too stable and predictable to be human  Shadow = too unstable since it moves but does not respond  Other subject’s avatar can react with communicative intent 52
  • 53. Froese and Di Paolo (2011)  Hypothesized that the lack of personal recognition of the other in the perceptual crossing paradigm was due to lack of a genuinely social experimental task  The mark of the social is the co-regulation of mutual interaction 53
  • 54. Primary Intersubjectivity in Infants  2-month old infants get distressed when shown a pre-recorded video of an interaction with their mother, as opposed to a live streamed video.  Simple recognition of a pattern of movements is not sufficient, and instead social action perception requires an understanding of how other's movements are related to our own.  Infants display movement synchrony with adult speech (Condon & Sander, 1974)  Still face studies (Toda & Fogel. 1993; Tronick, Als, Adamson., Wise. & Brazelton, 1979) 54