Keynote for World IA Day, answering the question "When, Where and How does Understanding occur?" Specifically, this talk discussed (1) interactions (and embodiement) (2) how new technology is changing the "information environments" we design for, and (3) a bit about perceptions and cognition.
6. What is the purpose of a map?
Navigation
Orientation
Discovery
Definition
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
-paths and core
-iPhone navigation example
8. …or this map?
By studying the similarities and differences between human genes and those of other
organisms, researchers can discover the functions of particular genes and identify
which genes are critical for life.
11. What is the purpose of a map?
Navigation
Orientation
Discovery
Definition
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
-paths and core
-iPhone navigation example
12. What is the purpose of a map?
Navigation
Orientation
Discovery
Definition
Understanding
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
What patterns do I
see? How do things
relate? What can I
infer from this?
-paths and core
-iPhone navigation example
13. DESIGN FOR
UNDERSTANDING
Navigation
Orientation
Discovery
Definition
Understanding
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
What patterns do I
see? How do things
relate? What can I
infer from this?
-paths and core
-iPhone navigation example
Learning through playful,
visual interactions.
22. “The approach to teaching without
words that I’m proposing makes heavy
use of interactivity and instant
informative feedback.”
STMath
http://www.creativitypost.com/education/teaching_without_words
25. from “Toward a Deeper Understanding of the Role of Interaction in Information Visualization”
26. Name
User Intent
Select
mark something as interesting
Explore
show me something else
Reconfigure
show me a different arrangement
Encode
show me a different
representation
Abstract/Elaborate
show me more or less detail
Filter
show me something
conditionally
Connect
show me related items
from “Toward a Deeper Understanding of the Role of Interaction in Information Visualization”
28. 3 Basic Interactions:
Conversing
conveying intended actions to a VR through language
(i.e., the mouth and talking).
Manipulating
touching, grasping, or handling visually perceptible
aspectsofaVR(i.e.,thehandsandhandling)
Navigating
moving from one location or piece of information in a
VR to another (i.e., the feet and walking).
from “Interaction and the epistemic potential of digital libraries”
29. 3 Basic Interactions:
Conversing
conveying intended actions to a VR through language
(i.e., the mouth and talking).
Manipulating
touching, grasping, or handling visually perceptible
13 Task-Based Interactions:
aspectsofaVR(i.e.,thehandsandhandling)
Navigating
Animating
Composing
moving from one initiatingor piece of information in a creating a new VR by putting
location and, optionally,
VR to another (i.e., the feet and walking).
controlling motion in a VR.
together independent visual
elements.
Annotating
placing informative marks, or
Cutting
meta-information, on or around a
removing extraneous elements
VR.
from a VR.
Chunking
grouping independent, but related,
visual elements into a unified
visual structure.
Cloning
creating an identical copy of a VR,
in whole or in part.
Filtering
exposing, concealing, or
transforming elements of a VR
that possess certain characteristics
or match certain criteria.
Fragmenting
dismantling aVR into its
component parts.
Collecting
gathering visual elements for
future use.
from “Interaction and the epistemic potential of digital libraries”
Probing
acquiring more detailed
information from a VR.
Rearranging
altering the spatial position and/or
the orientation of a VR, or the
components within it.
Repicturing
displaying a VR in a new or
different way
Searching
looking for, or ascertaining the
position of, specific features,
elements or structures in a VR.
30. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Interactions
31. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Embodied Interactions
41. PRAGMATIC
(Actions performed to bring one physically closer to a goal)
VS
EPISTEMIC ACTIONS
(Actions that use the world to improve cognition)
Thinking, then doing.
Thinking through doing.
from “Interaction and the epistemic potential of digital libraries”
42. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Embodied Interactions
43. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Information Environments
that help reveal patterns
57. “The “polar bear book” as it came to be known helped a
generation of information architects and user experience
designers make sense of the Web through structure,
organization, navigation, and search. Today, much of what
we wrote remains relevant, and yet new questions arise as
the world and the Web intertwingle…
How do we rise to the new challenges of creating paths and
places that bridge physical, digital, and cognitive spaces?”
TOOLS / OBJECTS
–P E T E R M O RV I L L E
!
OTHER
PEOPLE
PHYSICAL
ENVIRONMENTS
(from the foreward to Pervasive Information Architecture)
“the structural design of information environments”
60. Line between Digital and Physical is blurring
The world is becoming our information environment
61. Line between Digital and Physical is blurring
The world is becoming our information environment
Interactions will be much richer (and complex)
62. Line between Digital and Physical is blurring
The world is becoming our information environment
Interactions will be much richer (and complex)
#EXCITING!!
66. 10 distinct sensory modalities:
1. Visual (seeing)
2. Auditory (hearing)
3. Olfactory (smelling)
4. Gustatory (tasting)
5. Vestibular (sense of balance and body movement)
Everything your brain knows, it knows
because of your body (your senses)
6. Tactile (touching)
7. Thermoreceptive (feeling temperature)
8. Proprioceptive (positioning and movement of the extremities)
9. Introceptive (body condition and organ activity)
10. Nocioceptive (feeling pain)
(from Michael Haverkamp)
76. Dan Rubin
@Dan_Rubin_NY
Enchanted objects are incredibly purpose built - and you won't
need nav or a ui #enchantobj #SXSW
“From Human-Computer Interaction
to Human-Information Interaction”
78. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Information Environments
that help reveal patterns
79. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
81. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
82. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
Internal Representations
86. HEARING
TASTE
SMELL
TOUCH
VISION
(THE WORLD OUT THERE)
STIMULUS
(THE WORLD YOU PERCEIVE)
SENSORY ORGANS
PERCEPTUAL ORGAN
ICONIC
MEMORY
SHORT-TERM
MEMORY
BALANCE
Reality
PAIN
TIME
TEMPERATURE
AND
MORE!
Simulation
LONG-TERM
MEMORY
87. (THE WORLD YOU PERCEIVE)
(THE WORLD OUT THERE)
Reality
Simulation
101. Your brain constructs (an experience) of reality.
Perception is not a process of active
absorption but of active construction based
on prior experiences and memories.
102. Why do we know these are all the letter A?
A A A
A
A A A A
A AA A
111. “Message of Love from the Dolpins”
(Message d’Amour des Dauphins)
If you look at the vase you’ll probably agree
that it depicts a man holding and kissing a
woman from behind. What if I told you that
the image in fact depicts a number of
dolphins?
In fact it depicts both - it’s all a matter of how
your brain interprets it. Kids, who are
“inexperienced” tend to see the dolphins.
Grownups tend to see the loving couple, Some
grownups can’t even see the dolphins if they
try really hard.
It’s all about what the brain expects and
knows. If you know how to see a certain
pattern, you’re more likely to see that pattern.
112. “Message of Love from the Dolpins”
(Message d’Amour des Dauphins)
If you look at the vase you’ll probably agree
that it depicts a man holding and kissing a
woman from behind. What if I told you that
the image in fact depicts a number of
dolphins?
In fact it depicts both - it’s all a matter of how
your brain interprets it. Kids, who are
“inexperienced” tend to see the dolphins.
Grownups tend to see the loving couple, Some
grownups can’t even see the dolphins if they
try really hard.
It’s all about what the brain expects and
knows. If you know how to see a certain
pattern, you’re more likely to see that pattern.
113. Changing the label on wine
bottles changes the taste
http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price
114. brain scans confirmed that
people don't just think the
more expensive (but identical)
wine tasted better—it actually
really did taste better…
Changing the label on wine
bottles changes the taste
http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price
115.
116. “How fast was the car going when
it hit the other car?”
“How fast was the car going when
it smashed into the other car?”
117. “How fast was the car going when
it hit the other car?”
“How fast was the car going when
it smashed into the other car?”
118. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
Internal Representations
122. MACHINES TALKING TO MACHINES
INFORMATION ENVIRONMENTS
…and that whole
“pervasive IA” thing
Wearables
Digital
Things
Digital
Environments
PEOPLE
TOOLS / OBJECTS
Connected Media /
Devices
The World “Outside”
INTERACTIONS
The World “Inside”
REPRESENTATIONS
Perception & Cognition
PHYSICAL
ENVIRONMENTS
124. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
125. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
Maps that celebrate and amplify
human ingenuity.
126. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
Maps that celebrate and amplify
human ingenuity.
Maps that help us to understand
what is unknown.