Updated version of a talk first given at the e-Metrics Marketing and Optimization Summit, Washington, D.C., October 5, 2010. This version is for the J. Boye conference, Philadelphia, PA, 5-4-2011.
The talk spells out the lofty goals of the Smithsonian Institution and the Smithsonian Commons project, and then describes some of the unconventional measurement methodologies we're using to figure out what to do and how to do it.
J. Boye Conference page: http://jboye.com/conferences/philadelphia11/program/speakers/michael-edson/#presentation
Eluru Call Girls Service ☎ ️93326-06886 ❤️🔥 Enjoy 24/7 Escort Service
Michael Edson @ J. Boye 2011: Jedi Mind Tricks for Measuring and Optimizing Lofty Goals (updated from e-Metrics Summit)
1. Michael Edson
Director, Web and New Media Strategy
Smithsonian Institution, Office of the CIO
edsonm@si.edu | @mpedson
Jedi Mind Tricks for
Optimizing
Lofty Goals
andMeasuring
3. Preamble
Michael Edson
Director, Web and New Media Strategy
Smithsonian Institution, Office of the CIO
edsonm@si.edu | @mpedson
@mpedson
slideshare.net/edsonm
smithsonian-webstrategy.wikispaces.com
4. Preamble
Michael Edson
Director, Web and New Media Strategy
Smithsonian Institution, Office of the CIO
edsonm@si.edu | @mpedson
@mpedson
slideshare.net/edsonm
smithsonian-webstrategy.wikispaces.com
Get the full story here
5. Preamble
Michael Edson
Director, Web and New Media Strategy
Smithsonian Institution, Office of the CIO
edsonm@si.edu | @mpedson
@mpedson
slideshare.net/edsonm
smithsonian-webstrategy.wikispaces.com
…and here
6. Preamble
Michael Edson
Director, Web and New Media Strategy
Smithsonian Institution, Office of the CIO
edsonm@si.edu | @mpedson
The Smithsonian Commons
www.si.edu/commons
7. Preamble
Michael Edson
Director, Web and New Media Strategy
Smithsonian Institution, Office of the CIO
edsonm@si.edu | @mpedson
He’s not a
spokesman!
10. Smithsonian Strategic Plan
1. Unlocking the Mysteries of
the Universe
2. Understanding and
Sustaining a Biodiverse
Planet
3. Valuing World Cultures
4. Understanding the
American Experience
Four Grand Challenges
http://www.si.edu/about/
11. Smithsonian Strategic Plan
1. Unlocking the Mysteries of
the Universe
2. Understanding and
Sustaining a Biodiverse
Planet
3. Valuing World Cultures
4. Understanding the
American Experience
Four Grand Challenges
http://www.si.edu/about/
12. Smithsonian Strategic Plan
1. Unlocking the Mysteries of
the Universe
2. Understanding and
Sustaining a Biodiverse
Planet
3. Valuing World Cultures
4. Understanding the
American Experience
Four Grand Challenges
http://www.si.edu/about/
13. Smithsonian Strategic Plan
1. Unlocking the Mysteries of
the Universe
2. Understanding and
Sustaining a Biodiverse
Planet
3. Valuing World Cultures
4. Understanding the
American Experience
Four Grand Challenges
http://www.si.edu/about/
14. Smithsonian Strategic Plan
1. Unlocking the Mysteries of
the Universe
2. Understanding and
Sustaining a Biodiverse
Planet
3. Valuing World Cultures
4. Understanding the
American Experience
Four Grand Challenges
Strategy
Schmatergy! We’ve
seen strategy
before!
15. Smithsonian Strategic Plan
1. Unlocking the Mysteries of
the Universe
2. Understanding and
Sustaining a Biodiverse
Planet
3. Valuing World Cultures
4. Understanding the
American Experience
Four Grand Challenges
No! This is about
solving big hairy
problems— “work
that matters”
(via @timoreilly)
http://radar.oreilly.com/2009/01/work-on-stuff-that-
matters-fir.html
19. First order questions
• Where is this work going to take place?
• What kind of organization, infrastructure,
platforms will be needed to support it?
• What is the organizational change model?
How will change happen?
• Who will be the innovators? The connectors?
The drivers of change?
• …and how do you measure it?
21. Web and
New Media
Strategy
http://smithsonian-
webstrategy.wikispaces.com
More in Fast, Open, and Transparent: developing
the Smithsonian’s Web and New Media Strategy
http://www.slideshare.net/edsonm/michael-edson-the-smithsonian-
web-and-new-media-strategy-what-it-is-how-we-made-it-and-why-it-
makes-a-difference-3656578
And http://www.archimuse.com/mw2010/papers/edson/edson.html
23. http://smithsonian-webstrategy.wikispaces.com/
The strategy talks about an updated digital
experience, a new learning model that helps
people with their "lifelong learning journeys,"
and the creation of a Smithsonian Commons—
a new part of our digital presence dedicated to
stimulating learning, creation, and innovation
through open access to Smithsonian research,
collections and communities.
24. http://smithsonian-webstrategy.wikispaces.com/
The strategy talks about an updated digital
experience, a new learning model that helps
people with their "lifelong learning journeys,"
and the creation of a Smithsonian Commons—
a new part of our digital presence dedicated to
stimulating learning, creation, and innovation
through open access to Smithsonian research,
collections and communities.
25. http://smithsonian-webstrategy.wikispaces.com/
The strategy talks about an updated digital
experience, a new learning model that helps
people with their "lifelong learning journeys,"
and the creation of a Smithsonian Commons—
a new part of our digital presence dedicated to
stimulating learning, creation, and innovation
through open access to Smithsonian research,
collections and communities.
26. http://smithsonian-webstrategy.wikispaces.com/
The strategy talks about an updated digital
experience, a new learning model that helps
people with their "lifelong learning journeys,"
and the creation of a Smithsonian Commons—
a new part of our digital presence dedicated to
stimulating learning, creation, and innovation
through open access to Smithsonian research,
collections and communities.
Old Learning Model
New Learning Model
28. http://smithsonian-webstrategy.wikispaces.com/
Balancing autonomy and control within the
Smithsonian.rt of our digital presence
dedicated to stimulating learning, creation,
and innovation through open access to
Smithsonian research, collections and
communities.
Innovation at the Edges
---
A commons in the middle
29. http://smithsonian-webstrategy.wikispaces.com/
…and the creation of a Smithsonian
Commons—a new part of our digital presence
dedicated to stimulating learning, creation,
and innovation through open access to
Smithsonian research, collections and
communities.
30. http://smithsonian-webstrategy.wikispaces.com/
…and the creation of a Smithsonian
Commons—a new part of our digital presence
dedicated to stimulating learning, creation,
and innovation through open access to
Smithsonian research, collections and
communities.
35. What is a Commons?
An organized workshop where raw materials can be
found and assembled into new things.
36. What is a Commons?
Imagining a Smithsonian Commons
• http://www.slideshare.net/edsonm/cil-2009-michael-edson-text-version
Museum Commons: A professional interaction
http://www.slideshare.net/edsonm/museum-commons-a-professional-
interaction-museums-and-the-web-2010-michael-edson-and-rich-cherry
What is a Commons?
37. What is a Commons?
Imagining a Smithsonian Commons
• http://www.slideshare.net/edsonm/cil-2009-michael-edson-text-version
Museum Commons: A professional interaction
http://www.slideshare.net/edsonm/museum-commons-a-professional-
interaction-museums-and-the-web-2010-michael-edson-and-rich-cherry
What is a Commons?
Also…
A 15-minute talk at the Walker Art Center
Text/footnotes: http://www.slideshare.net/edsonm/m-4402558
Video (starts at minute 12):
http://channel.walkerart.org/play/opening-the-field/
Updated 6/21/2010
38. So now we’re at a moment…
The Grand Challenges
The Smithsonian Commons
How do you talk about
these things in
measurable business
terms?
39. So now we’re at a moment…
The Grand Challenges
The Smithsonian Commons
How do you use
“information” to
persuade, guide,
inform?
40. So now we’re at a moment…
The Grand Challenges
The Smithsonian Commons
How do you measure
things that are… difficult
to measure?
45. Relevance
Unexpected Rivals in Google Search
Google Images
Wikipedia
Ocean.com
Discoveryeducation.com
NASA
Enchantedlearning.com
46. Relevance
Unexpected Rivals in Reach
Enchantedlearning.com
si.edu
discoveryeducation.com
ocean.com
Google Images
Wikipedia
Ocean.com
…so much more reach than SI
that we don’t even show up on the graph…
48. Relevance
Unexpected Rivals in Reach (July – Sept, 2009)
Enchantedlearning.com
si.edu
discoveryeducation.com
ocean.com
Enchantedlearning.com
is a two person team,
with more online reach
than the world’s largest
museum and research
complex!
58. Relevance
The Demographic Tsunami
“Everything we hear from people we interview is
that today’s consumers draw no distinctions
between an organization’s Web site and their
traditional bricks-and-mortar presence: both
must be excellent for either to be excellent.”
Lee Rainie
Pew Internet and American Life Project
75. Jedi Mind Trick #9
Bake measurement into the
platform from the start
76. Jedi Mind Trick #9
Bake measurement into the
platform from the start
Smithsonian Office of the CIO
is starting to study the
as-is measurement/analysis
program
77. YES
NO
17%
83%
77
Survey Highlights
Which web analytics tools are you using?
What are the some
of the most
valuable behaviors
a user can perform
on your site?
10%
29%
61%
Are there web-user activities NOT being measured
that you WANT to measure?
83. Project Charter (draft)
3. Measurable Project Goals
The goal of the Smithsonian Commons project is
to stimulate learning, creation, and innovation
through open access to Smithsonian research,
collections and communities.
84. Project Charter (draft)
3. Measurable Project Goals
Precise, measurable goals are a hallmark of
successful project governance, but these kinds
of outcomes are notoriously hard to define and
measure in practice: seeking to define them too
precisely or in too nuanced a way early in the
project can be as counterproductive as not
measuring them at all.
85. Project Charter (draft)
3. Measurable Project Goals
Precise, measurable goals are a hallmark of
successful project governance, but these kinds
of outcomes are notoriously hard to define and
measure in practice: seeking to define them too
precisely or in too nuanced a way early in the
project can be as counterproductive as not
measuring them at all.
86. Project Charter (draft)
3. Measurable Project Goals
Therefore, the project will initially focus on
three measurements: the amount of
information in the Smithsonian Commons, the
amount of activity on the Smithsonian
Commons, and the satisfaction of people who
use the Smithsonian Commons.
87. Project Charter (draft)
3. Measurable Project Goals
Therefore, the project will initially focus on
three measurements: the amount of
information in the Smithsonian Commons, the
amount of activity on the Smithsonian
Commons, and the satisfaction of people who
use the Smithsonian Commons.
88. Project Charter (draft)
3. Measurable Project Goals
Therefore, the project will initially focus on
three measurements: the amount of
information in the Smithsonian Commons, the
amount of activity on the Smithsonian
Commons, and the satisfaction of people who
use the Smithsonian Commons.
89. Project Charter (draft)
3. Measurable Project Goals
Therefore, the project will initially focus on
three measurements: the amount of
information in the Smithsonian Commons, the
amount of activity on the Smithsonian
Commons, and the satisfaction of people who
use the Smithsonian Commons.
91. Project Charter (draft)
The specific, measurable 5-year goals
1) 100 million items in the commons…
2) 100 million transactions a year…
92. Project Charter (draft)
The specific, measurable 5-year goals
1) 100 million items in the commons…
2) 100 million transactions a year…
3) High end-user satisfaction, both internally
and internally, as measured through the Foresee
Results measurement tool or equivalent
93. Project Charter (draft)
The specific, measurable 5-year goals
1) 100 million items in the commons…
2) 100 million transactions a year…
3) High end-user satisfaction, both internally
and internally, as measured through the Foresee
Results measurement tool or equivalent
“Bits in: bits out”
(via Brewster Kahle)
94. Project Charter (draft)
Five additional measurable goals guide the
project. The Smithsonian Commons will,
4) Increase reuse of Smithsonian resources
5) Be family-safe and school-safe
6) Demonstrate new revenue models
7) Drive traffic to unit websites
8) Help eliminate cost and work at the unit level
95. Jedi Mind Trick #10
Measurement is only one piece of
the equation
96. Jedi Mind Trick #10
Measurement is only one piece of
the equation
It’s about
understanding and
improving user
experience
97. Jedi Mind Trick #10
Measurement is only one piece of
the equation
You need a team