1. DESIGN
RESEARCH
Tuesday, November 15, 2011

2. Something not on the site
Tuesday, November 15, 2011

3. Hi, I’m Nate Bolt
Author, Remote Research
President, Bolt | Peters
Time lapse addict
Tuesday, November 15, 2011

4. Tuesday, November 15, 2011

5. SF TO PARIS IN TWO MINUTES
Tuesday, November 15, 2011

6. Tuesday, November 15, 2011

7. Tuesday, November 15, 2011

8. Morgan Holtzer
Project Manager,
Web Group, Digital Media
The Metropolitan Museum of Art
Tuesday, November 15, 2011

9. What are ways
companies conduct
research?
Tuesday, November 15, 2011

10. oh 60 years ago
ai ,
f ay
e
Tuesday, November 15, 2011

11. 20 years ago
us e r
re s e
a rcb
tool
s
Tuesday, November 15, 2011

12. 1995
Tuesday, November 15, 2011

13. Decision Theory & Adaptive
Systems Group
Tuesday, November 15, 2011

14. Tuesday, November 15, 2011

15. “Misunderstood animated
pedagogical agent or spawn of
Satan?”
Tuesday, November 15, 2011

16. Bad Research
Tuesday, November 15, 2011

17. 1)Hypothetical Questions
2)A False Premise
3)Opinions are worthless
Tuesday, November 15, 2011

18. Never Ask People
“Would you use this?”
Tuesday, November 15, 2011

19. Tuesday, November 15, 2011

20. Tuesday, November 15, 2011

21. Tuesday, November 15, 2011

22. Good Research
Investigate current behavior
Tuesday, November 15, 2011

23. Tuesday, November 15, 2011

24. Dead Tomato Society
Tuesday, November 15, 2011

25. Plain, Spicy, Extra Chunky
Tuesday, November 15, 2011

26. "It used to be that the way to
find out what people wanted
to eat was to ask them."
Tuesday, November 15, 2011

27. Good Research
Tuesday, November 15, 2011

28. 1) Contextual
2) Time-aware
3) Behavioral
Tuesday, November 15, 2011

29. Screw Surveys
Tuesday, November 15, 2011

30. Sprint to a
functional prototype
Tuesday, November 15, 2011

31. A functional prototype
can be a static site, low
fidelity mock, paper
prototype, index cards,
…
Tuesday, November 15, 2011

32. …but use real data.
Tuesday, November 15, 2011

33. Iterate
Tuesday, November 15, 2011

34. Tuesday, November 15, 2011

35. Tuesday, November 15, 2011

36. Good Research
Tuesday, November 15, 2011

37. 1) Sprint to the testable.
2) Iterate.
Tuesday, November 15, 2011

38. People lie less
at home
Tuesday, November 15, 2011

39. Tuesday, November 15, 2011

40. Since 2007
Tuesday, November 15, 2011

41. Can tools make us better
researchers?
Tuesday, November 15, 2011

42. Tuesday, November 15, 2011

43. Tuesday, November 15, 2011

44. Tuesday, November 15, 2011

45. Tuesday, November 15, 2011

46. What we did for
Rdio
•GoToMeeting: 5 users (moderated)
•UserTesting.com: 10 users (self-
moderated)
•Usabilla: 50 users (automated)
•Ethnio: 468 recruits
Tuesday, November 15, 2011

47. Tuesday, November 15, 2011

48. What we did for
Volkswagen, Esurance,
and a Large Retailer
•$50 Webcam
•Free Ustream account
•Observed mobile users in-store and in a
lab
Tuesday, November 15, 2011

49. Good Research
Tuesday, November 15, 2011

50. 1) Mix online tools
2) Stream research live
Tuesday, November 15, 2011

51. For the rest of us,
we have to avoid
the big myth
Tuesday, November 15, 2011

52. The Myth:
Geniuses have genius ideas
that turn into genius
products.
Tuesday, November 15, 2011

53. The Truth:
Great Ideas come from
Other Great Ideas
Tuesday, November 15, 2011

54. More Truth:
Imaginative research
facilitates invention.
Tuesday, November 15, 2011

55. Research customers
the right way
•expand notion of what research is
•build
•behavior
•time-aware
Tuesday, November 15, 2011

56. tech!nol!o!guy
Tuesday, November 15, 2011

57. 1829
Tuesday, November 15, 2011

58. Tuesday, November 15, 2011

59. 1817
Tuesday, November 15, 2011

60. What Makes Beautiful Science?
Tuesday, November 15, 2011

61. The Process
Tuesday, November 15, 2011

62. Tuesday, November 15, 2011

63. What Makes Beautiful Art?
Tuesday, November 15, 2011

64. Authenticity
Tuesday, November 15, 2011

65. Tuesday, November 15, 2011

66. What Makes Beautiful Technology?
Tuesday, November 15, 2011

67. The Experience
Tuesday, November 15, 2011

68. Tuesday, November 15, 2011

69. What the Fuck is That?
Tuesday, November 15, 2011

70. Tuesday, November 15, 2011

71. EVERYONE WANTS TO
MAKE A DIFFERENCE
BUT RESEARCH DOESN’T GUARANTEE ANYTHING
Tuesday, November 15, 2011

72. “BUILD
STUFF
THAT’S
COOL”
Peter Merholz | Adaptive Path
Tuesday, November 15, 2011

73. “USABILITY
TESTING IS
A PATH TO
FAILURE”
Todd Wilkens | Adaptive Path
Tuesday, November 15, 2011

74. SO WHAT DO WE DO?
Tuesday, November 15, 2011

75. Tony Fadell
Tuesday, November 15, 2011

76. Tony Fadell
Tuesday, November 15, 2011

77. Tuesday, November 15, 2011

78. Tuesday, November 15, 2011

79. “ Every person on the team
should be treated like an artist. ”
- Tony Fadell
Tuesday, November 15, 2011

80. Edwin H. Land
Tuesday, November 15, 2011

81. Edwin H. Land
Tuesday, November 15, 2011

82. “ Market research is what you do
when your product isn’t any
good. ”
- Edwin H. Land
Tuesday, November 15, 2011

83. Tuesday, November 15, 2011

84. Tuesday, November 15, 2011

85. Tuesday, November 15, 2011

86. Tuesday, November 15, 2011

87. Some thoughts on analytics
What do helicopters do in action movies?
Explode
Tuesday, November 15, 2011

88. nate@boltpeters.com
@boltron
Tuesday, November 15, 2011