Presented at Prototype Camp September 2014 in Chicago, IL.

1. Prototype Testing
Working Smarter, Not Harder
Nicole Maynard | 9.13.14

2. Nicole Maynard
@punkynixter
#ProtoTest
Nicole Maynard | 9.13.14

3. Who?

4. The skinny on quick and smart testing
THE STORY BEGINS

5. 1 : 10 : 100 rule
$100
Design
$1,000
Development
$10,000
After Launch
It is 100xs cheaper to fix a design flaw at the early
design phase than fixing the flaw after the launch.
Nicole Maynard | 9.13.14

6. “
..making sure that something works well:
that a person of average (or even below
average) ability and experience can use
the thing --- for it’s intended purpose
without getting hopelessly frustrated.
-Steve Krug
”
Source: Don't Make Me Think, 2000, p. 5 Nicole Maynard | 9.13.14

7. Traditional Usability Testing
Varies
Weeks – months
$10,000 – $25,000
Source: www.mediabarnresearch.com/usability-testing Nicole Maynard | 9.13.14

8. Traditional Usability Testing
Image source: smist08.files.wordpress.com Nicole Maynard | 9.13.14

9. Traditional Usability Testing
Create test plan
Testing location
Recruit, pick & schedule
Prepare for test
Conduct test
Debrief participants & observers
Analyze data & observations
Report findings & recommendations
The Handbook of Usability Testing by Jeff Rubin and Dana Chisnell
Great Resource
Nicole Maynard | 9.13.14

10. PROJECT: Hotel Havoc

11. Project Timeline
Nicole Maynard | 9.13.14

12. Image source: news.tacticalgear.com/

13. “Oh $h*t”
Nicole Maynard | 9.13.14

14. Traditional Usability Testing
Condensed
Create test plan
Testing location
Day 1
Recruit, pick & schedule
Prepare for test
Day 2
Conduct test
Debrief participants & observers
Analyze data & observations
Report findings & recommendations
Day 3
Day 4
Nicole Maynard | 9.13.14

15. Day 1 Plan & Schedule
Test Plan
» Goals, task list
» Method
» Data, report contents
Schedule Sessions
» Stakeholder sent invites
Nicole Maynard | 9.13.14

16. Day 2 Prepare
Write tasks
Write script
Prepare prototype
Print and cut out screens
Test equipment
Dry runs
Nicole Maynard | 9.13.14

17. Day 3 Test
9:00 - 9:45 Session 1
10:00 - 10:45 Session 2
11:00 - 11:45 Session 3
12:00 - 12:45 Session 4+
12:45 - 1:15 Lunch
1:15 - 2:00 Session 5
2:15 – 3:00 Session 6
3:15 - 4:00 Session 7
4:00 - 4:30 Wrap Up
Nicole Maynard | 9.13.14

18. Day 3 Analyze
Nicole
Maynard
|
9.13.14

19. Day 4 Report
Nicole Maynard | 9.13.14

20. Day 4 Report
“
Let’s do this again next week.
We need to test for the next arm
of the application before we build…
-­‐
Key
Project
Owner
”
Nicole Maynard | 9.13.14

22. Good Things
Opened eyes
Prototype
Participants
Recordings
Information
Nicole Maynard | 9.13.14

23. Not So Good Things
Time
» Getting to yes
» Plan, prepare
» Tasks vs. session time
» Analyze & report
One person show
Flexibility
Nicole Maynard | 9.13.14

24. After iterations and adjustments
FAST FORWARD TO TODAY

25. Traditional Usability Testing
Create test plan
Testing location
Recruit, pick & schedule
Prepare for test
Conduct test
Debrief participants & observers
Analyze data & observations
Report findings & recommendations
Handbook of Usability Testing By Jeff Rubin and Dana Chisnell
Nicole Maynard | 9.13.14

26. Traditional Usability Testing
Condensed
Create test plan
Testing location
Recruit, pick & schedule
Prepare for test
Conduct test
Debrief participants & observers
Analyze data & observations
Report findings & recommendations
Nicole Maynard | 9.13.14

27. Traditional Smart
Prototype Testing
Create test plan
Find participants & formally schedule
Prepare for test
Conduct test
Debrief with observers
Analyze data & observations
Report findings & recommendations
Nicole Maynard | 9.13.14

28. Test Plan: Methodology
Image source: Vimrod Nicole Maynard | 9.13.14

29. Test Plan: Dashboard
Nicole Maynard | 9.13.14

30. Test Plan: Focus
Nicole Maynard | 9.13.14

31. Test Plan: Location
IN PERSON
Nicole Maynard | 9.13.14

32. Participants
10-­7-­ 5
FREE Hugs
Nicole Maynard | 9.13.14

33. Schedule
Adjust test if necessary
Debrief with observers
Compile notes
Iterate the prototype
Nicole Maynard | 9.13.14

34. Prepare
Script Report
Nicole Maynard | 9.13.14

35. Nicole Maynard | 9.13.14

36. Conduct Test
Open minds,Not our product
eyes ears
Project Developer Stakeholder Moderator
Manager
Designer
Nicole Maynard | 9.13.14

37. Debrief
Task 3 had
challenges
I noted that too
Nicole Maynard | 9.13.14

38. Analyze Report
Image source: www.iacquire.com
Report
Affinity Mapping
Nicole Maynard | 9.13.14

39. Proving more every test
ON THE RIGHT TRACK

40. Quotes From The Field
“
I was worried when I saw the
the schedule you were proposing.
I can’t believe we pulled that off!
- UX Researcher
”
Nicole Maynard | 9.13.14

41. Quotes From The Field
“
We can’t change the navigation.
It went over really well with the users.
- Project Owner
”

42. Quotes From The Field
“
It’s a big change to the design
pattern. Can we test it to make sure...
- Program Manager
”
Nicole Maynard | 9.13.14

43. Quickest Test To Date
90 min
Create test plan
Find participants
Conduct test
Debrief with observers
Nicole Maynard | 9.13.14

44. Remember
Team involvement
Flexible process
Trim extras
Nicole Maynard | 9.13.14

45. Remember
Even a small amount
of imperfect testing
is better than
no testing at all.
Nicole Maynard | 9.13.14

46. Thank You
@punkynixter
#ProtoTest

47. Resources
If you have a question or a challenging situation and want to think through it,
tweet or msg me @punkynixter
Books
Handbook of Usability Testing
Don’t Make Me Think
Articles
http://blog.skillpages.com/7-essential-steps-for-in-person-usability-testing/
Guerilla , Quick Dirty, etc.
http://www.uxbooth.com/articles/the-art-of-guerilla-usability-testing/
http://www.currybet.net/cbet_blog/2010/06/10-tips-for-ambush-guerilla-us.php
http://www.digital-loom.com/articles/usability-testing-case-study
Nicole Maynard | 9.13.14