1. User Research and Usability Methods
workshop
Jon-Eric Steinbomer, Director of Research
Jessica Sears Steinbomer, Principal
!1

2. Our Agenda
!
9-10 Research Methods!
10-10:30 Recruiting Participants!
coffee <br>!
10:45-11:15 Study Plans & Moderator
Guides!
11:15-12:00 Moderate!!
12:00-1:00 Lunch & Presenting
Research
!2 | © 2013 Progress UX LLC

3. UX Research
!3 | © 2013 Progress UX LLC

4. !4 | © 2013 Progress UX LLC

5. UX Research
!
What people do!
!
How people use!
!
Small sample size - usually 8-12
people per study!
....but great depth
!5 | © 2013 Progress UX LLC

6. Key UX Research Principals
•
•
•
•
Test early - with prototypes whenever possible.!
•
Focus on behaviors
Evidence is more important than deliverables.!
Iterate on the design during the research phase.!
Collaboration with design & development.!
rather opinions.
“Individuals and interactions over
processes and tools” -Agile Manifesto
!6 | © 2013 Progress UX LLC

7. Methods
!7 | © 2013 Progress UX LLC

8. Structure Common! to All Methods
Study Planning!
Recruiting!
Study Sessions!
Analysis and Reporting!
!8 | © 2013 Progress UX LLC

9. Study Planning
•
•
•
•
•
!
What are the goals?!
What are the research questions?!
Who are the users?!
Which context is appropriate?!
Which research method is
appropriate?!
!9 | © 2013 Progress UX LLC

10. Study Plans Contain !
•
•
•
•
•
•
Research Goals!
Research Questions!
Participants!
Method!
Measures!
Specific Tasks and Questions!
!10 | © 2013 Progress UX LLC

11. Contexts
•
•
•
!
Usability Lab!
Remote !
On Location (ethnography)
!11 | © 2013 Progress UX LLC

12. Usability Lab
Behind the glass
Moderator communicates through microphone
“voice of God”
!12 | © 2013 Progress UX LLC

13. Usability Lab Software
Morae ($1,995)
Silverback ($69.95)
!13 | © 2013 Progress UX LLC

14. Lab Best Practices
•
•
•
•
!
Participant Comfort!
Limit Distraction!
Just you and the participant!
Chat with observers/note-takers
!14 | © 2013 Progress UX LLC

15. Remote Research
Participant
Participant
Participant
Observers
Participant
Participant
Participant
Participant
Observers
Participant
Researchers
!15 | © 2013 Progress UX LLC
Participant

16. Ethnographic “bonus”
Participants are more comfortable as they speak
to us using their own OS, browser, resolution, etc.
!16 | © 2013 Progress UX LLC

17. Tools
!17 | © 2013 Progress UX LLC

18. Remote Case Study
!18 | © 2013 Progress UX LLC

19. Sweepstakes entry form
•
Too many abandons
!19 | © 2013 Progress UX LLC
18

20. Live Intercept
!20 | © 2013 Progress UX LLC
18

21. Recommendations sample
• Top-down design
• Validation before
human verify
• Better error
feedback
!21 | © 2013 Progress UX LLC
18

22. Remote UX Research Best Practices
•
•
•
Mind the time zones.!
•
•
Have a backup plan for the screen-share. !
One moderator per session.!
If time allows, start broad, then narrow down to your
subject (website, prototype, product).!
Test the screen share before the session.
!22 | © 2013 Progress UX LLC
18

23. Ethnography - Best Practices
!
•
Limit the number of
interviewers - 2 people if
possible!
•
•
Be nimble!
•
Note the environmental
factors!
•
Take lots of pictures and
video
Mind the background
noise!
!23 | © 2013 Progress UX LLC
18

24. Mobile Research
!24 | © 2013 Progress UX LLC

25. Mobile app/Hardware Research
!25 | © 2013 Progress UX LLC
18

26. Prototypes
!26 | © 2013 Progress UX LLC

27. Low-Fidelity Paper-based prototype
Full-Fidelity “clickable” prototype
Gesture prototype testing (Kinect)
Mid-fidelity Balsamiq prototype
!27 | © 2013 Progress UX LLC

28. Prototype Testing Best Practices
•
•
•
•
Flexibility when moderating is key!
Prototype should be easily modified!
Comfort with things breaking !
Make participant aware it’s a
prototype!
!28 | © 2013 Progress UX LLC
18

29. Moderating
!29 | © 2013 Progress UX LLC

30. Best Practices
•
•
•
•
•
•
Participant comfort!
It’s not about you (empathy)!
Place your participant as the expert!
Use their words!
Emphasize there is no right or wrong!
Don’t assume - ask!
!30 | © 2013 Progress UX LLC
18

31. Best Practices, cont.
•
Avoid asking leading questions or
“questioning with the target”!
•
•
Resist rescuing !
•
Introduce the goals and structure of
the session up-front
Let the participant lead as much as
possible!
!31 | © 2013 Progress UX LLC
18

32. Moderation Issues
•
•
•
•
•
Taking notes while moderating - takes practice!
Time management!
Talkers - interrupting gracefully!
Non-Talkers!
“Bad” Participants!
!
!32 | © 2013 Progress UX LLC
18

33. Recruiting Participants
!33 | © 2013 Progress UX LLC

34. Identify who you want to speak with
•
•
•
•
Personas
Marketing data
Call center data
Sales staff
!34 | © 2013 Progress UX LLC

35. Cast the net
Social media
Forums
Ethnio - Live Intercept
!35 | © 2013 Progress UX LLC

36. Recruiting - Ethnio Live Intercept
!36 | © 2013 Progress UX LLC

37. Collect the data
• Screening Survey
!37 | © 2013 Progress UX LLC

38. Scheduling
• Organization Tips
!38 | © 2013 Progress UX LLC

39. Make the Call
• Initial Contact
• Scheduling specifics
• Confirm
• Double Check
!39 | © 2013 Progress UX LLC

40. Bloopers and Out-takes
• No-shows- Oh No!
•
Recruit reserve participants
•
Make time in the schedule for reserves
• Mr. Wrong
!40 | © 2013 Progress UX LLC

41. Study Plans and Moderator Guides
!41 | © 2013 Progress UX LLC

42. Your turn!
!42 | © 2013 Progress UX LLC