Remote Testing
Adam Fendrych

snímek |
datum |
dokument | 2
Communication

snímek |
datum |
dokument |
Your visitors
3

snímek |
datum |
dokument |
Testing with Users
4

snímek |
datum |
dokument |
Why not?
5

snímek |
datum |
dokument |
Obstacles
• No need
• No time
• No money
• No know-how
6

snímek |
datum |
dokument |
No Need?
• User behavior assumptions
are 75% wrong
7

snímek |
datum |
dokument |
There Is No Such Thing as
Universal Design
8

snímek |
datum |
dokument | 9
9

snímek |
datum |
dokument |
No Need?
• Test early, fail early!
• Designing without testing is like driving
blindfolded
• If you say your design is perfect you are
not a good designer
10

snímek |
datum |
dokument |
No Time?
• Website analysis: 8 hours
• Recruiting 10 users: 8 hours
• Test scenarios: 6 hours
• Sessions: 20 hours
• Analysis: 16 hours
• Presentation: 4 hours
• Total: 62 hours
11

snímek |
datum |
dokument |
No Time?
• Grab 3 users: 1 hours
• Think of basic tasks: 1 hour
• 1/2hour sessions: 1,5 hours
• Analysis: 1,5 hours
• Total: 5 hours
12

snímek |
datum |
dokument |
No Money?
13
• Lab
• Eye Tracker
• Recruitment

snímek |
datum |
dokument |
No Money?
• 5 hours of your time
• Incentives: 240 zloty
14

snímek |
datum |
dokument |
And How About
• Recruit online
• Test anytime
• Test anywhere
• And even for free!
15
This is remote testing

snímek |
datum |
dokument |
And Where Is the Know-How?
16

snímek |
datum |
dokument |
The Basics
1. Have something to test
2. Get a few users
3. Watch them perform tasks
4. Analyze
5. Fix the most serious problems
6. Test again
17

snímek |
datum |
dokument |
Remote testing
• Moderated
• Unmoderated
18

snímek |
datum |
dokument |
Moderated
• Communicate with users in real time
• Qualitative data
• Ask questions
19

snímek |
datum |
dokument |
Moderated
20
• No eye contact
• Technical limitations
• No statistics

snímek |
datum |
dokument |
Technical Stuff
• Use conferencing software
» WebEx, Gotomeeting
• Tranfer voice and screen
» Skype, Mikogo
21

snímek |
datum |
dokument | 22

snímek |
datum |
dokument | 23

snímek |
datum |
dokument |
Some Tips
• Skype is fat
• Connection can be slow
• Record on your computer
» Morae, HypeCam
24

snímek |
datum |
dokument |
Unmoderated
25

snímek |
datum |
dokument |
How Does It Work
• Test a website or mockups
• Users provided, or get your own users
• Pay a monthly fee, or per user
• You get videos, or stats
• Plus some feedback
26

snímek |
datum |
dokument |
Usertesting.com
• You submit the website and your questions
• They provide users
• You get videos
27

snímek |
datum |
dokument |
OpenHallway.com
• Create the test
• Get the link to users – e-mail, Ethnio
• You get videos and feedback
28

snímek |
datum |
dokument |
Loop11.com
• Submit your website or mockups
• Create the test
• You get stats – success rates, navigation
path, click spots
• Speaks international
29

snímek |
datum |
dokument |
Navflow.com
• Test images only
• Free responses from community or link for
your users
• You see where they click
30

snímek |
datum |
dokument | 31

snímek |
datum |
dokument |
Remote testing
• Quick
• Less results
• Perfect for solving specific problems
• Lots of tools – why not build your own?
32

snímek |
datum |
dokument |
Questions?
adam.fendrych@dobryweb.cz
@adlo @fendrych
www.dobryweb.cz
33