1. Usability testing
Analyzing and reporting data
Tuesday, April 12, 2011

2. Assuming 5 users & the following measures:
1. Demographics, background
2. Task completion
3. Time on task
4. Expected difficulty
5. Actual difficulty
6. Observations
7. Overall satisfaction
Tuesday, April 12, 2011

3. 1. Demographics, background
3
2.25
40% 1.5
60%
0.75
0
Male Female
Male
Female
Tuesday, April 12, 2011

4. Graduate
(G1)
M
30
Senior
Electrical
and
Computer
Engineering
Tuesday, April 12, 2011

5. Participants Info.
4 Grad students (male)
1 Faculty member (female)
Who
Mechanical Eng.
Material Eng.
Electrical & Computer Eng.
How often Once a week (average)
Age 27.2 years old (average)
Range: 20~40
Tuesday, April 12, 2011

6. Participants Info. (Cont’d)
Total length of usage Time spent per Log-in
4 5
4
3
2.5
Hour(s)
Year(s)
3
2
2
1.7
1
1
0 0
P1 P2 P3 P4 P5 AVE P1 P2 P3 P4 P5 AVE
Participant # Participant #
Tuesday, April 12, 2011

7. 1. Demographics, background
Which presentation mode
did you like best?
Tuesday, April 12, 2011

8. 1. Demographics, background
Which presentation mode
did you like best?
Because of small number of
users, present both
averages and individual
data.
Tuesday, April 12, 2011

9. 2. Task completion
5 users -- 5 tasks
• All 5 users completed tasks 1 and 2
• 3 users completed task 3; 1 partial
completion, 1 incomplete
• 3 users completed task 4; 2 partial
completions
• 2 users completed, 3 partial completions
Tuesday, April 12, 2011

10. Tuesday, April 12, 2011

11. 3. Time on task
5 users -- 5 tasks
T1 T2 T3 T4 T5
U1
U2
U3
U4
U5
Tuesday, April 12, 2011

12. 3. Time on task
5 users -- 5 tasks
T1 T2 T3 T4 T5
U1
U2
Average per user
U3 OR
Average per task?
U4
U5
Tuesday, April 12, 2011

13. Which task was more difficult to complete?
Mean Time-on-Task (95%CI)
270!
240!
210!
203!
180!
150!
Time(sec)
120!
90!
75!
66!
60!
49!
30! 25!
0!
Task#1! Task#2! Task#3! Task#4! Task#5!
Tuesday, April 12, 2011

14. Is this graph useful? Why?
Tuesday, April 12, 2011

15. 4. Expected difficulty and 5. Actual difficulty
• Per task?
• Average across tasks?
Tuesday, April 12, 2011

16. 4. Expected difficulty and 5. Actual difficulty
• Per task?
• Average across tasks?
Tuesday, April 12, 2011

17. 4. Expected difficulty and 5. Actual difficulty
Tuesday, April 12, 2011

18. 6. Observations
• What do you think would be important to
report?
• How?
Tuesday, April 12, 2011

19. 7. Overall satisfaction
Tuesday, April 12, 2011

20. Overall “barometer”
# of Participants
0 1 2 3 4 5
Search
1 1 3
Feature
Ease of
4 1
Navigation
Terminology
3 2
Clarity
Organization
3 2
Clarity
Satisfied Neutral Disatisfied
Tuesday, April 12, 2011

21. Meaningful, Easy to read & Understand
1. Demographics, background
2. Task completion
3. Time on task
4. Expected difficulty
5. Actual difficulty
6. Observations
7. Overall satisfaction
Tuesday, April 12, 2011