1. CHI: evaluatie
Leuven, 29 March 2011
Erik Duval
http://erikduval.wordpress.com
@ErikDuval
1

2. http://www.slideshare.net/erik.duval
2

3. Criteria for evaluation:
what do you think?
• ... • ...

4. criteria
• Usability
• Usefulness
• Meaning
• (aesthetic) Qualities
• Sociability

5. criteria
• Usability • Learnability
• Usefulness • Efficiency
• Meaning • Memorability
• (aesthetic) Qualities • Accuracy
• Sociability • Satisfaction

6. criteria
• Usability • Learnability
• Usefulness • Efficiency
• Meaning • Memorability
• (aesthetic) Qualities • Accuracy
• Sociability • Satisfaction
[Nielsen, 1993]

7. Criteria

8. Criteria
• Time

9. Criteria
• Time
• to learn the application

10. Criteria
• Time
• to learn the application
• to perform task

11. Criteria
• Time
• to learn the application
• to perform task
• that users remember how and what

12. Criteria
• Time
• to learn the application
• to perform task
• that users remember how and what
• Errors

13. Criteria
• Time
• to learn the application
• to perform task
• that users remember how and what
• Errors
• number

14. Criteria
• Time
• to learn the application
• to perform task
• that users remember how and what
• Errors
• number
• kind

15. Criteria
• Time
• to learn the application
• to perform task
• that users remember how and what
• Errors
• number
• kind
• Subjective feeling of satisfaction

16. Criteria
• Time
• to learn the application
• to perform task
• that users remember how and what
• Errors
• number
• kind
• Subjective feeling of satisfaction
Often a compromise - important to make explicit

17. methods
- questionnaire
- usability engineering
- by experts

18. questionnaires
http://hcibib.org/perlman/question.html

19. http://www.cc.gatech.edu/gvu/images/lab/usability-lab.jpg
Usability Lab

20. Usability engineering
•‘Think-aloud protocol‘
•Video recording with annotation
•Log, remarks, etc. for analysis
•‘Discount usability engineering’
•Comparative test of user interface

21. By experts

22. By experts
•in HCI or domain

23. By experts
•in HCI or domain
•very effective

24. By experts
•in HCI or domain
•very effective
•delicate relation with developers

25. By experts
•in HCI or domain
•very effective
•delicate relation with developers
•target

26. By experts
•in HCI or domain
•very effective
•delicate relation with developers
•target
•identify problems

27. By experts
•in HCI or domain
•very effective
•delicate relation with developers
•target
•identify problems
•suggest solutions

28. By experts
•in HCI or domain
•very effective
•delicate relation with developers
•target
•identify problems
•suggest solutions
•through checklist of guidelines

29. Participants
• representative
• computer experience, language, task,
motivation, education, etc.
• gender, age
• have to know they are not being evaluated
• relationship
• colleagues, friends, family, ...

30. Factors that influence usability:
what do you think?
•... •...

31. Factoren: Cognitief

32. Factoren: Cognitief
•cognitive

33. Factoren: Cognitief
•cognitive
•fatigue, boredom, stress, fear, ...

34. Factoren: Cognitief
•cognitive
•fatigue, boredom, stress, fear, ...
•personality

35. Factoren: Cognitief
•cognitive
•fatigue, boredom, stress, fear, ...
•personality
•gender (‘abort’)

36. Factoren: Cognitief
•cognitive
•fatigue, boredom, stress, fear, ...
•personality
•gender (‘abort’)
•cultural

37. Factoren: Cognitief
•cognitive
•fatigue, boredom, stress, fear, ...
•personality
•gender (‘abort’)
•cultural
•i18n

38. Trash can in Thailand

39. Trash can in Thailand

40. Questions?
http://erikduval.wordpress.com/
twitter: @ErikDuval
15