1. Disabled ‘R’ All
Bridging the gap between
Accessibility and Usability
Hugo Nicolau
hman@vimmi.inesc-id.pt

2. Mobile devices

3. Powerful tools

4. Always near us

5. @ Home

6. @ Work

7. Outdoors

8. In car

9. @ Coffee shop

10. @ Subway

11. @ Airplain

12. And many many others …

13. Many contexts
CONTEXT

14. Overload

15. Leading to …
SIID

16. Motor capabilities

17. Loss of physical stability

18. Motor impaired

19. Similar problems?

20. Do they benefit from …
Similar solutions?

21. Goal

22. Hypothesis
“
Solutions designed for motor-impaired users
can be applied on mobile devices by assessing
the users’ capabilities within real mobile
contexts and thus enhancing their performance
”

23. Knowledge sharing and reuse

24. “Reinventing the wheel”

25. More and better research

26. Cost and availability

27. New connotation

28. RELATED
WORK

29. Context
Sears, 2003

30. Understanding SIID

31. Brewster, 2002
+ 17% workload
-32% data entered

32. Lin et al., 2007
Error rate
65% - 3%

33. Schedlbauer et al., 2007

34. Schildbach et al., 2010

35. Mizobuchi, 2005

36. Dealing with SIID
(Harrison et al., 2010) (Mistry et al., 2009)
(Sawheny and Schmandt, 2000) (Wigdor and Balakrisham, 2003)

37. Karlson, 2007; Baudisch, 2009
ThumbSpace
(Karlson and Bederson, 2007)
(Baudisch and Chu, 2009)

38. Context-aware interfaces
(Kane et al., 2008)

39. Alternative techniques
(Yatani and Troung, 2009)

40. Gesture interfaces
(Yfantidis, 2006)
(Bach, 2008)
(Guerreiro, 2009) (Goldberg, 1993)

41. Discussion on SIID

42. Target selection

43. Text-entry

44. Increase size

45. Evaluation

46. Still in its infancy

47. Understanding HIID

48. Dropping and long press
Dropping
Long press
> ffffffffffffff (Brown, 1992)

49. Bounce and additional press
Additional
Bounce
(Vanderheiden, 1993; Edwards, 1995; Poulson et al. 1996)

50. Trewin, 1999
Transposed
Remote
Bounce
Dropping
Missing
Additional
Long
0 500 1000 1500 2000 2500 3000

51. Mouse manipulation
(Riviere and Thakor, 1996; Hwang et al. 2004; Keates et al.,
2005)
Near misses
Not-so-near misses
Slips
Accidental clicks
Middle button press

52. Touch screens
(Guerreiro et al., 2010)

53. Dealing with HIID

54. Edge-based interfaces
Barrier Pointing
EdgeWrite
(Froehlich et al., 2007)
(Wobbrock et al., 2003)

55. Pointing
SUPPLE Steady Clicks
(Gajos et al., 2007)
(Trewin et al., 2006)

56. Text-Entry solutions
Filters
Suggestion and configuration systems
Word correction and prediction systems
Alternative techniques

57. Filters
Windows
Sticky keys
Slow keys OverlapKeys
Repeat keys
Mouse keys
(Trewin, 2002)

58. Suggestion systems
(Trewin and Pain, 1997)
(Koester et al., 2007)

59. Word correction
True Keys
(Kane et al., 2008)

60. Alternative techniques
Spread Keys
(Merlin and Raynal, 2010)
EdgeWrite
(Wobbrock et al., 2003)

61. Discussion HIID

62. Greater focus on problems

63. Reuse “soft-solutions”

64. Opportunities

65. APPROACH

66. Similar approaches

67. Focus on disability

68. Rather than …
Ability

69. Touch screens

70. Preliminary studies
(Guerreiro et al., 2010)

71. Tapping

72. Crossing

73. Exiting

74. Gesturing

75. Size
7 mm 12 mm 17 mm

76. Screen areas

77. Tapping

78. Size
12 mm
22%

79. Near support

80. Ability-design

81. Workplan
How do users select Selection techniques for
targets? touch screens
Text-entry Text-entry
Similar problems? errors (HIID) errors (SIID)
What solutions? Development
Similar solutions? Evaluation

82. Tapping
How do users select Selection techniques for
targets? touch screens
Text-entry Text-entry
Similar problems? errors (HIID) errors (SIID)
What solutions? Development
Similar solutions? Evaluation

83. Similar problems?
How do users select Selection techniques for
targets? touch screens
Text-entry Text-entry
Similar problems? errors (HIID) errors (SIID)
What solutions? Development
Similar solutions? Evaluation

84. Text-entry

85. Capture abilities

86. HIID

87. SIID

88. Comparison
Intra analysis
Inter analysis

89. What solutions?
How do users select Selection techniques for
targets? touch screens
Text-entry Text-entry
Similar problems? errors (HIID) errors (SIID)
What solutions? Development
Similar solutions? Evaluation

90. Three to five solutions
Filters
Configuration and suggestion systems
Orthographic correctors
Alternative techniques

91. Development

92. Similar solutions?
How do users select Selection techniques for
targets? touch screens
Text-entry Text-entry
Similar problems? errors (HIID) errors (SIID)
What solutions? Development
Similar solutions? Evaluation

93. Hypothesis validation
“
Solutions designed for motor-impaired users
can be applied on mobile devices by assessing
the users’ capabilities within real mobile
contexts and thus enhancing their performance
”

94. Most adequate solutions
100
Error rate (%)
2x
2x
0
Physical Impaired Situational Impaired
Traditional Alternative

95. Expected contributions
1. Analysis of selection techniques
2. Identify text-entry difficulties for motor
impaired users
3. Performance analysis whilst mobile
4. Mobile prototypes for text-entry tasks
5. User study with accessibility solutions
6. Guidelines for technology transfer

96. Expected Results
1. Similar selection techniques
2. Relationship between physical and
situational impairments
3. Solutions can be transferred between user
groups

97. Workplan

98. Expected publications
2010:
Full paper – ASSETS’10
Short paper – Mobile HCI’10
2011:
Doctoral consortium – ASSETS ‘11
Journal paper
2012:
Full paper – ASSETS’12
Full paper – Mobile HCI’12
2013:
Full paper – ASSETS’13
Full paper – CHI’13

99. THE END
Hugo Nicolau
hman@vimmi.inesc-id.pt

100. Questions