SlideShare a Scribd company logo
1 of 26
User Study of SADIe Transcoding Engine Darren Lunn, Sean Bechhofer and Simon Harper
Summary SADIe transcodes content based upon meaning of the visual rendering. User evaluation supports SADIe transcoding as a way to aid visually impaired users. Observations from the study also provide insights into further transformations. 2
The Web Focus on presenting information visually. Images. Columns. Chunks. Some knowledge is only available implicitly from the page rendering. 3
Implicit Knowledge Advertisement Banner Menu Main Content 4
Assistive Technologies Visually impaired users can make use of assistive technologies e.g. screen readers. Render pages sequentially in audio. Achieved by accessing the underlying HTML. Focus on visual presentation rather than content hampers this. Particularly if attention is not paid to coherent design. Subtleties of visual presentation can be lost. 5
Assistive Technologies Traversal of content is serial. Top-to-bottom. Left-to-right. Important information may not be encountered until later on. Some information such as menus can be repeated for every page. 6
Transcoding Rules / Patterns. Can adapt a large number of pages. Can suffer from reduced accuracy. Annotation. Accurate. Time consuming as every page is annotated.	 7
SADIe Approach The visual rendering of a Web element informs the user of its purpose. The CSS defines the visual rendering. Identifying the purpose of the CSS definition implicitly defines the purpose of the Web element. A single CSS definition is applied to every page within the Website. 8
SADIe Banner Heading Menu Banner Overview Heading Overview Main Story Tabs Advertisement                           Main Story Image 9
Is This Useful? Previously technically feasible of SADIe. Conducted user studies to support transcoding from user perspective. Identify future transcoding areas to investigate. 10
Remote Or Lab-Based Study? Remote Studies. Long term. Potentially more users. Can see what users did. Lab-based study. More controlled. Glean information from users. Can understand why users performed actions. 11
Stimuli Eight text-based Websites. News; Blogs; Search results. Taken from Alexa top 100. All pages transcoded in the same way. User presented with original or modified version. Tasks involved finding information on the page. 12
Users Four visually impaired users Frequent computer users. Used the Web daily. All used JAWS screen reader. 13
Tasks Users were presented with a page. They did not know which page. They did not know which version. Users were asked to complete a task. E.g. “What is the first search result”. Task completion time was calculated. 14
User Interaction Task index page Page 3 15
Time to Task Completion 16
T-Test Analysis Mean Times Original: 163.25 SADIe: 54.19 t(7.6) = -2.14 p = 0.033 As p < 0.05 statistically significant Supports the use of our transcoding 17
A Good Start Point Evaluation supports the use of SADIe transcoding. Defluff; Reorder; Menu. User discussions and observations highlight future areas of investigation. 18
Importance of Structure Participants frequently discussed the importance of page structure. “If you told me these were the results with a heading… that would help me.”- P1  “When you say heading level 4 or whatever, you need to describe what is under it.”- P3 19
Importance of Structure P3 found list structures much easier to navigate than paragraphs of text. Scope for not only reorganising page but restructuring elements. 20
Importance of Cues BBC News page required users to find story headline. SADIe version took longer. P2 reached headline within 3 seconds. Did not know it was the headline as page had changed. Required cue of “Africa” before realising they had gone too far. 21
Importance of Cues 22
Importance of Cues P1 identified search results from the word “cached.” P3 knew they had gone too far from the word “feedback.” Can we make use of these cues to guide people around the page? 23
User Strategies “Basic strategy is to use ‘find’ but this only really works when you know the page.” – P1 P2 quickly tabbed through the page to get an overview of the content. Can these strategies be utilised to help users? 24
Summary SADIe transcodes content based upon meaning of the visual rendering. User evaluation supports SADIe transcoding as a way to aid visually impaired users. Observations from the study provide insights into further transformations. 25
Questions? http://hcw.cs.manchester.ac.uk/ darren.lunn@cs.manchester.ac.uk

More Related Content

What's hot

Blogging In The Library Revised Oct 16
Blogging In The Library Revised Oct 16Blogging In The Library Revised Oct 16
Blogging In The Library Revised Oct 16
bhodes
 
Usability Guidelines
Usability GuidelinesUsability Guidelines
Usability Guidelines
homeplate31
 
More On Drupal - OSU Spring Training 2010
More On Drupal - OSU Spring Training 2010More On Drupal - OSU Spring Training 2010
More On Drupal - OSU Spring Training 2010
Bryan Mayjor
 

What's hot (14)

Blogging In The Library Revised Oct 16
Blogging In The Library Revised Oct 16Blogging In The Library Revised Oct 16
Blogging In The Library Revised Oct 16
 
Usability Guidelines
Usability GuidelinesUsability Guidelines
Usability Guidelines
 
Ruining The User Experience (The Rich Web Experience '07)
Ruining The User Experience (The Rich Web Experience '07)Ruining The User Experience (The Rich Web Experience '07)
Ruining The User Experience (The Rich Web Experience '07)
 
WordPress for Small Businesses
WordPress for Small BusinessesWordPress for Small Businesses
WordPress for Small Businesses
 
SPTechCon Boston 2012 - Flying in the Cloud: New Ways to Develop for SharePoint
SPTechCon Boston 2012 - Flying in the Cloud: New Ways to Develop for SharePointSPTechCon Boston 2012 - Flying in the Cloud: New Ways to Develop for SharePoint
SPTechCon Boston 2012 - Flying in the Cloud: New Ways to Develop for SharePoint
 
Aggregation Tools
Aggregation ToolsAggregation Tools
Aggregation Tools
 
Ruining The User Experience (The Ajax Experience Boston 2007)
Ruining The User Experience (The Ajax Experience Boston 2007)Ruining The User Experience (The Ajax Experience Boston 2007)
Ruining The User Experience (The Ajax Experience Boston 2007)
 
Web Usability Page Design
Web Usability   Page DesignWeb Usability   Page Design
Web Usability Page Design
 
Enriching Web Information Scent for Blind Users
Enriching Web Information Scent for Blind UsersEnriching Web Information Scent for Blind Users
Enriching Web Information Scent for Blind Users
 
November 2016 - ECN - You're Speaking Drupalese to Me
November 2016 - ECN - You're Speaking Drupalese to MeNovember 2016 - ECN - You're Speaking Drupalese to Me
November 2016 - ECN - You're Speaking Drupalese to Me
 
Different terms related issues web design
Different terms  related issues web designDifferent terms  related issues web design
Different terms related issues web design
 
November 2016 - Georgia Tech - Building a Research Website
November 2016 - Georgia Tech - Building a Research WebsiteNovember 2016 - Georgia Tech - Building a Research Website
November 2016 - Georgia Tech - Building a Research Website
 
Kevin jump, Jumoo
Kevin jump, JumooKevin jump, Jumoo
Kevin jump, Jumoo
 
More On Drupal - OSU Spring Training 2010
More On Drupal - OSU Spring Training 2010More On Drupal - OSU Spring Training 2010
More On Drupal - OSU Spring Training 2010
 

Similar to User Study of the SADIe Transcoding Engine

Heuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour WebsiteHeuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour Website
fabiolaeinhorn
 
Global Scope Final Report
Global Scope Final ReportGlobal Scope Final Report
Global Scope Final Report
Kamil Mustaffa
 
Information Design
Information DesignInformation Design
Information Design
Graeme Smith
 

Similar to User Study of the SADIe Transcoding Engine (20)

SADIe - Taming The Inaccessible Web
SADIe - Taming The Inaccessible WebSADIe - Taming The Inaccessible Web
SADIe - Taming The Inaccessible Web
 
SurfOpen Diary Study & Customer Insights
SurfOpen Diary Study & Customer InsightsSurfOpen Diary Study & Customer Insights
SurfOpen Diary Study & Customer Insights
 
Making Your Website Sing!
Making Your Website Sing!Making Your Website Sing!
Making Your Website Sing!
 
Making Your Website Sing!
Making Your Website Sing!Making Your Website Sing!
Making Your Website Sing!
 
WebE_chapter_16.ppt
WebE_chapter_16.pptWebE_chapter_16.ppt
WebE_chapter_16.ppt
 
18 Vital Tips for UI Designers
18 Vital Tips for UI Designers18 Vital Tips for UI Designers
18 Vital Tips for UI Designers
 
Heuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour WebsiteHeuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour Website
 
Competitive review
Competitive reviewCompetitive review
Competitive review
 
corePHP Usability Accessibility by Steven Pignataro
corePHP Usability Accessibility by Steven PignatarocorePHP Usability Accessibility by Steven Pignataro
corePHP Usability Accessibility by Steven Pignataro
 
Why Accessibility is More Than Just a Lighthouse Metric | SEONerdSwitzerland ...
Why Accessibility is More Than Just a Lighthouse Metric | SEONerdSwitzerland ...Why Accessibility is More Than Just a Lighthouse Metric | SEONerdSwitzerland ...
Why Accessibility is More Than Just a Lighthouse Metric | SEONerdSwitzerland ...
 
Global Scope Final Report
Global Scope Final ReportGlobal Scope Final Report
Global Scope Final Report
 
Plan For Accessibility - TODCon 2008
Plan For Accessibility - TODCon 2008Plan For Accessibility - TODCon 2008
Plan For Accessibility - TODCon 2008
 
UI Design Trends
UI Design TrendsUI Design Trends
UI Design Trends
 
Slides chapter 16
Slides chapter 16Slides chapter 16
Slides chapter 16
 
Uxpin web ui design patterns 2014
Uxpin web ui design patterns 2014Uxpin web ui design patterns 2014
Uxpin web ui design patterns 2014
 
Activate
ActivateActivate
Activate
 
WebBestPractices3
WebBestPractices3WebBestPractices3
WebBestPractices3
 
Dealing with organisational focused ia difficulties
Dealing with organisational focused ia difficultiesDealing with organisational focused ia difficulties
Dealing with organisational focused ia difficulties
 
Splunk conf2014 - Curating User Experience
Splunk conf2014 - Curating User ExperienceSplunk conf2014 - Curating User Experience
Splunk conf2014 - Curating User Experience
 
Information Design
Information DesignInformation Design
Information Design
 

Recently uploaded

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Recently uploaded (20)

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 

User Study of the SADIe Transcoding Engine

  • 1. User Study of SADIe Transcoding Engine Darren Lunn, Sean Bechhofer and Simon Harper
  • 2. Summary SADIe transcodes content based upon meaning of the visual rendering. User evaluation supports SADIe transcoding as a way to aid visually impaired users. Observations from the study also provide insights into further transformations. 2
  • 3. The Web Focus on presenting information visually. Images. Columns. Chunks. Some knowledge is only available implicitly from the page rendering. 3
  • 4. Implicit Knowledge Advertisement Banner Menu Main Content 4
  • 5. Assistive Technologies Visually impaired users can make use of assistive technologies e.g. screen readers. Render pages sequentially in audio. Achieved by accessing the underlying HTML. Focus on visual presentation rather than content hampers this. Particularly if attention is not paid to coherent design. Subtleties of visual presentation can be lost. 5
  • 6. Assistive Technologies Traversal of content is serial. Top-to-bottom. Left-to-right. Important information may not be encountered until later on. Some information such as menus can be repeated for every page. 6
  • 7. Transcoding Rules / Patterns. Can adapt a large number of pages. Can suffer from reduced accuracy. Annotation. Accurate. Time consuming as every page is annotated. 7
  • 8. SADIe Approach The visual rendering of a Web element informs the user of its purpose. The CSS defines the visual rendering. Identifying the purpose of the CSS definition implicitly defines the purpose of the Web element. A single CSS definition is applied to every page within the Website. 8
  • 9. SADIe Banner Heading Menu Banner Overview Heading Overview Main Story Tabs Advertisement Main Story Image 9
  • 10. Is This Useful? Previously technically feasible of SADIe. Conducted user studies to support transcoding from user perspective. Identify future transcoding areas to investigate. 10
  • 11. Remote Or Lab-Based Study? Remote Studies. Long term. Potentially more users. Can see what users did. Lab-based study. More controlled. Glean information from users. Can understand why users performed actions. 11
  • 12. Stimuli Eight text-based Websites. News; Blogs; Search results. Taken from Alexa top 100. All pages transcoded in the same way. User presented with original or modified version. Tasks involved finding information on the page. 12
  • 13. Users Four visually impaired users Frequent computer users. Used the Web daily. All used JAWS screen reader. 13
  • 14. Tasks Users were presented with a page. They did not know which page. They did not know which version. Users were asked to complete a task. E.g. “What is the first search result”. Task completion time was calculated. 14
  • 15. User Interaction Task index page Page 3 15
  • 16. Time to Task Completion 16
  • 17. T-Test Analysis Mean Times Original: 163.25 SADIe: 54.19 t(7.6) = -2.14 p = 0.033 As p < 0.05 statistically significant Supports the use of our transcoding 17
  • 18. A Good Start Point Evaluation supports the use of SADIe transcoding. Defluff; Reorder; Menu. User discussions and observations highlight future areas of investigation. 18
  • 19. Importance of Structure Participants frequently discussed the importance of page structure. “If you told me these were the results with a heading… that would help me.”- P1 “When you say heading level 4 or whatever, you need to describe what is under it.”- P3 19
  • 20. Importance of Structure P3 found list structures much easier to navigate than paragraphs of text. Scope for not only reorganising page but restructuring elements. 20
  • 21. Importance of Cues BBC News page required users to find story headline. SADIe version took longer. P2 reached headline within 3 seconds. Did not know it was the headline as page had changed. Required cue of “Africa” before realising they had gone too far. 21
  • 23. Importance of Cues P1 identified search results from the word “cached.” P3 knew they had gone too far from the word “feedback.” Can we make use of these cues to guide people around the page? 23
  • 24. User Strategies “Basic strategy is to use ‘find’ but this only really works when you know the page.” – P1 P2 quickly tabbed through the page to get an overview of the content. Can these strategies be utilised to help users? 24
  • 25. Summary SADIe transcodes content based upon meaning of the visual rendering. User evaluation supports SADIe transcoding as a way to aid visually impaired users. Observations from the study provide insights into further transformations. 25

Editor's Notes

  1. Mention what transformations we can do: Defluff, reorder, menu
  2. 1) About; 2) BBC News; 3) Yahoo; 4) Google; 5) CNN; 6) Lady Xanga Blog; 7) New York Times; 8) Cultured Left Foot blog
  3. Difference between the two means 109.06
  4. P3 used headings a lot and was frustrated when the heading didn’t match the content underneath.
  5. On the age found a heading with Africa and knew they had gone too far.