SlideShare una empresa de Scribd logo
1 de 12
[object Object],[object Object],[object Object],[object Object],Thoughts in progress! Conclusions up for discussion
[object Object],Usability testing Usability inspection
[object Object],Usability testing Usability inspection considering users observing users What do we miss by not accessing the user’s knowledge during our usability evaluations?
[object Object],What do we miss by not accessing the user’s knowledge during our usability evaluations? …  holds domain knowledge we cannot access
What we may miss if the user knows more of the domain than the usability evaluator:  Review of two studies of usability evaluation methods that allow us to access the users’ knowledge.
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],*) an inspection method allowing domain experts to serve as usability inspectors  12 % overlap in findings between evaluator groups Domain experts: 59 % domain specific findings Usability experts: 15 % domain specific findings Følstad, A., 2007. Work-domain experts as evaluators: usability inspection of domain-specific work-support systems. International Journal of Human– Computer Interaction 22 (3), 217–245.
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],*) an inspection method allowing domain experts to serve as usability inspectors  54 % of domain experts’ findings given high priority by client 27 % of usability experts’ findings given the same priority Følstad, A., 2007. Work-domain experts as evaluators: usability inspection of domain-specific work-support systems. International Journal of Human– Computer Interaction 22 (3), 217–245 .
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],*) usability testing with phases of interpretative dialogue with the user participant ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Følstad, A. & Hornbæk, K. (2010) Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability Testing. Journal of systems and software, 83, 2019-2030.
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],*) usability testing with phases of interpretative dialogue with the user participant Findings through user dialogue ...  had similar impact on subsequent development compared  to  findings through observation Følstad, A. & Hornbæk, K. (2010) Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability Testing. Journal of systems and software, 83, 2019-2030.
Why did it pay off to access the users’ knowledge in these cases?
[object Object],[object Object],*)  The unavailability of domain knowledge to the outsiders of a specific domain Level of training Level of specialization High High Low Low Specialist (Medical care at hospital wards; medical emergency response) Generalist (General office work; project leadership) Popular (eCommerce and eGovernment  customership) Limited training (Professional sales; parking enforcemenet)
In conclusion: When doing usability evaluation in exclusive domains … …  consider using methods that allow you to access the domain knowledge of users

Más contenido relacionado

La actualidad más candente

LIJI ppt new
 LIJI ppt new  LIJI ppt new
LIJI ppt new lijikc
 
W4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris BaileyW4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris Baileychrisbailey000
 
How does poll everywhere.com work
How does poll everywhere.com workHow does poll everywhere.com work
How does poll everywhere.com workFtoOmRose
 
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEEMEMTECHSTUDENTPROJECTS
 
Content Analysis - Theoretical Issues - Intro to Quantitative
Content Analysis - Theoretical Issues - Intro to Quantitative Content Analysis - Theoretical Issues - Intro to Quantitative
Content Analysis - Theoretical Issues - Intro to Quantitative Michigan State University
 
Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)David Lamas
 
Usability Test Process
Usability Test ProcessUsability Test Process
Usability Test ProcessKshitiz Anand
 
Handling missing Social Network data
Handling missing Social Network dataHandling missing Social Network data
Handling missing Social Network dataChristina Manteli
 

La actualidad más candente (11)

LIJI ppt new
 LIJI ppt new  LIJI ppt new
LIJI ppt new
 
W4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris BaileyW4A 2010 Education Tool to Support the Educational Process Chris Bailey
W4A 2010 Education Tool to Support the Educational Process Chris Bailey
 
How does poll everywhere.com work
How does poll everywhere.com workHow does poll everywhere.com work
How does poll everywhere.com work
 
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
 
Content Analysis - Theoretical Issues - Intro to Quantitative
Content Analysis - Theoretical Issues - Intro to Quantitative Content Analysis - Theoretical Issues - Intro to Quantitative
Content Analysis - Theoretical Issues - Intro to Quantitative
 
Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)
 
Evaluation of eLearning
Evaluation of eLearningEvaluation of eLearning
Evaluation of eLearning
 
Usability Test Process
Usability Test ProcessUsability Test Process
Usability Test Process
 
Handling missing Social Network data
Handling missing Social Network dataHandling missing Social Network data
Handling missing Social Network data
 
Introduction to Survey Data Quality
Introduction to Survey Data Quality  Introduction to Survey Data Quality
Introduction to Survey Data Quality
 
PSI e-infrastructures evaluation
PSI e-infrastructures evaluationPSI e-infrastructures evaluation
PSI e-infrastructures evaluation
 

Destacado

Q A R (question answer relationship) Sort
Q A R (question answer relationship)  SortQ A R (question answer relationship)  Sort
Q A R (question answer relationship) SortJC Sawyer Dolphins
 
Sosiale medier i offentlig sektor
Sosiale medier i offentlig sektorSosiale medier i offentlig sektor
Sosiale medier i offentlig sektorAsbjørn Følstad
 

Destacado (6)

Q A R (question answer relationship) Sort
Q A R (question answer relationship)  SortQ A R (question answer relationship)  Sort
Q A R (question answer relationship) Sort
 
Grace F Measurement Project
Grace F Measurement ProjectGrace F Measurement Project
Grace F Measurement Project
 
Byråkratrollen i endring
Byråkratrollen i endringByråkratrollen i endring
Byråkratrollen i endring
 
Sosiale medier i offentlig sektor
Sosiale medier i offentlig sektorSosiale medier i offentlig sektor
Sosiale medier i offentlig sektor
 
February 18th presentation
February 18th presentationFebruary 18th presentation
February 18th presentation
 
February 18th presentation
February 18th presentationFebruary 18th presentation
February 18th presentation
 

Similar a Usability evaluation in exclusive domains_presentation

Webinar Agile Presentation V.1.0
Webinar Agile Presentation V.1.0Webinar Agile Presentation V.1.0
Webinar Agile Presentation V.1.0fhios
 
When Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User InputWhen Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User InputHans-Joerg Happel
 
User Experience Research
User Experience ResearchUser Experience Research
User Experience ResearchSushmita Dutt
 
Mobile App Development and Management: Results from a Qualitative Investigation
Mobile App Development and Management: Results from a Qualitative InvestigationMobile App Development and Management: Results from a Qualitative Investigation
Mobile App Development and Management: Results from a Qualitative InvestigationMobileSoft
 
User Experience Evaluation for Automation Tools: An Industrial Experience
User Experience Evaluation for Automation Tools: An Industrial ExperienceUser Experience Evaluation for Automation Tools: An Industrial Experience
User Experience Evaluation for Automation Tools: An Industrial ExperienceIJCI JOURNAL
 
Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...
Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...
Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...VijiPriya Jeyamani
 
THE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCETHE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCEvivatechijri
 
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton Robotics
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton RoboticsUsability Challenges in Cutting-edge Medical Devices and Exoskeleton Robotics
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton RoboticsICS
 
2012 in tech-usability_of_interfaces (1)
2012 in tech-usability_of_interfaces (1)2012 in tech-usability_of_interfaces (1)
2012 in tech-usability_of_interfaces (1)Mahesh Kate
 
Cenec Use Scenarios, Gianluigi Bodi, CENEC
Cenec Use Scenarios, Gianluigi Bodi, CENECCenec Use Scenarios, Gianluigi Bodi, CENEC
Cenec Use Scenarios, Gianluigi Bodi, CENECErik Axdorph
 
Share.TEC use scenarios, CENEC
Share.TEC use scenarios, CENECShare.TEC use scenarios, CENEC
Share.TEC use scenarios, CENECShare.TEC
 
Ui Design And Usability For Everybody
Ui Design And Usability For EverybodyUi Design And Usability For Everybody
Ui Design And Usability For EverybodyEmpatika
 
NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...
NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...
NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...Carine Lallemand
 
Usages of ICT : A user-oriented innovation process
Usages of ICT : A user-oriented innovation processUsages of ICT : A user-oriented innovation process
Usages of ICT : A user-oriented innovation processM@rsouin
 

Similar a Usability evaluation in exclusive domains_presentation (20)

Webinar Agile Presentation V.1.0
Webinar Agile Presentation V.1.0Webinar Agile Presentation V.1.0
Webinar Agile Presentation V.1.0
 
When Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User InputWhen Users Becom Collaborators: Towards Continuous and Context-Aware User Input
When Users Becom Collaborators: Towards Continuous and Context-Aware User Input
 
Ijetr021224
Ijetr021224Ijetr021224
Ijetr021224
 
Ijetr021224
Ijetr021224Ijetr021224
Ijetr021224
 
Usability
UsabilityUsability
Usability
 
User Experience Research
User Experience ResearchUser Experience Research
User Experience Research
 
195
195195
195
 
Presentation ECSA
Presentation ECSAPresentation ECSA
Presentation ECSA
 
Mobile App Development and Management: Results from a Qualitative Investigation
Mobile App Development and Management: Results from a Qualitative InvestigationMobile App Development and Management: Results from a Qualitative Investigation
Mobile App Development and Management: Results from a Qualitative Investigation
 
User Experience Evaluation for Automation Tools: An Industrial Experience
User Experience Evaluation for Automation Tools: An Industrial ExperienceUser Experience Evaluation for Automation Tools: An Industrial Experience
User Experience Evaluation for Automation Tools: An Industrial Experience
 
Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...
Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...
Human Computer Interaction Chapter 4 Implementation Support and Evaluation Te...
 
THE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCETHE USABILITY METRICS FOR USER EXPERIENCE
THE USABILITY METRICS FOR USER EXPERIENCE
 
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton Robotics
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton RoboticsUsability Challenges in Cutting-edge Medical Devices and Exoskeleton Robotics
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton Robotics
 
2012 in tech-usability_of_interfaces (1)
2012 in tech-usability_of_interfaces (1)2012 in tech-usability_of_interfaces (1)
2012 in tech-usability_of_interfaces (1)
 
Chapter1
Chapter1Chapter1
Chapter1
 
Cenec Use Scenarios, Gianluigi Bodi, CENEC
Cenec Use Scenarios, Gianluigi Bodi, CENECCenec Use Scenarios, Gianluigi Bodi, CENEC
Cenec Use Scenarios, Gianluigi Bodi, CENEC
 
Share.TEC use scenarios, CENEC
Share.TEC use scenarios, CENECShare.TEC use scenarios, CENEC
Share.TEC use scenarios, CENEC
 
Ui Design And Usability For Everybody
Ui Design And Usability For EverybodyUi Design And Usability For Everybody
Ui Design And Usability For Everybody
 
NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...
NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...
NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...
 
Usages of ICT : A user-oriented innovation process
Usages of ICT : A user-oriented innovation processUsages of ICT : A user-oriented innovation process
Usages of ICT : A user-oriented innovation process
 

Más de Asbjørn Følstad

Social media in public sector innovation
Social media in public sector innovationSocial media in public sector innovation
Social media in public sector innovationAsbjørn Følstad
 
Sosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor webSosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor webAsbjørn Følstad
 
Chi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation webChi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation webAsbjørn Følstad
 
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-webNettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-webAsbjørn Følstad
 
Analysis in usability evaluation: Questionnaire
Analysis in usability evaluation: QuestionnaireAnalysis in usability evaluation: Questionnaire
Analysis in usability evaluation: QuestionnaireAsbjørn Følstad
 
Usability evaluation in exclusive domains
Usability evaluation in exclusive domainsUsability evaluation in exclusive domains
Usability evaluation in exclusive domainsAsbjørn Følstad
 
The relevance of UX models and measures
The relevance of UX models and measuresThe relevance of UX models and measures
The relevance of UX models and measuresAsbjørn Følstad
 
Participatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medierParticipatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medierAsbjørn Følstad
 
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medierBedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medierAsbjørn Følstad
 
Sosial tilbakemelding på design
Sosial tilbakemelding på designSosial tilbakemelding på design
Sosial tilbakemelding på designAsbjørn Følstad
 

Más de Asbjørn Følstad (13)

Politisk debatt på nett
Politisk debatt på nettPolitisk debatt på nett
Politisk debatt på nett
 
Social media in public sector innovation
Social media in public sector innovationSocial media in public sector innovation
Social media in public sector innovation
 
Single-user problems
Single-user problemsSingle-user problems
Single-user problems
 
Sosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor webSosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor web
 
Chi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation webChi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation web
 
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-webNettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
 
Analysis in usability evaluation: Questionnaire
Analysis in usability evaluation: QuestionnaireAnalysis in usability evaluation: Questionnaire
Analysis in usability evaluation: Questionnaire
 
Usability evaluation in exclusive domains
Usability evaluation in exclusive domainsUsability evaluation in exclusive domains
Usability evaluation in exclusive domains
 
The relevance of UX models and measures
The relevance of UX models and measuresThe relevance of UX models and measures
The relevance of UX models and measures
 
Participatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medierParticipatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medier
 
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medierBedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medier
 
Sosial tilbakemelding på design
Sosial tilbakemelding på designSosial tilbakemelding på design
Sosial tilbakemelding på design
 
Wud2009 Folstad Til Web
Wud2009 Folstad Til WebWud2009 Folstad Til Web
Wud2009 Folstad Til Web
 

Usability evaluation in exclusive domains_presentation

  • 1.
  • 2.
  • 3.
  • 4.
  • 5. What we may miss if the user knows more of the domain than the usability evaluator: Review of two studies of usability evaluation methods that allow us to access the users’ knowledge.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10. Why did it pay off to access the users’ knowledge in these cases?
  • 11.
  • 12. In conclusion: When doing usability evaluation in exclusive domains … … consider using methods that allow you to access the domain knowledge of users