SlideShare una empresa de Scribd logo
OCTOBER19TH
TED ROGERS SCHOOL OF MANAGEMENT,
RYERSON UNIVERSITY
PRESENTER-ADHITHYA KRISHNAMACHARI
ProductCamp
2019
productcamptoronto.ca
 Explore methods to validate a product & choose appropriate methods
based on:
-Stage of the product development cycle
-Effectiveness and time to set up the test
-Other factors
 Discuss real life use cases/examples suitable for each testing method
 Summarize key learnings
PURPOSE
TESTING METHODS
Ideation
Qualitative techniques
- UX Research (generative research)
Define goals/’jobs to be done’
• Discovery session
• Card sorting
- Interviews
- Experience maps
- Design sprints
- Focus Groups
Quantitative techniques
- Surveys/Questionnaires -Search patterns
- Email-campaigns -Order form
- Landing page
- CTA links
- Ads
Design
Validate UX- Is this the most optimal
solution? Fine tune solution before launch
- Usability tests (evaluative research)
• Prototype validation
• First click test
• First impression/5 second test
• Comparative test (our UI vs
Competitor’s UI)
• Tree Testing
• Observations/Job Shadowing
Optimization
Are we on achieving our KPI’s?
How can we improve?
- Analytics/Business Intelligence
- A/B Test
- Surveys
- Heatmaps
- Customer feedback
New Features/Redesign Improvements
Development
&
Deployment
-User Acceptance Testing
-Pilot/Beta testing
Why? Is there a demand ? Do users care? Get real-time user feedback
Redesign navigation on myKawartha.com
USE CASE
Old Navigation (Desktop)
New Navigation (Desktop)
Testing methods used
• Ideation: Discovery Session (20 users), (Closed)Card Sorting (10 users)
• Design: Tree testing (10 users and 2 studies)
• Optimization: Analytics, Customer feedback
• Design (post optimization): Comparative Test (5 users)
Closed card sorting: Determine where users think your site information is best placed within existing/pre-defined
categories
For Reference
Tree test: A tree test assesses the clarity of navigation labels by presenting only the navigation
tree and asking participants to use the tree find content
Organize each testing method based on strength of evidence it provides and time to set up the test
Exercise
Less set-up time More set-up time
Stronger evidence
Weaker evidence
Usability
Tests
Customer
co-creation
Pilot Test
Simulated Sales
A/B Testing Crowd-
funding
User Interviews
Focus Groups
UX Research
Design Sprints
Surveys
Search patterns
Other ways to organize test methods

Más contenido relacionado

Similar a Product camp toronto-2019-presentation

Prototyping and Usability Testing your designs
Prototyping and Usability Testing your designsPrototyping and Usability Testing your designs
Prototyping and Usability Testing your designs
Elizabeth Snowdon
 
Remote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinarRemote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinar
UserZoom
 
體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達
Visual Cognition and Modeling Lab
 
User Research to Validate Product Ideas Workshop
User Research to Validate Product Ideas WorkshopUser Research to Validate Product Ideas Workshop
User Research to Validate Product Ideas Workshop
Product School
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability Testing
UserZoom
 
Usability testing 2013.12.20.
Usability testing 2013.12.20.Usability testing 2013.12.20.
Usability testing 2013.12.20.
Visual Cognition and Modeling Lab
 
Usability testing
Usability testingUsability testing
Usability testing
pfasolo
 
Serve your customers better with User Experience Research
Serve your customers better with User Experience ResearchServe your customers better with User Experience Research
Serve your customers better with User Experience Research
Amanda Stockwell
 
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
BrittanyRubinstein
 
Advancing Testing Using Axioms
Advancing Testing Using AxiomsAdvancing Testing Using Axioms
Advancing Testing Using Axioms
Paul Gerrard
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
Carmen Brion
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Kay Aubrey
 
Product Management & The 3 E’s: Experiments, Experiences, and Efficiencies
Product Management & The 3 E’s: Experiments, Experiences, and EfficienciesProduct Management & The 3 E’s: Experiments, Experiences, and Efficiencies
Product Management & The 3 E’s: Experiments, Experiences, and Efficiencies
Aggregage
 
Straight from the user's mouth: Usability testing UNC's LibGuides
Straight from the user's mouth: Usability testing UNC's LibGuidesStraight from the user's mouth: Usability testing UNC's LibGuides
Straight from the user's mouth: Usability testing UNC's LibGuides
Sarah Joy Arnold
 
Leveraging User Research
Leveraging User ResearchLeveraging User Research
Leveraging User Research
Tom Satwicz
 
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
UserZoom
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Carol Smith
 
Intro to Product Management
Intro to Product Management Intro to Product Management
Intro to Product Management
Ria Sankar
 
Successfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX TestingSuccessfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX Testing
UserZoom
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working Group
NormanMendoza
 

Similar a Product camp toronto-2019-presentation (20)

Prototyping and Usability Testing your designs
Prototyping and Usability Testing your designsPrototyping and Usability Testing your designs
Prototyping and Usability Testing your designs
 
Remote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinarRemote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinar
 
體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達
 
User Research to Validate Product Ideas Workshop
User Research to Validate Product Ideas WorkshopUser Research to Validate Product Ideas Workshop
User Research to Validate Product Ideas Workshop
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability Testing
 
Usability testing 2013.12.20.
Usability testing 2013.12.20.Usability testing 2013.12.20.
Usability testing 2013.12.20.
 
Usability testing
Usability testingUsability testing
Usability testing
 
Serve your customers better with User Experience Research
Serve your customers better with User Experience ResearchServe your customers better with User Experience Research
Serve your customers better with User Experience Research
 
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
 
Advancing Testing Using Axioms
Advancing Testing Using AxiomsAdvancing Testing Using Axioms
Advancing Testing Using Axioms
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
 
Product Management & The 3 E’s: Experiments, Experiences, and Efficiencies
Product Management & The 3 E’s: Experiments, Experiences, and EfficienciesProduct Management & The 3 E’s: Experiments, Experiences, and Efficiencies
Product Management & The 3 E’s: Experiments, Experiences, and Efficiencies
 
Straight from the user's mouth: Usability testing UNC's LibGuides
Straight from the user's mouth: Usability testing UNC's LibGuidesStraight from the user's mouth: Usability testing UNC's LibGuides
Straight from the user's mouth: Usability testing UNC's LibGuides
 
Leveraging User Research
Leveraging User ResearchLeveraging User Research
Leveraging User Research
 
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
Intro to Product Management
Intro to Product Management Intro to Product Management
Intro to Product Management
 
Successfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX TestingSuccessfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX Testing
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working Group
 

Último

The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
OECD Directorate for Financial and Enterprise Affairs
 
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
OECD Directorate for Financial and Enterprise Affairs
 
ASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdfASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdf
ToshihiroIto4
 
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij
 
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussionPro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
gpww3sf4
 
XP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to LeadershipXP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to Leadership
samililja
 
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussionArtificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussionArtificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdfBRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
Robin Haunschild
 
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
OECD Directorate for Financial and Enterprise Affairs
 
Gregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics PresentationGregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics Presentation
gharris9
 
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
OECD Directorate for Financial and Enterprise Affairs
 
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
OECD Directorate for Financial and Enterprise Affairs
 
Carrer goals.pptx and their importance in real life
Carrer goals.pptx  and their importance in real lifeCarrer goals.pptx  and their importance in real life
Carrer goals.pptx and their importance in real life
artemacademy2
 
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
OECD Directorate for Financial and Enterprise Affairs
 
IEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdfIEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdf
Claudio Gallicchio
 
The remarkable life of Sir Mokshagundam Visvesvaraya.pptx
The remarkable life of Sir Mokshagundam Visvesvaraya.pptxThe remarkable life of Sir Mokshagundam Visvesvaraya.pptx
The remarkable life of Sir Mokshagundam Visvesvaraya.pptx
JiteshKumarChoudhary2
 
Using-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptxUsing-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptx
kainatfatyma9
 
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
OECD Directorate for Financial and Enterprise Affairs
 

Último (20)

The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
 
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
 
ASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdfASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdf
 
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
 
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussionPro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
 
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
 
XP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to LeadershipXP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to Leadership
 
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussionArtificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
 
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussionArtificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
 
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdfBRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
BRIC_2024_2024-06-06-11:30-haunschild_archival_version.pdf
 
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
 
Gregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics PresentationGregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics Presentation
 
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
 
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
 
Carrer goals.pptx and their importance in real life
Carrer goals.pptx  and their importance in real lifeCarrer goals.pptx  and their importance in real life
Carrer goals.pptx and their importance in real life
 
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
 
IEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdfIEEE CIS Webinar Sustainable futures.pdf
IEEE CIS Webinar Sustainable futures.pdf
 
The remarkable life of Sir Mokshagundam Visvesvaraya.pptx
The remarkable life of Sir Mokshagundam Visvesvaraya.pptxThe remarkable life of Sir Mokshagundam Visvesvaraya.pptx
The remarkable life of Sir Mokshagundam Visvesvaraya.pptx
 
Using-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptxUsing-Presentation-Software-to-the-Fullf.pptx
Using-Presentation-Software-to-the-Fullf.pptx
 
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
 

Product camp toronto-2019-presentation

  • 1. OCTOBER19TH TED ROGERS SCHOOL OF MANAGEMENT, RYERSON UNIVERSITY PRESENTER-ADHITHYA KRISHNAMACHARI ProductCamp 2019 productcamptoronto.ca
  • 2.  Explore methods to validate a product & choose appropriate methods based on: -Stage of the product development cycle -Effectiveness and time to set up the test -Other factors  Discuss real life use cases/examples suitable for each testing method  Summarize key learnings PURPOSE
  • 3. TESTING METHODS Ideation Qualitative techniques - UX Research (generative research) Define goals/’jobs to be done’ • Discovery session • Card sorting - Interviews - Experience maps - Design sprints - Focus Groups Quantitative techniques - Surveys/Questionnaires -Search patterns - Email-campaigns -Order form - Landing page - CTA links - Ads Design Validate UX- Is this the most optimal solution? Fine tune solution before launch - Usability tests (evaluative research) • Prototype validation • First click test • First impression/5 second test • Comparative test (our UI vs Competitor’s UI) • Tree Testing • Observations/Job Shadowing Optimization Are we on achieving our KPI’s? How can we improve? - Analytics/Business Intelligence - A/B Test - Surveys - Heatmaps - Customer feedback New Features/Redesign Improvements Development & Deployment -User Acceptance Testing -Pilot/Beta testing Why? Is there a demand ? Do users care? Get real-time user feedback
  • 4. Redesign navigation on myKawartha.com USE CASE Old Navigation (Desktop) New Navigation (Desktop) Testing methods used • Ideation: Discovery Session (20 users), (Closed)Card Sorting (10 users) • Design: Tree testing (10 users and 2 studies) • Optimization: Analytics, Customer feedback • Design (post optimization): Comparative Test (5 users)
  • 5. Closed card sorting: Determine where users think your site information is best placed within existing/pre-defined categories For Reference Tree test: A tree test assesses the clarity of navigation labels by presenting only the navigation tree and asking participants to use the tree find content
  • 6. Organize each testing method based on strength of evidence it provides and time to set up the test Exercise Less set-up time More set-up time Stronger evidence Weaker evidence Usability Tests Customer co-creation Pilot Test Simulated Sales A/B Testing Crowd- funding User Interviews Focus Groups UX Research Design Sprints Surveys Search patterns
  • 7. Other ways to organize test methods