Learn how to start a usability program at your organization, through a process that multiplies your current resources and can cost you little or nothing.
Make It Plain: Accessbility and Usability Through Plain Language
Get Your Train On: Building Your UX Team Through Practical Usability Testing
1. Get Your Train On:
Building Your UX Team Through
Practical Usability Testing
GSA First Fridays Usability Program
Jonathan Rubin
Angela Hooker
October 2012
22. Matrixed approach to staffing
Part-time
volunteers!
Borrow from other
departments
You are “providing
skill building
opportunities”
Flexible needs: 1
-20 hours a month
22
23. Many roles to choose from
• Observe
• Room Manager
• Greeter
• Data Collector
• Backup
23
38. Graduate 1: internal
• Needed UX work
• Four months training with us
• Comparison test – 2 designs, 30
users
38
39. Graduate 1: internal
• Needed UX work
• Four months training with us
• Comparison test – 2 designs, 30
users
• Informed content of 100s of pages
39
40. Graduate 1: internal
• Needed UX work
• Four months training with us
• Comparison test – 2 designs, 30
users
• Informed content of 100s of pages
• Speaks publicly about usability
40
41. Graduate 1: internal
• Needed UX work
• Four months training with us
• Comparison test – 2 designs, 30
users
• Informed content of 100s of pages
• Speaks publicly about usability
• Tests on Call Center
41
43. Graduate 2: external
Couldn’t persuade agency to test, so
volunteered
Four months training with us
43
44. Graduate 2: external
Couldn’t persuade agency to test, so
volunteered
Four months training with us
Made 8 personas (tested 4)
44
45. Graduate 2: external
Couldn’t persuade agency to test, so
volunteered
Four months training with us
Made 8 personas (tested 4)
UX test and marketed it
45
Problem – want to test sites but not enough staff or resources
Solution: combine testing and education and get more volunteers!
How to get some usability momentum at your agency
We’re part of the Office of Citizen Services and Innovative Technologies at the US General Services Administration (GSA) We handle innovative programs like prizes and challenges, sharing public data sets, digital content education, and lots more
Educate our clients who want to improve their sites Demonstration tests and invite people to see it Awareness – generate awareness for our training program, and see facilitators in practice
We use two rooms to test – our test participant room and our observation room where we get to see what’s going on in the test Provides a lot of insight into how people use the site You don’t need a lab – just a couple of conference rooms work find. Go low tech!
Our style in a nutshell – 3 testers an hour each Why 3 people and not 30? Research has shown that testing with 3-5 people can find up to 70% of usability problems, which gives you a lot of bang for your buck
Lunch – provide if you can; otherwise, have people bring back. Start on time; keep momentum going . Accessibility demonstration during lunch (we demonstrate how people would use assistive technologies on the site/project, and point out where they can improve accessibility for all users).
Go around the room and collect 2-3 problems per person. Or have them submit before they leave Important to have lots of people there – they become big evangelizers for you
Work with parties who are there to determine solutions that they can implement in 30 days
Done – people agree so they have marching orders. Send stakeholders the problems and solutions that day. Send a short report and accessibility feedback 2-3 days later.
Here’s who we’ve helped – over 52 agencies Saved them tons of feedback, headaches, and complaints
We post templates, best practices, roles and responsibilities, checklists, and much more on our website
Hallway test – more users, informal, public space. Very successful – army.mil test Video: http://www.youtube.com/watch?v=pC0ODg2MpuE
First Fridays teaches other agencies how to test So they don’t need to go out and pay to have this done – do it for themselves NOW! Makes sense for agencies to test (fish) for themselves Saved $1.3 million to date BY TEACHING and demoing
You have had the monopoly on user experience – you are the go-to person. People come to you for information; now, you are going to share your secrets. Don't want people to steal your thunder; it’s a competitive field and town. No one wants to make it look like that anyone can do their job, but if you believe in discount usability testing – that a smart person can learn to do a basic test in months and not years
Usability is now a team sport - relying on others to help you, or creating their teams and sending them off Guiding others says lots about how capable you are, what a great practitioner you are, and work collaboratively with other teams
First Fridays approach to staffing – one full time employee; all others borrowed
Best possible research – they can conduct a test, represent your program, spread the education, fix more sites
The bible of do-it-yourself testing Met someone at UX mixer; she bought the book; did tests; people thought she was a genius
Training manual for facilitators: pass out materials, give to bosses, etc.
Colleague had too much to test – we didn’t have time for all requests
Went through our training program – various roles, observing, feedback
Big test – hallway test, two types of content, timed tests, 30 users
He found the best content was written in plain language or used short subheads Became the new standard for all their content Extremely useful results – plain Language, style
Knows enough to talk about it
Will be applying it to non-web based products
Wasn’t comfortable with us posting their report online Didn’t want results to be public
He went back to his agency and tried to set up a set Took a lot of convincing, but he got approval to make personas and test them
Test was a big success, had middle managers to witness it and chime in Marketing the results heavily via email, newsletter, monthly reports Convinced people a lot about value of UX – voice of customer being important and how it could save money