1. SOLRpac Usability Test Results Analysis
Question 1:
You need to read The Sound and the Fury by William Faulkner for a literature course and you
don't want to buy the book. Does the library own it and is it available in King Library?
Completed: 14
Not completed: 0
Average time: 32 seconds
Methods Utilized:
Title search: 12, 75%
Keyword search: 3, 19%
Author search: 1, 6%
Comments:
concern that King library was lower on the list than Hamilton and others
should have done a title search
quot;this one is easier to readquot; - comparing the item location display with classic view
Question 1a:
Where is it located?
Completed: 14
Not completed: 0
Average time: 5 seconds
Methods Utilized:
Browse page: 14, 100%
Comments:
didn't scroll down to see if it was available from other libraries
Question 1b:
You want to go get the book but there's no paper around to write down the location. The
system has a feature that texts book and location information to your cell phone. How
would you do that?

2. Completed: 13
Not completed: 1
Average time: 15 seconds
Methods Utilized:
Browse page: 12; 86%
Advanced search options: 1; 7%
Request item: 1, 7%
Comments:
quot;that's really good. I hate when I write it down and later I look at it and say I don't know
what this is..quot;
quot;Hm. Very cool.quot;
quot;That is really nice, I could definitely see a lot of use for that.quot;
quot;I really like that a lotquot;
quot;Super usefulquot;
quot;This would be the last thing I would attempt to do.quot;
Question 2:
You need to get some other novels written by William Faulkner, author of The Sound and the
Fury. Show me how you would do that.
Completed: 13
Not completed: 1
Average time: 1:06 minutes
Methods Utilized:
Author search: 9; 64%
Keyword search: 2; 14%
Incorrect use of facets: 2; 14%
Author link: 1; 7%
Comments:
she thought there was a better way to do search but couldn't figure it out - 1-03
quot;okay, not clickablequot; referring to author's name
quot;there's no a start over, is there?quot;
quot;it'd be really nice if i could just click his name.quot;
quot;there might be an author thing here...i guess notquot; - referring to facets sidebar
Question 2a:

3. After you've found some books, you want to save them somehow so you can get back to
them easily. Tag the items quot;ENG 142quot; so you can find them later.
Completed: 13
Not completed: 1
Average time: 22 seconds
Methods Utilized:
Browse page: 13; 100%
Comments:
didn't notice button status change...
didn't understand question / didn't understand concept of tagging
quot;oh...that's really cool too.quot;
Question 3:
This literature course requires you to write a paper about Faulkner and his writings. You
need to find some books written about William Faulkner. How would you do that?
Completed: 11
Not completed: 1
Average time: 28 seconds
Methods Utilized:
Subject search: 11; 92%
Keyword search: 1; 8 %
Comments:
with reference to facet: quot;very fancyquot;
user said they'd like to see a description of item...such as an abstract..
liked the google books link
quot;is there a search within results?quot;
used google books link
Question 3a:
Can you find books in this set of results that are about quot;Yoknapatawpha Countyquot;?
Completed: 10
Not completed: 4
Average time: 1:13 minutes

4. Methods Utilized:
Advanced search options: 10; 48%
Correct use of facets: 6; 29%
Keyword search: 3; 14%
Subject search: 1; 5%
Ctrl-f: 1; 5%
Comments:
quot;there should be a way to search within thisquot;
quot;is there a way to search through these resultsquot;
quot;is there a search within results?quot;
quot;i don't know how you would do that..search within the search.quot;
Question 4:
You are writing a paper on aspects of economic recessions for an Econonomics course. Can
you find some available books on this subject?
Completed: 14
Not completed: 0
Average time: 45 seconds
Methods Utilized:
Keyword search: 8; 50%
Subject search: 8; 50%
Comments:
User said they are used to a quot;start overquot; link
Question 4a:
Where are they located?
Completed: 14
Not completed: 0
Average time: 5 seconds
Methods Utilized:
Browse record: 14; 100%
Comments:

5. -
Question 4b:
You need to compile a bibliography for the paper. Can you export one of the books to your
RefWorks account?
Completed: 12
Not completed: 0
Average time: 19 seconds
Methods Utilized:
Browse record: 12; 100%
Comments:
don't have refworks account
Question 4c:
If you don't have a RefWorks account, can you figure out how to get the citation for your
bibliography?
Completed: 11
Not completed: 2
Average time: 15 seconds
Methods Utilized:
Browse record: 10; 91%
Mark this record: 1; 9%
Comments:
quot;if i don't have it then usually i use some other citation machinequot;
quot;like this a lotquot;
user said would just do it the traditional way typically
quot;that's pretty sweet.quot;
Question 5:
You are taking a history course and your instructor wants you to read articles from his
favorite journal, The Public Historian. Does the library own this journal?

6. Completed: 13
Not completed: 1
Average time: 43 seconds
Methods Utilized:
Title search: 12; 42%
Keyword search: 4; 14%
Advanced search options: 5; 18%
Looked for journal title option: 7; 25%
Comments:
looking for quot;journal titlequot; in drop box
quot;that's pretty coolquot; referring to browse by format
Question 5a:
Where is it located?
Completed: 13
Not completed: 1
Average time: 5 seconds
Methods Utilized:
Browse record: 13; 100%
Comments:
didn't know what quot;king perquot; meant
Question 6:
You're taking a high level French course which requires you to read and report on any
fiction book written in French. How would you find this item?
Completed: 11
Not completed: 3
Average time: 1:26 minutes
Methods Utilized:
Browse and facets: 6; 35%
quot;french fictionquot; keyword search: 4; 23%

7. quot;french fictionquot; subject search: 4; 23%
Search and facets: 2; 12%
french keyword search: 1; 6%
Comments:
quot;usually i just walk over to sectionquot;
quot;this one has me stumpedquot;