Tom Edmonds spoke during the 'Measuring impact and quality' stream at the CILIP ARLG '12 on 'Measuring the use of online resources'.
Thank you to Graham Stone and Dave Pattern at the University of Huddersfield for the use of their slides in this presentation. http://library.hud.ac.uk/blogs/projects/lidp/
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
CILIP ARLG '12: Measuring impact and quality
1. Measuring impact and quality
Workshop: Measuring the use of online resources
Tom Edmonds
OpenAthens Product Manager
2. Maximising the ROI for library budgets
• Lightening demo!
• Where does your library budget go?
• What challenges do you face?
• Some solutions
• YOU
• Case studies
3. Eduserv - OpenAthens
1994 2000 2008 2009 2010 2011 Today…
• Athens • Athens • Athens • 33% of the • US • US Navy • > 4,000
developed & adopted by became Australian Department of Medicine customers
first web NHS England OpenAthens healthcare Veteran Information use
service in the UK market adopts Affairs adopts Systems OpenAthens
launched OpenAthens OpenAthens Support • > 4 million
- SAH Agency users
- DoH Victoria adopts worldwide
OpenAthens
www.eduserv.org.uk
[Lightning demo]
7. Where does your library budget go?
Resources
Personnel
Buildings
Other
www.eduserv.org.uk
8. Where does your library budget go?
23%
13%
Resources
Personnel
25% 39% Buildings
Other
www.eduserv.org.uk
Source: commercial research company
9. Where does your resources budget go?
e-Journals
68%
Online databases
2% Print
2%
Magazines & newspapers
10% Books
3%
15% e-Books
www.eduserv.org.uk
Source: commercial research company
10. Where does your e-resources budget go?
www.eduserv.org.uk
Source: Bath Spa University (2010)
11. JISC Activity data programme
Looking for the link between library usage and student
attainment
“There is a statistically significant correlation across a number of
universities between library activity data and student attainment”
- thank you to the JISC & Huddersfield University
www.eduserv.org.uk
19. Challenges…
• Budgets
• Suppliers
• Technologies
• IP address management
• Authentication steps for both the library and publisher
• User ID setups
• A to Z list management
• OpenURL management
• Licence compliance policy management
• Support: troubleshooting, downtime, usage monitoring, training etc.
www.eduserv.org.uk
29. The “Path of least resistance”
“...an information [seeker] will
tend to use the most convenient
search method, in the least
exacting mode available.
Information seeking behaviour
stops as soon as minimally
acceptable results are found.”
Source: http://en.wikipedia.org/wiki/
www.eduserv.org.uk
30. Principle of Least Effort
“...numerous studies have shown users
are often willing to sacrifice information
quality for accessibility. This fast food
approach to information consumption
drives librarians crazy. ‘Our information
is healthier and tastes better too’ they
shout.”
- Peter Morville (“Ambient Findability”, 2005)
www.eduserv.org.uk
30
33. Social media
“I found out all my students were looking
at material in the VLE but going straight
to Facebook to use the discussion tools
and discuss the material and the
lectures. I thought I might as well join
them and ask them questions in their
preferred space.”
- What is Web 2.0? Ideas, technologies and implications
for education. Paul Anderson. A JISC report
www.eduserv.org.uk
39. Small UK HE institution
Objectives: to implement Shibboleth
reduce burden of administering access
increase use of electronic resources
Constraints: no IT resource
Solution: implement a local authentication
solution.
www.eduserv.org.uk
41. Small UK HE institution – one year on…
• No access queries
• Handful of Athens queries!
• Integration with Google Docs
• Gmail access for post-graduates
• Increased resource usage
• 20,000 more sessions in 2010/11.
www.eduserv.org.uk
42. Small UK HE institution – number of logins
Year/
January February March
Month
No. % No. % No. %
2009 16,460 8,247 13,860
2010 18,198 11 11,345 37 21,276 54
2011 22,930 39 27,359 232 27,446 98
www.eduserv.org.uk
44. Commercial research library
Objectives: to simplify working in a fluid environment
manage changing need for information
Constraints: fixed (if not falling) budget
Solution: re-negotiate licences
integrate library services.
www.eduserv.org.uk
45. User behaviour:
Copied in the library
Borrowed
Downloaded
www.eduserv.org.uk
46. What are the consequences?
Subscription cost Number of downloads
60,000 6,000
50,000 5,000
40,000 4,000
30,000 3,000
20,000 2,000
10,000 1,000
- -
2007 2008 2009 2007 2008 2009
www.eduserv.org.uk
47. What are the consequences?
Cost per download
20.00
18.00
16.00
14.00
12.00
10.00
8.00
6.00
4.00
2.00
0.00
2007 2008 2009
www.eduserv.org.uk
48. Three steps to improve ROI
• Re-negotiated subscriptions
• Implemented a local identity and access management
solution (OpenAthens)
• Implemented OpenURL and A to Z list management
using TDNet.
www.eduserv.org.uk
49. Re-negotiated subscriptions
Publisher 1
• No movement on price or licencing terms
• No alternative arrangements available
• From 2010, the complete collection was replaced by a
collection of the most used titles.
www.eduserv.org.uk
50. What were the consequences?
Subscription cost Number of downloads
60,000 6,000
50,000 5,000
40,000 4,000
30,000 3,000
20,000 2,000
10,000 1,000
- -
2007 2008 2009 2010 2007 2008 2009 2010
www.eduserv.org.uk
51. What were the consequences?
Cost per download
20.00
18.00
16.00
14.00
12.00
10.00
8.00
6.00
4.00
2.00
0.00
2007 2008 2009 2010
www.eduserv.org.uk
52. The impact: publisher 1
• End users have less access
• Library service is curtailed
• Publisher loses income.
www.eduserv.org.uk
53. Re-negotiated subscriptions
Publisher 2:
• 2007 ~35 journals, not much used
• 2008 cancelled most of them
• 2010 new arrangement with publisher
o download everything at a fixed price
o subscriptions commence when it is profitable.
www.eduserv.org.uk
54. What were the consequences?
Cost of subscriptions Number of downloads
80,000
6,000
70,000
60,000 5,000
50,000 4,000
40,000
3,000
30,000
2,000
20,000
1,000
10,000
- -
2007 2008 2009 2010 2007 2008 2009 2010
www.eduserv.org.uk
55. What were the consequences?
Cost per download
40.00
35.00
30.00
25.00
20.00
15.00
10.00
5.00
0.00
2007 2008 2009 2010
www.eduserv.org.uk
56. The impact: publisher 2
• End users have more access than they did 3 years ago
• The library service improves
• Publisher regains income.
www.eduserv.org.uk
57. Conclusions…
• Negotiate
• Technology solutions
• Environment
• Social media
• Traditional tools
www.eduserv.org.uk
58. Thank you for listening
Twitter: @edm0nds
Skype: tomedmonds.eduserv
Email: tom.edmonds@eduserv.org.uk
www.eduserv.org.uk