Presentation for Academic Publishing in Europe 9 (APE2014)

1. Altmetrics:
building a broader picture of
impact
Paul Groth @pgroth
Web & Media Group
Department of Computer Science
The Network Institute
VU University Amsterdam
http://www.few.vu.nl/~pgroth
#APE2014

3. Research Project Grants
Applications, awards, and success rates
NIH Data Book – (http://report.nih.gov/ndb/index.aspx)
Data provided by the Division of Information Services, Reporting Branch

4. "Outside letters basically trump
everything," says Robert Simoni,
chairman of the biology
department at Stanford University
in California.
Metrics: Do metrics matter?
Nature 2010
http://doi.org/10.1038/465860a

6. ―Imagine how the academic appointment process
might change if search and review committees had
access—within an appropriately tagged or linked
online CV, for example, or via the ORCID system—
to information about the specific contributions
made by a candidate to each of his/her works,
including contributions that might not otherwise have
qualified for ‗authorship‘ status?‖
Point of view: Faculty appointments and the record of
scholarship
Amy Brand
http://dx.doi.org/10.7554/eLife.00452

7. Point of view: Faculty appointments and the record of scholarship
Amy Brand
http://dx.doi.org/10.7554/eLife.00452
Opportunities
• Individuals and institutions need better tools
for curating and networking their own record
of scholarship
• Institutions need more information about
scholarly contribution
• ALMs that reliably differentiate sources of
input (general; academic; expert; etc.) would
be more useful‖
Slide 3: http://article-level-metrics.plos.org/files/2013/10/Brand.pptx

8. ENTER ALTMETRICS

9. Altmetrics is the study and use of scholarly
impact measures based on activity in online
tools and environments.
http://doi.org/10.1371/journal.pone.0048753

10. http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest

11. Thanks Ian Mulvany

14. ALTMETRICS AS MEASURES
OF IMPACT?

15. ―It took approximately a generation (20
years) for bibliographic citation analysis to
achieve acceptability as a measure of
academic impact."
(Vaughan and Shaw,
2003)

16. (Birkholtz et al. 2013)
(Fausto et al 2012)
http://jasonpriem.org/self-archived/5uni-poster.png
The Research is Happening
http://ploscollections.org/altmetrics
http://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.html

17. http://www.cwts.nl/pdf/CWTS-WP-2013-003.pdf

18. http://www.slideshare.net/paulwouters1/issi2013-wg-pw

19. Bottom Line: use altmetrics as
evidence in a larger story

20. Examples

23. Published AND discussed AND cited
23

24. 24

28. Summary: a broader view
• Different research artifacts
– papers, preprints, slides, videos, code, data
• Different measures
– usage, mentions, views, sharing
• Different stories
– progress so far, workshop impact, outreach

29. Conclusion
• Altmetrics is still developing
– But useful today
• Allows to build a broader picture of impact
– Using a variety of Artifacts & Measures
• Final thought: research artifacts exist in a
network, we‘re starting to connect it

30. Thanks
Collaborators: Peter van den Besselaar, Julie
Birkholz, Frank van Harmelen, Shenghui Wang,
Rinke Hoekstra, Thomas Gurney, Mike Taylor,
Anita de Waard, Jason Priem, Dario Taraborelli,
Cameron Neylon, Ian Mulvany