1. LINKED JAZZ
52ND STREET:
A LOD Crowdsourcing Tool To Reveal
Connections Among Jazz Artists
Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen
Pratt Institute, New York, NY
Digital Humanities 2013 Ÿ Lincoln, Nebraska Ÿ July 17, 2013

2. THE LINKED JAZZ PROJECT
• Linked Open Data technology applied to digital
archives of jazz history
• Goal: To reveal the network of relationships among
the jazz artists as described in primary sources.
2Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute

3. 3Cristina Pattuelli | Pratt Institute

4. WHY CROWDSOURCING?
Automated techniques used to
generate a social network.
However, only humans can
reliably identify the nature of
the personal and professional
relationships between people.
4Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
Automation + human curation

5. LINKED JAZZ 52ND STREET
5
Landing page (http://linkedjazz.org/52ndStreet/)

6. LINKED JAZZ 52ND STREET
6
Task interface

7. DESIGNING A CROWDSOURCING TOOL
• Best practices for crowdsourcing design are scarce
• Methodology: survey of existing tools and literature
• Major considerations:
• Recruiting participants
• Retaining participants
• Quality control of the data collected
7Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute

8. DESIGNING A CROWDSOURCING TOOL
• Recruiting participants
• Retaining participants
8Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
Understanding what
motivates people to
participate in
crowdsourcing

9. LINKED JAZZ 52ND STREET
9Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
Landing page (http://linkedjazz.org/52ndStreet/)

10. 10
4-step introduction

11. 11Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute

12. 12
Available interview
transcripts

13. Progress bar
Ego network

14. USABILITY TESTING
Usability tests conducted with Dr. Craig MacDonald at Pratt Institute
• Took 30-45 minutes to complete.
• Participants: 10
• 2 team members present, also recorded.
• Evaluation criteria:
• Participants’ experience using the website
• Website’s design & functionality
• Participants’ level of engagement
• Pre-test questionnaire, 3 tasks, post-test questionnaire
14Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute

15. RESULTS
Overall participants had
a positive experience
with the website; likely to
visit the website again.
Website was found to be visually
appealing.
Participants did not always fully
understand their contributions to the
larger project.
Participants were not fully engaged with
the tool while using it. 15

16. PLANNED IMPROVEMENTS
16Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute

17. Add checkmarks to musician icons when
all relationships have been assigned
17
à Provide visual and textual indicators to give users more feedback
on task progress.
Track analysis progress on each
snippet
17

18. 18
à Arrange musicians alphabetically.

19. Individual and collaborative
contributions
à Connect users with the community more effectively. 19

20. FUTURE WORK
Iterative assessment process:
1. Interface Usability
2. Content and Functionality with domain experts
3. Performance and Data quality.
Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute 20

21. THANK YOU
Our Team:
Matt Miller
Lea Lange
Hilary Thorsen
Sean Fitzell
Carolyn Li-Madeo
Special thanks to:
Dr. Craig MacDonald and
the Pratt SILS UX Team
Contact:
CRISTINA PATTUELLI
MPATTUEL@PRATT.EDU