Presenting the results of the SEMLIB project: Pundit

1. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Public conference
Semantic Annotations
with Pundit
Dr. Christian Morbidoni
Semedia, Università Politecnica delle Marche, Ancona, Italy
venerdì 14 dicembre 12

2. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Role of UNIVPM in the Project
SemLib Public conference
venerdì 14 dicembre 12

3. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries WP3 objectives
• Objective: “To develop the foundational programming libraries to implement a modular
and configurable web annotation system based on Semantic Web technologies that can
be plugged into existing web application and digital libraries and that can export/import
semantic annotations from/to the Web of Data (Linked Data).”
• Deliverables:
• D3.1: Use cases and requirements.
• Partners collaboratively worked on use cases and requirements.
• D3.2: Prototype version of the Annotation System.
• A first working version of the annotation system to be tested and evaluated by
SMEs
• D3.3: Final version of the Annotation System.
• The SEMLIB release made available to SMEs for deployment
SemLib Public conference
venerdì 14 dicembre 12

4. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Linked Data and semantic annotations
SemLib Public conference
venerdì 14 dicembre 12

5. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
SemLib Public conference
venerdì 14 dicembre 12

6. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Web annotation
• Many tools to bookmark, highlight, comment web pages
• Many of them appeared in parallel with our development
• E.g. sharedcopy.com, annotateit.org, diigo.com,
clipboard.com, evernote.com
SemLib Public conference
venerdì 14 dicembre 12

7. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Web annotation
• Many tools to bookmark, highlight, comment web pages
• Many of them appeared in parallel with our development
• E.g. sharedcopy.com, annotateit.org, diigo.com,
clipboard.com, evernote.com
SemLib Public conference
venerdì 14 dicembre 12

8. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Web annotation
• Many tools to bookmark, highlight, comment web pages
• Many of them appeared in parallel with our development
• E.g. sharedcopy.com, annotateit.org, diigo.com,
clipboard.com, evernote.com
• Collaborative annotation adds a layer of knowledge to the web
SemLib Public conference
venerdì 14 dicembre 12

9. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Web annotation
• Many tools to bookmark, highlight, comment web pages
• Many of them appeared in parallel with our development
• E.g. sharedcopy.com, annotateit.org, diigo.com,
clipboard.com, evernote.com
• Collaborative annotation adds a layer of knowledge to the web
SemLib Public conference
venerdì 14 dicembre 12

10. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Web annotation
• Many tools to bookmark, highlight, comment web pages
• Many of them appeared in parallel with our development
• E.g. sharedcopy.com, annotateit.org, diigo.com,
clipboard.com, evernote.com
• Collaborative annotation adds a layer of knowledge to the web
• Annotations usually limited to simple tags and textual
comments
SemLib Public conference
venerdì 14 dicembre 12

11. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
SemLib Public conference
venerdì 14 dicembre 12

12. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Goal:
• “A web annotation tool to produce semantically structured
and reusable data: Linked Data”
SemLib Public conference
venerdì 14 dicembre 12

13. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Goal:
• “A web annotation tool to produce semantically structured
and reusable data: Linked Data”
SemLib Public conference
venerdì 14 dicembre 12

14. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries SCENARIO
• Goal:
• “A web annotation tool to produce semantically structured
and reusable data: Linked Data”
• Benefits:
• To unambiguously express semantics to be processed by
software agents
• Annotations power Digital Libraries, improving browsing,
search, automatic classification and recommendation of
content, etc.
• The reuse of such a collaborative knowledge in different
contexts and different applications. Creating ad hoc interactive
visualization and exploration apps.
SemLib Public conference
venerdì 14 dicembre 12

15. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data
2007
SemLib Public conference
venerdì 14 dicembre 12

16. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data
2008
SemLib Public conference
venerdì 14 dicembre 12

17. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data
2009
SemLib Public conference
venerdì 14 dicembre 12

18. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data
2010
SemLib Public conference
venerdì 14 dicembre 12

19. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data
2012
SemLib Public conference
venerdì 14 dicembre 12

20. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
SemLib Public conference
venerdì 14 dicembre 12

21. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Institutions
SemLib Public conference
venerdì 14 dicembre 12

22. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
SemLib Public conference
venerdì 14 dicembre 12

23. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
Geo-spatial
services
SemLib Public conference
venerdì 14 dicembre 12

24. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
Geo-spatial
services
Cultural Heritage
Libraries
SemLib Public conference
venerdì 14 dicembre 12

25. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
Geo-spatial
services
Cultural Heritage
Libraries
SemLib Public conference
venerdì 14 dicembre 12

26. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
Geo-spatial
services
Cultural Heritage
Libraries
SemLib Public conference
venerdì 14 dicembre 12

27. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
Geo-spatial
services
?
Cultural Heritage
Libraries
SemLib Public conference
venerdì 14 dicembre 12

28. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
Geo-spatial
services
?
Cultural Heritage
Libraries
SemLib Public conference
venerdì 14 dicembre 12

29. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Linked Data on the Web
Companies
Institutions
Geo-spatial
services
?
Cultural Heritage
Libraries
SemLib Public conference
venerdì 14 dicembre 12

30. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Companies
Institutions
Geo-spatial
services
?
Libraries
SemLib Public conference
venerdì 14 dicembre 12

31. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Companies
Institutions
Geo-spatial
services
?
Libraries
SemLib Public conference
venerdì 14 dicembre 12

32. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Companies
Institutions
Geo-spatial
services
?
Libraries
• Semantic Web Applications:
• Access/browse a global interconnected DB
• Merge, mix data
• Let people reuse your data in creative ways!
SemLib Public conference
venerdì 14 dicembre 12

33. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Companies
Institutions
Geo-spatial
services
?
Libraries
• Semantic Web Applications:
• Access/browse a global interconnected DB
• Merge, mix data
• Let people reuse your data in creative ways!
SemLib Public conference
venerdì 14 dicembre 12

34. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Companies
Institutions
Geo-spatial
services
?
Libraries
• Semantic Web Applications:
• Access/browse a global interconnected DB
• Merge, mix data
• Let people reuse your data in creative ways!
SemLib Public conference
venerdì 14 dicembre 12

35. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Companies
Institutions
Geo-spatial
services
?
Libraries
• Semantic Web Applications:
• Access/browse a global interconnected DB
• Merge, mix data
• Let people reuse your data in creative ways!
SemLib Public conference
venerdì 14 dicembre 12

36. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Companies
Institutions
Geo-spatial
services
?
Libraries
• Semantic Web Applications:
• Access/browse a global interconnected DB
• Merge, mix data
• Let people reuse your data in creative ways!
SemLib Public conference
venerdì 14 dicembre 12

37. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
SemLib Public conference
venerdì 14 dicembre 12

38. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
SemLib Public conference
venerdì 14 dicembre 12

39. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
SemLib Public conference
venerdì 14 dicembre 12

40. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
My Vocabulary/Ontology
- Philosophers
Nietzsche
Immanuel Kant
Socrates
….
+ Relevant Topics
God
Politics
Economy
+ Places
SemLib Public conference
venerdì 14 dicembre 12

41. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
My Vocabulary/Ontology
- Philosophers
Nietzsche
Immanuel Kant
Socrates
….
+ Relevant Topics
God
Politics
Economy
+ Places
SemLib Public conference
venerdì 14 dicembre 12

42. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
transcript
has topic
My Vocabulary/Ontology
- Philosophers
Nietzsche
Immanuel Kant
Socrates
….
+ Relevant Topics
God
Politics
Economy
+ Places
SemLib Public conference
venerdì 14 dicembre 12

43. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
criticizes
transcript quotes
has topic
My Vocabulary/Ontology
- Philosophers
Nietzsche
Immanuel Kant
Socrates
….
+ Relevant Topics
God
Politics
Economy
+ Places
SemLib Public conference
venerdì 14 dicembre 12

44. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
criticizes
transcript quotes
cites
has topic
My Vocabulary/Ontology
- Philosophers
Nietzsche
Immanuel Kant
Socrates
….
+ Relevant Topics
God
Politics
Economy
+ Places
SemLib Public conference
venerdì 14 dicembre 12

45. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
criticizes
transcript quotes
cites
has topic
My Vocabulary/Ontology
- Philosophers
Nietzsche
Immanuel Kant see also
Socrates
….
+ Relevant Topics
depicts
God
Politics
Economy
+ Places
SemLib Public conference
venerdì 14 dicembre 12

46. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Knowledge Graph
criticizes
transcript quotes
cites
has topic birth place
My Vocabulary/Ontology
influenced
- Philosophers
Nietzsche
Königsberg
Immanuel Kant see also
Socrates
….
+ Relevant Topics
depicts
God Max Weber
Politics
Economy
+ Places
birth place
Erfurt
SemLib Public conference
venerdì 14 dicembre 12

47. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
The Pundit Annotation system
SemLib Public conference
venerdì 14 dicembre 12

48. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries RDF Data model
Based on the Open Annotation Data Model
SemLib Public conference
venerdì 14 dicembre 12

49. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries RDF Data model
An annotation has a creator,
a date and other basic metadata
SemLib Public conference
venerdì 14 dicembre 12

50. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries RDF Data model
An annotation is attached to web resources,
as text excerpt in a page or (polygonal) regions
over an image
SemLib Public conference
venerdì 14 dicembre 12

51. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries RDF Data model
Annotations contains
semantic statements representing
the knowledge expressed by a user at a given time
E.g.
a text - cites - an author
an image - depicts - a place
a text - agrees with - an other text
a text - defines - a concept
SemLib Public conference
venerdì 14 dicembre 12

52. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Architecture
SemLib Annotation Server
Triplestore
Application Logic
RESTful API
SemLib Read/write public API calls
Annotation Client annotations Other web (and non web)
application
public or
SMEs ad-hoc API calls
digital archives
Web Browser
SemLib
Recommender System
Creates/explores annotations
while surfing the web
User
SemLib Public conference
venerdì 14 dicembre 12

53. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Architecture
Integrate by: SemLib Annotation Server
- Including js library in
web pages
Triplestore
- ... or dynamically load via
bookmarklet
Application Logic
RESTful API
SemLib Read/write public API calls
Annotation Client annotations Other web (and non web)
application
public or
SMEs ad-hoc API calls
digital archives
Web Browser
SemLib
Recommender System
Creates/explores annotations
while surfing the web
User
SemLib Public conference
venerdì 14 dicembre 12

54. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Architecture
Integrate by: SemLib Annotation Server
- Including js library in
web pages
Triplestore
- ... or dynamically load via
bookmarklet
Application Logic
RESTful API
SemLib Read/write public API calls
Annotation Client annotations Other web (and non web)
application
public or
SMEs ad-hoc API calls
digital archives
Web Browser
SemLib
Recommender System
Creates/explores annotations
while surfing the web
The recommender
fetches data via standard
SPARQL endpoint
User
SemLib Public conference
venerdì 14 dicembre 12

55. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Docs and demo: http://thepund.it
SemLib Public conference
venerdì 14 dicembre 12

56. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Users
• Users: OpenID
• google, facebook
• your own!
• No anonymous
annotations.
SemLib Public conference
venerdì 14 dicembre 12

57. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Users
• Users: OpenID
• google, facebook
• your own!
• No anonymous
annotations.
SemLib Public conference
venerdì 14 dicembre 12

58. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Notebooks
• Collect annotations into Notebooks
• private or public
• share with others
SemLib Public conference
venerdì 14 dicembre 12

59. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Notebooks
• Collect annotations into Notebooks
• private or public
• share with others
SemLib Public conference
venerdì 14 dicembre 12

60. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Media Fragments annotation
Fine granular annotations:
select precise fragments of texts or images
SemLib Public conference
venerdì 14 dicembre 12

61. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Selecting items
SemLib Public conference
venerdì 14 dicembre 12

62. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Triple composer
SemLib Public conference
venerdì 14 dicembre 12

63. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Triple composer
SemLib Public conference
venerdì 14 dicembre 12

64. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Triple composer
SemLib Public conference
venerdì 14 dicembre 12

65. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Triple composer
SemLib Public conference
venerdì 14 dicembre 12

66. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Triple composer
SemLib Public conference
venerdì 14 dicembre 12

67. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Custom vocabularies
Different communities need
different terms and relations
Plugin taxonomies and relation sets
linking simple JSON files
SemLib Public conference
venerdì 14 dicembre 12

68. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries Entity extraction
SemLib Public conference
venerdì 14 dicembre 12

69. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries The bookmarklet
• Bookmarklet version
• A clipping tool to annotate every pages
• No installation requirements
SemLib Public conference
venerdì 14 dicembre 12

70. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries The bookmarklet
SemLib Public conference
venerdì 14 dicembre 12

71. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
REST APIs to create and consume annotations
SemLib Public conference
venerdì 14 dicembre 12

72. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries REST API
• Annotation and authoring APIs
• APIs supports RDF/XML, RDF/JSON and N3 formats
• Examples:
• GET /annotations/search?query={http://example.com/doc1.html}
Gets the contexts of all the annotations referring to the specified
resource (or a part of it, e.g. a DOM fragment XPointer)
• GET /notebooks/21345/graph
Returns an RDF graph that merges all the annotation’s graphs included
in the notebook
• POST /notebooks/21345 with payload RDF
Creates a new annotations with the given triples as graph (context is
added at server side)
SemLib Public conference
venerdì 14 dicembre 12

73. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
• Users and permissions management APIs
• Login using OpenID
• No secret data (e.g. user passwords and credentials) need to be
managed
• Clients can access APIs by supporting standard HTTP redirect
• Users can login with existing accounts (e.g. Google Account)
• Public APIs
• Expose data only from public users notebooks!
• SPARQL endpoints
• Query one or more notebooks as a single RDF graph
SemLib Public conference
venerdì 14 dicembre 12

74. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
SMEs are already experimenting with such
APIs and producing interesting apps
SemLib Public conference
venerdì 14 dicembre 12

75. SEMLIB PROJECT
Semantic Web Tools for Digital Libraries
Thank you.
venerdì 14 dicembre 12