SlideShare a Scribd company logo
1 of 33
Scraping Toward A Giant EduGraph Patrick Murray-John ACCS 2009 Charlottesville, VA March 11, 2009
Semantic UMW
A Sad Story . . .  CHEMISTRY 101
CHEMISTRY 101
CHEMISTRY 101 ENGLISH 205
YOUR DATA!! SHALL NOT!! PASS!!  CHEMISTRY 101 ENGLISH 205
Here's the part that makes me cry Flickr image by Addrox  CC-BY-NC-ND
UNIVERSITY BOOKSTORE BOOKSTORE ORDER: CHEMISTRY 101 BOOKSTORE ORDER: ENGLISH 205
UNIVERSITY BOOKSTORE BOOKSTORE ORDER: CHEMISTRY 101 BOOKSTORE ORDER: ENGLISH 205
UNIVERSITY BOOKSTORE HELP ME!
Here's the part that makes me cry AGAIN
DEPARTMENT CHAIR SYLLABUS: CHEMISTRY 101 SYLLABUS: ENGLISH 205
Why am I crying? Flickr photo by ifindkarma CC-BY Flickr photo by manu contreras CC-BY
Instead. . .  Focus on the  data , not the document, and links can go anywhere Leana daProf Alice daStudent Chem101 Course Blog CHEMISTRY 101 Thank you!
A Giant EduGraph Giant Global Graph Semantic Web  (aka Giant Global Graph) Linked Open Data Aggregating / Exposing Higher Education Info
Courses Course Groups Institutions / Divisions Online Spaces Places Events / Lectures Library / Book Data Clubs / Organizations Requirements / Credentials  Flickr photo by smannion CC-BY-NC-SA Image from Wikipedia GNU-FDL
Semantic Web Identify things with a URI (a node in a graph) Frankenstein (URI)
Semantic Web Data is Nodes + Relationships between them CHEMISTRY101  S09-Group (URI) Frankenstein (URI) Alice daStudent (URI) Studies text Member
Linked Open Data Semantic Web + some technical goodies Open on web
Linked Open Data Flickr image by R é gis Gaidot CC-BY-NC
What Will It Look Like? Taps into LOD Cloud DBpedia references for topics, people events, etc. GeoNames for places, buildings, etc. OpenLibrary for book info Domain-specific sources (MusicBrainz, Linked Movie Database, more)
What Will It Look Like? Uses existing vocabularies • SIOC - Semantically Interlinked Online Communities  • FOAF - Friend Of A Friend • DCTERMS - Dublin Core • BIBO - Bibliographic Info • AIISO - Academic Institution Internal Structure Ontology . . . and more, plus some being developed
Where Will The Data Come From? Scrape existing structured data Courses and Course Groups Places People Requirements & Credentials
Where Will The Data Come From? Zotero (actually Bruce D'Arcus' ) likely to expose SW-friendly data in the future
Where Will The Data Come From? -- 13 years worth of circulation data anonymized and published as XML -- took about 3 days to RDFize it and make an Exhibit Follow lead of Univ. of Huddersfield
Where Will The Data Come From? Talis  Project Xiphos -- Putting UK university reading lists into RDF
Where Will The Data Come From? Need an easy interface to relate course group data to LOD data  (lookup.dbpedia.org) . . . and to relate people and course groups with online spaces . . . and to add data that isn't otherwise available
 
 
 
 
Biggest Challenge
Biggest Challenge OPENNESS

More Related Content

What's hot

Brian Harris 4767 ELA Presentation
Brian Harris 4767 ELA PresentationBrian Harris 4767 ELA Presentation
Brian Harris 4767 ELA Presentationbharris004
 
Libraries empowering scholars (and scholarly communication) through #altmetrics
Libraries empowering scholars (and scholarly communication) through #altmetricsLibraries empowering scholars (and scholarly communication) through #altmetrics
Libraries empowering scholars (and scholarly communication) through #altmetricsHeather Piwowar
 
a future where data citation Counts
a future where data citation Countsa future where data citation Counts
a future where data citation CountsHeather Piwowar
 
Experimenting with Experimental Ethics
Experimenting with Experimental EthicsExperimenting with Experimental Ethics
Experimenting with Experimental EthicsAdrian Howard
 
Experimenting with the Ethics of Experimentation, Spark the Change 2015
Experimenting with the Ethics of Experimentation, Spark the Change 2015Experimenting with the Ethics of Experimentation, Spark the Change 2015
Experimenting with the Ethics of Experimentation, Spark the Change 2015Adrian Howard
 
Disease and Communities
Disease and CommunitiesDisease and Communities
Disease and Communities16rang
 
Building Skyscrapers with our Scholarship
Building Skyscrapers with our ScholarshipBuilding Skyscrapers with our Scholarship
Building Skyscrapers with our ScholarshipHeather Piwowar
 
Math & Beauty 3: Fractals
Math & Beauty 3: FractalsMath & Beauty 3: Fractals
Math & Beauty 3: FractalsAlbert Wenger
 
The biggest threat to science today: the scholarly publishing system
The biggest threat to science today: the scholarly publishing systemThe biggest threat to science today: the scholarly publishing system
The biggest threat to science today: the scholarly publishing systemBjörn Brembs
 
St. basil cathedral
St. basil cathedral St. basil cathedral
St. basil cathedral Sara Huffman
 
Lean personas: discover your real customers
Lean personas: discover your real customersLean personas: discover your real customers
Lean personas: discover your real customersAdrian Howard
 
From research life cycle to networks: The role of the library
From research life cycle to networks: The role of the libraryFrom research life cycle to networks: The role of the library
From research life cycle to networks: The role of the libraryCameron Neylon
 
Bad Scholarship Fall 2018
Bad Scholarship Fall 2018Bad Scholarship Fall 2018
Bad Scholarship Fall 2018Gradlib
 
Growing Innovators: How Our Schools Will Make the Great Minds of Tomorrow
Growing Innovators: How Our Schools Will Make the Great Minds of TomorrowGrowing Innovators: How Our Schools Will Make the Great Minds of Tomorrow
Growing Innovators: How Our Schools Will Make the Great Minds of TomorrowRandy Rodgers
 
Restarting the Enterprise (or why innovation teams suck)
Restarting the Enterprise (or why innovation teams suck)Restarting the Enterprise (or why innovation teams suck)
Restarting the Enterprise (or why innovation teams suck)Adrian Howard
 

What's hot (20)

Brian Harris 4767 ELA Presentation
Brian Harris 4767 ELA PresentationBrian Harris 4767 ELA Presentation
Brian Harris 4767 ELA Presentation
 
Libraries empowering scholars (and scholarly communication) through #altmetrics
Libraries empowering scholars (and scholarly communication) through #altmetricsLibraries empowering scholars (and scholarly communication) through #altmetrics
Libraries empowering scholars (and scholarly communication) through #altmetrics
 
a future where data citation Counts
a future where data citation Countsa future where data citation Counts
a future where data citation Counts
 
Experimenting with Experimental Ethics
Experimenting with Experimental EthicsExperimenting with Experimental Ethics
Experimenting with Experimental Ethics
 
Experimenting with the Ethics of Experimentation, Spark the Change 2015
Experimenting with the Ethics of Experimentation, Spark the Change 2015Experimenting with the Ethics of Experimentation, Spark the Change 2015
Experimenting with the Ethics of Experimentation, Spark the Change 2015
 
Disease and Communities
Disease and CommunitiesDisease and Communities
Disease and Communities
 
Power point design
Power point designPower point design
Power point design
 
Building Skyscrapers with our Scholarship
Building Skyscrapers with our ScholarshipBuilding Skyscrapers with our Scholarship
Building Skyscrapers with our Scholarship
 
Lean Persona
Lean PersonaLean Persona
Lean Persona
 
Math & Beauty 3: Fractals
Math & Beauty 3: FractalsMath & Beauty 3: Fractals
Math & Beauty 3: Fractals
 
The biggest threat to science today: the scholarly publishing system
The biggest threat to science today: the scholarly publishing systemThe biggest threat to science today: the scholarly publishing system
The biggest threat to science today: the scholarly publishing system
 
Giant Edu Graph
Giant Edu GraphGiant Edu Graph
Giant Edu Graph
 
St. basil cathedral
St. basil cathedral St. basil cathedral
St. basil cathedral
 
Lean personas: discover your real customers
Lean personas: discover your real customersLean personas: discover your real customers
Lean personas: discover your real customers
 
From research life cycle to networks: The role of the library
From research life cycle to networks: The role of the libraryFrom research life cycle to networks: The role of the library
From research life cycle to networks: The role of the library
 
Iterative persona
Iterative personaIterative persona
Iterative persona
 
Bad Scholarship Fall 2018
Bad Scholarship Fall 2018Bad Scholarship Fall 2018
Bad Scholarship Fall 2018
 
Growing Innovators: How Our Schools Will Make the Great Minds of Tomorrow
Growing Innovators: How Our Schools Will Make the Great Minds of TomorrowGrowing Innovators: How Our Schools Will Make the Great Minds of Tomorrow
Growing Innovators: How Our Schools Will Make the Great Minds of Tomorrow
 
Restarting the Enterprise (or why innovation teams suck)
Restarting the Enterprise (or why innovation teams suck)Restarting the Enterprise (or why innovation teams suck)
Restarting the Enterprise (or why innovation teams suck)
 
Jia lu
Jia luJia lu
Jia lu
 

Viewers also liked

The Reformation
The ReformationThe Reformation
The ReformationMrLudwin
 
The Reformation
The  ReformationThe  Reformation
The ReformationMrLudwin
 
R.I.S.E Competition Presentation
R.I.S.E Competition PresentationR.I.S.E Competition Presentation
R.I.S.E Competition Presentationzfashola
 
Market Research
Market ResearchMarket Research
Market Researchzfashola
 
PR Family Promise Slideshow
PR Family Promise SlideshowPR Family Promise Slideshow
PR Family Promise Slideshowjenhoch20
 
Manual de Instalacion de Colummna Queen DISPRO SAS 2013
Manual de Instalacion de Colummna Queen DISPRO SAS 2013Manual de Instalacion de Colummna Queen DISPRO SAS 2013
Manual de Instalacion de Colummna Queen DISPRO SAS 2013myself11c
 
Instructional Design Challenges -- GMU-CODE Academy
Instructional Design Challenges -- GMU-CODE AcademyInstructional Design Challenges -- GMU-CODE Academy
Instructional Design Challenges -- GMU-CODE AcademyPatrick Murray-John
 
New role of universities
New role of universitiesNew role of universities
New role of universitiesBoriss Misnevs
 
The Renaissance
The RenaissanceThe Renaissance
The RenaissanceMrLudwin
 
The Reformation Vocab
The Reformation VocabThe Reformation Vocab
The Reformation VocabMrLudwin
 
Feudalism In Japan
Feudalism In JapanFeudalism In Japan
Feudalism In JapanMrLudwin
 
David Slideshow
David SlideshowDavid Slideshow
David Slideshowshafferd
 
Film genres
Film genresFilm genres
Film genresMrLudwin
 

Viewers also liked (19)

Us museums vhc
Us museums vhcUs museums vhc
Us museums vhc
 
The Reformation
The ReformationThe Reformation
The Reformation
 
The Reformation
The  ReformationThe  Reformation
The Reformation
 
R.I.S.E Competition Presentation
R.I.S.E Competition PresentationR.I.S.E Competition Presentation
R.I.S.E Competition Presentation
 
Executive Education
Executive EducationExecutive Education
Executive Education
 
Market Research
Market ResearchMarket Research
Market Research
 
PR Family Promise Slideshow
PR Family Promise SlideshowPR Family Promise Slideshow
PR Family Promise Slideshow
 
Manual de Instalacion de Colummna Queen DISPRO SAS 2013
Manual de Instalacion de Colummna Queen DISPRO SAS 2013Manual de Instalacion de Colummna Queen DISPRO SAS 2013
Manual de Instalacion de Colummna Queen DISPRO SAS 2013
 
Instructional Design Challenges -- GMU-CODE Academy
Instructional Design Challenges -- GMU-CODE AcademyInstructional Design Challenges -- GMU-CODE Academy
Instructional Design Challenges -- GMU-CODE Academy
 
Christmas
ChristmasChristmas
Christmas
 
New role of universities
New role of universitiesNew role of universities
New role of universities
 
Business School
Business SchoolBusiness School
Business School
 
Coaching Solutions
Coaching SolutionsCoaching Solutions
Coaching Solutions
 
The Renaissance
The RenaissanceThe Renaissance
The Renaissance
 
The Reformation Vocab
The Reformation VocabThe Reformation Vocab
The Reformation Vocab
 
Feudalism In Japan
Feudalism In JapanFeudalism In Japan
Feudalism In Japan
 
David Slideshow
David SlideshowDavid Slideshow
David Slideshow
 
Film genres
Film genresFilm genres
Film genres
 
Omeka S Intro for DPLA fest
Omeka S Intro for DPLA festOmeka S Intro for DPLA fest
Omeka S Intro for DPLA fest
 

Similar to Building a Giant EduGraph by Scraping and Linking Educational Data

Linked Open Data for Archives
Linked Open Data for ArchivesLinked Open Data for Archives
Linked Open Data for ArchivesCliff Landis
 
Radically Open at the National Archives
Radically Open at the National ArchivesRadically Open at the National Archives
Radically Open at the National ArchivesJon Voss
 
Linked Data, Cultural Heritage & the Karma Mapping Software
Linked Data, Cultural Heritage & the Karma Mapping SoftwareLinked Data, Cultural Heritage & the Karma Mapping Software
Linked Data, Cultural Heritage & the Karma Mapping SoftwarePedro Szekely
 
RBMS LODLAM presentation
RBMS LODLAM presentationRBMS LODLAM presentation
RBMS LODLAM presentationJon Voss
 
From LookBackMaps to Linked Open Data
From LookBackMaps to Linked Open DataFrom LookBackMaps to Linked Open Data
From LookBackMaps to Linked Open DataJon Voss
 
An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)Cliff Landis
 
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & MuseumsALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & MuseumsJon Voss
 
Linked data as a library data platform
Linked data as a library data platformLinked data as a library data platform
Linked data as a library data platformJindřich Mynarz
 
QR Codes and Augmented Reality Help Libraries Extend Services
QR Codes and Augmented Reality Help LibrariesExtend Services QR Codes and Augmented Reality Help LibrariesExtend Services
QR Codes and Augmented Reality Help Libraries Extend Services Rachel Vacek
 
Using flickr for photo management - UCDA
Using flickr for photo management - UCDAUsing flickr for photo management - UCDA
Using flickr for photo management - UCDAcindifarmer
 
Preparing for the Impact of Web 3.0
Preparing for the Impact of Web 3.0 Preparing for the Impact of Web 3.0
Preparing for the Impact of Web 3.0 Judy O'Connell
 
The Year of Blogging Dangerously
The Year of Blogging DangerouslyThe Year of Blogging Dangerously
The Year of Blogging DangerouslyDuncan Hull
 
Science communication in practice
Science communication in practiceScience communication in practice
Science communication in practicePer Olof Arnäs
 
What happened to the Semantic Web?
What happened to the Semantic Web?What happened to the Semantic Web?
What happened to the Semantic Web?Peter Mika
 
Defrosting the Digital Library: A survey of bibliographic tools for the next ...
Defrosting the Digital Library: A survey of bibliographic tools for the next ...Defrosting the Digital Library: A survey of bibliographic tools for the next ...
Defrosting the Digital Library: A survey of bibliographic tools for the next ...Duncan Hull
 
Intro to Linked Open Data in Libraries Archives & Museums.
Intro to Linked Open Data in Libraries Archives & Museums.Intro to Linked Open Data in Libraries Archives & Museums.
Intro to Linked Open Data in Libraries Archives & Museums.Jon Voss
 
WTF is Semantic Web?
WTF is Semantic Web?WTF is Semantic Web?
WTF is Semantic Web?milesw
 
Cinf flash v2 final
Cinf flash v2 finalCinf flash v2 final
Cinf flash v2 finalSean Ekins
 
Linked Open Data in Libraries, Archives & Museums
Linked Open Data in Libraries, Archives & MuseumsLinked Open Data in Libraries, Archives & Museums
Linked Open Data in Libraries, Archives & MuseumsJon Voss
 

Similar to Building a Giant EduGraph by Scraping and Linking Educational Data (20)

Linked Open Data for Archives
Linked Open Data for ArchivesLinked Open Data for Archives
Linked Open Data for Archives
 
Radically Open at the National Archives
Radically Open at the National ArchivesRadically Open at the National Archives
Radically Open at the National Archives
 
Linked Data, Cultural Heritage & the Karma Mapping Software
Linked Data, Cultural Heritage & the Karma Mapping SoftwareLinked Data, Cultural Heritage & the Karma Mapping Software
Linked Data, Cultural Heritage & the Karma Mapping Software
 
RBMS LODLAM presentation
RBMS LODLAM presentationRBMS LODLAM presentation
RBMS LODLAM presentation
 
From LookBackMaps to Linked Open Data
From LookBackMaps to Linked Open DataFrom LookBackMaps to Linked Open Data
From LookBackMaps to Linked Open Data
 
An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)An Introduction to Linked Data for Librarians (2018-06-28)
An Introduction to Linked Data for Librarians (2018-06-28)
 
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & MuseumsALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
 
Linked data as a library data platform
Linked data as a library data platformLinked data as a library data platform
Linked data as a library data platform
 
QR Codes and Augmented Reality Help Libraries Extend Services
QR Codes and Augmented Reality Help LibrariesExtend Services QR Codes and Augmented Reality Help LibrariesExtend Services
QR Codes and Augmented Reality Help Libraries Extend Services
 
Using flickr for photo management - UCDA
Using flickr for photo management - UCDAUsing flickr for photo management - UCDA
Using flickr for photo management - UCDA
 
Preparing for the Impact of Web 3.0
Preparing for the Impact of Web 3.0 Preparing for the Impact of Web 3.0
Preparing for the Impact of Web 3.0
 
The Year of Blogging Dangerously
The Year of Blogging DangerouslyThe Year of Blogging Dangerously
The Year of Blogging Dangerously
 
Science communication in practice
Science communication in practiceScience communication in practice
Science communication in practice
 
What happened to the Semantic Web?
What happened to the Semantic Web?What happened to the Semantic Web?
What happened to the Semantic Web?
 
Defrosting the Digital Library: A survey of bibliographic tools for the next ...
Defrosting the Digital Library: A survey of bibliographic tools for the next ...Defrosting the Digital Library: A survey of bibliographic tools for the next ...
Defrosting the Digital Library: A survey of bibliographic tools for the next ...
 
Intro to Linked Open Data in Libraries Archives & Museums.
Intro to Linked Open Data in Libraries Archives & Museums.Intro to Linked Open Data in Libraries Archives & Museums.
Intro to Linked Open Data in Libraries Archives & Museums.
 
WTF is Semantic Web?
WTF is Semantic Web?WTF is Semantic Web?
WTF is Semantic Web?
 
Future of web archiving
Future of web archivingFuture of web archiving
Future of web archiving
 
Cinf flash v2 final
Cinf flash v2 finalCinf flash v2 final
Cinf flash v2 final
 
Linked Open Data in Libraries, Archives & Museums
Linked Open Data in Libraries, Archives & MuseumsLinked Open Data in Libraries, Archives & Museums
Linked Open Data in Libraries, Archives & Museums
 

More from Patrick Murray-John

More from Patrick Murray-John (7)

mitdh-pmj.pdf
mitdh-pmj.pdfmitdh-pmj.pdf
mitdh-pmj.pdf
 
Omeka S workshop
Omeka S workshopOmeka S workshop
Omeka S workshop
 
Omeka s workshopdcmi
Omeka s workshopdcmiOmeka s workshopdcmi
Omeka s workshopdcmi
 
Omeka s workshopdlf
Omeka s workshopdlfOmeka s workshopdlf
Omeka s workshopdlf
 
Omeka sc4l
Omeka sc4lOmeka sc4l
Omeka sc4l
 
The More Things Change. . . New Technologies and Old-School Teaching
The More Things Change. . . New Technologies and Old-School TeachingThe More Things Change. . . New Technologies and Old-School Teaching
The More Things Change. . . New Technologies and Old-School Teaching
 
Zotero Lightning Talk, Faculty Academy 2010
Zotero Lightning Talk, Faculty Academy 2010Zotero Lightning Talk, Faculty Academy 2010
Zotero Lightning Talk, Faculty Academy 2010
 

Recently uploaded

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 

Recently uploaded (20)

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 

Building a Giant EduGraph by Scraping and Linking Educational Data

  • 1. Scraping Toward A Giant EduGraph Patrick Murray-John ACCS 2009 Charlottesville, VA March 11, 2009
  • 3. A Sad Story . . . CHEMISTRY 101
  • 6. YOUR DATA!! SHALL NOT!! PASS!! CHEMISTRY 101 ENGLISH 205
  • 7. Here's the part that makes me cry Flickr image by Addrox CC-BY-NC-ND
  • 8. UNIVERSITY BOOKSTORE BOOKSTORE ORDER: CHEMISTRY 101 BOOKSTORE ORDER: ENGLISH 205
  • 9. UNIVERSITY BOOKSTORE BOOKSTORE ORDER: CHEMISTRY 101 BOOKSTORE ORDER: ENGLISH 205
  • 11. Here's the part that makes me cry AGAIN
  • 12. DEPARTMENT CHAIR SYLLABUS: CHEMISTRY 101 SYLLABUS: ENGLISH 205
  • 13. Why am I crying? Flickr photo by ifindkarma CC-BY Flickr photo by manu contreras CC-BY
  • 14. Instead. . . Focus on the data , not the document, and links can go anywhere Leana daProf Alice daStudent Chem101 Course Blog CHEMISTRY 101 Thank you!
  • 15. A Giant EduGraph Giant Global Graph Semantic Web (aka Giant Global Graph) Linked Open Data Aggregating / Exposing Higher Education Info
  • 16. Courses Course Groups Institutions / Divisions Online Spaces Places Events / Lectures Library / Book Data Clubs / Organizations Requirements / Credentials Flickr photo by smannion CC-BY-NC-SA Image from Wikipedia GNU-FDL
  • 17. Semantic Web Identify things with a URI (a node in a graph) Frankenstein (URI)
  • 18. Semantic Web Data is Nodes + Relationships between them CHEMISTRY101 S09-Group (URI) Frankenstein (URI) Alice daStudent (URI) Studies text Member
  • 19. Linked Open Data Semantic Web + some technical goodies Open on web
  • 20. Linked Open Data Flickr image by R é gis Gaidot CC-BY-NC
  • 21. What Will It Look Like? Taps into LOD Cloud DBpedia references for topics, people events, etc. GeoNames for places, buildings, etc. OpenLibrary for book info Domain-specific sources (MusicBrainz, Linked Movie Database, more)
  • 22. What Will It Look Like? Uses existing vocabularies • SIOC - Semantically Interlinked Online Communities • FOAF - Friend Of A Friend • DCTERMS - Dublin Core • BIBO - Bibliographic Info • AIISO - Academic Institution Internal Structure Ontology . . . and more, plus some being developed
  • 23. Where Will The Data Come From? Scrape existing structured data Courses and Course Groups Places People Requirements & Credentials
  • 24. Where Will The Data Come From? Zotero (actually Bruce D'Arcus' ) likely to expose SW-friendly data in the future
  • 25. Where Will The Data Come From? -- 13 years worth of circulation data anonymized and published as XML -- took about 3 days to RDFize it and make an Exhibit Follow lead of Univ. of Huddersfield
  • 26. Where Will The Data Come From? Talis Project Xiphos -- Putting UK university reading lists into RDF
  • 27. Where Will The Data Come From? Need an easy interface to relate course group data to LOD data (lookup.dbpedia.org) . . . and to relate people and course groups with online spaces . . . and to add data that isn't otherwise available
  • 28.  
  • 29.  
  • 30.  
  • 31.