SlideShare a Scribd company logo
1 of 16
Download to read offline
Urbanopoly: Collection and Quality
Assessment of Geo-spatial Linked Data
via a Human Computation Game

Irene Celino, Dario Cerizza, Simone Contessa,
Marta Corubolo, Daniele Dell’Aglio, Emanuele Della Valle,
Stefano Fumeo and Federico Piccinini
Semantic Web Challenge @ ISWC 2012 - 2012/11/14
Citizen Science?
Glacier NPS http://www.flickr.com/photos/glaciernps/4427416227/

Mount Rainier NPS
http://www.flickr.com/photos/mountrainiernps/6997851139/
Glacier NPS http://www.flickr.com/photos/glaciernps/4427412443/

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

2

Urbanopoly
What about those citizens?

Gareth 1953 http://www.flickr.com/photos/gareth1953/6786545520/

Boris van Hoytema http://www.flickr.com/photos/borisvanhoytema/685879933/

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

paul_houle http://www.flickr.com/photos/paul_houle/3301438074/

graziano88 http://www.flickr.com/photos/8482460@N06/6884509346/

3

Urbanopoly
Citizen Computation
Human Computation

Citizen Science

exploiting human capabilities
to solve computational tasks
difficult for machines

exploiting volunteers
to collect scientific data or
to conduct experiments
"in the world"

Citizen Computation
exploiting human capabilities
to contribute to a mixed
computational system
by living "in the world"

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

4

Urbanopoly
Human Computation Games with a Purpose

Purpose
within
the game:

Purpose outside the game:
You help image search engines by manually tagging images

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

5

Urbanopoly
Citizen Computation Game with a Purpose

Purpose within
the game:

Purpose outside
the game:

Create your venues' portfolio and become
the greatest landlord ever!
Collect and verify information about your city
by playing with the neighborhood around you

http://bit.ly/urbanopoly
Semantic Web Challenge @ ISWC 2012 - 2012/11/14

6

Urbanopoly
Urbanopoly – high-level view
Game purpose: check and correct geo-spatial data
from pre-existing sources + collect missing data
game to buy / sell
venues with missions

LinkedGeoData +
Lombardia Open Data

2

players
data about
venues as
missions

1
bootstrap of
"venues" data

verified / improved data
+ new data

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

GWAP approach to
3
consolidate data

4

7

Urbanopoly
Urbanopoly Input Data


OpenStreetMap (OSM)
http://www.openstreetmap.org/
via LinkedGeoData (LGD)
http://linkedgeodata.org/
data as linked data, described by an ontology



Lombardia Open Data
https://dati.lombardia.it
data about "agriturismo" places as CSV converted to RDF



Urbanopoly data bootstrap: venues are "instances" of
selected LGD "classes" with their OSM tags as features,
thus Urbanopoly data are RDF statements of the form:
<venue> <feature> <value>
Semantic Web Challenge @ ISWC 2012 - 2012/11/14

8

Urbanopoly
Urbanopoly gameplay

http://bit.ly/u-video

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

9

Urbanopoly
Urbanopoly mini-games for Data Collection

data acquisition challenges as
contributions to an advertising campaign
– left: inserting a value,
right: taking a picture

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

data validation challenges to check
pre-existing data or other players’
contribution – left: answering a quiz,
right: rating a poster

10

Urbanopoly
Urbanopoly Data Consolidation


Each statement has a confidence score:

{ <venue> <feature> <value> . } <confidence>
which indicates the probability of the statement to be true


Each player action is taken as an evidence of the associated
knowledge and alters the confidence score



A weighted majority voting algorithm aggregates the evidences:



Player’s reputation (e.g., number of errors)





Difficulty to acquire the contribution (e.g., typing vs. check box)

Player’s distance to the venue at contribution time (as sensed by the device)

When the confidence score overcomes a threshold, the triple
<venue> <feature> <value> gets consolidated

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

11

Urbanopoly
Urbanopoly Data Publication


True statements published as linked open data




If a statement's confidence overcomes the threshold, the statement
is asserted: <venue> <feature> <value> (as in LGD/OSM)

But there's more interesting information to publish!


False statements, statements' confidence, provenance info, etc.
provo:Entity

provo:Agent





We published this further
knowledge as annotations to the reified
<venue> <feature> <value> statements

contributionFrom

Contribution

Contributor

solvedBy

Human
Computation
Task

12

Consolidated
Information

enabledBy

Human
Computation
Algorithm

provo:Activity

Cf. http://swa.cefriel.it/linkeddata/
Semantic Web Challenge @ ISWC 2012 - 2012/11/14

aggregatedFrom

aggregatedBy

We created a Human Computation
ontology (http://swa.cefriel.it/ontologies/hc)
extending the W3C PROV-O ontology

solutionTo



Urbanopoly
Urbanopoly Evaluation (1/2)


"Enjoyability" of the game (engagement potential):





"Effectiveness" of the GWAP mechanism:






Average life play: ALP = Played Time / Active Players
~ 100 minutes  very good result 

Throughput = Solved Problems / Played Time
~ 287 collected evidences / hour  very good 
~ 5 consolidated statements / hour  can be improved 

"Precision" of the results (measured on results' subset)



Accuracy = ( (P – FP) + (N – FN) ) / (P + N)
~ 92 %  very good result 

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

13

Urbanopoly
Urbanopoly Evaluation (2/2)


"Playability" of the game






Evaluation survey at http://bit.ly/u-survey, with questions about
usability, social aspects, physical presence, motivation, etc.
Feedbacks very encouraging 

"Sociability" through Facebook channel




With Facebook Insights (http://www.facebook.com/insights/),
tracking of installs, demographics,
log-ins, content sharing, etc.
Example of published "story" on
Facebook Timeline:



Statistics about "stories" and
"impressions":



Interesting results, but channel to be further exploited 

Semantic Web Challenge @ ISWC 2012 - 2012/11/14

14

Urbanopoly
Conclusions


Urbanopoly is an end-user mobile application with
a multi-language attractive user interface



Urbanopoly manages urban data at a real scale
(ca. 50,000 venues) from heterogeneous sources



The meaning of data is core to the application and
consolidated data are published as linked open data



Urbanopoly is aimed at geo-spatial data collection and
quality assurance, especially for dynamic data



Our rigorous evaluation shows the high accuracy of results
and feasibility of the approach



Urbanopoly shows a clear commercial potential: further
data collection or validation needs can be added as further
mini-games or challenges within the game
Semantic Web Challenge @ ISWC 2012 - 2012/11/14

15

Urbanopoly
Thanks for your attention!
Questions?
Keep on playing
Urbanopoly!
Irene Celino – CEFRIEL, ICT Institute Politecnico di Milano
email: Irene.Celino@cefriel.it – web: http://swa.cefriel.it
slides at: http://www.slideshare.net/iricelino
Semantic Web Challenge @ ISWC 2012 - 2012/11/14

More Related Content

Similar to Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via a Human Computation Game

Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...Irene Celino
 
Urbanopoly @ SoHuman - SocialCom 2012
Urbanopoly @ SoHuman - SocialCom 2012Urbanopoly @ SoHuman - SocialCom 2012
Urbanopoly @ SoHuman - SocialCom 2012Irene Celino
 
StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...
StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...
StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...Laila Shoukry
 
Bearing witness through civic media
Bearing witness through civic mediaBearing witness through civic media
Bearing witness through civic mediaSanjana Hattotuwa
 
Smart City Semantics - Data Analytics and Human Computation to understand the...
Smart City Semantics - Data Analytics and Human Computation to understand the...Smart City Semantics - Data Analytics and Human Computation to understand the...
Smart City Semantics - Data Analytics and Human Computation to understand the...Irene Celino
 
Urbanopoly @ PlanetData review
Urbanopoly @ PlanetData reviewUrbanopoly @ PlanetData review
Urbanopoly @ PlanetData reviewIrene Celino
 
UrbanGames in PlanetData: introducing Urbanopoly
UrbanGames in PlanetData: introducing UrbanopolyUrbanGames in PlanetData: introducing Urbanopoly
UrbanGames in PlanetData: introducing UrbanopolyIrene Celino
 

Similar to Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via a Human Computation Game (7)

Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via ...
 
Urbanopoly @ SoHuman - SocialCom 2012
Urbanopoly @ SoHuman - SocialCom 2012Urbanopoly @ SoHuman - SocialCom 2012
Urbanopoly @ SoHuman - SocialCom 2012
 
StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...
StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...
StoryPlay Multimodal: A Research Tool for the Multimodal Evaluation of Seriou...
 
Bearing witness through civic media
Bearing witness through civic mediaBearing witness through civic media
Bearing witness through civic media
 
Smart City Semantics - Data Analytics and Human Computation to understand the...
Smart City Semantics - Data Analytics and Human Computation to understand the...Smart City Semantics - Data Analytics and Human Computation to understand the...
Smart City Semantics - Data Analytics and Human Computation to understand the...
 
Urbanopoly @ PlanetData review
Urbanopoly @ PlanetData reviewUrbanopoly @ PlanetData review
Urbanopoly @ PlanetData review
 
UrbanGames in PlanetData: introducing Urbanopoly
UrbanGames in PlanetData: introducing UrbanopolyUrbanGames in PlanetData: introducing Urbanopoly
UrbanGames in PlanetData: introducing Urbanopoly
 

More from PlanetData Network of Excellence

A Contextualized Knowledge Repository for Open Data about Trentino
A Contextualized Knowledge Repository for Open Data about TrentinoA Contextualized Knowledge Repository for Open Data about Trentino
A Contextualized Knowledge Repository for Open Data about TrentinoPlanetData Network of Excellence
 
Linking Smart Cities Datasets with Human Computation: the case of UrbanMatch
Linking Smart Cities Datasets with Human Computation: the case of UrbanMatchLinking Smart Cities Datasets with Human Computation: the case of UrbanMatch
Linking Smart Cities Datasets with Human Computation: the case of UrbanMatchPlanetData Network of Excellence
 
SciQL, Bridging the Gap between Science and Relational DBMS
SciQL, Bridging the Gap between Science and Relational DBMSSciQL, Bridging the Gap between Science and Relational DBMS
SciQL, Bridging the Gap between Science and Relational DBMSPlanetData Network of Excellence
 
Scalable Nonmonotonic Reasoning over RDF Data Using MapReduce
Scalable Nonmonotonic Reasoning over RDF Data Using MapReduceScalable Nonmonotonic Reasoning over RDF Data Using MapReduce
Scalable Nonmonotonic Reasoning over RDF Data Using MapReducePlanetData Network of Excellence
 
Evolution of Workflow Provenance Information in the Presence of Custom Infere...
Evolution of Workflow Provenance Information in the Presence of Custom Infere...Evolution of Workflow Provenance Information in the Presence of Custom Infere...
Evolution of Workflow Provenance Information in the Presence of Custom Infere...PlanetData Network of Excellence
 
Towards Parallel Nonmonotonic Reasoning with Billions of Facts
Towards Parallel Nonmonotonic Reasoning with Billions of FactsTowards Parallel Nonmonotonic Reasoning with Billions of Facts
Towards Parallel Nonmonotonic Reasoning with Billions of FactsPlanetData Network of Excellence
 
Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...
Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...
Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...PlanetData Network of Excellence
 
Adaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of EndpointsAdaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of EndpointsPlanetData Network of Excellence
 
Exploring The Hubness-Related Properties of Oceanographic Sensor Data
Exploring The Hubness-Related Properties of Oceanographic Sensor DataExploring The Hubness-Related Properties of Oceanographic Sensor Data
Exploring The Hubness-Related Properties of Oceanographic Sensor DataPlanetData Network of Excellence
 

More from PlanetData Network of Excellence (20)

A Contextualized Knowledge Repository for Open Data about Trentino
A Contextualized Knowledge Repository for Open Data about TrentinoA Contextualized Knowledge Repository for Open Data about Trentino
A Contextualized Knowledge Repository for Open Data about Trentino
 
Linking Smart Cities Datasets with Human Computation: the case of UrbanMatch
Linking Smart Cities Datasets with Human Computation: the case of UrbanMatchLinking Smart Cities Datasets with Human Computation: the case of UrbanMatch
Linking Smart Cities Datasets with Human Computation: the case of UrbanMatch
 
SciQL, Bridging the Gap between Science and Relational DBMS
SciQL, Bridging the Gap between Science and Relational DBMSSciQL, Bridging the Gap between Science and Relational DBMS
SciQL, Bridging the Gap between Science and Relational DBMS
 
CLODA: A Crowdsourced Linked Open Data Architecture
CLODA: A Crowdsourced Linked Open Data ArchitectureCLODA: A Crowdsourced Linked Open Data Architecture
CLODA: A Crowdsourced Linked Open Data Architecture
 
Scalable Nonmonotonic Reasoning over RDF Data Using MapReduce
Scalable Nonmonotonic Reasoning over RDF Data Using MapReduceScalable Nonmonotonic Reasoning over RDF Data Using MapReduce
Scalable Nonmonotonic Reasoning over RDF Data Using MapReduce
 
Data and Knowledge Evolution
Data and Knowledge Evolution  Data and Knowledge Evolution
Data and Knowledge Evolution
 
Evolution of Workflow Provenance Information in the Presence of Custom Infere...
Evolution of Workflow Provenance Information in the Presence of Custom Infere...Evolution of Workflow Provenance Information in the Presence of Custom Infere...
Evolution of Workflow Provenance Information in the Presence of Custom Infere...
 
Access Control for RDF graphs using Abstract Models
Access Control for RDF graphs using Abstract ModelsAccess Control for RDF graphs using Abstract Models
Access Control for RDF graphs using Abstract Models
 
Arrays in Databases, the next frontier?
Arrays in Databases, the next frontier?Arrays in Databases, the next frontier?
Arrays in Databases, the next frontier?
 
Abstract Access Control Model for Dynamic RDF Datasets
Abstract Access Control Model for Dynamic RDF DatasetsAbstract Access Control Model for Dynamic RDF Datasets
Abstract Access Control Model for Dynamic RDF Datasets
 
Towards Parallel Nonmonotonic Reasoning with Billions of Facts
Towards Parallel Nonmonotonic Reasoning with Billions of FactsTowards Parallel Nonmonotonic Reasoning with Billions of Facts
Towards Parallel Nonmonotonic Reasoning with Billions of Facts
 
Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...
Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...
Automation in Cytomics: A Modern RDBMS Based Platform for Image Analysis and ...
 
Heuristic based Query Optimisation for SPARQL
Heuristic based Query Optimisation for SPARQLHeuristic based Query Optimisation for SPARQL
Heuristic based Query Optimisation for SPARQL
 
Adaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of EndpointsAdaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of Endpoints
 
Building a Front End for a Sensor Data Cloud
Building a Front End for a Sensor Data CloudBuilding a Front End for a Sensor Data Cloud
Building a Front End for a Sensor Data Cloud
 
OntoGen Extension for Exploring Image Collections
OntoGen Extension for Exploring Image CollectionsOntoGen Extension for Exploring Image Collections
OntoGen Extension for Exploring Image Collections
 
Exploring The Hubness-Related Properties of Oceanographic Sensor Data
Exploring The Hubness-Related Properties of Oceanographic Sensor DataExploring The Hubness-Related Properties of Oceanographic Sensor Data
Exploring The Hubness-Related Properties of Oceanographic Sensor Data
 
Exposing Real World Information for the Web of Things
Exposing Real World Information for the Web of ThingsExposing Real World Information for the Web of Things
Exposing Real World Information for the Web of Things
 
Spatio-temporal reasoning for traffic scene understanding
Spatio-temporal reasoning for traffic scene understandingSpatio-temporal reasoning for traffic scene understanding
Spatio-temporal reasoning for traffic scene understanding
 
Tractor Pulling on Data Warehouse
Tractor Pulling on Data WarehouseTractor Pulling on Data Warehouse
Tractor Pulling on Data Warehouse
 

Recently uploaded

Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 

Recently uploaded (20)

Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 

Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via a Human Computation Game

  • 1. Urbanopoly: Collection and Quality Assessment of Geo-spatial Linked Data via a Human Computation Game Irene Celino, Dario Cerizza, Simone Contessa, Marta Corubolo, Daniele Dell’Aglio, Emanuele Della Valle, Stefano Fumeo and Federico Piccinini Semantic Web Challenge @ ISWC 2012 - 2012/11/14
  • 2. Citizen Science? Glacier NPS http://www.flickr.com/photos/glaciernps/4427416227/ Mount Rainier NPS http://www.flickr.com/photos/mountrainiernps/6997851139/ Glacier NPS http://www.flickr.com/photos/glaciernps/4427412443/ Semantic Web Challenge @ ISWC 2012 - 2012/11/14 2 Urbanopoly
  • 3. What about those citizens? Gareth 1953 http://www.flickr.com/photos/gareth1953/6786545520/ Boris van Hoytema http://www.flickr.com/photos/borisvanhoytema/685879933/ Semantic Web Challenge @ ISWC 2012 - 2012/11/14 paul_houle http://www.flickr.com/photos/paul_houle/3301438074/ graziano88 http://www.flickr.com/photos/8482460@N06/6884509346/ 3 Urbanopoly
  • 4. Citizen Computation Human Computation Citizen Science exploiting human capabilities to solve computational tasks difficult for machines exploiting volunteers to collect scientific data or to conduct experiments "in the world" Citizen Computation exploiting human capabilities to contribute to a mixed computational system by living "in the world" Semantic Web Challenge @ ISWC 2012 - 2012/11/14 4 Urbanopoly
  • 5. Human Computation Games with a Purpose Purpose within the game: Purpose outside the game: You help image search engines by manually tagging images Semantic Web Challenge @ ISWC 2012 - 2012/11/14 5 Urbanopoly
  • 6. Citizen Computation Game with a Purpose Purpose within the game: Purpose outside the game: Create your venues' portfolio and become the greatest landlord ever! Collect and verify information about your city by playing with the neighborhood around you http://bit.ly/urbanopoly Semantic Web Challenge @ ISWC 2012 - 2012/11/14 6 Urbanopoly
  • 7. Urbanopoly – high-level view Game purpose: check and correct geo-spatial data from pre-existing sources + collect missing data game to buy / sell venues with missions LinkedGeoData + Lombardia Open Data 2 players data about venues as missions 1 bootstrap of "venues" data verified / improved data + new data Semantic Web Challenge @ ISWC 2012 - 2012/11/14 GWAP approach to 3 consolidate data 4 7 Urbanopoly
  • 8. Urbanopoly Input Data  OpenStreetMap (OSM) http://www.openstreetmap.org/ via LinkedGeoData (LGD) http://linkedgeodata.org/ data as linked data, described by an ontology  Lombardia Open Data https://dati.lombardia.it data about "agriturismo" places as CSV converted to RDF  Urbanopoly data bootstrap: venues are "instances" of selected LGD "classes" with their OSM tags as features, thus Urbanopoly data are RDF statements of the form: <venue> <feature> <value> Semantic Web Challenge @ ISWC 2012 - 2012/11/14 8 Urbanopoly
  • 9. Urbanopoly gameplay http://bit.ly/u-video Semantic Web Challenge @ ISWC 2012 - 2012/11/14 9 Urbanopoly
  • 10. Urbanopoly mini-games for Data Collection data acquisition challenges as contributions to an advertising campaign – left: inserting a value, right: taking a picture Semantic Web Challenge @ ISWC 2012 - 2012/11/14 data validation challenges to check pre-existing data or other players’ contribution – left: answering a quiz, right: rating a poster 10 Urbanopoly
  • 11. Urbanopoly Data Consolidation  Each statement has a confidence score: { <venue> <feature> <value> . } <confidence> which indicates the probability of the statement to be true  Each player action is taken as an evidence of the associated knowledge and alters the confidence score  A weighted majority voting algorithm aggregates the evidences:   Player’s reputation (e.g., number of errors)   Difficulty to acquire the contribution (e.g., typing vs. check box) Player’s distance to the venue at contribution time (as sensed by the device) When the confidence score overcomes a threshold, the triple <venue> <feature> <value> gets consolidated Semantic Web Challenge @ ISWC 2012 - 2012/11/14 11 Urbanopoly
  • 12. Urbanopoly Data Publication  True statements published as linked open data   If a statement's confidence overcomes the threshold, the statement is asserted: <venue> <feature> <value> (as in LGD/OSM) But there's more interesting information to publish!  False statements, statements' confidence, provenance info, etc. provo:Entity provo:Agent   We published this further knowledge as annotations to the reified <venue> <feature> <value> statements contributionFrom Contribution Contributor solvedBy Human Computation Task 12 Consolidated Information enabledBy Human Computation Algorithm provo:Activity Cf. http://swa.cefriel.it/linkeddata/ Semantic Web Challenge @ ISWC 2012 - 2012/11/14 aggregatedFrom aggregatedBy We created a Human Computation ontology (http://swa.cefriel.it/ontologies/hc) extending the W3C PROV-O ontology solutionTo  Urbanopoly
  • 13. Urbanopoly Evaluation (1/2)  "Enjoyability" of the game (engagement potential):    "Effectiveness" of the GWAP mechanism:     Average life play: ALP = Played Time / Active Players ~ 100 minutes  very good result  Throughput = Solved Problems / Played Time ~ 287 collected evidences / hour  very good  ~ 5 consolidated statements / hour  can be improved  "Precision" of the results (measured on results' subset)   Accuracy = ( (P – FP) + (N – FN) ) / (P + N) ~ 92 %  very good result  Semantic Web Challenge @ ISWC 2012 - 2012/11/14 13 Urbanopoly
  • 14. Urbanopoly Evaluation (2/2)  "Playability" of the game    Evaluation survey at http://bit.ly/u-survey, with questions about usability, social aspects, physical presence, motivation, etc. Feedbacks very encouraging  "Sociability" through Facebook channel   With Facebook Insights (http://www.facebook.com/insights/), tracking of installs, demographics, log-ins, content sharing, etc. Example of published "story" on Facebook Timeline:  Statistics about "stories" and "impressions":  Interesting results, but channel to be further exploited  Semantic Web Challenge @ ISWC 2012 - 2012/11/14 14 Urbanopoly
  • 15. Conclusions  Urbanopoly is an end-user mobile application with a multi-language attractive user interface  Urbanopoly manages urban data at a real scale (ca. 50,000 venues) from heterogeneous sources  The meaning of data is core to the application and consolidated data are published as linked open data  Urbanopoly is aimed at geo-spatial data collection and quality assurance, especially for dynamic data  Our rigorous evaluation shows the high accuracy of results and feasibility of the approach  Urbanopoly shows a clear commercial potential: further data collection or validation needs can be added as further mini-games or challenges within the game Semantic Web Challenge @ ISWC 2012 - 2012/11/14 15 Urbanopoly
  • 16. Thanks for your attention! Questions? Keep on playing Urbanopoly! Irene Celino – CEFRIEL, ICT Institute Politecnico di Milano email: Irene.Celino@cefriel.it – web: http://swa.cefriel.it slides at: http://www.slideshare.net/iricelino Semantic Web Challenge @ ISWC 2012 - 2012/11/14