SlideShare una empresa de Scribd logo
1 de 52
Reputation, community, Web
2.0, and games: incentives for
semantics – about getting people
involved
www.insemtives.eu 1
Katharina Siorpaes and Elena Simperl
SemTech 2010
Executive summary
• Many tasks related to semantic content authoring cannot be undertaken
without human contribution.
• User motivation is essential for semantic applications to achieve critical
mass and ensure sustainable growth.
• How to encourage user participation
– Incentives
– Technology design
– Usability engineering
– Games with a purpose
www.insemtives.eu 2
About the speakers
www.insemtives.eu 3
Katharina Siorpaes Elena Simperl
Agenda
• Human-driven semantic content authoring
• Incentives and participatory design
• Example: Casual games
• Example: Virtual worlds
• Conclusion
www.insemtives.eu 4
HUMAN-DRIVEN SEMANTIC
CONTENT AUTHORING
Human-driven semantic content authoring
Incentives and participatory design
Example: Casual games
Example: Virtual worlds
Conclusions
www.insemtives.eu 5
Human vs computational intelligence
• Ordered sequence of tasks into which the
authoring exercise can be divided
• Required skills and expertise
www.insemtives.eu 6
Example: semantic annotation
www.insemtives.eu 7
Example: ontology evaluation
www.insemtives.eu 8
Example: ontology alignment
www.insemtives.eu 9
MILLION DOLLAR QUESTION
HOW CAN WE MOTIVATE PEOPLE
TO DEDICATE THEIR VALUABLE TIME
TO ANNOTATE THEIR/OUR DATA?
www.insemtives.eu 10
INCENTIVES AND PARTICIPATORY
DESIGN
Human-driven semantic content authoring
Incentives and participatory design
Example: Casual games
Example: Virtual worlds
Conclusions
www.insemtives.eu 11
www.insemtives.eu 12
Motivation vs incentives
• Incentives are ‘rewards’ assigned by an external
‘judge’ to a performer for undertaking a specific task.
• Common belief (among economists): incentives can
be translated into a sum of money for all practical
purposes.
• Incentives can be related to both extrinsic and
intrinsic motivations.
www.insemtives.eu 13
Extrinsic vs intrinsic motivation
• Extrinsic motivation if task is considered
– Boring, dangerous, useless, socially undesirable,
dislikable by the performer.
• Intrinsic motivation if
– The performer likes what he/she is doing
– The act is satisfying in itself (it can happen for
many different reasons).
Web 2.0 is hot, Semantic Web is
not?
www.insemtives.eu 14
Web 2.0 motivators
www.insemtives.eu 15
User-empowered Web
• Comprehensive incentives studies are
available (Kuznetsov, 2004; Marlow et
al.,2006; Wikipedia, 2009).
www.insemtives.eu 1616
Example: Wikipedians
• Reciprocity: Altruistic contributors receive a
benefit in return.
• Community: “Wikipedians […] feel needed”, there
is “a sense of common purpose and belonging “.
• Reputation: Contributors “develop identities in
order to be respected, trusted, and appreciated
by peers”.
• Autonomy: Contributors enjoy “the freedom of
independent decision”.
Kuznetsov, 2004
www.insemtives.eu 17
Factors influencing incentives design
• Tasks or an ordered collection of tasks into
which the authoring exercise can be divided.
• Skills required to undertake the task.
• Goal of the authoring exercise.
• Social structure, i.e. social relationships
among the subjects participating in the
exercise.
• Nature of the good.www.insemtives.eu 18
Example: image sharing on a social
platform
• Task: attaching concepts and
relationships to images
(iPhoto).
• Skills: identifying objects in
images and choosing the
right description.
• Goal: sharing and retrieval.
• Social structure: Friends (in
social network).
• Nature of the good:
annotations accessible to me
and my friends.
www.insemtives.eu 19
Example: UNSPSC and eCl@ss
alignment
• Task: ontology alignment
• Skills: domain knowledge,
modeling skills
• Goal: interoperability
• Social structure:
enterprise, team
• Nature of good: for
benefit of enterprise
www.insemtives.eu 20
Technology and application design
• Involve users in the design process.
– Design workshops, interviews etc.
• Take usability serious.
– Design for efficiency, effectiveness and user
satisfaction.
• Design for sociability.
– Support sharing, contributing, collaborating,
identity-building.
www.insemtives.eu 21
Technology and application design
(ii)
• Respect trust/security and safety/privacy
issues.
– Support visibility and awareness.
• Design for fun.
• Follow an user experience design approach.
• Support a user’s individual identity in a (and
contribution to a) community with collaborative
activities.
www.insemtives.eu 22
Example: image annotation in
OKEnterprise (i)
• Involvement of users in design
process
– Interviews and user
workshops
• Usability
– Interviews, usability
evaluations
• Design for sociability
– User interaction, visibility of
contributions, registered
users, collaborative working
• Trust and privacy
– Trust in enterprise portal,
rating
– Privacy: users have control
over their data
www.insemtives.eu 23
Example: image annotation in
OKEnterprise (ii)
• Design for fun
– Annotator of the week,
rankings
– Casual games
• User-experience design
approach
– Evaluate and revise
depending on user
experience
• Support user’s individual
identity
– Registration of users,
individual user pages
www.insemtives.eu 24
NOW: FUN AND COMPETITION:
GAMES FOR SEMANTICS!
Human-driven semantic content authoring
Incentives and participatory design
Example: Casual games
Example: Virtual worlds
Conclusions
www.insemtives.eu 25
1/28/2015
ESWC 2008 26
OntoPronto: Step 1
OntoPronto: Step 2
1/28/2015
ESWC 2008 28
OntoTube
OntoTube
Results
n=2905 rounds
n=2234
12.9%
10.2%
76.9%
Either skipped or no
consensus found in
the first task
Challenges in which
only the first task was
completed
consensually
Challenges in which
both tasks were
completed
consensually
97.6%
0.5%
1.9%
Challenges in which
at least the first task
was completed
consensually
Wrong judgements of
ontological nature
Wrong abstractions
MASSACRE – MASive Semantic
Annotation Creation Game
www.insemtives.eu 31
Phratris – Phrase Analysis TETRIS
www.insemtives.eu 32
playence’ Uhani (i)
www.insemtives.eu 33
Check
www.playence.com!
playence’ Uhani (ii)
www.insemtives.eu 34
Casual games
1. Steep learning curve
2. Fast game play: little time effort required
3. Simple implementation (simple interface and
graphics)
4. Low hardware efforts (usually browser or
mobile app)
5. Low bandwidth requirements
6. Mass audience
www.insemtives.eu 35
How to design your own game
1. Specify output
2. Identify input
3. Choose type of game and define game play
4. Based on previous decisions, define game
play and adapt underlying game ontology
5. Adapt or define export algorithm
6. Evaluate output
www.insemtives.eu 36
Guidelines
1. Timed response
2. Score keeping
3. Player skill level
4. High score lists
5. Randomness
5. Random player pairing
6. Player testing
7. Repetition
8. Taboo outputs
www.insemtives.eu 37
Luis von Ahn. Games With A Purpose.
IEEE Computer Magazine, June 2006. pp
96-98.
Challenges
• Identifying suitable tasks in semantic content creation.
• Designing games.
• Designing a usable, attractive interface.
• Identifying suitable knowledge corpora.
• Preventing cheating.
• Defusing typical pitfalls of conceptual modeling.
• Distribution of labor.
• Fostering user participation.
• Deriving formal representations.
• Scalability and performance.
www.insemtives.eu 38
ANNOTATION IN VIRTUAL WORLDS
Human-driven semantic content authoring
Incentives and participatory design
Example: Casual games
Example: Virtual worlds
Conclusions
www.insemtives.eu 39
Tiny Planets
• Kids TV property licensed in over
100 countries worldwide
• Education
• Diverse broadcaster base – from
Al Jazeera to American Armed
Forces network
• Unusual age profile – kids 4 -11
• Brand extensions into web and
virtual world
www.insemtives.eu 40
Tiny Planets (ii)
• Tiny Planets website – 40,000
unique visitors per month
• 100,000 page impressions
• Average stay 8 minutes
• MTP virtual world – active
47,000 user accounts
• Books, Fun, TV, Learning, Labs
sites as well as virtual world
• Real and virtual currencies
• Cross-site account creation
www.insemtives.eu 41
• Engage kids with annotation
games as a means of expression
• Combination of ‘rating’, ‘tagging’,
and pre-scripted comments
• Locate content within virtual
world to inform friends, give
clues in games, give an
‘emotional’ context to items by
expressing opinions. Search for
clues and comments left by
friends
• Reward annotations with virtual
currency
www.insemtives.eu 42
Virtual world
Real world
• Real-world science experiment
based on Galaxy Zoo format
• Crater marking using data from
NASA LRO
• Use My Tiny Planets account
for sign in and performance
tracking
• Reward annotations with
achievements and virtual
currency
• And kudos; kids get to know
they’re doing science for real,
and its going to be used.
www.insemtives.eu 43
INSEMTIVES talk at Semtech2010
Incentives
• Earn Stars to spend on Virtual
Goods, games or videos
• Earn awards that can be seen by
other players in your passport
• Rise in Rank as you perform
targeted activities
• Join the Pro circuit so that your
top scores can be seen by other
players
• Buy Keys, which unlock new
areas and new activities in
which to spend your Stars.
www.insemtives.eu 45
INSEMTIVES talk at Semtech2010
INSEMTIVES talk at Semtech2010
INSEMTIVES talk at Semtech2010
INSEMTIVES talk at Semtech2010
CONCLUSIONS
Human-driven semantic content authoring
Incentives and participatory design
Example: Casual games
Example: Virtual worlds
Conclusions
www.insemtives.eu 50
Summary
• Human contribution is needed for selected tasks in
semantic content authoring.
• Web 2.0 has impressively demonstrated how strong
incentives can foster user participation and create
successful applications.
• Turning semantic content creation tasks into games is
an especially intriguing idea because of the potentially
large amounts of human-produced data that can be
created.
• Challenges are manifold: knowledge corpora,
interesting game design, ensuring uptake, difficulty of
tasks, etc.
www.insemtives.eu 51
1/28/2015 www.insemtives.eu 52
Realizing the Semantic Web by
encouraging millions of end-users
to create semantic content.

Más contenido relacionado

Destacado

University of St. Thomas MBA Viewbook
University of St. Thomas MBA ViewbookUniversity of St. Thomas MBA Viewbook
University of St. Thomas MBA Viewbookfutureandnow
 
Activities at-school11
Activities at-school11Activities at-school11
Activities at-school11clarodgers
 
Il buzzieqa magika
Il buzzieqa magikaIl buzzieqa magika
Il buzzieqa magikaclarodgers
 
스테인글라스
스테인글라스스테인글라스
스테인글라스HyunTae Shin
 
Be a fruit champion!!!
Be a fruit champion!!!Be a fruit champion!!!
Be a fruit champion!!!clarodgers
 
Formulari nadal
Formulari nadalFormulari nadal
Formulari nadalLua1
 
체육수업에서 활용할 수 있는 New sports 소개
체육수업에서 활용할 수 있는 New sports 소개체육수업에서 활용할 수 있는 New sports 소개
체육수업에서 활용할 수 있는 New sports 소개HyunTae Shin
 
Nemzetközi Foursquare Day 2012 Meetoff
Nemzetközi Foursquare Day 2012 MeetoffNemzetközi Foursquare Day 2012 Meetoff
Nemzetközi Foursquare Day 2012 MeetoffLilla Juhász
 
Fandom e broadcaster: l'interazione è possibile?
Fandom e broadcaster: l'interazione è possibile?Fandom e broadcaster: l'interazione è possibile?
Fandom e broadcaster: l'interazione è possibile?Beatrice Belli
 
2010’ 계절스포츠(스키) 체험프로그램
2010’ 계절스포츠(스키) 체험프로그램2010’ 계절스포츠(스키) 체험프로그램
2010’ 계절스포츠(스키) 체험프로그램HyunTae Shin
 
University of St. Thomas, College of Business, Brand Identity Guide
University of St. Thomas, College of Business, Brand Identity GuideUniversity of St. Thomas, College of Business, Brand Identity Guide
University of St. Thomas, College of Business, Brand Identity Guidefutureandnow
 
Подарим детям сказку
Подарим детям сказкуПодарим детям сказку
Подарим детям сказкуNikita Kudelin
 
Декада инвалидов
Декада инвалидовДекада инвалидов
Декада инвалидовNikita Kudelin
 
Loghob tradizzjonali
Loghob tradizzjonaliLoghob tradizzjonali
Loghob tradizzjonaliclarodgers
 
비사치기 방법
비사치기 방법비사치기 방법
비사치기 방법HyunTae Shin
 
Ringor e catalog 2010-2011 catalog
Ringor e catalog 2010-2011 catalogRingor e catalog 2010-2011 catalog
Ringor e catalog 2010-2011 catalogJay Halbrook
 
WP8 Dissemination and Exploitation
WP8 Dissemination and ExploitationWP8 Dissemination and Exploitation
WP8 Dissemination and ExploitationINSEMTIVES project
 

Destacado (20)

University of St. Thomas MBA Viewbook
University of St. Thomas MBA ViewbookUniversity of St. Thomas MBA Viewbook
University of St. Thomas MBA Viewbook
 
Activities at-school11
Activities at-school11Activities at-school11
Activities at-school11
 
Il buzzieqa magika
Il buzzieqa magikaIl buzzieqa magika
Il buzzieqa magika
 
스테인글라스
스테인글라스스테인글라스
스테인글라스
 
Be a fruit champion!!!
Be a fruit champion!!!Be a fruit champion!!!
Be a fruit champion!!!
 
Formulari nadal
Formulari nadalFormulari nadal
Formulari nadal
 
체육수업에서 활용할 수 있는 New sports 소개
체육수업에서 활용할 수 있는 New sports 소개체육수업에서 활용할 수 있는 New sports 소개
체육수업에서 활용할 수 있는 New sports 소개
 
Nemzetközi Foursquare Day 2012 Meetoff
Nemzetközi Foursquare Day 2012 MeetoffNemzetközi Foursquare Day 2012 Meetoff
Nemzetközi Foursquare Day 2012 Meetoff
 
Technology - WP3 and WP4
Technology - WP3 and WP4Technology - WP3 and WP4
Technology - WP3 and WP4
 
Fandom e broadcaster: l'interazione è possibile?
Fandom e broadcaster: l'interazione è possibile?Fandom e broadcaster: l'interazione è possibile?
Fandom e broadcaster: l'interazione è possibile?
 
2010’ 계절스포츠(스키) 체험프로그램
2010’ 계절스포츠(스키) 체험프로그램2010’ 계절스포츠(스키) 체험프로그램
2010’ 계절스포츠(스키) 체험프로그램
 
University of St. Thomas, College of Business, Brand Identity Guide
University of St. Thomas, College of Business, Brand Identity GuideUniversity of St. Thomas, College of Business, Brand Identity Guide
University of St. Thomas, College of Business, Brand Identity Guide
 
Подарим детям сказку
Подарим детям сказкуПодарим детям сказку
Подарим детям сказку
 
Декада инвалидов
Декада инвалидовДекада инвалидов
Декада инвалидов
 
Loghob tradizzjonali
Loghob tradizzjonaliLoghob tradizzjonali
Loghob tradizzjonali
 
다색판화
다색판화다색판화
다색판화
 
비사치기 방법
비사치기 방법비사치기 방법
비사치기 방법
 
Ringor e catalog 2010-2011 catalog
Ringor e catalog 2010-2011 catalogRingor e catalog 2010-2011 catalog
Ringor e catalog 2010-2011 catalog
 
Semantic Games
Semantic GamesSemantic Games
Semantic Games
 
WP8 Dissemination and Exploitation
WP8 Dissemination and ExploitationWP8 Dissemination and Exploitation
WP8 Dissemination and Exploitation
 

Similar a INSEMTIVES talk at Semtech2010

INSEMTIVES Tutorial ISWC2011 - Session1
INSEMTIVES Tutorial ISWC2011 - Session1INSEMTIVES Tutorial ISWC2011 - Session1
INSEMTIVES Tutorial ISWC2011 - Session1INSEMTIVES project
 
Insemtives iswc2011 session1
Insemtives iswc2011 session1Insemtives iswc2011 session1
Insemtives iswc2011 session1Elena Simperl
 
Social Games Design Workshop
Social Games Design WorkshopSocial Games Design Workshop
Social Games Design WorkshopAki Järvinen
 
Gamifiying information systems: How to motivate users with game elements
Gamifiying information systems: How to motivate users with game elementsGamifiying information systems: How to motivate users with game elements
Gamifiying information systems: How to motivate users with game elementsLuis de-Marcos Ortega
 
Introduction (1/6)
Introduction (1/6)Introduction (1/6)
Introduction (1/6)Roberta Cuel
 
Improving Productivity with SharePoint 2013 and Gamification
Improving Productivity with SharePoint 2013 and GamificationImproving Productivity with SharePoint 2013 and Gamification
Improving Productivity with SharePoint 2013 and GamificationChristian Buckley
 
INSEMTIVES Tutorial ISWC2011 - Session5
INSEMTIVES Tutorial ISWC2011 - Session5INSEMTIVES Tutorial ISWC2011 - Session5
INSEMTIVES Tutorial ISWC2011 - Session5INSEMTIVES project
 
Phishing: It’s Not Just for Pentesters Using Phishing to Build a Successful ...
Phishing: It’s Not Just for Pentesters  Using Phishing to Build a Successful ...Phishing: It’s Not Just for Pentesters  Using Phishing to Build a Successful ...
Phishing: It’s Not Just for Pentesters Using Phishing to Build a Successful ...EC-Council
 
The Birth of the HUGE UX School
The Birth of the HUGE UX SchoolThe Birth of the HUGE UX School
The Birth of the HUGE UX SchoolMichal Pasternak
 
Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...
Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...
Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...Junie Kwon
 
Gamifying Aplications (aguascalientes_oct2014)
Gamifying Aplications (aguascalientes_oct2014)Gamifying Aplications (aguascalientes_oct2014)
Gamifying Aplications (aguascalientes_oct2014)Luis de-Marcos Ortega
 
Quest for Aesthetics in a Metrics-driven Business
Quest for Aesthetics in a Metrics-driven BusinessQuest for Aesthetics in a Metrics-driven Business
Quest for Aesthetics in a Metrics-driven BusinessAki Järvinen
 
Insemtives cluj iccp
Insemtives cluj iccpInsemtives cluj iccp
Insemtives cluj iccpElena Simperl
 
Rev gaming learning analytics rage and beaconing
Rev gaming learning analytics  rage and beaconingRev gaming learning analytics  rage and beaconing
Rev gaming learning analytics rage and beaconingBaltasar Fernández-Manjón
 
Multimedia phase 1
Multimedia phase 1Multimedia phase 1
Multimedia phase 1Online
 
CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2Dr. Ahmed Al Zaidy
 
Serious play (ENG version)
Serious play (ENG version)Serious play (ENG version)
Serious play (ENG version)ISMB
 

Similar a INSEMTIVES talk at Semtech2010 (20)

INSEMTIVES Tutorial ISWC2011 - Session1
INSEMTIVES Tutorial ISWC2011 - Session1INSEMTIVES Tutorial ISWC2011 - Session1
INSEMTIVES Tutorial ISWC2011 - Session1
 
Insemtives iswc2011 session1
Insemtives iswc2011 session1Insemtives iswc2011 session1
Insemtives iswc2011 session1
 
Insemtives iswc2010
Insemtives iswc2010Insemtives iswc2010
Insemtives iswc2010
 
Social Games Design Workshop
Social Games Design WorkshopSocial Games Design Workshop
Social Games Design Workshop
 
Gamifiying information systems: How to motivate users with game elements
Gamifiying information systems: How to motivate users with game elementsGamifiying information systems: How to motivate users with game elements
Gamifiying information systems: How to motivate users with game elements
 
Introduction (1/6)
Introduction (1/6)Introduction (1/6)
Introduction (1/6)
 
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
 
Improving Productivity with SharePoint 2013 and Gamification
Improving Productivity with SharePoint 2013 and GamificationImproving Productivity with SharePoint 2013 and Gamification
Improving Productivity with SharePoint 2013 and Gamification
 
INSEMTIVES Tutorial ISWC2011 - Session5
INSEMTIVES Tutorial ISWC2011 - Session5INSEMTIVES Tutorial ISWC2011 - Session5
INSEMTIVES Tutorial ISWC2011 - Session5
 
Phishing: It’s Not Just for Pentesters Using Phishing to Build a Successful ...
Phishing: It’s Not Just for Pentesters  Using Phishing to Build a Successful ...Phishing: It’s Not Just for Pentesters  Using Phishing to Build a Successful ...
Phishing: It’s Not Just for Pentesters Using Phishing to Build a Successful ...
 
The Birth of the HUGE UX School
The Birth of the HUGE UX SchoolThe Birth of the HUGE UX School
The Birth of the HUGE UX School
 
Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...
Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...
Gamify Your Team Design Thinking : Experimental Study on a Co-Evolution Theor...
 
Gamifying Aplications (aguascalientes_oct2014)
Gamifying Aplications (aguascalientes_oct2014)Gamifying Aplications (aguascalientes_oct2014)
Gamifying Aplications (aguascalientes_oct2014)
 
Quest for Aesthetics in a Metrics-driven Business
Quest for Aesthetics in a Metrics-driven BusinessQuest for Aesthetics in a Metrics-driven Business
Quest for Aesthetics in a Metrics-driven Business
 
Generative AI How It's Changing Our World and What It Means for You_final.pdf
Generative AI How It's Changing Our World and What It Means for You_final.pdfGenerative AI How It's Changing Our World and What It Means for You_final.pdf
Generative AI How It's Changing Our World and What It Means for You_final.pdf
 
Insemtives cluj iccp
Insemtives cluj iccpInsemtives cluj iccp
Insemtives cluj iccp
 
Rev gaming learning analytics rage and beaconing
Rev gaming learning analytics  rage and beaconingRev gaming learning analytics  rage and beaconing
Rev gaming learning analytics rage and beaconing
 
Multimedia phase 1
Multimedia phase 1Multimedia phase 1
Multimedia phase 1
 
CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2
 
Serious play (ENG version)
Serious play (ENG version)Serious play (ENG version)
Serious play (ENG version)
 

Más de INSEMTIVES project

SemTech 2012 - Making your semantic app addictive: Incentivizing Users
SemTech 2012 - Making your semantic app addictive: Incentivizing UsersSemTech 2012 - Making your semantic app addictive: Incentivizing Users
SemTech 2012 - Making your semantic app addictive: Incentivizing UsersINSEMTIVES project
 
SocInfo2011 - Designing For Motivation
SocInfo2011 - Designing For MotivationSocInfo2011 - Designing For Motivation
SocInfo2011 - Designing For MotivationINSEMTIVES project
 
AAAI2012 - Crowd Sourcing Web Service Annotations
AAAI2012 - Crowd Sourcing Web Service AnnotationsAAAI2012 - Crowd Sourcing Web Service Annotations
AAAI2012 - Crowd Sourcing Web Service AnnotationsINSEMTIVES project
 
SemTech2011 - Employee-of-the-Month' Badge Unlocked
SemTech2011 - Employee-of-the-Month' Badge UnlockedSemTech2011 - Employee-of-the-Month' Badge Unlocked
SemTech2011 - Employee-of-the-Month' Badge UnlockedINSEMTIVES project
 
INSEMTIVES Tutorial ISWC2011 - Session4
INSEMTIVES Tutorial ISWC2011 - Session4INSEMTIVES Tutorial ISWC2011 - Session4
INSEMTIVES Tutorial ISWC2011 - Session4INSEMTIVES project
 
INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3INSEMTIVES project
 
INSEMTIVES Tutorial ISWC2011 - Session2
INSEMTIVES Tutorial ISWC2011 - Session2INSEMTIVES Tutorial ISWC2011 - Session2
INSEMTIVES Tutorial ISWC2011 - Session2INSEMTIVES project
 
UAB 2011 - Seekda Webservices Portal
UAB 2011 - Seekda Webservices PortalUAB 2011 - Seekda Webservices Portal
UAB 2011 - Seekda Webservices PortalINSEMTIVES project
 
UAB 2011- Combining human and computational intelligence
UAB 2011- Combining human and computational intelligenceUAB 2011- Combining human and computational intelligence
UAB 2011- Combining human and computational intelligenceINSEMTIVES project
 
INSEMTIVES year 2 - Dissemination and Community Building
INSEMTIVES year 2  - Dissemination and Community BuildingINSEMTIVES year 2  - Dissemination and Community Building
INSEMTIVES year 2 - Dissemination and Community BuildingINSEMTIVES project
 
WP8 Okenterprise Use Case - Applying Insemtives to Corporate Portals
WP8 Okenterprise Use Case - Applying Insemtives to Corporate PortalsWP8 Okenterprise Use Case - Applying Insemtives to Corporate Portals
WP8 Okenterprise Use Case - Applying Insemtives to Corporate PortalsINSEMTIVES project
 

Más de INSEMTIVES project (17)

SemTech 2012 - Making your semantic app addictive: Incentivizing Users
SemTech 2012 - Making your semantic app addictive: Incentivizing UsersSemTech 2012 - Making your semantic app addictive: Incentivizing Users
SemTech 2012 - Making your semantic app addictive: Incentivizing Users
 
SocInfo2011 - Designing For Motivation
SocInfo2011 - Designing For MotivationSocInfo2011 - Designing For Motivation
SocInfo2011 - Designing For Motivation
 
AAAI2012 - Crowd Sourcing Web Service Annotations
AAAI2012 - Crowd Sourcing Web Service AnnotationsAAAI2012 - Crowd Sourcing Web Service Annotations
AAAI2012 - Crowd Sourcing Web Service Annotations
 
SemTech2011 - Employee-of-the-Month' Badge Unlocked
SemTech2011 - Employee-of-the-Month' Badge UnlockedSemTech2011 - Employee-of-the-Month' Badge Unlocked
SemTech2011 - Employee-of-the-Month' Badge Unlocked
 
INSEMTIVES Tutorial ISWC2011 - Session4
INSEMTIVES Tutorial ISWC2011 - Session4INSEMTIVES Tutorial ISWC2011 - Session4
INSEMTIVES Tutorial ISWC2011 - Session4
 
INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3
 
INSEMTIVES Tutorial ISWC2011 - Session2
INSEMTIVES Tutorial ISWC2011 - Session2INSEMTIVES Tutorial ISWC2011 - Session2
INSEMTIVES Tutorial ISWC2011 - Session2
 
UAB 2011 - Seekda Webservices Portal
UAB 2011 - Seekda Webservices PortalUAB 2011 - Seekda Webservices Portal
UAB 2011 - Seekda Webservices Portal
 
UAB 2011 - L!nks Showcase
UAB 2011 - L!nks ShowcaseUAB 2011 - L!nks Showcase
UAB 2011 - L!nks Showcase
 
UAB 2011- Combining human and computational intelligence
UAB 2011- Combining human and computational intelligenceUAB 2011- Combining human and computational intelligence
UAB 2011- Combining human and computational intelligence
 
UAB 2011 - Games
UAB 2011 - GamesUAB 2011 - Games
UAB 2011 - Games
 
L!NKS Showcase
L!NKS ShowcaseL!NKS Showcase
L!NKS Showcase
 
INSEMTIVES year 2 - Dissemination and Community Building
INSEMTIVES year 2  - Dissemination and Community BuildingINSEMTIVES year 2  - Dissemination and Community Building
INSEMTIVES year 2 - Dissemination and Community Building
 
WP8 Okenterprise Use Case - Applying Insemtives to Corporate Portals
WP8 Okenterprise Use Case - Applying Insemtives to Corporate PortalsWP8 Okenterprise Use Case - Applying Insemtives to Corporate Portals
WP8 Okenterprise Use Case - Applying Insemtives to Corporate Portals
 
WP2 2nd Review
WP2 2nd ReviewWP2 2nd Review
WP2 2nd Review
 
WP2 1st Review
WP2 1st ReviewWP2 1st Review
WP2 1st Review
 
WP1 1st Review
WP1 1st ReviewWP1 1st Review
WP1 1st Review
 

Último

NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceMartin Humpolec
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncObject Automation
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.francesco barbera
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 

Último (20)

NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your Salesforce
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation Inc
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 

INSEMTIVES talk at Semtech2010

  • 1. Reputation, community, Web 2.0, and games: incentives for semantics – about getting people involved www.insemtives.eu 1 Katharina Siorpaes and Elena Simperl SemTech 2010
  • 2. Executive summary • Many tasks related to semantic content authoring cannot be undertaken without human contribution. • User motivation is essential for semantic applications to achieve critical mass and ensure sustainable growth. • How to encourage user participation – Incentives – Technology design – Usability engineering – Games with a purpose www.insemtives.eu 2
  • 3. About the speakers www.insemtives.eu 3 Katharina Siorpaes Elena Simperl
  • 4. Agenda • Human-driven semantic content authoring • Incentives and participatory design • Example: Casual games • Example: Virtual worlds • Conclusion www.insemtives.eu 4
  • 5. HUMAN-DRIVEN SEMANTIC CONTENT AUTHORING Human-driven semantic content authoring Incentives and participatory design Example: Casual games Example: Virtual worlds Conclusions www.insemtives.eu 5
  • 6. Human vs computational intelligence • Ordered sequence of tasks into which the authoring exercise can be divided • Required skills and expertise www.insemtives.eu 6
  • 10. MILLION DOLLAR QUESTION HOW CAN WE MOTIVATE PEOPLE TO DEDICATE THEIR VALUABLE TIME TO ANNOTATE THEIR/OUR DATA? www.insemtives.eu 10
  • 11. INCENTIVES AND PARTICIPATORY DESIGN Human-driven semantic content authoring Incentives and participatory design Example: Casual games Example: Virtual worlds Conclusions www.insemtives.eu 11
  • 12. www.insemtives.eu 12 Motivation vs incentives • Incentives are ‘rewards’ assigned by an external ‘judge’ to a performer for undertaking a specific task. • Common belief (among economists): incentives can be translated into a sum of money for all practical purposes. • Incentives can be related to both extrinsic and intrinsic motivations.
  • 13. www.insemtives.eu 13 Extrinsic vs intrinsic motivation • Extrinsic motivation if task is considered – Boring, dangerous, useless, socially undesirable, dislikable by the performer. • Intrinsic motivation if – The performer likes what he/she is doing – The act is satisfying in itself (it can happen for many different reasons).
  • 14. Web 2.0 is hot, Semantic Web is not? www.insemtives.eu 14
  • 16. User-empowered Web • Comprehensive incentives studies are available (Kuznetsov, 2004; Marlow et al.,2006; Wikipedia, 2009). www.insemtives.eu 1616
  • 17. Example: Wikipedians • Reciprocity: Altruistic contributors receive a benefit in return. • Community: “Wikipedians […] feel needed”, there is “a sense of common purpose and belonging “. • Reputation: Contributors “develop identities in order to be respected, trusted, and appreciated by peers”. • Autonomy: Contributors enjoy “the freedom of independent decision”. Kuznetsov, 2004 www.insemtives.eu 17
  • 18. Factors influencing incentives design • Tasks or an ordered collection of tasks into which the authoring exercise can be divided. • Skills required to undertake the task. • Goal of the authoring exercise. • Social structure, i.e. social relationships among the subjects participating in the exercise. • Nature of the good.www.insemtives.eu 18
  • 19. Example: image sharing on a social platform • Task: attaching concepts and relationships to images (iPhoto). • Skills: identifying objects in images and choosing the right description. • Goal: sharing and retrieval. • Social structure: Friends (in social network). • Nature of the good: annotations accessible to me and my friends. www.insemtives.eu 19
  • 20. Example: UNSPSC and eCl@ss alignment • Task: ontology alignment • Skills: domain knowledge, modeling skills • Goal: interoperability • Social structure: enterprise, team • Nature of good: for benefit of enterprise www.insemtives.eu 20
  • 21. Technology and application design • Involve users in the design process. – Design workshops, interviews etc. • Take usability serious. – Design for efficiency, effectiveness and user satisfaction. • Design for sociability. – Support sharing, contributing, collaborating, identity-building. www.insemtives.eu 21
  • 22. Technology and application design (ii) • Respect trust/security and safety/privacy issues. – Support visibility and awareness. • Design for fun. • Follow an user experience design approach. • Support a user’s individual identity in a (and contribution to a) community with collaborative activities. www.insemtives.eu 22
  • 23. Example: image annotation in OKEnterprise (i) • Involvement of users in design process – Interviews and user workshops • Usability – Interviews, usability evaluations • Design for sociability – User interaction, visibility of contributions, registered users, collaborative working • Trust and privacy – Trust in enterprise portal, rating – Privacy: users have control over their data www.insemtives.eu 23
  • 24. Example: image annotation in OKEnterprise (ii) • Design for fun – Annotator of the week, rankings – Casual games • User-experience design approach – Evaluate and revise depending on user experience • Support user’s individual identity – Registration of users, individual user pages www.insemtives.eu 24
  • 25. NOW: FUN AND COMPETITION: GAMES FOR SEMANTICS! Human-driven semantic content authoring Incentives and participatory design Example: Casual games Example: Virtual worlds Conclusions www.insemtives.eu 25
  • 30. Results n=2905 rounds n=2234 12.9% 10.2% 76.9% Either skipped or no consensus found in the first task Challenges in which only the first task was completed consensually Challenges in which both tasks were completed consensually 97.6% 0.5% 1.9% Challenges in which at least the first task was completed consensually Wrong judgements of ontological nature Wrong abstractions
  • 31. MASSACRE – MASive Semantic Annotation Creation Game www.insemtives.eu 31
  • 32. Phratris – Phrase Analysis TETRIS www.insemtives.eu 32
  • 33. playence’ Uhani (i) www.insemtives.eu 33 Check www.playence.com!
  • 35. Casual games 1. Steep learning curve 2. Fast game play: little time effort required 3. Simple implementation (simple interface and graphics) 4. Low hardware efforts (usually browser or mobile app) 5. Low bandwidth requirements 6. Mass audience www.insemtives.eu 35
  • 36. How to design your own game 1. Specify output 2. Identify input 3. Choose type of game and define game play 4. Based on previous decisions, define game play and adapt underlying game ontology 5. Adapt or define export algorithm 6. Evaluate output www.insemtives.eu 36
  • 37. Guidelines 1. Timed response 2. Score keeping 3. Player skill level 4. High score lists 5. Randomness 5. Random player pairing 6. Player testing 7. Repetition 8. Taboo outputs www.insemtives.eu 37 Luis von Ahn. Games With A Purpose. IEEE Computer Magazine, June 2006. pp 96-98.
  • 38. Challenges • Identifying suitable tasks in semantic content creation. • Designing games. • Designing a usable, attractive interface. • Identifying suitable knowledge corpora. • Preventing cheating. • Defusing typical pitfalls of conceptual modeling. • Distribution of labor. • Fostering user participation. • Deriving formal representations. • Scalability and performance. www.insemtives.eu 38
  • 39. ANNOTATION IN VIRTUAL WORLDS Human-driven semantic content authoring Incentives and participatory design Example: Casual games Example: Virtual worlds Conclusions www.insemtives.eu 39
  • 40. Tiny Planets • Kids TV property licensed in over 100 countries worldwide • Education • Diverse broadcaster base – from Al Jazeera to American Armed Forces network • Unusual age profile – kids 4 -11 • Brand extensions into web and virtual world www.insemtives.eu 40
  • 41. Tiny Planets (ii) • Tiny Planets website – 40,000 unique visitors per month • 100,000 page impressions • Average stay 8 minutes • MTP virtual world – active 47,000 user accounts • Books, Fun, TV, Learning, Labs sites as well as virtual world • Real and virtual currencies • Cross-site account creation www.insemtives.eu 41
  • 42. • Engage kids with annotation games as a means of expression • Combination of ‘rating’, ‘tagging’, and pre-scripted comments • Locate content within virtual world to inform friends, give clues in games, give an ‘emotional’ context to items by expressing opinions. Search for clues and comments left by friends • Reward annotations with virtual currency www.insemtives.eu 42 Virtual world
  • 43. Real world • Real-world science experiment based on Galaxy Zoo format • Crater marking using data from NASA LRO • Use My Tiny Planets account for sign in and performance tracking • Reward annotations with achievements and virtual currency • And kudos; kids get to know they’re doing science for real, and its going to be used. www.insemtives.eu 43
  • 45. Incentives • Earn Stars to spend on Virtual Goods, games or videos • Earn awards that can be seen by other players in your passport • Rise in Rank as you perform targeted activities • Join the Pro circuit so that your top scores can be seen by other players • Buy Keys, which unlock new areas and new activities in which to spend your Stars. www.insemtives.eu 45
  • 50. CONCLUSIONS Human-driven semantic content authoring Incentives and participatory design Example: Casual games Example: Virtual worlds Conclusions www.insemtives.eu 50
  • 51. Summary • Human contribution is needed for selected tasks in semantic content authoring. • Web 2.0 has impressively demonstrated how strong incentives can foster user participation and create successful applications. • Turning semantic content creation tasks into games is an especially intriguing idea because of the potentially large amounts of human-produced data that can be created. • Challenges are manifold: knowledge corpora, interesting game design, ensuring uptake, difficulty of tasks, etc. www.insemtives.eu 51
  • 52. 1/28/2015 www.insemtives.eu 52 Realizing the Semantic Web by encouraging millions of end-users to create semantic content.

Notas del editor

  1. Instead of explaining what they are I would present some examples