SlideShare a Scribd company logo
1 of 55
Urban*: Crowdsourcing for the good of London
@danielequercia
Yahoo! Labs, Barcelona
daniele quercia
offline & online
offline & online
Facebook+
census deprivation + data
So what?
Situation

(Its already 75% in the USA)
Situation

By 2025 another 1.2 billion living in urban areas
Situation

Cities in developing countries: 5M new inhabitants each month
Problem
Inequality! Timely allocation of
scarce resources
census deprivation + londoners on twitter
1 census deprivation + sentiment
[CSCW’12] Tracking Gross Community Happiness from Tweets
3 match sentiment with (census) deprivation
2 classify sentiment of profiles
1 collect profiles & geo-reference them
250K profiles in London (31.5M tweets)
3 seeds: newspaper accounts
1 collect profiles & geo-reference them
1,323 in London neighborhoods  573 in 51 neighborhoods
social medialanguage personality
r=.350 word count r=.365 MaxEnt
predicting socioeconomic well-being with twitter
2 census deprivation + topics
social media
environment
sports
health Royal wedding
Spanish/Portuguese
celebrity gossips
Talk of the City [ICWSM’12]
read profiles & define topics
create virtual bins (latent topics)
assign words to a bin (@ random)
for each bin:
select pair of words
if co-occur more than chance:
keep them in the bin
else:
put them into another bin (@ random)
Facebook
Twitter
read profiles & define topics
create virtual bins (latent topics)
assign words to a bin (@ random)
for each bin:
select pair of words
if co-occur more than chance:
keep them in the bin
else:
put them into another bin (@ random)
Facebook
Twitter
social
econometrics
read profiles & define topics
create virtual bins (latent topics)
assign words to a bin (@ random)
for each bin:
select pair of words
if co-occur more than chance:
keep them in the bin
else:
put them into another bin (@ random)
Facebook
Twitter
social
econometrics
Latent Dirichlet Allocation (LDA)
Latent Dirichlet Allocation (LDA)
Analyze geo-referenced tweets
(not only residents but also visitors)
Linear Regression
R2
=.49 (49% of IMD variability explained)
3 census deprivation + tube trips
4 census deprivation + “mental maps”
Psychological Maps 2.0 [WWW’13]
draw a map
WEIRD trap!
Few hundreds of WEIRDos
White,Educated,Industrialized,Rich, and Democratic undergraduates
WWW
launched few months ago > 2K players
Regions
Regions
Boroughs
Boroughs
Londoners vs. UK vs. World
Vibility vs. Exposure
Visibility & Social Deprivation
5 Beyond visibility…
UrbanGems.org
To quantify “fuzzy” concepts
(a) (b) (c) (d)
(e) (f) (g) (h)
Figure 5: Visual Wordsfor Beauty (top row) and Ugly (bottom row).
and guardrails. The red dots on top-ranked pictures
hose on bottom-ranked ones mean two different things
ormer reflect positive(e.g., happy) visual words, while
Picture Quality Bias. Photos might not necessarily
what they aresupposed to show (representativeurban s
in each neighborhood), and somepictures might beof
Research?
This work is at intersection of two emerging fields:
a) computational aesthetic
b) computational geo-cultural modeling
unleashing the potential of mobile data
vs0
@danielequercia

More Related Content

Similar to Urban*: Crowdsourcing for the Good of London

Final Exam Study GuidePlease review the following questions an.docx
Final Exam Study GuidePlease review the following questions an.docxFinal Exam Study GuidePlease review the following questions an.docx
Final Exam Study GuidePlease review the following questions an.docx
RAJU852744
 
Final Exam Study GuidePlease review the following questi.docx
Final Exam Study GuidePlease review the following questi.docxFinal Exam Study GuidePlease review the following questi.docx
Final Exam Study GuidePlease review the following questi.docx
ssuser454af01
 
Project X impact of social media on public safety
Project X impact of social media on public safetyProject X impact of social media on public safety
Project X impact of social media on public safety
TNO
 
Creative Cities _ A critical review _ Bertram Niessen 2008 (ENG)
Creative Cities _ A critical review _  Bertram Niessen 2008 (ENG)Creative Cities _ A critical review _  Bertram Niessen 2008 (ENG)
Creative Cities _ A critical review _ Bertram Niessen 2008 (ENG)
Bertram Niessen
 
Lesson 1 numbers in the media
Lesson 1 numbers in the mediaLesson 1 numbers in the media
Lesson 1 numbers in the media
chin1440
 
DC Tech and Humanities talk
DC Tech and Humanities talkDC Tech and Humanities talk
DC Tech and Humanities talk
Bryan Alexander
 

Similar to Urban*: Crowdsourcing for the Good of London (20)

Talk of the City: Londoners and Social Media
Talk of the City: Londoners and Social MediaTalk of the City: Londoners and Social Media
Talk of the City: Londoners and Social Media
 
The Social World of Twitter: Topics, Geography, and Emotions
The Social World of Twitter: Topics, Geography, and EmotionsThe Social World of Twitter: Topics, Geography, and Emotions
The Social World of Twitter: Topics, Geography, and Emotions
 
2011 ku architecture intro for gaunt
2011 ku architecture intro for gaunt2011 ku architecture intro for gaunt
2011 ku architecture intro for gaunt
 
Twitter as a cognitive framework and heuristic media
Twitter as a cognitive framework and heuristic mediaTwitter as a cognitive framework and heuristic media
Twitter as a cognitive framework and heuristic media
 
Mining the Social Web - Lecture 3 - T61.6020
Mining the Social Web - Lecture 3 - T61.6020Mining the Social Web - Lecture 3 - T61.6020
Mining the Social Web - Lecture 3 - T61.6020
 
10 urban intangible properties
10 urban intangible properties10 urban intangible properties
10 urban intangible properties
 
Final Exam Study GuidePlease review the following questions an.docx
Final Exam Study GuidePlease review the following questions an.docxFinal Exam Study GuidePlease review the following questions an.docx
Final Exam Study GuidePlease review the following questions an.docx
 
Final Exam Study GuidePlease review the following questi.docx
Final Exam Study GuidePlease review the following questi.docxFinal Exam Study GuidePlease review the following questi.docx
Final Exam Study GuidePlease review the following questi.docx
 
Chap. 6
Chap. 6Chap. 6
Chap. 6
 
Project X impact of social media on public safety
Project X impact of social media on public safetyProject X impact of social media on public safety
Project X impact of social media on public safety
 
Creative Cities _ A critical review _ Bertram Niessen 2008 (ENG)
Creative Cities _ A critical review _  Bertram Niessen 2008 (ENG)Creative Cities _ A critical review _  Bertram Niessen 2008 (ENG)
Creative Cities _ A critical review _ Bertram Niessen 2008 (ENG)
 
Web 2.0 An Introduction
Web 2.0   An IntroductionWeb 2.0   An Introduction
Web 2.0 An Introduction
 
Educational Uses of SL
Educational Uses of SLEducational Uses of SL
Educational Uses of SL
 
Lesson 1 numbers in the media
Lesson 1 numbers in the mediaLesson 1 numbers in the media
Lesson 1 numbers in the media
 
Lecture 1- Understanding Urbanism.pdf easy
Lecture 1- Understanding Urbanism.pdf easyLecture 1- Understanding Urbanism.pdf easy
Lecture 1- Understanding Urbanism.pdf easy
 
New Media and Business
New Media and BusinessNew Media and Business
New Media and Business
 
TOWARD THE URBAN FUTURE BY J. PALEN
TOWARD THE URBAN FUTURE BY J. PALENTOWARD THE URBAN FUTURE BY J. PALEN
TOWARD THE URBAN FUTURE BY J. PALEN
 
DC Tech and Humanities talk
DC Tech and Humanities talkDC Tech and Humanities talk
DC Tech and Humanities talk
 
Beyond the Radar: Love, Passion and Fun
Beyond the Radar: Love, Passion and Fun Beyond the Radar: Love, Passion and Fun
Beyond the Radar: Love, Passion and Fun
 
ML Summit 2013 Speaker Presentations: Forces of Change
ML Summit 2013 Speaker Presentations: Forces of ChangeML Summit 2013 Speaker Presentations: Forces of Change
ML Summit 2013 Speaker Presentations: Forces of Change
 

More from Daniele Quercia

Personality in Twitter: influentials and popular users
Personality in Twitter: influentials and popular usersPersonality in Twitter: influentials and popular users
Personality in Twitter: influentials and popular users
Daniele Quercia
 
Geomob London September 2011
Geomob London September 2011Geomob London September 2011
Geomob London September 2011
Daniele Quercia
 
Rethinking Mobile Recommendations
Rethinking Mobile RecommendationsRethinking Mobile Recommendations
Rethinking Mobile Recommendations
Daniele Quercia
 

More from Daniele Quercia (20)

Like Partying? Your Face Says It All. Predicting Place AMBIANCE From Profile ...
Like Partying? Your Face Says It All. Predicting Place AMBIANCE From Profile ...Like Partying? Your Face Says It All. Predicting Place AMBIANCE From Profile ...
Like Partying? Your Face Says It All. Predicting Place AMBIANCE From Profile ...
 
The Digital Life of Walkable Streets
The Digital Life of Walkable StreetsThe Digital Life of Walkable Streets
The Digital Life of Walkable Streets
 
Spotting Trends: The Wisdom of the Few
Spotting Trends: The Wisdom of the FewSpotting Trends: The Wisdom of the Few
Spotting Trends: The Wisdom of the Few
 
Ads and the City
Ads and the CityAds and the City
Ads and the City
 
Unleashing the potential of spatial data
Unleashing the potential of spatial dataUnleashing the potential of spatial data
Unleashing the potential of spatial data
 
Loosing "Friends" on Facebook
Loosing "Friends" on FacebookLoosing "Friends" on Facebook
Loosing "Friends" on Facebook
 
Facebook and Privacy: The Balancing Act of Personality, Gender, and Relations...
Facebook and Privacy: The Balancing Act of Personality, Gender, and Relations...Facebook and Privacy: The Balancing Act of Personality, Gender, and Relations...
Facebook and Privacy: The Balancing Act of Personality, Gender, and Relations...
 
Middleware for social computing: a roadmap
Middleware for social computing: a roadmap	Middleware for social computing: a roadmap
Middleware for social computing: a roadmap
 
Auralist: Introducing Serendipity into Music Recommendation
Auralist: Introducing Serendipity into Music RecommendationAuralist: Introducing Serendipity into Music Recommendation
Auralist: Introducing Serendipity into Music Recommendation
 
Personality in Twitter: influentials and popular users
Personality in Twitter: influentials and popular usersPersonality in Twitter: influentials and popular users
Personality in Twitter: influentials and popular users
 
In the mood for being influential
In the mood for being influential In the mood for being influential
In the mood for being influential
 
Geomob London September 2011
Geomob London September 2011Geomob London September 2011
Geomob London September 2011
 
Rethinking Mobile Recommendations
Rethinking Mobile RecommendationsRethinking Mobile Recommendations
Rethinking Mobile Recommendations
 
FriendSensing
FriendSensingFriendSensing
FriendSensing
 
Sybil Attacks Against Mobile Users
Sybil Attacks Against Mobile UsersSybil Attacks Against Mobile Users
Sybil Attacks Against Mobile Users
 
Promoting location privacy… one lie at a time
Promoting location privacy… one lie at a timePromoting location privacy… one lie at a time
Promoting location privacy… one lie at a time
 
Netsci10 report
Netsci10 reportNetsci10 report
Netsci10 report
 
MobiRate [Ubicomp 2008]
MobiRate [Ubicomp 2008]MobiRate [Ubicomp 2008]
MobiRate [Ubicomp 2008]
 
Selecting Trustworthy Content Using Tags
Selecting Trustworthy Content Using TagsSelecting Trustworthy Content Using Tags
Selecting Trustworthy Content Using Tags
 
Mobisys
MobisysMobisys
Mobisys
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 

Urban*: Crowdsourcing for the Good of London

Editor's Notes

  1. notes
  2. we use the gravity model to study flows of passengers on London’s rail system. extensive network. 588 stations. click for oyster card. oyster cards record the point and time of entry… and link all journeys to a user id, so we can analyse individual travel patterns. stats – 1 month = 77 million journeys by 5 million users between 588 stations.
  3. the world is currently undergoing a massive influx of people into cities. which means that (next slide)
  4. the world is currently undergoing a massive influx of people into cities. which means that (next slide)
  5. the world is currently undergoing a massive influx of people into cities. which means that (next slide)
  6. in particular, transport analysts and planners need to be able to understand and predict passenger flow so far there has been little work on modeling flows on public transport systems in an urban environment, or at the intra- city level. one reason for this may be lack of data, but with adoption of AFC in cities all over the world, this data is now readily available.