SlideShare una empresa de Scribd logo
1 de 14
Descargar para leer sin conexión
CROWD SOURCING 102
                          Real-Time Data Mining and Curation with SwiftRiver



                                  Personal Democracy Forum 2011
                                           jg@swiftly.org
                                        @jongos @swiftriver




Tuesday, June 7, 2011
About Ushahidi                       Notable Uses                             The Challenge
    Ushahidi is a free, open-source      Ushahidi has been deployed in            As the amounts of data
    platform used for crowdsourcing      major global crisis scenarios,           aggregated by Ushahidi users
    and visualizing data geospatially.   allowing organizations to draw           grows, they face a common
    It was born out of the 2008          situational awareness from the           problem. How do they effectively
    election unrest when founders        crowd.      To date it’s been            manage this realtime data? How
    Juliana Rotish, Erik Hersman, Ory    downloaded over 15,000 times.            can we help them discover
    Okolloh and David Kobia wanted                                                credible and actionable info from
    to allow Kenyan citizens a way to    S o m e o f t h e m o re n o t a b l e   the deluge of reports they’ll get
    SMS reports of incident to know      deployments include recently in          from the public? The SwiftRiver
    what was occurring around them.      Egypt, the Haiti earthquakes, the        initiative was created to begin to
    This was one of the earliest uses    fires in Russia, the Queensland           answer some of these questions
    of crowdsourcing for crisis          floods in Australia.                      for Ushahidi deployers.
    response.

Tuesday, June 7, 2011
“It’s not information overload. It’s filter failure.”
                                                                - Clay Shirky




Tuesday, June 7, 2011
PLATFORM GOALS
                  Consider the context, relevance defined by the user

                  Offer an opt-in global database of trust and authority

                  Algorithms augment, but not define, human decision making

                  Work across media channels (Twitter, Email, Feeds, SMS)

                  Be accessible (offline/online/mobile)

                  Index massive amounts of the mobile/social web


Tuesday, June 7, 2011
THIS IS A DATA PROBLEM




Tuesday, June 7, 2011
DATA IS AGNOSTIC




Tuesday, June 7, 2011
STRATEGY


                  Operate more like a startup than activists

                  Test humanitarian solutions in a business context

                  Journalists, Private Sector, NGOs & Government Agencies

                  Build internal engineering capacity




Tuesday, June 7, 2011
PROGRESS

                  7,000+ downloads in 6 months

                  7,000+ API Users

                  100,000+ Lines of code

                  5 APIs and 2 Apps

                  Data Items Processed - 70,000,000 (liberal extrapolation)



Tuesday, June 7, 2011
Tuesday, June 7, 2011
Tuesday, June 7, 2011
Tuesday, June 7, 2011
ABC Australia Deployment

Tuesday, June 7, 2011
Sweeper - User Interface

Tuesday, June 7, 2011
CROWD SOURCING 102
                          Real-Time Data Mining and Curation with SwiftRiver



                              jg@swiftly.org
                            @jongos @swiftriver


Tuesday, June 7, 2011

Más contenido relacionado

Similar a Crowdsourcing 102: Mining Real-Time Data

Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011
Adam Ford
 
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Katie Whipkey
 
John_Smart_Amplify11
John_Smart_Amplify11John_Smart_Amplify11
John_Smart_Amplify11
AmplifyFest
 

Similar a Crowdsourcing 102: Mining Real-Time Data (20)

Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011Ben Goertzel - Singularity Summit Australia talk in 2011
Ben Goertzel - Singularity Summit Australia talk in 2011
 
Scraping the Social Graph with Ushahidi and SwiftRiver
Scraping the Social Graph with Ushahidi and SwiftRiverScraping the Social Graph with Ushahidi and SwiftRiver
Scraping the Social Graph with Ushahidi and SwiftRiver
 
Big data, democratized analytics and deep context,
Big data, democratized analytics and deep context, Big data, democratized analytics and deep context,
Big data, democratized analytics and deep context,
 
Big Data, Democratized Analytics and International Development
Big Data, Democratized Analytics and International Development Big Data, Democratized Analytics and International Development
Big Data, Democratized Analytics and International Development
 
Ushahidi esri juliana
Ushahidi esri julianaUshahidi esri juliana
Ushahidi esri juliana
 
Global pulse technology
Global pulse technologyGlobal pulse technology
Global pulse technology
 
Global pulse technology summary
Global pulse technology summaryGlobal pulse technology summary
Global pulse technology summary
 
Data Science For Social Good: Tackling the Challenge of Homelessness
Data Science For Social Good: Tackling the Challenge of HomelessnessData Science For Social Good: Tackling the Challenge of Homelessness
Data Science For Social Good: Tackling the Challenge of Homelessness
 
ICCM 2013 Panel 1: What's so Big about Big Data?
ICCM 2013 Panel 1: What's so Big about Big Data?ICCM 2013 Panel 1: What's so Big about Big Data?
ICCM 2013 Panel 1: What's so Big about Big Data?
 
Privacy, Security and Motivation of Crowds
Privacy, Security and Motivation of CrowdsPrivacy, Security and Motivation of Crowds
Privacy, Security and Motivation of Crowds
 
Foresight Analytics
Foresight AnalyticsForesight Analytics
Foresight Analytics
 
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
 
US Office of Personnel Management: Notes on "Big Data"
US Office of Personnel Management: Notes on  "Big Data" US Office of Personnel Management: Notes on  "Big Data"
US Office of Personnel Management: Notes on "Big Data"
 
Open Data Movement around the Globe
Open Data Movement around the GlobeOpen Data Movement around the Globe
Open Data Movement around the Globe
 
ITP / SED Day 2
ITP / SED Day 2ITP / SED Day 2
ITP / SED Day 2
 
Ushahidi 101 (old)
Ushahidi 101 (old)Ushahidi 101 (old)
Ushahidi 101 (old)
 
Ushahidi: mobile crisis reporting
Ushahidi: mobile crisis reportingUshahidi: mobile crisis reporting
Ushahidi: mobile crisis reporting
 
Edyra
EdyraEdyra
Edyra
 
John_Smart_Amplify11
John_Smart_Amplify11John_Smart_Amplify11
John_Smart_Amplify11
 
The Evolution of Open Data
The Evolution of Open DataThe Evolution of Open Data
The Evolution of Open Data
 

Más de Ushahidi

Pivoting An African Open Source Project
Pivoting An African Open Source ProjectPivoting An African Open Source Project
Pivoting An African Open Source Project
Ushahidi
 

Más de Ushahidi (20)

Data Science for Social Good and Ushahidi - Final Presentation
Data Science for Social Good and Ushahidi - Final PresentationData Science for Social Good and Ushahidi - Final Presentation
Data Science for Social Good and Ushahidi - Final Presentation
 
Corruption mapping (april 2013, part 2)
Corruption mapping (april 2013, part 2)Corruption mapping (april 2013, part 2)
Corruption mapping (april 2013, part 2)
 
Anti-Corruption Mapping (April 2013, part 1)
Anti-Corruption Mapping (April 2013, part 1)Anti-Corruption Mapping (April 2013, part 1)
Anti-Corruption Mapping (April 2013, part 1)
 
Ushahdi 3.0 Design Framework
Ushahdi 3.0 Design Framework Ushahdi 3.0 Design Framework
Ushahdi 3.0 Design Framework
 
Around the Globe Corruption Mapping (part 2)
Around the Globe Corruption Mapping (part 2)Around the Globe Corruption Mapping (part 2)
Around the Globe Corruption Mapping (part 2)
 
Around the Globe Corruption Mapping (part 1)
Around the Globe Corruption Mapping (part 1)Around the Globe Corruption Mapping (part 1)
Around the Globe Corruption Mapping (part 1)
 
Ushahidi Toolbox - Real-time Evaluation
Ushahidi Toolbox - Real-time EvaluationUshahidi Toolbox - Real-time Evaluation
Ushahidi Toolbox - Real-time Evaluation
 
Ushahidi Toolbox - Implementation
Ushahidi Toolbox - ImplementationUshahidi Toolbox - Implementation
Ushahidi Toolbox - Implementation
 
Ushahidi Toolbox - Assessment
Ushahidi Toolbox - AssessmentUshahidi Toolbox - Assessment
Ushahidi Toolbox - Assessment
 
Kenya Ushahidi Evaluation: Unsung Peace Heros/Building Bridges
Kenya Ushahidi Evaluation: Unsung Peace Heros/Building BridgesKenya Ushahidi Evaluation: Unsung Peace Heros/Building Bridges
Kenya Ushahidi Evaluation: Unsung Peace Heros/Building Bridges
 
Kenya Ushahidi Evaluation: Uchaguzi
Kenya Ushahidi Evaluation: UchaguziKenya Ushahidi Evaluation: Uchaguzi
Kenya Ushahidi Evaluation: Uchaguzi
 
Kenya Ushahidi Evaluation: Blog Series
Kenya Ushahidi Evaluation: Blog SeriesKenya Ushahidi Evaluation: Blog Series
Kenya Ushahidi Evaluation: Blog Series
 
Pivoting An African Open Source Project
Pivoting An African Open Source ProjectPivoting An African Open Source Project
Pivoting An African Open Source Project
 
Ushahidi personas scenarios
Ushahidi personas scenariosUshahidi personas scenarios
Ushahidi personas scenarios
 
Citizen pollution mapping made easy
Citizen pollution mapping made easy Citizen pollution mapping made easy
Citizen pollution mapping made easy
 
Testimony
TestimonyTestimony
Testimony
 
Map it, Change it
Map it, Change itMap it, Change it
Map it, Change it
 
Map it, Make it, Hack it
Map it, Make it, Hack itMap it, Make it, Hack it
Map it, Make it, Hack it
 
What if Citizens Mapped Health?
What if Citizens Mapped Health?What if Citizens Mapped Health?
What if Citizens Mapped Health?
 
Re-imagining Citizen Engagement
Re-imagining Citizen EngagementRe-imagining Citizen Engagement
Re-imagining Citizen Engagement
 

Último

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Último (20)

Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 

Crowdsourcing 102: Mining Real-Time Data

  • 1. CROWD SOURCING 102 Real-Time Data Mining and Curation with SwiftRiver Personal Democracy Forum 2011 jg@swiftly.org @jongos @swiftriver Tuesday, June 7, 2011
  • 2. About Ushahidi Notable Uses The Challenge Ushahidi is a free, open-source Ushahidi has been deployed in As the amounts of data platform used for crowdsourcing major global crisis scenarios, aggregated by Ushahidi users and visualizing data geospatially. allowing organizations to draw grows, they face a common It was born out of the 2008 situational awareness from the problem. How do they effectively election unrest when founders crowd. To date it’s been manage this realtime data? How Juliana Rotish, Erik Hersman, Ory downloaded over 15,000 times. can we help them discover Okolloh and David Kobia wanted credible and actionable info from to allow Kenyan citizens a way to S o m e o f t h e m o re n o t a b l e the deluge of reports they’ll get SMS reports of incident to know deployments include recently in from the public? The SwiftRiver what was occurring around them. Egypt, the Haiti earthquakes, the initiative was created to begin to This was one of the earliest uses fires in Russia, the Queensland answer some of these questions of crowdsourcing for crisis floods in Australia. for Ushahidi deployers. response. Tuesday, June 7, 2011
  • 3. “It’s not information overload. It’s filter failure.” - Clay Shirky Tuesday, June 7, 2011
  • 4. PLATFORM GOALS Consider the context, relevance defined by the user Offer an opt-in global database of trust and authority Algorithms augment, but not define, human decision making Work across media channels (Twitter, Email, Feeds, SMS) Be accessible (offline/online/mobile) Index massive amounts of the mobile/social web Tuesday, June 7, 2011
  • 5. THIS IS A DATA PROBLEM Tuesday, June 7, 2011
  • 7. STRATEGY Operate more like a startup than activists Test humanitarian solutions in a business context Journalists, Private Sector, NGOs & Government Agencies Build internal engineering capacity Tuesday, June 7, 2011
  • 8. PROGRESS 7,000+ downloads in 6 months 7,000+ API Users 100,000+ Lines of code 5 APIs and 2 Apps Data Items Processed - 70,000,000 (liberal extrapolation) Tuesday, June 7, 2011
  • 13. Sweeper - User Interface Tuesday, June 7, 2011
  • 14. CROWD SOURCING 102 Real-Time Data Mining and Curation with SwiftRiver jg@swiftly.org @jongos @swiftriver Tuesday, June 7, 2011