SlideShare una empresa de Scribd logo
1 de 21
Descargar para leer sin conexión
cityforward.org
City Forward and open data standards
Gina Cardosi and Dave Rook
3-Aug-2012
2© 2012 IBM Corporation 2© 2010 IBM Corporation© 2012 IBM Corporation
More than ever before, human life
revolves around the city.
In 1900,
13%
of the world’s
population
lived in cities.
In 2007, that
number surpassed
50%
—and it continues
to grow.*
By 2050,
70%
of all people on
earth will be city
dwellers.
* We are adding the
equivalent of seven
New Yorks to the
planet every year.
2
3© 2012 IBM Corporation
Our Cities Generate Vital Signs
 Today, almost anything—any object, process or system—can be
instrumented, interconnected and infused with intelligence.
 Data is lying in archives, published on government websites, being
sensed from instrumentation in the environment, deduced from
aerial imagery, and built from the ground-up by citizens
electronically communicating about city life.
 This reality holds enormous promise for people everywhere. Nowhere
is the potential for progress more evident than in the world’s cities.
4© 2012 IBM Corporation
Map provided by Data.gov http://www.data.gov/community#mapanchor
Open Data is global
4
“I want us to ask ourselves everyday, how are we using
technology to make a real difference in people’s lives.”
- President Barack Obama
5© 2012 IBM Corporation 5© 2010 IBM Corporation
Our mission: To bring together information
about cities and communities in ways that lead
to new insights and support decision-making.
6© 2012 IBM Corporation 6© 2010 IBM Corporation
What is Corporate Citizenship?
© 2012 IBM Corporation 6
IBM has developed a thoughtful, comprehensive approach to corporate citizenship that aligns
with IBM’s values and maximizes the impact we can make as a global enterprise. We focus on
specific societal issues, including the environment, community economic development,
education, health, literacy, language and culture.
7© 2012 IBM Corporation© 2012 IBM Corporation
8© 2012 IBM Corporation© 2012 IBM Corporation 8
9© 2012 IBM Corporation
Adding data to City Forward
 Once sources are identified there are still legal and technical steps
involved in adding data to City Forward.
Load into Database
Identify Data Source
Map to Data Structure
Review Legality
Assess the Value
Data challenges
• Some cities don’t have data that’s
publically available and free
• Each new source introduces
additional transformation rules
Value challenges
• Data isn’t at a city level
• Data doesn’t span years to
allow for patterns over time
Legal challenges
• Data is publicly available
but with restrictions, must
seek permission
10© 2012 IBM Corporation
Data Issues
 Standard classifications
Integrating data from different countries introduces incompatibilities in classifications of
data. For example, defining poverty and education level varies by country. In
addition, defining the geography or time frame requires an administrative
organization to define the city or metro area boundaries and when the reporting
period starts and ends (e.g., school year).
 Aggregation
Non-additive data such as indicators cannot be aggregated over geography, time, or
other classification. For example, unemployment rates, poverty rates, gross domestic
product per capita are indicators that must be recomputed by geographic level and
time frame. Having the unemployment rate at the county level cannot be summed to
compute the unemployment rate for the metro area.
 Availability
Gathering data and making it available costs money. Most countries do not have data
like the US Census American Community Survey (ACS) that provides annual
estimates on many topics. The House of Representatives voted to eliminate funding
for the ACS and the Senate has yet to vote on the issue.
11© 2012 IBM Corporation
Open Data Movement timeline
Source: http://visual.ly/open-data-movement
12© 2012 IBM Corporation
Impact on everyday life
 How safe is
my neighborhood?
 Which career is
right for me?
 What type of
education do I need?
Sources: http://www.chicagocitycrime.com/, http://www.bls.gov/ooh/computer-and-information-technology/software-developers.htm, http://cityforward.org
12
13© 2012 IBM Corporation
The United States advocates agencies make
data available via APIs and widgets and
provides an open source version of data.gov
Source: http://www.data.gov/opengovplatform
14© 2012 IBM Corporation
Options for data analysis and integration are
increasing
 Government agencies are promoting not only data, but application
programming interfaces (APIs) and interactive widgets to help
developers get access to timely data
 Sites like DBpedia, Freebase, and Tetherless World Constellation
(TWI) are cataloging data in Resource Description Language (RDF) to
make data accessible anywhere anytime.
Linked data is prominent at data.gov.uk, dublinked, and other open
data sites.
 Non profit organizations are proving community level data to enhance
citizen engagement.
15© 2012 IBM Corporation
Linked Data
 DBPedia
http://dbpedia.org/About
 Freebase
http://www.freebase.com/
 Data.gov.uk
http://data.gov.uk/
 Dublinked
http://www.dublinked.ie/
 Data.gov
http://www.data.gov/
Sourc: http://linkeddata.org/
Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/
16© 2012 IBM Corporation
The Open Data Protocol (OData) is an
emerging standard
 Based on web technology standards
HTTP, Atom Publishing Protocol (AtomPub), JSON, and REST
 OData is used to access data in various data sources
Relational databases, file systems, content management, web sites, etc.
 See ecosystem link on odata.org to see current list of
Consumers: Applications to process OData
Applications: Applications exposing OData
Producers: Live OData Services
Sample Services and Sample Code
 Link to article about OData and RDF ->
http://www.ibm.com/developerworks/webservices/library/standards-odata/
Source: http://www.odata.org/
17© 2012 IBM Corporation
Socrata is an open data vendor gaining market share
 Growing list of customers (see list ->)
 G7 cities working together on sharing
applications by standardizing data
formats: Chicago, Los Angeles, Boston,
New York, Seattle, Washington, DC,
and San Francisco.
 SODA is the Socrata Open Data API
Customer Web site
City of New Orleans data.nola.gov
MetroChicagoData.com metrochicagodata.com
City of Baltimore data.baltimorecity.gov
City of Austin data.austintexas.gov
SAMHSA info.samhsa.gov
City of San Francisco data.sfgov.org
U.N.D.P. data.undp.com
Kenya opendata.go.ke
New York City nyc.gov/data
State of Illinois data.illinois.gov
King County datakc.org
Cook County datacatalog.cookcountyil.gov
City of Edmonton data.edmonton.ca
Data.gov explore.data.gov
Medicare data.medicare.gov
State of Oregon data.oregon.gov
State of Oklahoma data.ok.gov
City of Chicago data.cityofchicago.org
City of Seattle data.seattle.gov
State of Colorado data.colorado.gov
Region of Lombardia dati.lombardia.it
State of Missouri data.mo.gov
Ethics.gov ethics.gov
City of De Leon deleon.socrata.com
source: http://www.socrata.com/customer-spotlight/
18© 2012 IBM Corporation
Widgets
Government
agencies are now
creating interactive
widgets and gadgets
that can be
embedded into other
web sites.
Examples:
US Census
Environment
Protection Agency
(EPA)
Sources: http://2010.census.gov/2010census/data/index.php, http://www.epa.gov/enviro/facts/widgets.html
19© 2012 IBM Corporation
Open 311
Source: http://open311.org/
20© 2012 IBM Corporation
For more information
 Open Government Initiatives -> http://wiki.civiccommons.org/Initiatives
 Global Pulse -> http://www.unglobalpulse.org/
 Open Government Data Catalog (RDF) ->
http://logd.tw.rpi.edu/demo/international_dataset_catalog_search
 Global City Indicators -> http://www.cityindicators.org/
 NNIP Best Metro Data Releases of 2011 ->
http://www.theatlanticcities.com/technology/2011/12/best-metro-data-releases-of
 US Census Developer page -> http://www.census.gov/developers/
 Dept of Labor Developer web site -> http://developer.dol.gov/
 EPA Developer page -> http://www.epa.gov/developer/index.html
cityforward.org
Thank you.

Más contenido relacionado

La actualidad más candente

wp-us-cities-exposed-industries-and-ics
wp-us-cities-exposed-industries-and-icswp-us-cities-exposed-industries-and-ics
wp-us-cities-exposed-industries-and-icsNumaan Huq
 
GIS and Asset Management Moving to the Future :
GIS and Asset Management  Moving to the Future : GIS and Asset Management  Moving to the Future :
GIS and Asset Management Moving to the Future : Symphony3
 
The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com
The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com
The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com Kapil Khandelwal (KK)
 
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...Ben Cave
 
Who Has Your Back 2014: Protecting Your Data From Government Requests
Who Has Your Back 2014: Protecting Your Data From Government RequestsWho Has Your Back 2014: Protecting Your Data From Government Requests
Who Has Your Back 2014: Protecting Your Data From Government Requests- Mark - Fullbright
 
Virtual school of ig economic issues_2021
Virtual school of ig  economic issues_2021Virtual school of ig  economic issues_2021
Virtual school of ig economic issues_2021Desiree Miloshevic
 
Final LA tech and venture landscape
Final LA tech and venture landscapeFinal LA tech and venture landscape
Final LA tech and venture landscapeMark Suster
 
20170207 THe Valley_Internet of things ongoing revolution
20170207 THe Valley_Internet of things ongoing revolution20170207 THe Valley_Internet of things ongoing revolution
20170207 THe Valley_Internet of things ongoing revolutionBernardo Campillo
 
FUTURISTIC TECHNOLOGIES
FUTURISTIC TECHNOLOGIESFUTURISTIC TECHNOLOGIES
FUTURISTIC TECHNOLOGIESChuck Brooks
 
Civic data and open government: How you and your organization can get involved
Civic data and open government: How you and your organization can get involvedCivic data and open government: How you and your organization can get involved
Civic data and open government: How you and your organization can get involvedKDMC
 
20210128 jim spohrer ai house_fund v4
20210128 jim spohrer ai house_fund v420210128 jim spohrer ai house_fund v4
20210128 jim spohrer ai house_fund v4ISSIP
 
Five Disruptive Technologies and Their Impact on Connecticut's Jobs
Five Disruptive Technologies and Their Impact on Connecticut's JobsFive Disruptive Technologies and Their Impact on Connecticut's Jobs
Five Disruptive Technologies and Their Impact on Connecticut's JobsBillKelvie
 
The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com
The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com
The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com Kapil Khandelwal (KK)
 
Leveraging the Government Platform
Leveraging the Government PlatformLeveraging the Government Platform
Leveraging the Government PlatformMark Headd
 
The 10 Vital Skills You Will Need For The Future Of Work
The 10 Vital Skills You Will Need For The Future Of WorkThe 10 Vital Skills You Will Need For The Future Of Work
The 10 Vital Skills You Will Need For The Future Of WorkBernard Marr
 
Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com
Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com
Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com Kapil Khandelwal (KK)
 

La actualidad más candente (19)

computational_law
computational_lawcomputational_law
computational_law
 
wp-us-cities-exposed-industries-and-ics
wp-us-cities-exposed-industries-and-icswp-us-cities-exposed-industries-and-ics
wp-us-cities-exposed-industries-and-ics
 
GIS and Asset Management Moving to the Future :
GIS and Asset Management  Moving to the Future : GIS and Asset Management  Moving to the Future :
GIS and Asset Management Moving to the Future :
 
The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com
The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com
The Genomic Opportunity: Kapil Khandelwal, www.kapilkhandelwal.com
 
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...
 
Who Has Your Back 2014: Protecting Your Data From Government Requests
Who Has Your Back 2014: Protecting Your Data From Government RequestsWho Has Your Back 2014: Protecting Your Data From Government Requests
Who Has Your Back 2014: Protecting Your Data From Government Requests
 
Virtual school of ig economic issues_2021
Virtual school of ig  economic issues_2021Virtual school of ig  economic issues_2021
Virtual school of ig economic issues_2021
 
Final LA tech and venture landscape
Final LA tech and venture landscapeFinal LA tech and venture landscape
Final LA tech and venture landscape
 
20170207 THe Valley_Internet of things ongoing revolution
20170207 THe Valley_Internet of things ongoing revolution20170207 THe Valley_Internet of things ongoing revolution
20170207 THe Valley_Internet of things ongoing revolution
 
FUTURISTIC TECHNOLOGIES
FUTURISTIC TECHNOLOGIESFUTURISTIC TECHNOLOGIES
FUTURISTIC TECHNOLOGIES
 
Civic data and open government: How you and your organization can get involved
Civic data and open government: How you and your organization can get involvedCivic data and open government: How you and your organization can get involved
Civic data and open government: How you and your organization can get involved
 
20210128 jim spohrer ai house_fund v4
20210128 jim spohrer ai house_fund v420210128 jim spohrer ai house_fund v4
20210128 jim spohrer ai house_fund v4
 
Five Disruptive Technologies and Their Impact on Connecticut's Jobs
Five Disruptive Technologies and Their Impact on Connecticut's JobsFive Disruptive Technologies and Their Impact on Connecticut's Jobs
Five Disruptive Technologies and Their Impact on Connecticut's Jobs
 
Sxsw march12 2011
Sxsw march12 2011Sxsw march12 2011
Sxsw march12 2011
 
The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com
The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com
The Promise of Omics : Kapil Khandelwal, www.kapilkhandelwal.com
 
How china broke up with its internet companies
How china broke up with its internet companiesHow china broke up with its internet companies
How china broke up with its internet companies
 
Leveraging the Government Platform
Leveraging the Government PlatformLeveraging the Government Platform
Leveraging the Government Platform
 
The 10 Vital Skills You Will Need For The Future Of Work
The 10 Vital Skills You Will Need For The Future Of WorkThe 10 Vital Skills You Will Need For The Future Of Work
The 10 Vital Skills You Will Need For The Future Of Work
 
Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com
Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com
Agenda for a Healthy City: Kapil Khandelwal, www.kapilkhandelwal.com
 

Similar a City Forward and Open Data Standards

Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...
Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...
Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...Forum One
 
Go Code Colorado: Inspiring Innovation & Opening Data
Go Code Colorado: Inspiring Innovation & Opening DataGo Code Colorado: Inspiring Innovation & Opening Data
Go Code Colorado: Inspiring Innovation & Opening DataSalesforce Developers
 
Open Innovation - Winter 2014 - Socrata, Inc.
Open Innovation - Winter 2014 - Socrata, Inc.Open Innovation - Winter 2014 - Socrata, Inc.
Open Innovation - Winter 2014 - Socrata, Inc.Socrata
 
Ibm and open data final
Ibm and open data finalIbm and open data final
Ibm and open data finalloredanasales
 
Semantics for Smarter Cities
Semantics for Smarter CitiesSemantics for Smarter Cities
Semantics for Smarter CitiesLD4SC
 
Open data for smart cities
Open data for smart citiesOpen data for smart cities
Open data for smart citiesSören Auer
 
Innovating with Open Data - Avi Bender
Innovating with Open Data - Avi Bender Innovating with Open Data - Avi Bender
Innovating with Open Data - Avi Bender scoopnewsgroup
 
Open government international garry lloyd
Open government international   garry lloydOpen government international   garry lloyd
Open government international garry lloydGarry Lloyd
 
AMO 2010 Urban Symposium
AMO 2010 Urban SymposiumAMO 2010 Urban Symposium
AMO 2010 Urban SymposiumBepublic
 
Mary Meeker Internet Trends Report for 2019
Mary Meeker Internet Trends Report for 2019Mary Meeker Internet Trends Report for 2019
Mary Meeker Internet Trends Report for 2019Eric Johnson
 
Digital 2022 Global Overview Report (January 2022) v05
Digital 2022 Global Overview Report (January 2022) v05Digital 2022 Global Overview Report (January 2022) v05
Digital 2022 Global Overview Report (January 2022) v05DataReportal
 
Digital 2022 Global Overview Report Essentials.pdf
Digital 2022 Global Overview Report Essentials.pdfDigital 2022 Global Overview Report Essentials.pdf
Digital 2022 Global Overview Report Essentials.pdfWalidMorchid
 
Smart cities presentation (4) cg (1)
Smart cities presentation (4) cg (1)Smart cities presentation (4) cg (1)
Smart cities presentation (4) cg (1)EdGaskin1
 
2012_Detroit End of Year Report
2012_Detroit End of Year Report2012_Detroit End of Year Report
2012_Detroit End of Year ReportCode for America
 
Leveraging Data to Engage Citizens and Drive Innovation
Leveraging Data to Engage Citizens and Drive InnovationLeveraging Data to Engage Citizens and Drive Innovation
Leveraging Data to Engage Citizens and Drive InnovationThomas Robbins
 
Big Data Ecosystem presentation on the introduction
Big Data Ecosystem presentation on the introductionBig Data Ecosystem presentation on the introduction
Big Data Ecosystem presentation on the introductionoyeitsmihir
 

Similar a City Forward and Open Data Standards (20)

Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...
Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...
Vivek Kundra: Creating the Digital Public Square / Forum One Web Executive Se...
 
Innovations in Data for Decision Making
Innovations in Data for Decision MakingInnovations in Data for Decision Making
Innovations in Data for Decision Making
 
Go Code Colorado: Inspiring Innovation & Opening Data
Go Code Colorado: Inspiring Innovation & Opening DataGo Code Colorado: Inspiring Innovation & Opening Data
Go Code Colorado: Inspiring Innovation & Opening Data
 
Open Innovation - Winter 2014 - Socrata, Inc.
Open Innovation - Winter 2014 - Socrata, Inc.Open Innovation - Winter 2014 - Socrata, Inc.
Open Innovation - Winter 2014 - Socrata, Inc.
 
Ibm and open data final
Ibm and open data finalIbm and open data final
Ibm and open data final
 
Semantics for Smarter Cities
Semantics for Smarter CitiesSemantics for Smarter Cities
Semantics for Smarter Cities
 
Open data for smart cities
Open data for smart citiesOpen data for smart cities
Open data for smart cities
 
Innovating with Open Data - Avi Bender
Innovating with Open Data - Avi Bender Innovating with Open Data - Avi Bender
Innovating with Open Data - Avi Bender
 
Open government international garry lloyd
Open government international   garry lloydOpen government international   garry lloyd
Open government international garry lloyd
 
AMO 2010 Urban Symposium
AMO 2010 Urban SymposiumAMO 2010 Urban Symposium
AMO 2010 Urban Symposium
 
Mary Meeker Internet Trends Report for 2019
Mary Meeker Internet Trends Report for 2019Mary Meeker Internet Trends Report for 2019
Mary Meeker Internet Trends Report for 2019
 
Pesquisa Redes Sociais
Pesquisa Redes SociaisPesquisa Redes Sociais
Pesquisa Redes Sociais
 
Digital 2022 Global Overview Report (January 2022) v05
Digital 2022 Global Overview Report (January 2022) v05Digital 2022 Global Overview Report (January 2022) v05
Digital 2022 Global Overview Report (January 2022) v05
 
Digital 2022 Global Overview Report Essentials.pdf
Digital 2022 Global Overview Report Essentials.pdfDigital 2022 Global Overview Report Essentials.pdf
Digital 2022 Global Overview Report Essentials.pdf
 
Smart cities presentation (4) cg (1)
Smart cities presentation (4) cg (1)Smart cities presentation (4) cg (1)
Smart cities presentation (4) cg (1)
 
2012_Detroit End of Year Report
2012_Detroit End of Year Report2012_Detroit End of Year Report
2012_Detroit End of Year Report
 
Smart cities and the Internet of Things
Smart cities and the Internet of ThingsSmart cities and the Internet of Things
Smart cities and the Internet of Things
 
Caribbean Digital Economy:Opportunities and Challenges
Caribbean Digital Economy:Opportunities and ChallengesCaribbean Digital Economy:Opportunities and Challenges
Caribbean Digital Economy:Opportunities and Challenges
 
Leveraging Data to Engage Citizens and Drive Innovation
Leveraging Data to Engage Citizens and Drive InnovationLeveraging Data to Engage Citizens and Drive Innovation
Leveraging Data to Engage Citizens and Drive Innovation
 
Big Data Ecosystem presentation on the introduction
Big Data Ecosystem presentation on the introductionBig Data Ecosystem presentation on the introduction
Big Data Ecosystem presentation on the introduction
 

Más de IBM Analytics

Data Lake: A simple introduction
Data Lake: A simple introductionData Lake: A simple introduction
Data Lake: A simple introductionIBM Analytics
 
10 WealthTech podcasts every wealth advisor should listen to
10 WealthTech podcasts every wealth advisor should listen to10 WealthTech podcasts every wealth advisor should listen to
10 WealthTech podcasts every wealth advisor should listen toIBM Analytics
 
Advantages of an integrated governance, risk and compliance environment
Advantages of an integrated governance, risk and compliance environmentAdvantages of an integrated governance, risk and compliance environment
Advantages of an integrated governance, risk and compliance environmentIBM Analytics
 
Cognitive banking with expert insights
Cognitive banking with expert insightsCognitive banking with expert insights
Cognitive banking with expert insightsIBM Analytics
 
Sales performance management and C-level goals
Sales performance management and C-level goalsSales performance management and C-level goals
Sales performance management and C-level goalsIBM Analytics
 
The science of client insight: Increase revenue through improved engagement
The science of client insight: Increase revenue through improved engagementThe science of client insight: Increase revenue through improved engagement
The science of client insight: Increase revenue through improved engagementIBM Analytics
 
Expert opinion on managing data breaches
Expert opinion on managing data breachesExpert opinion on managing data breaches
Expert opinion on managing data breachesIBM Analytics
 
Top industry use cases for streaming analytics
Top industry use cases for streaming analyticsTop industry use cases for streaming analytics
Top industry use cases for streaming analyticsIBM Analytics
 
Make data simple in the cognitive era
Make data simple in the cognitive eraMake data simple in the cognitive era
Make data simple in the cognitive eraIBM Analytics
 
IBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive era
IBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive eraIBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive era
IBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive eraIBM Analytics
 
4 common headaches with sales compensation management
4 common headaches with sales compensation management4 common headaches with sales compensation management
4 common headaches with sales compensation managementIBM Analytics
 
IBM Virtual Finance Forum 2016: Top 10 reasons to attend
IBM Virtual Finance Forum 2016: Top 10 reasons to attendIBM Virtual Finance Forum 2016: Top 10 reasons to attend
IBM Virtual Finance Forum 2016: Top 10 reasons to attendIBM Analytics
 
Data science tips for data engineers
Data science tips for data engineersData science tips for data engineers
Data science tips for data engineersIBM Analytics
 
How secure is your enterprise from threats?
How secure is your enterprise from threats? How secure is your enterprise from threats?
How secure is your enterprise from threats? IBM Analytics
 
10 benefits to thinking inside Box
10 benefits to thinking inside Box10 benefits to thinking inside Box
10 benefits to thinking inside BoxIBM Analytics
 
The digital transformation of the French Open
The digital transformation of the French OpenThe digital transformation of the French Open
The digital transformation of the French OpenIBM Analytics
 
Bridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architectureBridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architectureIBM Analytics
 
What does data tell you about the customer journey?
What does data tell you about the customer journey?What does data tell you about the customer journey?
What does data tell you about the customer journey?IBM Analytics
 
What CEOs want from CDOs and how to deliver on it
What CEOs want from CDOs and how to deliver on itWhat CEOs want from CDOs and how to deliver on it
What CEOs want from CDOs and how to deliver on itIBM Analytics
 
Banking in the age of the empowered consumer
Banking in the age of the empowered consumerBanking in the age of the empowered consumer
Banking in the age of the empowered consumerIBM Analytics
 

Más de IBM Analytics (20)

Data Lake: A simple introduction
Data Lake: A simple introductionData Lake: A simple introduction
Data Lake: A simple introduction
 
10 WealthTech podcasts every wealth advisor should listen to
10 WealthTech podcasts every wealth advisor should listen to10 WealthTech podcasts every wealth advisor should listen to
10 WealthTech podcasts every wealth advisor should listen to
 
Advantages of an integrated governance, risk and compliance environment
Advantages of an integrated governance, risk and compliance environmentAdvantages of an integrated governance, risk and compliance environment
Advantages of an integrated governance, risk and compliance environment
 
Cognitive banking with expert insights
Cognitive banking with expert insightsCognitive banking with expert insights
Cognitive banking with expert insights
 
Sales performance management and C-level goals
Sales performance management and C-level goalsSales performance management and C-level goals
Sales performance management and C-level goals
 
The science of client insight: Increase revenue through improved engagement
The science of client insight: Increase revenue through improved engagementThe science of client insight: Increase revenue through improved engagement
The science of client insight: Increase revenue through improved engagement
 
Expert opinion on managing data breaches
Expert opinion on managing data breachesExpert opinion on managing data breaches
Expert opinion on managing data breaches
 
Top industry use cases for streaming analytics
Top industry use cases for streaming analyticsTop industry use cases for streaming analytics
Top industry use cases for streaming analytics
 
Make data simple in the cognitive era
Make data simple in the cognitive eraMake data simple in the cognitive era
Make data simple in the cognitive era
 
IBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive era
IBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive eraIBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive era
IBM CDO Fall Summit 2016 Keynote: Driving innovation in the cognitive era
 
4 common headaches with sales compensation management
4 common headaches with sales compensation management4 common headaches with sales compensation management
4 common headaches with sales compensation management
 
IBM Virtual Finance Forum 2016: Top 10 reasons to attend
IBM Virtual Finance Forum 2016: Top 10 reasons to attendIBM Virtual Finance Forum 2016: Top 10 reasons to attend
IBM Virtual Finance Forum 2016: Top 10 reasons to attend
 
Data science tips for data engineers
Data science tips for data engineersData science tips for data engineers
Data science tips for data engineers
 
How secure is your enterprise from threats?
How secure is your enterprise from threats? How secure is your enterprise from threats?
How secure is your enterprise from threats?
 
10 benefits to thinking inside Box
10 benefits to thinking inside Box10 benefits to thinking inside Box
10 benefits to thinking inside Box
 
The digital transformation of the French Open
The digital transformation of the French OpenThe digital transformation of the French Open
The digital transformation of the French Open
 
Bridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architectureBridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architecture
 
What does data tell you about the customer journey?
What does data tell you about the customer journey?What does data tell you about the customer journey?
What does data tell you about the customer journey?
 
What CEOs want from CDOs and how to deliver on it
What CEOs want from CDOs and how to deliver on itWhat CEOs want from CDOs and how to deliver on it
What CEOs want from CDOs and how to deliver on it
 
Banking in the age of the empowered consumer
Banking in the age of the empowered consumerBanking in the age of the empowered consumer
Banking in the age of the empowered consumer
 

Último

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 

Último (20)

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 

City Forward and Open Data Standards

  • 1. cityforward.org City Forward and open data standards Gina Cardosi and Dave Rook 3-Aug-2012
  • 2. 2© 2012 IBM Corporation 2© 2010 IBM Corporation© 2012 IBM Corporation More than ever before, human life revolves around the city. In 1900, 13% of the world’s population lived in cities. In 2007, that number surpassed 50% —and it continues to grow.* By 2050, 70% of all people on earth will be city dwellers. * We are adding the equivalent of seven New Yorks to the planet every year. 2
  • 3. 3© 2012 IBM Corporation Our Cities Generate Vital Signs  Today, almost anything—any object, process or system—can be instrumented, interconnected and infused with intelligence.  Data is lying in archives, published on government websites, being sensed from instrumentation in the environment, deduced from aerial imagery, and built from the ground-up by citizens electronically communicating about city life.  This reality holds enormous promise for people everywhere. Nowhere is the potential for progress more evident than in the world’s cities.
  • 4. 4© 2012 IBM Corporation Map provided by Data.gov http://www.data.gov/community#mapanchor Open Data is global 4 “I want us to ask ourselves everyday, how are we using technology to make a real difference in people’s lives.” - President Barack Obama
  • 5. 5© 2012 IBM Corporation 5© 2010 IBM Corporation Our mission: To bring together information about cities and communities in ways that lead to new insights and support decision-making.
  • 6. 6© 2012 IBM Corporation 6© 2010 IBM Corporation What is Corporate Citizenship? © 2012 IBM Corporation 6 IBM has developed a thoughtful, comprehensive approach to corporate citizenship that aligns with IBM’s values and maximizes the impact we can make as a global enterprise. We focus on specific societal issues, including the environment, community economic development, education, health, literacy, language and culture.
  • 7. 7© 2012 IBM Corporation© 2012 IBM Corporation
  • 8. 8© 2012 IBM Corporation© 2012 IBM Corporation 8
  • 9. 9© 2012 IBM Corporation Adding data to City Forward  Once sources are identified there are still legal and technical steps involved in adding data to City Forward. Load into Database Identify Data Source Map to Data Structure Review Legality Assess the Value Data challenges • Some cities don’t have data that’s publically available and free • Each new source introduces additional transformation rules Value challenges • Data isn’t at a city level • Data doesn’t span years to allow for patterns over time Legal challenges • Data is publicly available but with restrictions, must seek permission
  • 10. 10© 2012 IBM Corporation Data Issues  Standard classifications Integrating data from different countries introduces incompatibilities in classifications of data. For example, defining poverty and education level varies by country. In addition, defining the geography or time frame requires an administrative organization to define the city or metro area boundaries and when the reporting period starts and ends (e.g., school year).  Aggregation Non-additive data such as indicators cannot be aggregated over geography, time, or other classification. For example, unemployment rates, poverty rates, gross domestic product per capita are indicators that must be recomputed by geographic level and time frame. Having the unemployment rate at the county level cannot be summed to compute the unemployment rate for the metro area.  Availability Gathering data and making it available costs money. Most countries do not have data like the US Census American Community Survey (ACS) that provides annual estimates on many topics. The House of Representatives voted to eliminate funding for the ACS and the Senate has yet to vote on the issue.
  • 11. 11© 2012 IBM Corporation Open Data Movement timeline Source: http://visual.ly/open-data-movement
  • 12. 12© 2012 IBM Corporation Impact on everyday life  How safe is my neighborhood?  Which career is right for me?  What type of education do I need? Sources: http://www.chicagocitycrime.com/, http://www.bls.gov/ooh/computer-and-information-technology/software-developers.htm, http://cityforward.org 12
  • 13. 13© 2012 IBM Corporation The United States advocates agencies make data available via APIs and widgets and provides an open source version of data.gov Source: http://www.data.gov/opengovplatform
  • 14. 14© 2012 IBM Corporation Options for data analysis and integration are increasing  Government agencies are promoting not only data, but application programming interfaces (APIs) and interactive widgets to help developers get access to timely data  Sites like DBpedia, Freebase, and Tetherless World Constellation (TWI) are cataloging data in Resource Description Language (RDF) to make data accessible anywhere anytime. Linked data is prominent at data.gov.uk, dublinked, and other open data sites.  Non profit organizations are proving community level data to enhance citizen engagement.
  • 15. 15© 2012 IBM Corporation Linked Data  DBPedia http://dbpedia.org/About  Freebase http://www.freebase.com/  Data.gov.uk http://data.gov.uk/  Dublinked http://www.dublinked.ie/  Data.gov http://www.data.gov/ Sourc: http://linkeddata.org/ Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/
  • 16. 16© 2012 IBM Corporation The Open Data Protocol (OData) is an emerging standard  Based on web technology standards HTTP, Atom Publishing Protocol (AtomPub), JSON, and REST  OData is used to access data in various data sources Relational databases, file systems, content management, web sites, etc.  See ecosystem link on odata.org to see current list of Consumers: Applications to process OData Applications: Applications exposing OData Producers: Live OData Services Sample Services and Sample Code  Link to article about OData and RDF -> http://www.ibm.com/developerworks/webservices/library/standards-odata/ Source: http://www.odata.org/
  • 17. 17© 2012 IBM Corporation Socrata is an open data vendor gaining market share  Growing list of customers (see list ->)  G7 cities working together on sharing applications by standardizing data formats: Chicago, Los Angeles, Boston, New York, Seattle, Washington, DC, and San Francisco.  SODA is the Socrata Open Data API Customer Web site City of New Orleans data.nola.gov MetroChicagoData.com metrochicagodata.com City of Baltimore data.baltimorecity.gov City of Austin data.austintexas.gov SAMHSA info.samhsa.gov City of San Francisco data.sfgov.org U.N.D.P. data.undp.com Kenya opendata.go.ke New York City nyc.gov/data State of Illinois data.illinois.gov King County datakc.org Cook County datacatalog.cookcountyil.gov City of Edmonton data.edmonton.ca Data.gov explore.data.gov Medicare data.medicare.gov State of Oregon data.oregon.gov State of Oklahoma data.ok.gov City of Chicago data.cityofchicago.org City of Seattle data.seattle.gov State of Colorado data.colorado.gov Region of Lombardia dati.lombardia.it State of Missouri data.mo.gov Ethics.gov ethics.gov City of De Leon deleon.socrata.com source: http://www.socrata.com/customer-spotlight/
  • 18. 18© 2012 IBM Corporation Widgets Government agencies are now creating interactive widgets and gadgets that can be embedded into other web sites. Examples: US Census Environment Protection Agency (EPA) Sources: http://2010.census.gov/2010census/data/index.php, http://www.epa.gov/enviro/facts/widgets.html
  • 19. 19© 2012 IBM Corporation Open 311 Source: http://open311.org/
  • 20. 20© 2012 IBM Corporation For more information  Open Government Initiatives -> http://wiki.civiccommons.org/Initiatives  Global Pulse -> http://www.unglobalpulse.org/  Open Government Data Catalog (RDF) -> http://logd.tw.rpi.edu/demo/international_dataset_catalog_search  Global City Indicators -> http://www.cityindicators.org/  NNIP Best Metro Data Releases of 2011 -> http://www.theatlanticcities.com/technology/2011/12/best-metro-data-releases-of  US Census Developer page -> http://www.census.gov/developers/  Dept of Labor Developer web site -> http://developer.dol.gov/  EPA Developer page -> http://www.epa.gov/developer/index.html