This document discusses smart cities, open data, and semantic mediawiki (SMW). It provides an overview of a conference on these topics held in Carlsbad, CA in 2012. It discusses the goals of using open data and SMW to stimulate app development, encourage innovation, and create new intellectual property. It also provides examples of how crowdsourcing and incentivized competitions can drive innovation.
23. Citywide
Events
Calendar
Electronics
Stores
Parking
Facili7es
Sidewalk
Cafes
Laundry
Facili7es
Financial
Empowerment
Centers
IPIS
(Integrated
Property
Informa7on
System)
City
government
retrofit
projects
NYC
Civil
Service
Titles
NYC
Department
of
Educa7on
Job
Titles
Lis7ng
of
cultural
organiza7ons
with
vital
stats
Programs
Funding
for
FY2010
24. Land
cover
Reservoir
and
Dam
sta7s7cs
Hydrostats
TSA
Entertainment
venues
TSA
Food
and
Beverage
loca7ons
TSA
Hotels
TSA
screens
TSA
pedestrian
counts
Lincoln
Square
BID
Business
List
Museums
and
galleries
City
government
retrofit
projects
School
Point
Loca7ons
School
Zones
2009
School
Survey
2010
School
Survey
25. Main Goals
• stimulate development of apps
that improve access to info
and govt transparency,
and;
• encourage innovation & the
creation of new IP with
commercial potential
31. CROWDSOURCING
• Challenge:
Improve Recommendation Algorithm
by 10%
• Dataset:
STATISTICS
• 100 million ratings (training set) • just 6 days into contest,
• Half a million Users Cinematch bested by 1%
• 18 thousand movies • 20,000 Teams, 150 countries
• Entrants:
• Prize: • Bell Labs
One million US Dollars
• Opera Solutions
• Well-renowned universities
32. CROWDSOURCING
• Challenge:
Improve Recommendation Algorithm
by 10%
• Dataset:
STATISTICS
• 100 million ratings (training set) • just 6 days into contest,
• Half a million Users Cinematch bested by 1%
• 18 thousand movies • 20,000 Teams, 150 countries
• Entrants:
• Prize: • Bell Labs
One million US Dollars
• Opera Solutions
• Well-renowned universities
40. • First Federal CIO - Vivek Kundra
• Open Government Initiative
• Recovery.gov
• Data.gov
• USAspending.gov
• IT Dashboard
• Performance.gov
• Fedspace
• Citizen Services Dashboard
41. • First Federal CIO - Vivek Kundra
• Open Government Initiative
• Recovery.gov
• Data.gov
• USAspending.gov
• IT Dashboard
• Performance.gov
• Fedspace
• Citizen Services Dashboard
42. • First Federal CIO - Vivek Kundra
• Open Government Initiative
• Recovery.gov
• Data.gov
• USAspending.gov
• IT Dashboard
• Performance.gov
• Fedspace
• Citizen Services Dashboard
43. • First Federal CIO - Vivek Kundra
• Open Government Initiative
• Recovery.gov
• Data.gov
• USAspending.gov
• IT Dashboard
• Performance.gov
• Fedspace
• Citizen Services Dashboard
44. • First Federal CIO - Vivek Kundra
• Open Government Initiative
• Recovery.gov
}
• Data.gov Li fe
S u pp o r
t
• USAspending.gov
• IT Dashboard
• Performance.gov
• Fedspace
• Citizen Services Dashboard
45. • First Federal CIO - Vivek Kundra
• Open Government Initiative
•
sh ed
Recovery.gov
}
e t• sla o u Li fe
t S pp
B u dg i lli on
Data.gov
• m
ort
$ 34 o n USAspending.gov
fr o m •m i l l i
$8
IT Dashboard
• Performance.gov
• Fedspace
• Citizen Services Dashboard
51. Int. No. 29: Accessibility to Public Data Sets
“...requires that all public data sets
maintained by City agencies shall be made
available on the Internet through a single
web portal, formatted to enable viewing by
web browsers and mobile devices and also in
their raw or unprocessed form.”
52.
53. ch and
b io ni
Principles
• Cost Effective
• Easy to Use (Developers/Publishers/Citizens)
• based on Open Standards
• Low Adoption Curve
• Help Accelerate Open Data Innovation
• Useable Data Now!
55. Useable Data Now
• “Beautiful” Website
• Useable by Developers/Publishers/Citizens
• based on Open Standards
• Low Adoption Curve
• Help Accelerate Open Data Innovation
• Useable Data Now!
56. What
NYCBigApps
Developers
were
Doing
Download &
Decipher
ETL Text
Processes
Siloed Data
• Spend inordinate amount of time interpreting data
• Massaged Data was then staged locally
• Developers kept reinventing the wheel
• Limited Data mashups
• Applications disconnected from NYCDatamine
42
58. How it Started
• Oct 12, 2010 - NYCBigApps 2.0 announced
• Nov 9, 2010 - NYCBigApps 2.0 kickoff meeting
• late Nov 2010 - spoke with Revelytix/Spry about
collaborating
• early Dec 2010 - started work on NYCDataWeb
• Jan 26, 2011 ~4:30p - submitted entry
59.
60.
61. What
We
Did
Domain
Ontology
Query &
Results
Cache Optimizer
Definitions
Re-Writer Planner
Siloed Data
Indexes Rules
Re-Writer Optimizer Mapping
Ontology
Indexes Planner Rules
Metadata
Ontology
47
85. Phase 2
• Integrate NYCreation • Make it easier for
and NYCmantics Citizens
• Incorporate the whole • Incorporate the best of
NYC datamine Socrata and data.gov
• Make it easier for • Position SMW+ as the
Publishers accelerated data mashup
platform
• Make it easier for
Developers • ...powered by NYC
DataWeb
86. Phase 3
• Open-source • Make it easier STILL for
collaboration with Publishers, Developers
Revelytix and Citizens
(more info at SemTech 2011)
• Widespread adoption of
• <Your city here> SMW/SMW+
DataWeb
• ... keep standing on the
• DataWeb Deployment shoulders of giants
Framework bundle
87. Phase 3
• Open-source • Make it easier STILL for
collaboration with Publishers, Developers
Revelytix and Citizens
(more info at SemTech 2011)
• Widespread adoption of
• <Your city here> SMW/SMW+
DataWeb
• ... keep standing on the
• DataWeb Deployment shoulders of giants
Framework bundle
88. Phase 3
• Open-source • Make it easier STILL for
collaboration with Publishers, Developers
Revelytix and Citizens
(more info at SemTech 2011)
• Widespread adoption of
• <Your city here> SMW/SMW+
DataWeb
• ... keep standing on the
• DataWeb Deployment shoulders of giants
Framework bundle
89. The Genesis of
Ontodia
• Oct 4, 2011 - “Find your next Startup Partner”
meetup - NYEBN
• Oct 5, 2011 - Steve Jobs dies
• Oct 11, 2011 - NYCBigApps 3.0 announced
• Oct 17, 2011 - Joel leaves TCG
• Oct 25, 2011 - Ontodia, LLC formed
90.
91. Your time is limited. Don’t
waste your time living
someone else’s life.
92. We’re here to put a dent in
the universe. Otherwise,
why even be here?
101. "Over
the
next
decade,
cities
will
continue
to
grow
larger
at
a
rapid
pace.
At
the
same
time,
new
technologies
will
unlock
massive
streams
of
data
about
cities
and
their
residents.
As
these
forces
collide,
they
will
turn
every
city
into
a
unique
civic
laboratory—a
place
where
technology
is
adapted
in
novel
ways
to
meet
local
needs."
December
2010.
Institute
of
the
Future's
2020
Forecast
–
The
Future
of
Cities,
Information
and
Inclusion.
102. Ci4es:
Worldwide,
city
leaders
and
managers
need
cost-‐effective
&
smart
solutions
Popula'on
Growth:
-‐ 221
cities
globally
with
more
than
1
million
citizens
-‐
China
will
move
300
million
people
to
cities
by
2020
-‐
90%
of
these
cities
are
in
emerging
markets
-‐
In
2008,
more
people
lived
in
cities
(3.3
billion),
by
2030,
5
billion
-‐ Cities
are
more
efJicient
and
have
less
environmental
impact
Cost
of
City
Services:
Aging
infrastructure,
resource
constraints
&
waste
-‐ Washington
DC’s
water
system
has
elements
that
date
to
the
Civil
War
-‐ InefJiciency,
leaks
and
waste
rival
maintenance
and
expansion
costs
source:
Gartner
–
Is
Smart
Cities
the
Next
Big
Market?
March
2011
103. Why NYC?
• City Population: • Gross Metropolitan Product:
8.1 million (2010 Census) USD $ 1.28 Trillion
(Greyhill Advisors)
• Metro NYC Population:
18.9 million (2010 Census) • DOITT annual budget:
USD $325 million
• City Density:
10,630/km2 (2010 Census) • ~120 City Agencies/
Departments, each with
• Metro NYC Density: multiple datasources and
standards
1,085.7/km2 (2010 Census)
• 50 million visitors a year • Second only to Silicon Valley for
most startups
104. Why NYC?
• Jan 24, 2011 - First Chief Digital Officer Appointed
• May 16, 2011 - NYC Digital Roadmap released
• Dec 19, 2011 - Cornell University-Technion-Israel
Institute of Technology announced
• Mar 7, 2012 - NYC Open Data Bill passed
• April 17, 2012 - NYC Open Data Standards wiki
launched
• April 17, 2012 - NYCBigApps 3.0 awards ceremony
105.
106.
107.
108.
109.
110. ROAD MAP FOR THE
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011
111. ROAD MAP FOR THE
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011
112. ROAD MAP FOR THE
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011
113. ROAD MAP FOR THE
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011
NYC
Open
Data
114. ROAD MAP FOR THE
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011
NYC
Open
Data
115. ROAD MAP FOR THE
Linked
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011
APIs Data
NYC
Open
???
Data
116. Developers,
Businesses,
Citizens, etc.
ROAD MAP FOR THE
Linked
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011
APIs Data
NYC
Open
???
Data
119. 0. Huge Open Data
1. Extract Metadata
2. Derive ExtraMetadata
(Semantics + Statistics + Algorithm + Crowd)
3. Do Federated Queries on both the
Metadata AND the Data
Crowdknowing
126. New York > Manhattan > Midtown > Times Square > 42nd Street
What do you want?
Top Gluten-free Restaurants
Eat for less than $10
Discount Broadway Tickets
Item 4
Michelin-rated restaurants
Events in the next hour
Tourist Resident Business Developer Government
130. We need your help & feedback
A Smart Data Exchange for All Data NYC
Find out more at
http://nyc.pediacities.com/facets
131. CREDITS
• Lego Faceparty picture by RichardAM (http://www.richard-am.net/)
• Lego Inauguration Pictures from various Flickr Users (sluggobear, Atwater,
Dan Hontz)
• Lego Luke looses his Hand by Flickr user wwwayazdotcom
• Tim Berners-Lee highlight from TED (http://www.ted.com/talks/
tim_berners_lee_on_the_next_web.html)
• Hans Rosling highlight from TED (http://www.ted.com/talks/
hans_rosling_shows_the_best_stats_you_ve_ever_seen.html)
• FlowerPowerpont2.pptx provided by Anna Rosling Rönnlund of gapminder
• several images taken from NYC.gov properties
• Various screenshots provided by Revelytix, Spry Inc. and TCG Software
Services