1.
Hey, it's THE PEOPLE'S data! The global emergence of the Open Data Movement Tom Johnson Managing Director Institute for Analytic Journalism Santa Fe, NM tom@jtjohnson.com

2.
<ul><li>Presented at the Santa Fe Complex 5 Oct. 2011 </li></ul><ul><li>Slides may be found at http://opendatanm.pbworks.com </li></ul>It's the people's data by J. T. Johnson is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs

3.
Cause for optimism? <ul><li>&quot; All agencies should adopt a presumption in favor of disclosure. &quot; </li></ul><ul><li>&quot; We must operate state government in an open and transparent manner. &quot; </li></ul>

4.
<ul><li>&quot; All agencies should adopt a presumption in favor of disclosure. &quot; </li></ul><ul><li>Barack Obama . &quot;Freedom of Information Act: MEMORANDUM FOR THE HEADS OF EXECUTIVE DEPARTMENTS AND AGENCIES.&quot; </li></ul><ul><li>&quot; We must operate state government in an open and transparent manner. “ </li></ul><ul><li>Susana Martinez . &quot;Ensuring Transparency and Ethics in Our Government.&quot; </li></ul>

5.
Tonight’s Objectives <ul><li>Part of the SFX series &quot;What's happening now?“ </li></ul><ul><li>Brief interested citizens and journos on potential for citizen control of our data </li></ul><ul><li>Test the water to see if others in SFe might be interested in building a &quot;Get our data&quot; project </li></ul>

6.
Objectives - &quot;It's The People's data.&quot; <ul><li>Basic Process: Data In  Analysis  Info Out </li></ul><ul><li>Facilitate transparency, participation, collaboration, economic development </li></ul><ul><li>Create greater efficiency and utility for public administrators </li></ul><ul><li>Create a culture in government and public administration that assumes The People's Data will be quickly online in its original file format . </li></ul><ul><li>Educate citizens on how to identify, retrieve, analyze and present data </li></ul>

7.
Backstory & Assumptions <ul><li>It IS the people's data </li></ul><ul><ul><li>Changing Functions of gov't. </li></ul></ul><ul><ul><li>Fight against the &quot;data huggers&quot; </li></ul></ul><ul><li>An informed electorate is better than uninformed </li></ul><ul><li>Full political spectrum can agree on importance of data (if not interpretation) </li></ul><ul><li>The technology is relatively easy; changing the culture is hard </li></ul><ul><li>Supply analytic tools if possible, i.e. sort and array, GIS, visual stats </li></ul>

8.
Assumptions <ul><li>Default: Post all gov't data in original file format as soon as possible </li></ul><ul><ul><li>Make as easy to download in original format as possible </li></ul></ul><ul><li>Yes, there are/will be privacy issues </li></ul><ul><ul><li>But start with “put the data up” </li></ul></ul><ul><ul><li>Then ask, “OK, is there going to be anything here that encroaches on an individual’s privacy?” </li></ul></ul>

9.
Why timely? <ul><li>“ The Big Bundle” examination of NM voter rolls </li></ul><ul><ul><li>Clean up registered voter list </li></ul></ul><ul><ul><li>64k “questionable” voters on roles </li></ul></ul><ul><ul><li>Outcome always determined by methodology </li></ul></ul><ul><li>Santa Fe Public Schools performance data &quot; Zero Sum: School district 'erased' low achievers to improve data &quot; </li></ul><ul><li>PRC expense report data </li></ul><ul><ul><li>PRC activates gas-card alerts </li></ul></ul>

10.
Open Data Movement is NOT about… <ul><li>• technology alone or • building a portal or • transparency for the sake of transparency. </li></ul>

11.
Greater benefits of open data… <ul><li>Increased internal government efficiency and effectiveness </li></ul><ul><li>Increased citizen participation and inclusion with more services closer to people’s needs </li></ul><ul><li>More services to people because of increased base of more potential service providers </li></ul><ul><li>New businesses/jobs for application and service developers </li></ul><ul><li>Synergies between government, public administration and civil society organizations </li></ul><ul><li>New uses of open data spur innovation and development in the CIT sector </li></ul>

12.
Development Seed

13.
About Moscow city administration opendata plans <ul><li>“ I would like to lauch public discussion here in Russia about city data openness and to civil oversight over city administration activities. So could you help me please with information about similar city projects around the world ? I know that there are Toronto, Chicago, Berlin and dozen other city opendata projects. If you know about any city level opendata portal, could you tell me about: > - how long time it takes to create it and to make it public? </li></ul>

14.
Int’l examples <ul><li>Ukraine - </li></ul>

15.
International <ul><li>from: Ann Frisch [email_address] date: Wed, Sep 21, 2011 at 2:33 PM subject: Re: [open-government] open-government Digest, Vol 19, Issue 28 mailing list: open-government.lists.okfn.org “I would like to get together with Open Data members from South Sudan, Philippines and South Caucasus region to what is being done in those areas in terms of open data.” </li></ul>

16.
Open Government Data Camp 2011 <ul><li>http://ogdcamp.org/cfp/ What: The world's biggest open data event to date. * When: 20-21st October, with satellite events from 17-26th October * Where: Warsaw, Poland * Web: http://www.ogdcamp.org * Hashtag: #ogdcamp </li></ul><ul><li>The camp has 4 key objectives: * Build consensus – around core open data principles and values * Build community – expand and strengthen international open data community * Share ideas – on the future of open data and how we can do things better * Make things – from starting projects, to making plans, to writing code </li></ul>

17.
Open Government Data Camp 2011 <ul><li>http://ogdcamp.org/cfp/ What: The world's biggest open data event to date. * When: 20-21st October, with satellite events from 17-26th October * Where: Warsaw, Poland * Web: http://www.ogdcamp.org * Hashtag: #ogdcamp </li></ul><ul><li>The camp has 4 key objectives: * Build consensus – around core open data principles and values * Build community – expand and strengthen international open data community * Share ideas – on the future of open data and how we can do things better * Make things – from starting projects, to making plans, to writing code </li></ul>

18.
Culture “hacks”

19.

20.
Hacks and Hackers around the world

21.

22.
Hacks and Hackers chapters

23.
What’s the process? Where’s the data? <ul><li>Data In  Analysis  Info Out </li></ul>

24.
<ul><li>TWC International Open Government Dataset Catalog (IOGDC http://logd.tw.rpi.edu/demo/international_dataset_catalog_search </li></ul>

25.
Open Data Showroom - http://opendata-showroom.org/

26.
AskTheEU.org

27.

28.
OpenlyLocal.com

29.
Hyperlocal Sites in UK & Ireland

30.
San Francisco: Data Sharing Among City Departments and Agencies

31.
International Excellent meta-data

32.
San Antonio Payment Register

33.
Santa Fe .gov

34.
Data search and retrieval <ul><li>What is the law? </li></ul><ul><ul><li>NM Foundation for Open Government </li></ul></ul><ul><ul><li>Records Retention Schedules and Their Use </li></ul></ul><ul><ul><ul><li>NM Statute 1.13.30 authority of state records administrator </li></ul></ul></ul><ul><ul><ul><li>May be policies unique to agency/department </li></ul></ul></ul><ul><ul><li>NM “Inspection of Public Records Act” </li></ul></ul><ul><ul><ul><li>FOG: http://nmfog.org/Recent_Changes_to_IPRA.aspx </li></ul></ul></ul>

35.
Retention of local gov’t records <ul><li>New Mexico - Local Government Records Retention and Disposition Schedules http://www.nmcpr.state.nm.us/nmac/_title01/T01C019.htm </li></ul>

36.
Retention of NM state gov’t records <ul><li>Administrative Records for state agencies http://www.nmcpr.state.nm.us/nmac/_title01/T01C015.htm </li></ul><ul><li>Executive records http://www.nmcpr.state.nm.us/nmac/_title01/T01C018.htm </li></ul><ul><li>Legislative records http://www.nmcpr.state.nm.us/nmac/_title01/T01C016.htm </li></ul><ul><li>Judicial records http://www.nmcpr.state.nm.us/nmac/_title01/T01C017.htm </li></ul><ul><li>1 NMAC 3.2.50.1, Destruction of Public Records http://www.nmcpr.state.nm.us/nmac/parts/title01/01.013.0030.htm </li></ul>

37.
Data search and retrieval <ul><li>What is the document? </li></ul><ul><ul><li>Origins? </li></ul></ul><ul><ul><ul><li>Who created? When? Why? How? </li></ul></ul></ul><ul><ul><ul><li>Verification? Who? When? Why? </li></ul></ul></ul><ul><ul><li>File type(s) </li></ul></ul><ul><ul><ul><li>Analysis often limited by PDF files; </li></ul></ul></ul><ul><ul><ul><li>Always seek document/data in its original file format </li></ul></ul></ul><ul><ul><ul><li>Strive to get the “metadata” of the document/data </li></ul></ul></ul><ul><ul><li>If spreadsheet or database, request “code sheet” or “database schema” </li></ul></ul>

38.
Gov’t agencies in NM

39.
New, major function for government in the Digital Age

40.
Next steps? <ul><li>Remember: Data In  Analysis  InfoOut </li></ul><ul><ul><li>Room for all skilled and yet-to-be skilled </li></ul></ul><ul><ul><li>Scaleable local to state </li></ul></ul><ul><li>Create “jump station” database of all NM “records custodians” for all levels of government </li></ul><ul><li>Build catalog of gov’t agencies/depts. data </li></ul><ul><ul><li>State and local library initiatives to submit their data? </li></ul></ul>

41.
Next steps? <ul><li>Anyone interested in OpenData-NM? </li></ul><ul><ul><li>Fill out info card </li></ul></ul><ul><ul><li>Recruit others </li></ul></ul><ul><li>Visit “rough sketch” wiki – o p e n d a t a n m . p b w o r k s . c o m </li></ul><ul><li>Make suggestions </li></ul><ul><li>Step up to develop/manage a pertinent project </li></ul>

42.
Hey, it's THE PEOPLE'S data! The global emergence of the Open Data Movement Tom Johnson Managing Director Institute for Analytic Journalism Santa Fe, NM t o m @ j t j o h n s o n . c o m Slides may be found at http://opendatanm.pbworks.com