The document discusses open data and its opportunities. It defines internal, closed data that organizations keep private versus open data that is freely available to the public. Examples of open data portals from the US, UK, Taiwan, Thailand and Hong Kong are provided. The document also discusses how open data can benefit governments and businesses when combined with big data and how it creates opportunities for data science projects. Issues around what types of data should be open and the ongoing debate on open data are also summarized.

1. Open Data, Open Opportunity, Open to Progress
Korkrid Akepanidtaworn
Data Science Society
LSE Students’ Union
December 7, 2016
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 1 / 27

2. Outline
1 Internal Data
2 Open Data
3 Data for Your Projects
4 Open Data Debate
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 2 / 27

3. Internal Data
Internal Data
Organizational or Closed Data
The disclosure of data is not permissible as it may harm the company
or a particular group.
The IT department of the company generally imposes data
governance and permissibility.
Some examples are: sales databases/CRM, marketing data, customer
complaints, customer service records, and government data (that is
linked to national security.)
Another closed data that may be more familiar to you is academic
dataset. The data ethical issue comes into play with regard to the
request of data from professors or authors, which is subject to
academic plagiarism.
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 3 / 27

4. Internal Data
Data Governance in the Organization
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 4 / 27

5. Internal Data
Organizational Data Workflow
Many business organizations use SAS as the main analytics software
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 5 / 27

6. Internal Data
Examples of Organizational Data
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 6 / 27

7. Internal Data
Closed Data
Several mechanisms restrict access to or reuse of data. They include:
Making data available for a charge.
Compilation in databases or websites to which only registered
members or customers can have access.
Use of a proprietary or closed technology or encryption which creates
a barrier for access.
Copyright forbidding (or obfuscating) re-use of the data, including the
use of ”no derivatives” requirements.
Patent forbidding re-use of the data (for example the 3-dimensional
coordinates of some experimental protein structures have been
patented).
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 7 / 27

8. Open Data
The Concept of Open Data
Open data is the idea that some data should be freely available to
everyone to use and republish as they wish, without restrictions from
copyright, patents or other mechanisms of control.
The goals of the open data movement are similar to those of other
”open” movements such as open source, open hardware, open
content and open access.
Some examples are: Data.gov (USA), Data.gov.uk.(UK), Data.gov.au
(Australia)
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 8 / 27

9. Open Data
Open Data
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 9 / 27

10. Open Data
Open Data, Open Decisions, and Open Services
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 10 / 27

11. Open Data
Data.gov (USA)
Data.gov is a U.S. government website launched in late May 2009 by
the then Federal Chief Information Officer (CIO) of the United States,
Vivek Kundra.
Data.gov aims to improve public access to high value, machine
readable datasets generated by the Executive Branch of the Federal
Government.
A variety of available data e.g. agriculture, climate, consumer,
eco-system, energy, finance, and health. Total data is 193,059
datasets (up to Dec 6, 2016)
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 11 / 27

12. Open Data
Data.gov (USA)
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 12 / 27

13. Open Data
NYC Open Data: State-Level
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 13 / 27

14. Open Data
Open Data in Taiwan
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 14 / 27

15. Open Data
Open Data in Thailand
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 15 / 27

16. Open Data
Open Data in Hong Kong
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 16 / 27

17. Open Data
Open Data, Open Govt, and Big Data
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 17 / 27

18. Open Data
5Vs Pillars of Big Data
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 18 / 27

19. Open Data
What Types of Data Should be Open?
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 19 / 27

20. Open Data
Open Data, Open Opportunity, Open to Progress
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 20 / 27

21. Open Data
Open Ecosystem
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 21 / 27

22. Open Data
Data to Insight
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 22 / 27

23. Open Data
Open Data Barometer
Governments are still failing to provide ”enough information in an
accessible form to their citizens and businesses” according to the 2013
open data index published today by the Open Knowledge Foundation.
Countries are ranked on the availability and accessibility of
information in ten key areas; government spending, election results,
transport timetables, pollution levels, government budget, company
register, national statistics, legislation, postcodes and availability of a
high level copy of a national map.
The UK and US lead on open government data according to the
index. (1 and 2 respectively!)
There are still key areas for improvement. The UK Electoral
Commission doesn’t allow open reuse of election data for example,
whilst in the US there is no federal dataset that contains all corporate
registrations.
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 23 / 27

24. Open Data
Further Resources of Open Data
What is Open Data? (Open Data Institute)
Global Open Data Index
Global Census on Open Data Index
An introduction to open data, Sally Jenkinson
Nationale Smart City-Tagung: Open Data und Open Government
Data for Everyone: Using Open Data to Unlock Germany’s Innovative
Potential
How do Open Data contribute to a Local Open Government?
Open Data: Open Your Mind
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 24 / 27

25. Data for Your Projects
External Data
Quandl — Financial Data — Economic Data — Open Data
19 Free Public Data Sets For Your First Data Science Project
Data for Empirical Exercises and Test Bank
Transportation Data
US Flight Data
NBA Player Analysis Dataset
OKCupid hacker scripts, data, etc
Awesome Public Datasets, GitHub Repository
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 25 / 27

26. Open Data Debate
Discussion of Open Data
The debate on Open Data is still evolving.
The best open government applications seek to empower citizens, to
help small businesses, or to create value in some other positive,
constructive way.
Opening government data is only a way-point on the road to
improving education, improving government, and building tools to
solve other real world problems.
What are your thoughts on open data? Is this a good idea for the
government, businesses, and academics?
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 26 / 27

27. Open Data Debate
Open Data, Open Opportunity, Open to Progress
Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 27 / 27