Another joint presentation covering CKAN and updates from what is going on in Australia surrounding open data initiatives. This was my first chance to also showcase the work of WA Parks and Wildlife and Florian Mayer's approach as a data pipeline plumber.

1. STEVEN DE COSTA
Steering Group Member
@STARL3N
PUBLIC DATA AND CKAN

3. Introduction 3
Link Digital
Executive Director
CKAN Association
Steering Group Member
Open Knowledge Australia
Co-Secretary & Treasurer
Data Shades
Founder
GovHack
National Organiser
AWS User Group
CBR Organiser

4. STEVEN DE COSTA
Steering Group Member
@STARL3N

5. STEVEN DE COSTA
Steering Group Member
@STARL3N

6. 6Link Digital’s Network Map

8. Data portal software:
1. Open Source
2. Large and expanding installation base
within Government worldwide
3. Expanding use cases in the wider data
ecosystem
4. Python web app, PostgreSQL DB
5. Built for machines,
custodians and end users
WHAT IS CKAN?

9. LEARN MORE AT CKAN.org

10. DOWNLOAD FROM github.com/ckan/ckan

11. 1. >> Organisations (optionally with sub-organisations)
2. >> >> Datasets
3. >> >> >> Resources
4. >> Platform Custodian
5. >> >> Organisation Custodian, Editor or Member
6. >> Published or Private datasets
CKAN STRUCTURE

12. 1. >> Constitution
2. >> >> Parliamentary Legislation and Acts (Jurisdiction = Platform)
3. >> >> >> Ministries (Organisation)
4. >> >> >> >> Programs (Sub-Organisations)
5. >> >> >> >> >> Projects (Datasets)
6. >> >> >> >> >> >> Outcomes (Resources)
CKAN USE CASE PARADIGM

13. 1. User registration
2. User management
3. Custodian workflows (manage datasets and data resources)
4. Directory Browse by organisation or group
5. Faceted search for multiple fields (supporting end user discovery)
6. Resource views to preview data (a recently improved feature)
7. Metadata view
CKAN UI

14. 1. Create an organistation (usually done by platform owner)
2. Login as member of organisation
3. Click ‘add dataset’
4. Step 1: Add a title, description and other metadata
5. Step 2: Add resources (links to data or upload data files for hosting)
6. Step 3: Add any additional info
CKAN CUSTODIAN WORKFLOW

15. 1. Join the dev mailing list (monitored by tech team):
https://lists.okfn.org/mailman/listinfo/ckan-dev
2. Search Stack overflow under CKAN:
http://stackoverflow.com/search?q=CKAN
3. Check the roadmap on waffle.io:
https://waffle.io/ckan/ideas-and-roadmap
4. Join a tech team meeting:
http://ckan.org/about/technical-team/
WHERE TO GET HELP

16. CKAN API DOCUMENTATION

17. 1. Get JSON-formatted lists of a site’s datasets, groups or other CKAN objects
2. Get a full JSON representation of a dataset, resource or other object
3. Search for packages or resources matching a query
4. Create, update and delete datasets, resources and other objects
5. Get an activity stream of recently changed datasets on a site
CKAN API

18. 1. CKAN as an Information Asset Register
2. FileStore – For hosting of data and resources
3. DataStore - provides a database for structured storage of data together with a powerful Web-
accessible Data API
4. License Selection (machine ready?)
5. Harvesting
A FEW MORE POINTS

19. Delivering the world’s best open
data management system
The purpose of the CKAN Association
is to support sustainable growth and
development of CKAN while also
protecting the interests of the CKAN
community.
The Association values a healthy and
thriving community which continues
to deliver the best open data
management system in the world.
CKAN ASSOCIATION: STATEMENT OF PURPOSE

20. Community interests, or needs, can be generalised as:
1. Users need an enterprise level open data management system tailored to meet their needs
now and into the future.
2. Individual contributors need a project that is rewarding to work for, inclusive and active.
COMMUNITY INTERESTS

21. Who owns or directly manages the CKAN project?
The project, its releases and future direction are cooperatively managed by its community of
users and contributors. Association delegates, staff and office holders may be active within the
project but will exercise no more or less influence than any other contributor or user.
More information about CKAN and how to contribute can be found at CKAN.org.
DELEGATION TO SERVE AND PROTECT

22. What is the current structure of
the CKAN Association?
See http://ckan.org
The steering group carries on a
number of business activities.
This includes raising revenue,
managing resources and directing
projects or programs of activity
relevant to the CKAN Association’s
statement of purpose.
COMPLETENESS OF PURPOSE

23. FORMAL MEMBERSHIPS

24. It's easy to find people willing to fund or work on the flashier parts of CKAN, and there is some funding for
core work such as meetings and preparing releases. But there are a few important things that aren't getting
addressed.
Fix Security Issues
There are a small number of known issues that high profile sites work around by implementing workflows and
tight controls over users and data published. Everyone else would benefit from a more-secure-by-default
CKAN.
Clear Technical Debt
CKAN, has some parts that should be replaced or removed. This work doesn't add any new features and
worse, threatens to break upgrades for existing sites and extensions. It is necessary work though. Unless
performance and technical limitations are addressed they will grow and start turning users away from CKAN.
Ref: https://github.com/ckan/ideas-and-roadmap/issues/152 - Raised by Ian Ward, Tech Team Lead
HOW MEMBERSHIPS BENEFIT CKAN

25. Foundations of Open Government 25
My Administration is committed to creating an
unprecedented level of openness in Government.
We will work together to ensure the public trust
and establish a system of transparency, public
participation, and collaboration. Openness will
strengthen our democracy and promote efficiency
and effectiveness in Government.
Sources:
http://www.whitehouse.gov/the_press_office/TransparencyandOpenGovernment
Hope Poster by Shepard Fairey: http://en.wikipedia.org/wiki/File:Barack_Obama_Hope_poster.jpg

26. The role of Government in Australia 26
It should support civil society and its multiplicity of voices and activities.
It should provide the economic framework and the essential infrastructure for
public and private enterprise.
Source: http://www.australiancollaboration.com.au/pdf/FactSheets/Role-government-FactSheet.pdf

27. Business Cases: Theory of the firm & Transaction costs 27

28. Where is there work to do with Open Data? 28

29. Published Data Handbook 29

30. Published Data Handbook 30
Recipe Name What you’ll need Ingredients Method Perfect for…

31. 31Establishing Data Publishing Policy

32. 32Establishing Data Management Systems

33. 33Educating Data Publishers

34. 34Facilitation within tech communities

35. Establishing enterprise solution architecture 35

36. 36Extract, Transform and Load Connectors

37. 37Cleaning of Messy Data

38. 38Geospatial Integration

39. 39Resource View Integration

40. 40Enriched Data and Analytics

41. 41The perfect storm

42. 42Drupal interface

43. 43CKAN interface

44. 44What the DFMP does

45. 45Launched Globally as CKAN Galleries

46. 46Launched Globally as CKAN Galleries

47. 47Government as an API - Digital Transformation Office

48. 48Data.vic.gov.au on CKAN, Drupal and AWS

49. Classifying data 49
The three tiers are:
internal
whole of Government
open

50. 50Data.vic.gov.au data classification

51. 51The ‘go. no go’ gates for going open

52. OEH Data Management System 52

53. Take Note: What is NOT good 53

54. Take Note: What is best… 54