1. CKAN Tutorial
@ odw2013
Presenter: 李承錱 Cheng-Jen Lee (Sol)
Email: cjlee AT iis.sinica.edu.tw
This work is licensed under a
Creative Commons Attribution-ShareAlike 3.0 Taiwan License.
2. 2013/11/9
Agenda
● About CKAN
● Feature Tour
– Publish & Find Datasets
– Store & Manage Data
– Engage with Users & Others
– Customise & Extend
● CKAN and 5 ★ Open Data
● Showcase
● Installation
● Harvesters
● Issues
3. 2013/11/9
Agenda
● About CKAN
● Feature Tour
– Publish & Find Datasets
– Store & Manage Data
– Engage with Users & Others
– Customise & Extend
● CKAN and 5 ★ Open Data
● Showcase
● Installation
● Harvesters
● Issues
4. 2013/11/9
About CKAN
● The Comprehensive Knowledge Archive
Network
● A powerful data management system
● Publishing
● Sharing
● Finding
● Using Data
19. 2013/11/9
Feature Tour (3)
Engage with Users & Others
Manage Role of Members
Admin: edit datasets & members
Editor: edit datasets
Viewer: view (private) datasets
Note: Public datasets are visible to
everyone
22. 2013/11/9
Feature Tour (4)
Customise & Extend
● RESTful JSON APIs
– The Action API
– The DataStore API
– The FileStore API...
● Extensions (over 60)
– ckanext-harvest
– ckanext-spatial
Open source is good!
● Themable
● Integrates with other CMS (ex. Drupal)
24. CKAN and 5 ★ Open Data
● ★ Make your stuff available on the Web (whatever
format) under an open license
2013/11/9
25. CKAN and 5 ★ Open Data
● ★★ Make it available as structured data (e.g.,
Excel instead of image scan of a table)
★★★ Use non-proprietary formats (e.g., CSV
instead of Excel)
– Accept any data format
– Beautiful data demonstration
2013/11/9
26. CKAN and 5 ★ Open Data
● ★★★★ Use URIs to denote things, so that people
can point at your stuff
– Permanent link for each dataset
– Get Dataset URI through API
● ★★★★★ Link your data to other data to provide
context
– Linked data and RDF for metadata
2013/11/9
27. CKAN and 5 ★ Open Data
● RDF for metadata
– DCAT and Dublin Core
– curl -L -H "Accept:application/rdf+xml"
http://thedatahub.org/dataset/gold-prices
2013/11/9
28. 2013/11/9
Agenda
● About CKAN
● Feature Tour
– Publish & Find Datasets
– Store & Manage Data
– Engage with Users & Others
– Customise & Extend
● CKAN and 5 ★ Open Data
● Showcase
● Installation
● Harvesters
● Issues
50. 2013/11/9
Harvesters
Custom harvester
● Implement the harvester interface
to perform harvesting operations
● Three stages
● gather: get the identification
● fetch: fetch the contents
● import: create ckan package(dataset)
51. 2013/11/9
Harvesters
The harvesting interface
from base import HarvesterBase
class SRDAHarvester(HarvesterBase):
def _set_config(self,config_str):
def info(self):
...
def gather_stage(self, harvest_job):
def fetch_stage(self, harvest_object):
def import_stage(self, harvest_object):
See the extension site for details
An example (SRDA): http://goo.gl/ZMnND7
52. 2013/11/9
Agenda
● About CKAN
● Feature Tour
– Publish & Find Datasets
– Store & Manage Data
– Engage with Users & Others
– Customise & Extend
● CKAN and 5 ★ Open Data
● Showcase
● Installation
● Harvesters
● Issues
53. 2013/11/9
Issues
● CJK Support
– CJK Search
– Some broken translations
– Frequent updates
● Extensions compatibilities
● Tons of tweaks needed
● Performance Issue
● Complicated Architecture
54. ● Official Documents:
– http://docs.ckan.org/en/latest/
● Installation Notes (in Chinese):
– https://ckan-docs-tw.readthedocs.org/
● CKAN Development Discussions:
– http://lists.okfn.org/mailman/listinfo/ckan-dev
● CKAN Taiwan Interest Group:
– https://groups.google.com/forum/#!forum/ckan-taiwan-interest-group
2013/11/9
Resources
55. Thanks for your attention!
2013/11/9
Any Q?
Email: u10313335 AT citi.sinica.edu.tw
http://about.me/sollee
Notas del editor
由 Open Knowledge Foundation 支持
由 Open Knowledge Foundation 支持
公布網址
Data.gov.uk 即是 drupal+CKAN
Store the raw data and metadata. Visualise structured data with interactive tables, graphs and maps.
