AWS Community Day CPH - Three problems of Terraform
ckan 2.0: a deeper look
1. ckan 2.0: a deeper look
Internship @ Academia Sinica
Report #2
This work is licensed under a
Creative Commons Attribution-ShareAlike 3.0 Taiwan License.
Presenter: Cheng-Jen Lee (Sol)
Email: u10313335 AT citi.sinica.edu.tw
10. Aug 5, 2013 10
GeoJSON Prevew
●
a GeoJSON previewer
●
Live Demo
11. Aug 5, 2013 11
CSW Server
Spatial Harvesters
●
still in investigation
●
CSW Server
– to server metadata from the CKAN instance
●
Spatial Harvesters
– for importing spatial metadata into CKAN
– 3 formats: CSW, WAF, doc
– 3 stages: gather, fetch, import
14. Aug 5, 2013 14
Import/Export
●
Importing Datasets with the CKAN
RESTful API
– request =
urllib2.Request('http://www.my_ckan_site.
com/api/action/package_create')
●
Export: json, csv, and db dump
– paster db ...
– Restore and migration?
16. Aug 5, 2013 16
Migration
●
paster db simple-dump-json/csv
– datasets and users cannot be imported
simultaneously
●
paster db dump
– SQLAlchemy error (maybe the version of
PostgreSQL...)
●
Raw db dump
●
Target machine:
– Apache + mod_wsgi OK→
– Sub-url redirection sucks
– PostgreSQL 8.4 (instead of 9.1)
●
postgresql-8.4-postgis is no longer supported
19. Aug 5, 2013 19
UNIX user auth
●
Data.gov.uk:
– User log-on and credentials are handled by
Drupal
– Drupal provides an internal API for CKAN to
confirm the details
20. Aug 5, 2013 20
Thanks for your attention!
Any Q?
Notas del editor
gather_stage - Aggregates all the remote identifiers for a particular source (ie identifiers for a CSW server, files for a WAF). fetch_stage - Fetches all the remote documents and stores them on the database. import_stage - Performs all the processing for transforming the remote content into a CKAN dataset: validates the document, parses it, converts it to a CKAN dataset dict and saves it in the database.