SlideShare una empresa de Scribd logo
1 de 16
Transforming EA Detailed River Network
into INSPIRE Annex I Hydrography Theme
Debbie Wilson – Business Consultant
debbie.wilson@snowflakesoftware.com
UK Location Data Providers Event
Thursday February 9, 2012
Introduction
• Detailed River Network provides information about the
River Network for England & Wales
• Contains 3 layers:
– DRN
– DRNNODES
– DRNOUTLINES
• Falls within scope of the Annex I Hydrography Theme:
– HydroNetwork <<Application Schema>>
Mapping DRN to HydroNetwork
DRN
DRNNODES
fictitiousbeginLifeSpanVersion
Mandatory property but assigned
<<voidable>> stereotype so we can create a
nilReason value = “Unknown”
Reclassification of codelist values
Conditional statements were used to transform values
form one codelist to another using If-then-else logic
Example:
If flowDirection = 1 then output value is ‘inDirection’
Create references from DRNNODE to DRN –
spokeStart & spokeEnd
Relationship is defined in one direction from DRN to
DRNNODES so had to join DRN table to DRNNODES
twise
Mapping DRN to HydroNetwork
DRN
DRNNODES
DRN to WatercourseLink:
• 7 of 11 properties map to data in DRN table
• 1 of 7 properties mapped required
transformation (reclassification)
• 1 of 11 properties can be derived using
constants
• 1 of 11 properties mapped to nilReason
• 2 of 11 properties don’t apply in real-world
so not mapped
DRNNODES to WatercourseLink:
• 3 of 9 properties map to data in DRNNODES
table
• 1 of 3 properties mapped required transformation
(reclassification)
• 2 of 9 properties can be derived using joins
• 1 of 9 properties mapped to nilReason
• 3 of 9 properties don’t apply in real-world so not
mapped
Transforming data using GO Publisher Desktop
Source Data Output XML
Preview Sample Validate Sample
Create XML structure by grouping columns
Adding new content: inspireID/namespace
Deriving content using joins
NOTE: These local object references can be replaced by a Linked Data
URIs when publishing data via a web service to enable then to be retrieved.
Example: http://location.data.gov.uk/so/hy/hydroNode/eaew.drn/
eaew1001000000066258/1
Reclassifying code values and creating NilReason
values using conditional statements (if-then-else)
CRS Transformation
Publishing and Validating Data
Copy Schema includes all the
relevant schemas into output
folder for exchange with data
Output data can be
raw xml or
compressed (zip/gzip)
Validate shall run in-built data validation to
check data is:
1. Well-formed
2. Schema valid
3. Conforms to business
rules/constraints (in production)
Publishing Data via WFS in 4 steps
Step 1: Change mapping to
output data within
wfs:FeatureCollection not
base:SpatialDataSet
& update object references
Publishing Data via WFS in 4 steps
Step 2: Configure
GetCapabilities
Publishing Data via WFS in 4 steps
Step 3: Bundle transformation
configuration, WFS software and
schemas, within WAR ready for
deployment
Publishing Data via WFS in 4 steps
Step 4: Deploy to
application server and test
WFS Response: Get first 10 WatercourseLinks
http://localhost:8080/Hydrography_DRN/GOPublisherWFS?service=wfs&version=
2.0.0&request=GetFeature&count=10&typenames=hy-n:WatercourseLink

Más contenido relacionado

La actualidad más candente

Mapreduce total order sorting technique
Mapreduce total order sorting techniqueMapreduce total order sorting technique
Mapreduce total order sorting technique
Uday Vakalapudi
 
Parallel Algorithms K – means Clustering
Parallel Algorithms K – means ClusteringParallel Algorithms K – means Clustering
Parallel Algorithms K – means Clustering
Andreina Uzcategui
 
[Foss4 g2013]the architecture of mobile traffic map service final
[Foss4 g2013]the architecture of mobile traffic map service final[Foss4 g2013]the architecture of mobile traffic map service final
[Foss4 g2013]the architecture of mobile traffic map service final
BJ Jang
 

La actualidad más candente (20)

Determining the k in k-means with MapReduce
Determining the k in k-means with MapReduceDetermining the k in k-means with MapReduce
Determining the k in k-means with MapReduce
 
A time energy performance analysis of map reduce on heterogeneous systems wit...
A time energy performance analysis of map reduce on heterogeneous systems wit...A time energy performance analysis of map reduce on heterogeneous systems wit...
A time energy performance analysis of map reduce on heterogeneous systems wit...
 
Parallel-kmeans
Parallel-kmeansParallel-kmeans
Parallel-kmeans
 
Migration of groups of virtual machines in distributed data centers to reduce...
Migration of groups of virtual machines in distributed data centers to reduce...Migration of groups of virtual machines in distributed data centers to reduce...
Migration of groups of virtual machines in distributed data centers to reduce...
 
Managing Multi-DBMS on a Single UI , a Web-based Spatial DB Manager-FOSS4G A...
Managing Multi-DBMS on a Single UI, a Web-based Spatial DB Manager-FOSS4G A...Managing Multi-DBMS on a Single UI, a Web-based Spatial DB Manager-FOSS4G A...
Managing Multi-DBMS on a Single UI , a Web-based Spatial DB Manager-FOSS4G A...
 
I²: Interactive Real-Time Visualization for Streaming Data with Apache Flink ...
I²: Interactive Real-Time Visualization for Streaming Data with Apache Flink ...I²: Interactive Real-Time Visualization for Streaming Data with Apache Flink ...
I²: Interactive Real-Time Visualization for Streaming Data with Apache Flink ...
 
MapReduce
MapReduceMapReduce
MapReduce
 
H base introduction & development
H base introduction & developmentH base introduction & development
H base introduction & development
 
Mapreduce total order sorting technique
Mapreduce total order sorting techniqueMapreduce total order sorting technique
Mapreduce total order sorting technique
 
Hadoop job chaining
Hadoop job chainingHadoop job chaining
Hadoop job chaining
 
Hive query optimization infinity
Hive query optimization infinityHive query optimization infinity
Hive query optimization infinity
 
04 pig data operations
04 pig data operations04 pig data operations
04 pig data operations
 
Hadoop combiner and partitioner
Hadoop combiner and partitionerHadoop combiner and partitioner
Hadoop combiner and partitioner
 
Earthquake Updates and Enhancements to Processing for Hazus-MH 3.2
Earthquake Updates and Enhancements to Processing for Hazus-MH 3.2Earthquake Updates and Enhancements to Processing for Hazus-MH 3.2
Earthquake Updates and Enhancements to Processing for Hazus-MH 3.2
 
Map reduce in Hadoop
Map reduce in HadoopMap reduce in Hadoop
Map reduce in Hadoop
 
Parallel Algorithms K – means Clustering
Parallel Algorithms K – means ClusteringParallel Algorithms K – means Clustering
Parallel Algorithms K – means Clustering
 
Transf from csv to xml
Transf from csv to xmlTransf from csv to xml
Transf from csv to xml
 
[Foss4 g2013]the architecture of mobile traffic map service final
[Foss4 g2013]the architecture of mobile traffic map service final[Foss4 g2013]the architecture of mobile traffic map service final
[Foss4 g2013]the architecture of mobile traffic map service final
 
MapReduce: Simplified Data Processing On Large Clusters
MapReduce: Simplified Data Processing On Large ClustersMapReduce: Simplified Data Processing On Large Clusters
MapReduce: Simplified Data Processing On Large Clusters
 
Introduction to MapReduce
Introduction to MapReduceIntroduction to MapReduce
Introduction to MapReduce
 

Destacado (9)

Mi Colegio
Mi ColegioMi Colegio
Mi Colegio
 
Para leer
Para leerPara leer
Para leer
 
Turnurile Din Hanoi
Turnurile Din HanoiTurnurile Din Hanoi
Turnurile Din Hanoi
 
Metodologia e tecnologia
Metodologia e tecnologiaMetodologia e tecnologia
Metodologia e tecnologia
 
Aplicaciones más manejables
Aplicaciones más manejablesAplicaciones más manejables
Aplicaciones más manejables
 
Beterraba Early Wonder Super Tall Top
Beterraba Early Wonder Super Tall TopBeterraba Early Wonder Super Tall Top
Beterraba Early Wonder Super Tall Top
 
Presentación Serena 1
Presentación Serena 1Presentación Serena 1
Presentación Serena 1
 
Efl Paradigms
Efl ParadigmsEfl Paradigms
Efl Paradigms
 
EAD - O Papel Do Professor
EAD - O Papel Do Professor EAD - O Papel Do Professor
EAD - O Papel Do Professor
 

Similar a Transforming EADRN into INSPIRE Hydrography

L2s 090701234157 Phpapp02
L2s 090701234157 Phpapp02L2s 090701234157 Phpapp02
L2s 090701234157 Phpapp02
google
 
A complete-guide-to-oracle-to-redshift-migration
A complete-guide-to-oracle-to-redshift-migrationA complete-guide-to-oracle-to-redshift-migration
A complete-guide-to-oracle-to-redshift-migration
bindu1512
 
Database Mirror for the exceptional DBA – David Izahk
Database Mirror for the exceptional DBA – David IzahkDatabase Mirror for the exceptional DBA – David Izahk
Database Mirror for the exceptional DBA – David Izahk
sqlserver.co.il
 

Similar a Transforming EADRN into INSPIRE Hydrography (20)

Simplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data VirtualizationSimplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data Virtualization
 
Linked data integration_framework
Linked data integration_frameworkLinked data integration_framework
Linked data integration_framework
 
Fyp presentation 2 (SQL Converter)
Fyp presentation 2 (SQL Converter)Fyp presentation 2 (SQL Converter)
Fyp presentation 2 (SQL Converter)
 
Migrating Databases to AWS for Business Critical Applications and Analytics
Migrating Databases to AWS for Business Critical Applications and Analytics Migrating Databases to AWS for Business Critical Applications and Analytics
Migrating Databases to AWS for Business Critical Applications and Analytics
 
Enabling Cloud Data Integration (EMEA)
Enabling Cloud Data Integration (EMEA)Enabling Cloud Data Integration (EMEA)
Enabling Cloud Data Integration (EMEA)
 
Getting Started with AWS Database Migration Service
Getting Started with AWS Database Migration ServiceGetting Started with AWS Database Migration Service
Getting Started with AWS Database Migration Service
 
Why should you trust my data code4lib 2016
Why should you trust my data code4lib 2016Why should you trust my data code4lib 2016
Why should you trust my data code4lib 2016
 
Migrating your Databases to AWS: Deep Dive on Amazon RDS and AWS Database Mig...
Migrating your Databases to AWS: Deep Dive on Amazon RDS and AWS Database Mig...Migrating your Databases to AWS: Deep Dive on Amazon RDS and AWS Database Mig...
Migrating your Databases to AWS: Deep Dive on Amazon RDS and AWS Database Mig...
 
L2s 090701234157 Phpapp02
L2s 090701234157 Phpapp02L2s 090701234157 Phpapp02
L2s 090701234157 Phpapp02
 
A complete-guide-to-oracle-to-redshift-migration
A complete-guide-to-oracle-to-redshift-migrationA complete-guide-to-oracle-to-redshift-migration
A complete-guide-to-oracle-to-redshift-migration
 
Database Mirror for the exceptional DBA – David Izahk
Database Mirror for the exceptional DBA – David IzahkDatabase Mirror for the exceptional DBA – David Izahk
Database Mirror for the exceptional DBA – David Izahk
 
Government GraphSummit: Leveraging Knowledge Graphs for Foundational Intellig...
Government GraphSummit: Leveraging Knowledge Graphs for Foundational Intellig...Government GraphSummit: Leveraging Knowledge Graphs for Foundational Intellig...
Government GraphSummit: Leveraging Knowledge Graphs for Foundational Intellig...
 
Object Relational Mapping with LINQ To SQL
Object Relational Mapping with LINQ To SQLObject Relational Mapping with LINQ To SQL
Object Relational Mapping with LINQ To SQL
 
Change RelationalDB to GraphDB with OrientDB
Change RelationalDB to GraphDB with OrientDBChange RelationalDB to GraphDB with OrientDB
Change RelationalDB to GraphDB with OrientDB
 
WEB PROGRAMMING USING ASP.NET
WEB PROGRAMMING USING ASP.NETWEB PROGRAMMING USING ASP.NET
WEB PROGRAMMING USING ASP.NET
 
Intro to Database Design
Intro to Database DesignIntro to Database Design
Intro to Database Design
 
Developing Kafka Streams Applications with Upgradability in Mind with Neil Bu...
Developing Kafka Streams Applications with Upgradability in Mind with Neil Bu...Developing Kafka Streams Applications with Upgradability in Mind with Neil Bu...
Developing Kafka Streams Applications with Upgradability in Mind with Neil Bu...
 
Virtualization in 4-4 1-4 Data Center Network.
Virtualization in 4-4 1-4 Data Center Network.Virtualization in 4-4 1-4 Data Center Network.
Virtualization in 4-4 1-4 Data Center Network.
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
 
數據庫遷移到雲端的成功秘訣
數據庫遷移到雲端的成功秘訣數據庫遷移到雲端的成功秘訣
數據庫遷移到雲端的成功秘訣
 

Último

Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
FIDO Alliance
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
Wonjun Hwang
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
Muhammad Subhan
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 

Último (20)

The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
 
الأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهلهالأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهله
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
How to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in PakistanHow to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in Pakistan
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
 

Transforming EADRN into INSPIRE Hydrography

  • 1. Transforming EA Detailed River Network into INSPIRE Annex I Hydrography Theme Debbie Wilson – Business Consultant debbie.wilson@snowflakesoftware.com UK Location Data Providers Event Thursday February 9, 2012
  • 2. Introduction • Detailed River Network provides information about the River Network for England & Wales • Contains 3 layers: – DRN – DRNNODES – DRNOUTLINES • Falls within scope of the Annex I Hydrography Theme: – HydroNetwork <<Application Schema>>
  • 3. Mapping DRN to HydroNetwork DRN DRNNODES fictitiousbeginLifeSpanVersion Mandatory property but assigned <<voidable>> stereotype so we can create a nilReason value = “Unknown” Reclassification of codelist values Conditional statements were used to transform values form one codelist to another using If-then-else logic Example: If flowDirection = 1 then output value is ‘inDirection’ Create references from DRNNODE to DRN – spokeStart & spokeEnd Relationship is defined in one direction from DRN to DRNNODES so had to join DRN table to DRNNODES twise
  • 4. Mapping DRN to HydroNetwork DRN DRNNODES DRN to WatercourseLink: • 7 of 11 properties map to data in DRN table • 1 of 7 properties mapped required transformation (reclassification) • 1 of 11 properties can be derived using constants • 1 of 11 properties mapped to nilReason • 2 of 11 properties don’t apply in real-world so not mapped DRNNODES to WatercourseLink: • 3 of 9 properties map to data in DRNNODES table • 1 of 3 properties mapped required transformation (reclassification) • 2 of 9 properties can be derived using joins • 1 of 9 properties mapped to nilReason • 3 of 9 properties don’t apply in real-world so not mapped
  • 5. Transforming data using GO Publisher Desktop Source Data Output XML Preview Sample Validate Sample
  • 6. Create XML structure by grouping columns
  • 7. Adding new content: inspireID/namespace
  • 8. Deriving content using joins NOTE: These local object references can be replaced by a Linked Data URIs when publishing data via a web service to enable then to be retrieved. Example: http://location.data.gov.uk/so/hy/hydroNode/eaew.drn/ eaew1001000000066258/1
  • 9. Reclassifying code values and creating NilReason values using conditional statements (if-then-else)
  • 11. Publishing and Validating Data Copy Schema includes all the relevant schemas into output folder for exchange with data Output data can be raw xml or compressed (zip/gzip) Validate shall run in-built data validation to check data is: 1. Well-formed 2. Schema valid 3. Conforms to business rules/constraints (in production)
  • 12. Publishing Data via WFS in 4 steps Step 1: Change mapping to output data within wfs:FeatureCollection not base:SpatialDataSet & update object references
  • 13. Publishing Data via WFS in 4 steps Step 2: Configure GetCapabilities
  • 14. Publishing Data via WFS in 4 steps Step 3: Bundle transformation configuration, WFS software and schemas, within WAR ready for deployment
  • 15. Publishing Data via WFS in 4 steps Step 4: Deploy to application server and test
  • 16. WFS Response: Get first 10 WatercourseLinks http://localhost:8080/Hydrography_DRN/GOPublisherWFS?service=wfs&version= 2.0.0&request=GetFeature&count=10&typenames=hy-n:WatercourseLink