SlideShare una empresa de Scribd logo
1 de 34
Descargar para leer sin conexión
Data Management and
Applications at SOCIB
IMDIS 2013
Lucca, Italy

David March
dmarch@socib.es

S. Lora, JP. Beltran, K. Sebastián, S. Gómara and J. Tintoré
OUTLINE

• What is SOCIB?
• Data Management
• Applications
• Further works
OUTLINE

• What is SOCIB?
• Data Management
• Applications
• Further works
WHAT IS SOCIB
• Marine Research Infrastructure located in Balearic Islands
• Integrated system in implementation phase (2010-2014)
• Nearshore to open sea (NW Mediterranean)
• Components:
– Distributed multiplatform observing system
– Numerical forecasting system
– Data Management and visualization system
• Provide free open and quality controlled data for science, technology development and
response to society needs
WHAT IS SOCIB

OBSERVING FACILITIES

Research vessel

MODELLING FACILITY

HF Radar

Currents (ROMS)

Waves (SWAN)

STRATEGIC ISSUES & APPLICATIONS
FOR SOCIETY
Glider

Fixed stations

Drifting buoys

Beach Monitoring

Integrated Coastal
Management

Marine Spatial Planning
WHAT IS SOCIB
DATA SOURCES

PARAMETERS

DATA TYPES

DATA FORMATS
OUTLINE

• What is SOCIB?
• Data Management
• Applications
• Further works
DATA MANAGEMENT

DATA CENTER FACILITY

•

Manage all multi-platform SOCIB Data

•

Allow users to discover, gather, visualize and download

•

Immerse in the international framework

OPEN DATA PRINCIPLES
• Discoverable and accessible

• Freely available
• Interoperable, standardized and quality controlled
CHALLENGE

• Implement an integrated data management system
DATA MANAGEMENT
LIFE CYCLE OF DATA
DATA MANAGEMENT
LIFE CYCLE OF DATA
DATA MANAGEMENT
DATA PROCESSING
DATA PROCESSING STAGES

INSTRUMENTATION MANAGEMENT DB
• Manages the state of all the instrumentation
• PostgreSQL
• Managed by web-based application

1. Input data ingestion
2. Data calibration
3. Parameter derivation
4. Merging (existent & new)
5. Quality Control
6. Product generation

SOCIB Web based Real-Time Data Monitor

Custom software implementations
(operational / sporadic running)

Java

Matlab

Python

R

GIS
DATA MANAGEMENT
LIFE CYCLE OF DATA
DATA MANAGEMENT
DATA ARCHIVAL

netCDF REPOSITORY
• CF conventions
• GRID / RASTER / MESH / TIME SERIES

SPATIAL DATABASE
• POINT / LINE / POLYGON
DATA MANAGEMENT
LIFE CYCLE OF DATA
DATA MANAGEMENT
DATA DISTRIBUTION AND ACCESS
THREDDS

GEOSERVER

• OGC (WMS) , OpenDAP, jWebChart

• OGC (WMS, WFS, KML)

http://thredds.socib.es/

http://gis.socib.es/geoserver

DATA DISCOVERY
• API RESTful
• JSON/GeoJSON

API

http://apps.socib.es/DataDiscovery
DATA MANAGEMENT
LIFE CYCLE OF DATA
DATA MANAGEMENT
DATA CATALOG AND DATA DISCOVERY
SOCIB INSTRUMENTATION APP

GEONETWORK

• Observation platforms, CF conventions

• ISO19115, CSW

THREDDS
• ncISO

http://gis.socib.es/geonetwork
DATA MANAGEMENT
LIFE CYCLE OF DATA
DATA MANAGEMENT
APPLICATIONS AND USERS
WEB DEVELOPMENT

MAPPING LIBRARIES

OpenLayers

Mobile

Google Maps

USERS

MULTIPLE DEVICES

Desktop / Web

GeoExt

Researchers
and
Techinicians

General society
Policy and
decision makers
DATA MANAGEMENT
DATA MANAGEMENT
Data Center in numbers 2010 – present
DATA PRODUCTION
• 184 deployments
• 201 instruments
• Serving more than 50,000 NetCDF files (3.1 TB)

CORPORATE WEBSITE
• 248,935 pageviews
• 59,128 visitors (4.21 pages/visit)
• 3’49” Avg. visit duration
OUTLINE

• What is SOCIB?
• Data Management
• Applications
• Further works
APPLICATIONS

DAPP – Deployments application
http://apps.socib.es/dapp/

TECHNOLOGIES

Web application to display information related to trajectories
from mobile platforms (e.g., gliders, drifter buoys, ARGO
profilers, research vessel)
API

USERS

• Scientists & Researchers
• Technicians
• Search and Rescue (SAR)
APPLICATIONS

LW4NC2
http://thredds.socib.es/lw4nc2

TECHNOLOGIES

Web application for multidimensional (grid) data from
netCDF files, usually from numerical models or HF radar.

USERS

• Researchers
• Technicians
APPLICATIONS

SACOSTA
http://gis.socib.es/sacosta

TECHNOLOGIES

Web-based map viewer for cartographic data such as
environmental sensitivity of the coastline

USERS

• Search and Rescue (SAR)
• Policy makers
APPLICATIONS

SEABOARD
http://seaboard.socib.es

TECHNOLOGIES

Web tool to disseminate SOCIB real time data to entities that
collaborate with the SOCIB Beach Monitoring Facility
API

USERS

• Hotel guest
• Beach users
APPLICATIONS

FOLLOW THE GLIDER
http://followtheglider.com/

TECHNOLOGIES

Educational web tool aimed to present the autonomous
underwater gliders and gain awareness of their importance
for coastal research.

API

USERS

• Students
• Teachers
• General public
APPLICATIONS

BEAMON
http://apps.socib.es/beamon

TECHNOLOGIES

Web tool to display real time data of beach images acquired
by the beach monitoring facility.

USERS

• Researchers
• Surfers, anglers
• General public
APPLICATIONS

SOCIB MOBILE
Apps for real-time data from fixed stations (oceanographic
buoys, sea level stations and coastal weather stations, etc.)
and glider trajectories

TECHNOLOGIES

API

USERS

• General public
• Researchers
• Technicians
APPLICATIONS

SOCIB WEBSITE
http://www.socib.es/

TECHNOLOGIES

Corporate website to provide an overview of the different
Facilities.

USERS

• General public
• Researchers
OUTLINE

• What is SOCIB?
• Data Management
• Applications
• Further works
FURTHER WORKS

MANAGE BIG DATA

OBSERVATIONAL DATA

MONITORING SERVICES

vs

DATA DISCOVERY

NEW APPLICATIONS
CONCLUSIONS
• SOCIB Data Centre is an example of the marine information
systems of new ocean observatories and/or marine research
infrastructures
• Open Data principles in line with the INSPIRE Directive and other
important European initiatives such as Emodnet or Copernicus
• Response to society needs and provide support to the Integrated
Maritime Policy and the Marine Strategy Framework Directive
THANK YOU!
GRAZIE!
GRACIAS!
David March
dmarch@socib.es
S. Lora

K. Sebastián

S. Gómara

JP. Beltran

B. Frontera

J. Tintoré

Data Centre
data.centre@socib.es

Más contenido relacionado

Destacado

Gaad presentation at hub ottawa
Gaad presentation at hub ottawaGaad presentation at hub ottawa
Gaad presentation at hub ottawa
Mike Gifford
 

Destacado (20)

[After Going Live Studio] Software archaeology
[After Going Live Studio] Software archaeology[After Going Live Studio] Software archaeology
[After Going Live Studio] Software archaeology
 
Toshiba Storage Protfolio 2014
Toshiba Storage Protfolio 2014Toshiba Storage Protfolio 2014
Toshiba Storage Protfolio 2014
 
[Student exchange vietnam] Vietnamese language training
[Student  exchange vietnam] Vietnamese language training[Student  exchange vietnam] Vietnamese language training
[Student exchange vietnam] Vietnamese language training
 
快乐是发现得來的
快乐是发现得來的快乐是发现得來的
快乐是发现得來的
 
Folhas anatomia
Folhas   anatomiaFolhas   anatomia
Folhas anatomia
 
Gaad presentation at hub ottawa
Gaad presentation at hub ottawaGaad presentation at hub ottawa
Gaad presentation at hub ottawa
 
Unemployment
UnemploymentUnemployment
Unemployment
 
Lentera News edisi September 2015 | Bijak Kata Bijak Berbagi
Lentera News edisi September 2015 | Bijak Kata Bijak BerbagiLentera News edisi September 2015 | Bijak Kata Bijak Berbagi
Lentera News edisi September 2015 | Bijak Kata Bijak Berbagi
 
Confeitaria Dukan
Confeitaria DukanConfeitaria Dukan
Confeitaria Dukan
 
Mobile marketing presentation market wave
Mobile marketing presentation market waveMobile marketing presentation market wave
Mobile marketing presentation market wave
 
Grafix360 Company Profile
Grafix360 Company ProfileGrafix360 Company Profile
Grafix360 Company Profile
 
Experience Consolidation by Charles Schawrz
Experience Consolidation by Charles SchawrzExperience Consolidation by Charles Schawrz
Experience Consolidation by Charles Schawrz
 
La funcionalitat de l'ICE: la formació de formadors
La funcionalitat de l'ICE: la formació de formadorsLa funcionalitat de l'ICE: la formació de formadors
La funcionalitat de l'ICE: la formació de formadors
 
My-MartGlobal.com | My mart global business preview
My-MartGlobal.com | My mart global business previewMy-MartGlobal.com | My mart global business preview
My-MartGlobal.com | My mart global business preview
 
May 2014 wealthbuilder Stock Market Brief
May 2014 wealthbuilder Stock Market BriefMay 2014 wealthbuilder Stock Market Brief
May 2014 wealthbuilder Stock Market Brief
 
GLS
GLSGLS
GLS
 
Mixing asp.net mvc & web form into hybrid project
Mixing asp.net mvc & web form into hybrid projectMixing asp.net mvc & web form into hybrid project
Mixing asp.net mvc & web form into hybrid project
 
Unit 1,2 essence of ecos
Unit 1,2 essence of ecosUnit 1,2 essence of ecos
Unit 1,2 essence of ecos
 
Wto intro 1
Wto intro 1Wto intro 1
Wto intro 1
 
Sentinel report q4 2015
Sentinel report   q4 2015Sentinel report   q4 2015
Sentinel report q4 2015
 

Similar a Data Management and Applications at SOCIB

SeaDataCloud - Introduction to SeaDataNet infrastructure
SeaDataCloud - Introduction to SeaDataNet infrastructureSeaDataCloud - Introduction to SeaDataNet infrastructure
SeaDataCloud - Introduction to SeaDataNet infrastructure
EUDAT
 
Multidimensional Data in the VO
Multidimensional Data in the VOMultidimensional Data in the VO
Multidimensional Data in the VO
Jose Enrique Ruiz
 
Map4rdf - Faceted Browser for Geospatial Datasets
Map4rdf - Faceted Browser for Geospatial DatasetsMap4rdf - Faceted Browser for Geospatial Datasets
Map4rdf - Faceted Browser for Geospatial Datasets
Boris Villazón-Terrazas
 

Similar a Data Management and Applications at SOCIB (20)

One GeoNode, many GeoNodes
One GeoNode, many GeoNodesOne GeoNode, many GeoNodes
One GeoNode, many GeoNodes
 
Facing data sharing in a heterogeneous research community: lights and shadows...
Facing data sharing in a heterogeneous research community: lights and shadows...Facing data sharing in a heterogeneous research community: lights and shadows...
Facing data sharing in a heterogeneous research community: lights and shadows...
 
Hydrographic and marine software Solutions
Hydrographic and marine software SolutionsHydrographic and marine software Solutions
Hydrographic and marine software Solutions
 
SMART SEWER NETWORK MONITORING USING IOT AND AI
SMART SEWER NETWORK MONITORING USING IOT AND AISMART SEWER NETWORK MONITORING USING IOT AND AI
SMART SEWER NETWORK MONITORING USING IOT AND AI
 
Progetto INNO ed esempi di applicazioni nel campo della GEOMATICA - P.Cau
Progetto INNO ed esempi di applicazioni nel campo della GEOMATICA - P.CauProgetto INNO ed esempi di applicazioni nel campo della GEOMATICA - P.Cau
Progetto INNO ed esempi di applicazioni nel campo della GEOMATICA - P.Cau
 
Geospatial data & Web Portals for IWRM:-NRSC Perspective By Dr. J.R. Sharma
Geospatial data &  Web Portals for IWRM:-NRSC Perspective  By Dr. J.R. SharmaGeospatial data &  Web Portals for IWRM:-NRSC Perspective  By Dr. J.R. Sharma
Geospatial data & Web Portals for IWRM:-NRSC Perspective By Dr. J.R. Sharma
 
Lapis Guides
Lapis GuidesLapis Guides
Lapis Guides
 
SeaDataCloud - Introduction to SeaDataNet infrastructure
SeaDataCloud - Introduction to SeaDataNet infrastructureSeaDataCloud - Introduction to SeaDataNet infrastructure
SeaDataCloud - Introduction to SeaDataNet infrastructure
 
Presentation of YARIS platform
Presentation of YARIS platformPresentation of YARIS platform
Presentation of YARIS platform
 
GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020
 
Danis biosystematics2011
Danis biosystematics2011Danis biosystematics2011
Danis biosystematics2011
 
Multidimensional Data in the VO
Multidimensional Data in the VOMultidimensional Data in the VO
Multidimensional Data in the VO
 
COBWEB technology platform and future development needs
COBWEB technology platform and future development needsCOBWEB technology platform and future development needs
COBWEB technology platform and future development needs
 
COBWEB technology platform and future development needs, ISPRA 2016
COBWEB technology platform and future development needs, ISPRA 2016COBWEB technology platform and future development needs, ISPRA 2016
COBWEB technology platform and future development needs, ISPRA 2016
 
Validation of services, data and metadata
Validation of services, data and metadataValidation of services, data and metadata
Validation of services, data and metadata
 
IoT Meets Geo
IoT Meets GeoIoT Meets Geo
IoT Meets Geo
 
The Whitebox Geospatial-Analyisis Tools Project and Open-Access GIS
The Whitebox Geospatial-Analyisis Tools Project and Open-Access GISThe Whitebox Geospatial-Analyisis Tools Project and Open-Access GIS
The Whitebox Geospatial-Analyisis Tools Project and Open-Access GIS
 
Challenges and Opportunities of the IoT Data and Service Interoperability
Challenges and Opportunities of the IoT Data and Service InteroperabilityChallenges and Opportunities of the IoT Data and Service Interoperability
Challenges and Opportunities of the IoT Data and Service Interoperability
 
2016 GMekong Forum - Session 6 - Intro to SERVIR Mekong and dam inundation pr...
2016 GMekong Forum - Session 6 - Intro to SERVIR Mekong and dam inundation pr...2016 GMekong Forum - Session 6 - Intro to SERVIR Mekong and dam inundation pr...
2016 GMekong Forum - Session 6 - Intro to SERVIR Mekong and dam inundation pr...
 
Map4rdf - Faceted Browser for Geospatial Datasets
Map4rdf - Faceted Browser for Geospatial DatasetsMap4rdf - Faceted Browser for Geospatial Datasets
Map4rdf - Faceted Browser for Geospatial Datasets
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 

Data Management and Applications at SOCIB