Scaling API-first – The story of a global engineering organization
SC7 Workshop 3: Copernicus Data and Information Access Services (DIAS)
1. Copernicus EU
Copernicus EU www.copernicus.eu
Copernicus EU
C o p e r n i c u s
D a t a a n d I n f o r m a t i o n
A c c e s s S e r v i c e s ( D I A S )
DG GROW
Unit I3
2. Copernicus
T H E B I G D A T A C H A L L E N G E
• Massive amounts of data
• Full, open and free-of-charge
• Ease of access and use
• Different types of dissemination
infrastructures
• Member States Collaborative GS
• New technology developments
• ICT and EO cross-fertilisation
• Interoperability with non-EO datasets
• Public programmes as enablers
• Growth and jobs in downstream sector
Over 10 Petabyte/year
of new data
with just Sentinels-1, -2
and -3 fully operational
(data are downloaded
many times over)
2
3. Copernicus
H o w d i d w e g o t h e r e ?
• Discussions at COM and ESA (Copernicus
Committee, IGS Task Force, PB-EO) in 2015/2016
• EU Space Strategy Communication, ESA
Ministerial Council, EUMETSAT Council
• Consultation with industry (e.g. Value Chain
Workshop in April 2016, Brussels; Workshop on
EO exploitation Platforms October 2016,
ESRIN)…
4. Copernicus
C O P E R N I C U S B I G D A T A A P P R O A C H
Dual approach :
• Strengthening Copernicus Distribution Services for
search, view, download
• Setting up of Data Access and Information
Services (DIAS)
– Access to all Copernicus data and information
virtually collocated with computing resources
– Allowing Big Data analytics without the need to
download the data and information
– Allowing data fusion with non-EO data and
information
– Bring together all user communities (public,
research, commercial, private,…)
4
6. Copernicus
D I A S C o n c e p t
Copernicus DIAS
Back office
Front Office
Scalable storage
Copernicus Data &
information
Basic Data
Exploration
Tools
Third Party
Services &
Environment
CopernicusfundedServices
ThirdPartyfundedServices
End-Users
Scalable storage(s)
for 3rd party data
Scalable computing
environment
Scalable computing
environment
Integration
Interface layer
7. Copernicus
DIAS Provider
D I A S C o n c e p t
Third-Party: User implementing and/or
operating a local service making use of
the DIAS storage and interface
Scalable on-line
storage
Interface for storage
access & processing
and management
Provision of Front-
Office Infrastructure
is under Third-Party
responsibility
8. Copernicus
E u r o p e a n E O D a t a e c o s y s t e m o n D I A S
End user: User of the third-parties services
Sentinel Collaborative Ground Segment
National/commercial missions data access
EOEP-5 (“EO Science for Society”)
Heritage Data (LTDP+), Earthnet
EarthWatch CCI, InCubed
Copernicus Data & Information Access Services
Open Science Cloud & GEOSS Infrastructure
Copernicus Services & user uptake
Research and Innovation Projects (H2020)
Funded by
third-parties
DIAS
funded
Pathfinder projects
SAF
EU Member States & particpating countries
Third
Party
Users
Third-party
Users
Commercial or research users or
initiatives (e.g. EO Market place,..)
9. Data
Access
D A T A & I N F O R M A T I O N A C C E S S S E R V I C E S
• ESA
– Industry Information day:
December 2016
– Procurement initiated in
January 2017
– Offers received in April 2017
– Evaluation for June 2017
– In negotiations
– Initial operations forseen
Q1/Q2 2018
• Announcement event: Q1/Q2
2018
9
10. Copernicus
W E A R E N O T S T A R T I N G F R O M S C R A T C H !
• COM H2020
– DG/GROW, RTD and CNECT
– EOSC
• ESA Programmes
– TEPs
– Toolboxes
– Development initiatives
– ….
• EUMETSAT Pathfinders
• National initiatives
– Collaborative Ground
Segments
– …
10
11. Copernicus
I M P L E M E N T A T I O N A P P R O A C H
• Supply side measures implemented
through the Entrusted Entities –
Copernicus Services, ESA and
EUMETSAT
– Distribution
– DIAS
– Interoperability
• Demand side measures, R&I
– Implemented by COM, Member
States, ESA and EUMETSAT
• Coordination to optimise impact
11