2. ① Policy and governance framework
② Data Strategy
③ Roadmap
④ Key actions
⑤ Catalogue of Services
⑥ Community of Practice
⑦ Digital Pole
⑧ Conclusions
Emanuele BALDACCI
Director Digital Services, DIGIT
1
Agenda
3. 2
Agreement on the free flow of non-personal data: "Data is the backbone of today's digital
economy. The European data economy can become a powerful driver for growth, create
new jobs and open up new business models and innovation opportunities. With this
agreement we are one step closer to completing the Digital Single Market"
Commissioner for Digital Economy and Society, Mariya Gabriel
Unlocking the power of data
4. Communication
to the Commission on
Data, Information and
Knowledge Management
at the European Commission
adopted on the 18th October 2016
1 2
Data, information and
knowledge should be shared
Collaborative working
practices
5. Mandated by the College to
implement the strategy
described in the Data,
Information and Knowledge
Management communicationIMT
Information
Management Team
Data4Policy
group
Sherpa
group
HoU
DGx
DGx
HoU
SG | AGRI | BUDG | CNECT |
COMP | DEVCO | DGT | DIGIT |
ENV | ESTAT | GROW | HR | JRC |
OP | REGIO | RTD | TAXUD |
EACEA
IMSB
Information Management Steering Board
Governance
6. Data-Driven Organisation
To make better decisions based on
evidence, by using internal and external
data more effectively and by enhancing our
data analytics technologies.
To transform the European Commission in a
Challenge
7. DATA ECOSYSTEM
a system of interconnected
resources and services
for capturing, curating, storing,
protecting, elaborating, accessing,
using, re-using, consuming, analysing,
disseminating and sharing data
Set-up a Commission
dataStrategy@EC
Solution
Data
10. Infrastructure
Data Lake
Data Corporate Services
Implementation Projects
Key actions
2020
Big Data Test Infrastructure
full implementation
2017
Budget for
Results first
implementation
Q2
2018
One business case
for HR implemented
2019
Generic EC Data Lake
Federated Catalogue of Services
Q1
2018
& DORIS / BRP Integration
Set-up corporate web analytics
service
end
2018
Q2
2018
Blue Economy
Indicators Prototype
(DG MARE)
2020
Analytics for the design of
educational policies
(DG EAC)
2018
Big Data Test Infrastructure
platform as a service
11. DORIS: analysing feedback from EU citizens
10
Why a solution was needed?
The solution
• To analyse data from open and closed questions
• Dashboard to visualise and further analyse the
results of the consultation
• Text analysis, sentiment analysis, data mining and
reporting techniques to facilitate the analysis of
structured and unstructured information
• Optimisation of the time required for the analysis
• Different analytics techniques (clustering, keyword
extraction, name entity recognition, sentiment
analysis and campaign detection)
• Web interface to access the results of the analysis
with basic functionalities such as filters, maps,
translation and automatic charts
Data4Policy
12. Data Lake at Work – EU Results
11
Why a solution was needed?
The solution
• Manual collection of information on project funded
by the European Commission
• Different information system for the EC programmes
• Need to communicate to citizens
• Huge potential number of projects not manageable
by hand
• Data lake infrastructure
• Structured and unstructured data input
• Data Labs
• Data Products
• Reusable data for different purposes
• Automatic treatment
• Increased capabilities
Some results…
From 2000 project treated manually in 2 years to 172000 project ingested
by the data lake in 3 months
No need to force a data model for data ingested
Set-up of a data model for the final product
Ingestion from Information systems but also from already available web
portals
Considerable gain in the time of treatment
Infrastructure
13. Federated Catalogue of Services
12
The Federated Catalogue of Services provides a full range of Data & Analytics service offering to the end-users and
to the practitioners of big data and data analytics within the European Commission.
Users
Departments providing services
14. Beyond technology – community of practices
Collaborate
Federate
Capacity
Experiment
Together
Ongoing
cross-DG
Projects
Federated
Catalogue of
Data Services
Communities of
Practices
Use mature data and
analytics services,
including data, tools
and/or expertise,
federated across the
Commission Services
Join forces between
DGs to uplift innovation
through domain-specific
implementation projects
Find expertise, connect and share experience with
other DGs through the Data4Policy community
15. Location
leveraging on Luxembourg's strong digital ecosystem
Close collaboration
between the Commission and Luxembourg
Organisation
with a tight integration between the different components,
maximising synergies and mutual added value
CRITICAL SUCCESS FACTORS
DIGITAL
POLE
16. 4 takeaways
Cooperation
& Data Sharing
Setting up the right
frameworks for data quality
the first steps in building a data-driven
culture
Experimentation and piloting
are key to boost innovation It’s always about people
Conclusions
skills and literacy
curate and trust data
boost innovation and build expertise
17. Collaborative platform
Offers services to e-
Government professionals
to share experiences and
solutions
Repository of
shared & reused
solutions
Reusable Source
Code for setup own
platform
Federation with
other repositories
software, IT specifications,
data models, common
principles, business process
Observatory
News, events, documents
on interoperability such as
studies