SlideShare a Scribd company logo
1 of 26
Download to read offline
THE SHARED VALUE OF PERSONAL
AND POPULATION DATA
Trusted architectures, self management, patient driven hypotheses | Wessel Kraaij
TNO technical sciences, The Hague
Radboud University, Nijmegen
Wessel.kraaij@tno.nl
HEALTH IS MORE THAN MOLECULES
Health is complex
Body and mind are integrated
Environment is important
(physical and social)
 Multiple relations and data !
TNO Early Research Programmes
(2015-2018)
• Making Sense of Big Data
• Grip on Health (Complexity)
• Personalized Food
• Human Resilience
QUANTIFIED SELF DATA FOR HEALTH?
3
bron: MIT
QS: A movement of citizens and
‘makers’ that aim to explore the
possibilities of self-tracking.
Gary Wolf (Wired): “Almost
everything we do generates
data”.
WHAT COULD WE LEARN IF?
we could measure and record
activities, social context,
environmental context, physiological
parameters, food intake, sleep across
our entire lifetime? Now we have
sensors for most of these..
75% NL
population
owns
smartphone
• Always on…
• Online
• Multiple sensors
• Located near people
IMPLICATIONS
New data acquisition methods
ICT challenges
New research questions and challenges
Data science, causal inference
New dynamic (ownership, control points, agenda setting)
Crucial:
Trust (ethical, legal policies)
Data governance
ICT , privacy by design
4
HEALTH CARE DATA:
DIFFERENT STAKEHOLDERS, DIFFERENT
INTERESTS
Insurance: minimize cost of care
Hospitals: Optimize processes (# successful treatments)
Researchers: collect data for studies (# top publications)
Tech platform companies (Google/Apple): pervasive monitoring of
personal data (#users)
Patient interest?
Future scenario #1:
Uber health
Uber connects patients and
caregivers (private clinics) directly
Uber owns patient health data
FUTURE SCENARIOS
6
Future scenario #2:
Google health
Google recommends you to visit a GP nearby
with high evaluations as soon as it finds that your
pulse shows irregularities
Google owns patient health data
Future scenario #3: Value based HC
(Porter)
Core value:
‘health outcomes that matter to patients’
Patients own their own data.
A brief overview of the COMMIT/ SWELL project
The ‘personalized health’
perspective
7
SWELL Project
• Goal
• Keep knowledge workers healthy
• Mental: workload, stress, burn-out
• Physical: activity levels, sleep
• Approach
A. Estimating mental and physical state by combining
multiple unobtrusive sensor streams
B. Offer support based on BCT
Smart reasoning systems for WELL-being (7 Meuro, 5 yr)
INFORMATION FROM SENSORS
Work characteristics: work tasks, topics
Stress related variables: task load, mental effort, emotion, perceived stress
SWELL WORKLOAD MIRROR
How to visualize sensor data?
SWELL PROTOTYPES
Brightr e-coach
SWELL
Fishualization:
SWELL NiceWork e-
coach:
Deal with
jetlag
real time mapping of sensor data
recommender system for tips
WHAT DID WE LEARN: PRIVACY
CONCERNS
Candidate subjects did have concerns to share data
Main concern was sharing detailed data with manager
Degree of privacy concerns varies significantly across subject
Project focus choice:
Subjects (employees) control access to personal data
No aggregation
[Koldijk, S., Koot, G., Neerincx, M.A., & Kraaij, W. (2014). Privacy and User Trust in Context-Aware
Systems. In: Proceedings of the 22nd Conference on User Modeling, Adaptation and Personalization
(UMAP 2014) (Aalborg, Denmark, 7-11 July 2014).]
Project design choice:
=>Subjects (employees) control access to personal data
=>No aggregation, pure self management
The need for reference data and/or
models in Pmed & Phealth
13
REFERENCE DATA NEEDED FOR CLINICAL
REASONING AND SELF MANAGEMENT
Example: Fitness metric VO2 Max depends on gender, age, genetics and
body size
Population peer data helps to interpret fitness level
Example: Growth data of large cohort of infants can be used to estimate the
effect of an intervention for an individual child
[van Buuren S (2014) Curve Matching: A Data-Driven Technique to
Improve Individual Prediction of Childhood Growth. Annals of Nutrition
& Metabolism, 65(3), 225-231]
Helps to reduce under/overtreatment based on average causal
effect reasoning
14
Data driven
approach
Data Model
User Interface
Advice
Lifestyle
advice
BUILDING PERSONALIZED SYSTEM-BASED
HEALTH ADVICE SYSTEMS
Measurements
Interventions
Behaviour
change
Health
Projections
Data cooperative
Food intake
Wellbeing
Modelling health
Personalized
food advice
N=1 analysis
Health biomarkers
Health visualization
Phenflex II
Hybrid approach:
data & model
THE MUTUAL DEPENDENCE OF PERSONAL AND
POPULATION HEALTH DATA
17
Bron: cbw.ge en wikimedia.org
Van ‘big’ naar ik
The health data infrastructure
challenge
18
TOWARDS PERSONAL HEALTH DATA
STORES (1)
Starting point: a single
infrastructure for:
Patients
Control and ownership of data
Fine grained access policies
Coverage: from conception to
end of life
Research
FAIR principles (Findable,
Accessible, Interoperable,
Reusable), anonimized
aggregated
19
Health professionals
Data from similar individuals
supports clinical reasoning
(Pseudonymized)
Government & Industry
Access anonimized
aggregated data
TOWARDS PERSONAL HEALTH DATA
STORES (2)
Support different vendors of DIY measurements
Some measurements will be computed locally and aggregated to acceptable
privacy disclosure level
Ecosystem of different PHDS providers e.g. Apple, Google, Health Data
Cooperative, regional health data intermediary, ISP/cloud solutions
Should support minimal standards
Should support efficient patient similarity search
20
Example of a patient group driven study:
exploring what matters to GIST patients
GIST: rare cancer 15 over 1,000,000 new cases annually
GIST Facebook group study
22
GIST FACEBOOK MINER
Aggregating patient data is particularly relevant for rare diseases
Search and explore web forum discussions for patients and hypothesis
generation
Combining deep learning (Word2vec) and domain knowledge (Concept
tagging)
Word2vec
Generates a semantic model of a large text corpus based on word contexts.
Example: Gleevec: Glivec, Sutent, Mg, 400 Mg, Gleevic
Concept tagging of UMLS (Unified Medical Language System) concepts
I’m on a clinical trial with the drug Ponatinib on a daily dosage of 30 mg trying to
shrink 8 tumors.
Research Activity Medicines Temporal Concept Neoplastic ProcessGIST
CONCEPTS RELATED
TO “ITCHY”
GIST
GIST
CONCLUSIONS
1. New forms of personal data have a potential for improving individual
health outcomes and prevention
Combination of different data sources, new sensors, patient networks, models
2. The potential is best realized when compared with population or peer
data
We also need data about healthy people
But many of the new measures are privacy sensitive
This is a serious barrier for uptake on a large scale
3. A health data infrastructure should be built on ‘privacy by design’
principles to safeguard the interests of all stakeholders
Interoperability between different flavours: Google/Apple; health data
cooperatives, personal data stores
Access controlled by owners
26
CALL TO ACTION
Dutch ICT sector promotes a large R&D
programme on Big Data:
COMMIT2DATA
Life (including Health) is one of the
focal domains
personal and population data
We are looking for partners to co-create
a health data infrastructure built on the
principles of shared value
5-Oct-2015
THANK YOU FOR YOUR ATTENTION
Wessel.Kraaij@tno.nl

More Related Content

What's hot

Big Data and the Future by Sherri Rose
Big Data and the Future by Sherri RoseBig Data and the Future by Sherri Rose
Big Data and the Future by Sherri RoseLewis Lin 🦊
 
National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013
National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013
National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013Warren Kibbe
 
Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...
Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...
Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...Fundación Ramón Areces
 
Open science-open-data-pnc-20103
Open science-open-data-pnc-20103Open science-open-data-pnc-20103
Open science-open-data-pnc-20103hjl7
 
Towards More Computable Knowledge
Towards More Computable KnowledgeTowards More Computable Knowledge
Towards More Computable KnowledgeDeborah McGuinness
 
Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...
Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...
Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...Katarzyna Wac & The QoL Lab
 
Big Data and Population Health: SBM 2015
Big Data and Population Health: SBM 2015Big Data and Population Health: SBM 2015
Big Data and Population Health: SBM 2015Bradford Hesse
 
From Big Data to Precision Medicine
From Big Data to Precision Medicine From Big Data to Precision Medicine
From Big Data to Precision Medicine Year of the X
 
Towards an Environmental Health Sciences Ontology: CHEAR to HHEAR and Beyond
Towards an Environmental Health Sciences Ontology:CHEAR to HHEAR and BeyondTowards an Environmental Health Sciences Ontology:CHEAR to HHEAR and Beyond
Towards an Environmental Health Sciences Ontology: CHEAR to HHEAR and BeyondDeborah McGuinness
 
Secure Data Sharing and Related Matters – An NIH View
Secure Data Sharing and Related Matters – An NIH ViewSecure Data Sharing and Related Matters – An NIH View
Secure Data Sharing and Related Matters – An NIH ViewPhilip Bourne
 
Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...Artificial Intelligence Institute at UofSC
 
What are scal­able best prac­tices to spread smart health?
What are scal­able best prac­tices to spread smart health? What are scal­able best prac­tices to spread smart health?
What are scal­able best prac­tices to spread smart health? SharpBrains
 
One Funder’s View for Advancing Open Science
One Funder’s View for Advancing Open ScienceOne Funder’s View for Advancing Open Science
One Funder’s View for Advancing Open SciencePhilip Bourne
 
kHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma Care
kHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma CarekHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma Care
kHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma CareAmit Sheth
 
Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...Katarzyna Wac & The QoL Lab
 
Pattern diagnostics 2015
Pattern diagnostics 2015Pattern diagnostics 2015
Pattern diagnostics 2015Thomas Wilckens
 
Self tracking and digital health
Self tracking and digital healthSelf tracking and digital health
Self tracking and digital healthJohn Rooksby
 

What's hot (20)

Big Data and the Future by Sherri Rose
Big Data and the Future by Sherri RoseBig Data and the Future by Sherri Rose
Big Data and the Future by Sherri Rose
 
National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013
National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013
National Cancer Policy Forum Summit - Warren Kibbe Keynote November 2013
 
Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...
Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...
Thomas Willkens-El impacto de las ciencias ómicas en la medicina, la nutrició...
 
Open science-open-data-pnc-20103
Open science-open-data-pnc-20103Open science-open-data-pnc-20103
Open science-open-data-pnc-20103
 
Towards More Computable Knowledge
Towards More Computable KnowledgeTowards More Computable Knowledge
Towards More Computable Knowledge
 
Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...
Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...
Quality of Life Technologies: From Fundamentals of Mobile Computing to Patter...
 
Big Data and Population Health: SBM 2015
Big Data and Population Health: SBM 2015Big Data and Population Health: SBM 2015
Big Data and Population Health: SBM 2015
 
From Big Data to Precision Medicine
From Big Data to Precision Medicine From Big Data to Precision Medicine
From Big Data to Precision Medicine
 
Towards an Environmental Health Sciences Ontology: CHEAR to HHEAR and Beyond
Towards an Environmental Health Sciences Ontology:CHEAR to HHEAR and BeyondTowards an Environmental Health Sciences Ontology:CHEAR to HHEAR and Beyond
Towards an Environmental Health Sciences Ontology: CHEAR to HHEAR and Beyond
 
Secure Data Sharing and Related Matters – An NIH View
Secure Data Sharing and Related Matters – An NIH ViewSecure Data Sharing and Related Matters – An NIH View
Secure Data Sharing and Related Matters – An NIH View
 
Transcriptional Science
Transcriptional ScienceTranscriptional Science
Transcriptional Science
 
Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...
 
Depression slides.pptx
Depression slides.pptxDepression slides.pptx
Depression slides.pptx
 
What are scal­able best prac­tices to spread smart health?
What are scal­able best prac­tices to spread smart health? What are scal­able best prac­tices to spread smart health?
What are scal­able best prac­tices to spread smart health?
 
One Funder’s View for Advancing Open Science
One Funder’s View for Advancing Open ScienceOne Funder’s View for Advancing Open Science
One Funder’s View for Advancing Open Science
 
kHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma Care
kHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma CarekHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma Care
kHealth: Semantic Multi-sensory Mobile Approach to Personalized Asthma Care
 
Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...
 
Pattern diagnostics 2015
Pattern diagnostics 2015Pattern diagnostics 2015
Pattern diagnostics 2015
 
Self tracking and digital health
Self tracking and digital healthSelf tracking and digital health
Self tracking and digital health
 
mQoL-Lab : Living Lab Infrastructure
mQoL-Lab : Living Lab InfrastructuremQoL-Lab : Living Lab Infrastructure
mQoL-Lab : Living Lab Infrastructure
 

Similar to The shared value of personal and population data

Future of Healthcare: 3 Disruptive Trends
Future of Healthcare: 3 Disruptive TrendsFuture of Healthcare: 3 Disruptive Trends
Future of Healthcare: 3 Disruptive TrendsSean Koon, MD, MS
 
Sun==big data analytics for health care
Sun==big data analytics for health careSun==big data analytics for health care
Sun==big data analytics for health careAravindharamanan S
 
Ehealth: enabling self-management, public health 2.0 and citizen science
Ehealth: enabling self-management, public health 2.0 and citizen scienceEhealth: enabling self-management, public health 2.0 and citizen science
Ehealth: enabling self-management, public health 2.0 and citizen scienceKathleen Gray
 
Person-generated health data: How can it help us to feel better?
Person-generated health data: How can it help us to feel better?Person-generated health data: How can it help us to feel better?
Person-generated health data: How can it help us to feel better?Kathleen Gray
 
Improving health care outcomes with responsible data science
Improving health care outcomes with responsible data scienceImproving health care outcomes with responsible data science
Improving health care outcomes with responsible data scienceWessel Kraaij
 
Introduction to engineering entrepreneurship in the public health and life sc...
Introduction to engineering entrepreneurship in the public health and life sc...Introduction to engineering entrepreneurship in the public health and life sc...
Introduction to engineering entrepreneurship in the public health and life sc...Nikos Papachristou
 
Khoury ashg2014
Khoury ashg2014Khoury ashg2014
Khoury ashg2014muink
 
Researcher Dilemmas using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...
Researcher Dilemmas  using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...Researcher Dilemmas  using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...
Researcher Dilemmas using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...Galit Shmueli
 
M. Chris Gibbons - Health IT and Healthcare Disparities
M. Chris Gibbons - Health IT and Healthcare DisparitiesM. Chris Gibbons - Health IT and Healthcare Disparities
M. Chris Gibbons - Health IT and Healthcare DisparitiesPlain Talk 2015
 
The Learning Health System: Thinking and Acting Across Scales
The Learning Health System: Thinking and Acting Across ScalesThe Learning Health System: Thinking and Acting Across Scales
The Learning Health System: Thinking and Acting Across ScalesPhilip Payne
 
Diabetes, PHRs,at teams - Hopkins Capstone
Diabetes, PHRs,at teams - Hopkins CapstoneDiabetes, PHRs,at teams - Hopkins Capstone
Diabetes, PHRs,at teams - Hopkins CapstoneWade Schuette
 
ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...
ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...
ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...ICEGOV
 
HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...
HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...
HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...Pei-Yun Sabrina Hsueh
 

Similar to The shared value of personal and population data (20)

Panel at AMIA 2013 Conference on big data - The Exposome and the quantified s...
Panel at AMIA 2013 Conference on big data - The Exposome and the quantified s...Panel at AMIA 2013 Conference on big data - The Exposome and the quantified s...
Panel at AMIA 2013 Conference on big data - The Exposome and the quantified s...
 
Future of Healthcare: 3 Disruptive Trends
Future of Healthcare: 3 Disruptive TrendsFuture of Healthcare: 3 Disruptive Trends
Future of Healthcare: 3 Disruptive Trends
 
Sun==big data analytics for health care
Sun==big data analytics for health careSun==big data analytics for health care
Sun==big data analytics for health care
 
Ehealth: enabling self-management, public health 2.0 and citizen science
Ehealth: enabling self-management, public health 2.0 and citizen scienceEhealth: enabling self-management, public health 2.0 and citizen science
Ehealth: enabling self-management, public health 2.0 and citizen science
 
Big data for health
Big data for healthBig data for health
Big data for health
 
Integrated health monitoring
Integrated health monitoringIntegrated health monitoring
Integrated health monitoring
 
Person-generated health data: How can it help us to feel better?
Person-generated health data: How can it help us to feel better?Person-generated health data: How can it help us to feel better?
Person-generated health data: How can it help us to feel better?
 
Improving health care outcomes with responsible data science
Improving health care outcomes with responsible data scienceImproving health care outcomes with responsible data science
Improving health care outcomes with responsible data science
 
Introduction to engineering entrepreneurship in the public health and life sc...
Introduction to engineering entrepreneurship in the public health and life sc...Introduction to engineering entrepreneurship in the public health and life sc...
Introduction to engineering entrepreneurship in the public health and life sc...
 
Khoury ashg2014
Khoury ashg2014Khoury ashg2014
Khoury ashg2014
 
Precision and Participatory Medicine - MEDINFO 2015 Panel on big data
Precision and Participatory Medicine - MEDINFO 2015 Panel on big dataPrecision and Participatory Medicine - MEDINFO 2015 Panel on big data
Precision and Participatory Medicine - MEDINFO 2015 Panel on big data
 
Researcher Dilemmas using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...
Researcher Dilemmas  using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...Researcher Dilemmas  using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...
Researcher Dilemmas using Behavioral Big Data in Healthcare (INFORMS DMDA Wo...
 
Geohealth symposium-UTen ITC
Geohealth symposium-UTen ITCGeohealth symposium-UTen ITC
Geohealth symposium-UTen ITC
 
M. Chris Gibbons - Health IT and Healthcare Disparities
M. Chris Gibbons - Health IT and Healthcare DisparitiesM. Chris Gibbons - Health IT and Healthcare Disparities
M. Chris Gibbons - Health IT and Healthcare Disparities
 
The Learning Health System: Thinking and Acting Across Scales
The Learning Health System: Thinking and Acting Across ScalesThe Learning Health System: Thinking and Acting Across Scales
The Learning Health System: Thinking and Acting Across Scales
 
AI & Healthcare @ AIISC: May 2021 Snapshot
AI & Healthcare @ AIISC: May 2021 SnapshotAI & Healthcare @ AIISC: May 2021 Snapshot
AI & Healthcare @ AIISC: May 2021 Snapshot
 
Towards a learning health system
Towards a learning health systemTowards a learning health system
Towards a learning health system
 
Diabetes, PHRs,at teams - Hopkins Capstone
Diabetes, PHRs,at teams - Hopkins CapstoneDiabetes, PHRs,at teams - Hopkins Capstone
Diabetes, PHRs,at teams - Hopkins Capstone
 
ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...
ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...
ICEGOV2009 - Tutorial 4 - E-Health Standards in Practice: Challenges and Oppo...
 
HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...
HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...
HEC 2016 Panel: Putting User-Generated Data in Action: Improving Interpretabi...
 

More from Wessel Kraaij

Unobtrusive sensors for measuring well-being at work
Unobtrusive sensors for measuring well-being at workUnobtrusive sensors for measuring well-being at work
Unobtrusive sensors for measuring well-being at workWessel Kraaij
 
Improving health care outcomes with responsible data science #escience2018
Improving health care outcomes with responsible data science #escience2018Improving health care outcomes with responsible data science #escience2018
Improving health care outcomes with responsible data science #escience2018Wessel Kraaij
 
Enabling Analytics on Sensitive Medical Data with Secure Multiparty Computation
Enabling Analytics on Sensitive Medical Data with Secure Multiparty ComputationEnabling Analytics on Sensitive Medical Data with Secure Multiparty Computation
Enabling Analytics on Sensitive Medical Data with Secure Multiparty ComputationWessel Kraaij
 
From personal health data to a personalized advice
From personal health data to a personalized adviceFrom personal health data to a personalized advice
From personal health data to a personalized adviceWessel Kraaij
 
Citizen controlled health data lockers as a game changer
Citizen controlled health data lockers as a game changerCitizen controlled health data lockers as a game changer
Citizen controlled health data lockers as a game changerWessel Kraaij
 
Kraaij infrastructures for secure data analytics def brussel 2017
Kraaij infrastructures for secure data analytics def brussel 2017Kraaij infrastructures for secure data analytics def brussel 2017
Kraaij infrastructures for secure data analytics def brussel 2017Wessel Kraaij
 
Towards an ecosystem for privacy respecting analysis of distributed health data
Towards an ecosystem for privacy respecting analysis of distributed health data Towards an ecosystem for privacy respecting analysis of distributed health data
Towards an ecosystem for privacy respecting analysis of distributed health data Wessel Kraaij
 
Quantified Self voor gepersonaliseerde gezondheid
Quantified Self voor gepersonaliseerde gezondheidQuantified Self voor gepersonaliseerde gezondheid
Quantified Self voor gepersonaliseerde gezondheidWessel Kraaij
 

More from Wessel Kraaij (8)

Unobtrusive sensors for measuring well-being at work
Unobtrusive sensors for measuring well-being at workUnobtrusive sensors for measuring well-being at work
Unobtrusive sensors for measuring well-being at work
 
Improving health care outcomes with responsible data science #escience2018
Improving health care outcomes with responsible data science #escience2018Improving health care outcomes with responsible data science #escience2018
Improving health care outcomes with responsible data science #escience2018
 
Enabling Analytics on Sensitive Medical Data with Secure Multiparty Computation
Enabling Analytics on Sensitive Medical Data with Secure Multiparty ComputationEnabling Analytics on Sensitive Medical Data with Secure Multiparty Computation
Enabling Analytics on Sensitive Medical Data with Secure Multiparty Computation
 
From personal health data to a personalized advice
From personal health data to a personalized adviceFrom personal health data to a personalized advice
From personal health data to a personalized advice
 
Citizen controlled health data lockers as a game changer
Citizen controlled health data lockers as a game changerCitizen controlled health data lockers as a game changer
Citizen controlled health data lockers as a game changer
 
Kraaij infrastructures for secure data analytics def brussel 2017
Kraaij infrastructures for secure data analytics def brussel 2017Kraaij infrastructures for secure data analytics def brussel 2017
Kraaij infrastructures for secure data analytics def brussel 2017
 
Towards an ecosystem for privacy respecting analysis of distributed health data
Towards an ecosystem for privacy respecting analysis of distributed health data Towards an ecosystem for privacy respecting analysis of distributed health data
Towards an ecosystem for privacy respecting analysis of distributed health data
 
Quantified Self voor gepersonaliseerde gezondheid
Quantified Self voor gepersonaliseerde gezondheidQuantified Self voor gepersonaliseerde gezondheid
Quantified Self voor gepersonaliseerde gezondheid
 

Recently uploaded

Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...amitlee9823
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraGovindSinghDasila
 
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -Pooja Nehwal
 
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night StandCall Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...ZurliaSoop
 
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...karishmasinghjnh
 
Detecting Credit Card Fraud: A Machine Learning Approach
Detecting Credit Card Fraud: A Machine Learning ApproachDetecting Credit Card Fraud: A Machine Learning Approach
Detecting Credit Card Fraud: A Machine Learning ApproachBoston Institute of Analytics
 
➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men 🔝Sambalpur🔝 Esc...
➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men  🔝Sambalpur🔝   Esc...➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men  🔝Sambalpur🔝   Esc...
➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men 🔝Sambalpur🔝 Esc...amitlee9823
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...amitlee9823
 
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...amitlee9823
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Researchmichael115558
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...amitlee9823
 
Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...gajnagarg
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...amitlee9823
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...gajnagarg
 
Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...
Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...
Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...gajnagarg
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...Elaine Werffeli
 

Recently uploaded (20)

Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
 
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night StandCall Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
 
Detecting Credit Card Fraud: A Machine Learning Approach
Detecting Credit Card Fraud: A Machine Learning ApproachDetecting Credit Card Fraud: A Machine Learning Approach
Detecting Credit Card Fraud: A Machine Learning Approach
 
➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men 🔝Sambalpur🔝 Esc...
➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men  🔝Sambalpur🔝   Esc...➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men  🔝Sambalpur🔝   Esc...
➥🔝 7737669865 🔝▻ Sambalpur Call-girls in Women Seeking Men 🔝Sambalpur🔝 Esc...
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
 
Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Mysore Escorts ☎️9352988975 Two shot with one girl (...
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
 
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
 
Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...
Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...
Just Call Vip call girls Erode Escorts ☎️9352988975 Two shot with one girl (E...
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 

The shared value of personal and population data

  • 1. THE SHARED VALUE OF PERSONAL AND POPULATION DATA Trusted architectures, self management, patient driven hypotheses | Wessel Kraaij TNO technical sciences, The Hague Radboud University, Nijmegen Wessel.kraaij@tno.nl
  • 2. HEALTH IS MORE THAN MOLECULES Health is complex Body and mind are integrated Environment is important (physical and social)  Multiple relations and data ! TNO Early Research Programmes (2015-2018) • Making Sense of Big Data • Grip on Health (Complexity) • Personalized Food • Human Resilience
  • 3. QUANTIFIED SELF DATA FOR HEALTH? 3 bron: MIT QS: A movement of citizens and ‘makers’ that aim to explore the possibilities of self-tracking. Gary Wolf (Wired): “Almost everything we do generates data”. WHAT COULD WE LEARN IF? we could measure and record activities, social context, environmental context, physiological parameters, food intake, sleep across our entire lifetime? Now we have sensors for most of these.. 75% NL population owns smartphone • Always on… • Online • Multiple sensors • Located near people
  • 4. IMPLICATIONS New data acquisition methods ICT challenges New research questions and challenges Data science, causal inference New dynamic (ownership, control points, agenda setting) Crucial: Trust (ethical, legal policies) Data governance ICT , privacy by design 4
  • 5. HEALTH CARE DATA: DIFFERENT STAKEHOLDERS, DIFFERENT INTERESTS Insurance: minimize cost of care Hospitals: Optimize processes (# successful treatments) Researchers: collect data for studies (# top publications) Tech platform companies (Google/Apple): pervasive monitoring of personal data (#users) Patient interest?
  • 6. Future scenario #1: Uber health Uber connects patients and caregivers (private clinics) directly Uber owns patient health data FUTURE SCENARIOS 6 Future scenario #2: Google health Google recommends you to visit a GP nearby with high evaluations as soon as it finds that your pulse shows irregularities Google owns patient health data Future scenario #3: Value based HC (Porter) Core value: ‘health outcomes that matter to patients’ Patients own their own data.
  • 7. A brief overview of the COMMIT/ SWELL project The ‘personalized health’ perspective 7
  • 8. SWELL Project • Goal • Keep knowledge workers healthy • Mental: workload, stress, burn-out • Physical: activity levels, sleep • Approach A. Estimating mental and physical state by combining multiple unobtrusive sensor streams B. Offer support based on BCT Smart reasoning systems for WELL-being (7 Meuro, 5 yr)
  • 9. INFORMATION FROM SENSORS Work characteristics: work tasks, topics Stress related variables: task load, mental effort, emotion, perceived stress
  • 10. SWELL WORKLOAD MIRROR How to visualize sensor data?
  • 11. SWELL PROTOTYPES Brightr e-coach SWELL Fishualization: SWELL NiceWork e- coach: Deal with jetlag real time mapping of sensor data recommender system for tips
  • 12. WHAT DID WE LEARN: PRIVACY CONCERNS Candidate subjects did have concerns to share data Main concern was sharing detailed data with manager Degree of privacy concerns varies significantly across subject Project focus choice: Subjects (employees) control access to personal data No aggregation [Koldijk, S., Koot, G., Neerincx, M.A., & Kraaij, W. (2014). Privacy and User Trust in Context-Aware Systems. In: Proceedings of the 22nd Conference on User Modeling, Adaptation and Personalization (UMAP 2014) (Aalborg, Denmark, 7-11 July 2014).] Project design choice: =>Subjects (employees) control access to personal data =>No aggregation, pure self management
  • 13. The need for reference data and/or models in Pmed & Phealth 13
  • 14. REFERENCE DATA NEEDED FOR CLINICAL REASONING AND SELF MANAGEMENT Example: Fitness metric VO2 Max depends on gender, age, genetics and body size Population peer data helps to interpret fitness level Example: Growth data of large cohort of infants can be used to estimate the effect of an intervention for an individual child [van Buuren S (2014) Curve Matching: A Data-Driven Technique to Improve Individual Prediction of Childhood Growth. Annals of Nutrition & Metabolism, 65(3), 225-231] Helps to reduce under/overtreatment based on average causal effect reasoning 14 Data driven approach
  • 15. Data Model User Interface Advice Lifestyle advice BUILDING PERSONALIZED SYSTEM-BASED HEALTH ADVICE SYSTEMS Measurements Interventions Behaviour change Health Projections Data cooperative Food intake Wellbeing Modelling health Personalized food advice N=1 analysis Health biomarkers Health visualization Phenflex II Hybrid approach: data & model
  • 16. THE MUTUAL DEPENDENCE OF PERSONAL AND POPULATION HEALTH DATA 17 Bron: cbw.ge en wikimedia.org Van ‘big’ naar ik
  • 17. The health data infrastructure challenge 18
  • 18. TOWARDS PERSONAL HEALTH DATA STORES (1) Starting point: a single infrastructure for: Patients Control and ownership of data Fine grained access policies Coverage: from conception to end of life Research FAIR principles (Findable, Accessible, Interoperable, Reusable), anonimized aggregated 19 Health professionals Data from similar individuals supports clinical reasoning (Pseudonymized) Government & Industry Access anonimized aggregated data
  • 19. TOWARDS PERSONAL HEALTH DATA STORES (2) Support different vendors of DIY measurements Some measurements will be computed locally and aggregated to acceptable privacy disclosure level Ecosystem of different PHDS providers e.g. Apple, Google, Health Data Cooperative, regional health data intermediary, ISP/cloud solutions Should support minimal standards Should support efficient patient similarity search 20
  • 20. Example of a patient group driven study: exploring what matters to GIST patients GIST: rare cancer 15 over 1,000,000 new cases annually GIST Facebook group study 22
  • 21. GIST FACEBOOK MINER Aggregating patient data is particularly relevant for rare diseases Search and explore web forum discussions for patients and hypothesis generation Combining deep learning (Word2vec) and domain knowledge (Concept tagging) Word2vec Generates a semantic model of a large text corpus based on word contexts. Example: Gleevec: Glivec, Sutent, Mg, 400 Mg, Gleevic Concept tagging of UMLS (Unified Medical Language System) concepts I’m on a clinical trial with the drug Ponatinib on a daily dosage of 30 mg trying to shrink 8 tumors. Research Activity Medicines Temporal Concept Neoplastic ProcessGIST
  • 23. GIST
  • 24. CONCLUSIONS 1. New forms of personal data have a potential for improving individual health outcomes and prevention Combination of different data sources, new sensors, patient networks, models 2. The potential is best realized when compared with population or peer data We also need data about healthy people But many of the new measures are privacy sensitive This is a serious barrier for uptake on a large scale 3. A health data infrastructure should be built on ‘privacy by design’ principles to safeguard the interests of all stakeholders Interoperability between different flavours: Google/Apple; health data cooperatives, personal data stores Access controlled by owners 26
  • 25. CALL TO ACTION Dutch ICT sector promotes a large R&D programme on Big Data: COMMIT2DATA Life (including Health) is one of the focal domains personal and population data We are looking for partners to co-create a health data infrastructure built on the principles of shared value 5-Oct-2015
  • 26. THANK YOU FOR YOUR ATTENTION Wessel.Kraaij@tno.nl