Modern Data Science is enabling NASA's engineers uncover actionable information from our "dark" data coffers. From starting small to operating at scale, Rob will discuss applications in telemetry, workforce analytics and liberating data from the Mars Rovers. Tools include iPython, Pandas, Boto and more.
How to Troubleshoot Apps for the Modern Connected Worker
Dark Data: A Data Scientists Exploration of the Unknown by Rob Witoff PyData SV 2014
1. Dark Data
A Data Scientist’s
Exploration
of the Unknown
Rob Witoff
!
Data Scientist
IT CTO Office
@rwitoff
Jet Propulsion Laboratory
California Institute of Technology
12. Amazon SWF
Decider
Data Processing Tasks
File Transfer Tasks
Decision Tasks
Data Processing Workers
EC2 EC2 EC2 EC2 S3
JPL Data Center
Decider
File Transfer
Workers
Data
Processing
Workers
Polyphony
Cloud Computing
24. “If this species is to survive indefinitely we need to
become a multi-planet species. We need to go to Mars,
and Mars is a stepping stone to other solar systems.”
!
NASA Administrator, Charlie Bolden
37. JPL Data Center
Decider
File Transfer
Workers
Data
Processing
Workers
Polyphony
Amazon SWF
Decider
Data Processing Tasks
File Transfer Tasks
Decision Tasks
Data Processing Workers
EC2 EC2 EC2 EC2 S3
Cloud Computing
113. Amazon SWF
Decider
Data Processing Tasks
File Transfer Tasks
Decision Tasks
Data Processing Workers
EC2 EC2 EC2 EC2 S3
JPL Data Center
Decider
File Transfer
Workers
Data
Processing
Workers
Polyphony
114.
115. Q What if we could
interact with ALL of
our Data?