Talk at the EarthCube End-User Domain Workshop for Rock Deformation and Mineral Physics Research. By Jim Bowring, College of Charleston

1. Automating Workflow from
Raw Data to Repository:
Collaborative Software Engineering
James F. Bowring
Computer Science Department
College of Charleston
EarthCube End-User Domain Workshop
for Rock Deformation & Mineral Physics
Alexandria VA, 13 November 2013

2. Roadmap
Background
EarthCube
EARTHTIME as Mainstream Science
Software Chasm
CIRDLES as Mainstream Solution Provider
Thoughts
Questions
13 November 2013
Jim Bowring EarthCube Alexandria
2

3. Background
College of Charleston: Teaching / Research
Software Design / Engineering / Testing
EarthCube: Governance & Software
EARTHTIME: Collaborator
CIRDLES: PI
13 November 2013
Jim Bowring EarthCube Alexandria
3

4. 13 November 2013
Jim Bowring EarthCube Alexandria
Photo courtesy of C. Frank StarmerJuly 2005
4

5. EarthCube
Structure
&
Tectonic
s
Geodesy
Solar
Terrestria
l
Aeronom
y
Meteorology
Magnetospheric
Physics
PaleoClimate
Solid and
Aqueous
Geochem
-istry
Space
Weather
Climate &
Large
Scale
Dynamic
s
NCAR
Atmospheric
Chemistr
y
EarthCube
CI
Geobiolo
gy &
Geo Ed &
PaleoenWorkforc
tology
e
Geophysi
Training
Cryosphe
cs &
Sediment
re & Ice
Geody-ology &
Dynamic
namics
Stratis
graphy
Critical
Hydrolog
Zone &
y
Soil
Science
Geomorphology
Bioinformati
cs
Physical
Oceanography
Biologica
l
Oceanography
Biology
Ecosyste
ms
Software
&
Modeling
High Perf
Computin
g
Semantic
s&
Ontologi
es
13 November 2013
Igneous
Petrology
& Volcanology
Marine
Geology
Ocean
Drilling &
Engineering
Chemical
Oceanography
Algorith
ms &
Data
Mining
Ocean
Educatio
n
Marine
Geophysi
cs
Jim Bowring EarthCube Alexandria
5

6. Goal:
calibrate earth history and develop the
geochronological techniques necessary to produce
high precision dates
Requires:
robust software for data reduction, analysis, and
archiving to support both science and education
13 November 2013
Jim Bowring EarthCube Alexandria
6

7. EARTHTIME
Software Requirements
open-source applications for full real-time
interactive data reduction and uncertainty
propagation
provide extensible plug-n-play models
provide graphical and statistical tools
produce publication-ready artifacts
automatically capture meta-data
produce a standardized & extensible record
for transport to / from archival databases
13 November 2013
Jim Bowring EarthCube Alexandria
7

8. Software Chasm
Kelly: domain-independent software
engineering solutions serve to isolate
the scientific-computing community
[IEEE Software 2007]
Wilson: treat scientific software with
scientific rigor
[American Scientist 2006]
13 November 2013
Jim Bowring EarthCube Alexandria
8

9. CIRDLES
Cyber Infrastructure Research and
Development Lab for the Earth Sciences
CIRDLES.org
Collaborative domain-specific software
engineering research to produce tools that
advance science
13 November 2013
Jim Bowring EarthCube Alexandria
9

10. Collaborative Development Process
13 November 2013
Jim Bowring EarthCube Alexandria
10

11. Long Tail Solution
13 November 2013
Jim Bowring EarthCube Alexandria
11

12. Archive with a Click !
13 November 2013
Jim Bowring EarthCube Alexandria
12

13. Thoughts:
Automating Workflow
from Raw Data to Repository
EarthCube must serve scientists and science
Collaborative Software / CI Engineering
Long-term support for software products
Less tedium, more science
Semantic Web Open World Assumption
13 November 2013
Jim Bowring EarthCube Alexandria
13

14. Questions ?
13 November 2013
Jim Bowring EarthCube Alexandria
14