Presented by William Michener on 11-15-2012

1. DuraSpace/ARL/DLF
E-Science Institute
DataONE: Tools and Approaches for
Supporting the Data Life Cycle
Supplemental Webinar
Thursday, November 15, 2012
1:00-2:30 pm EDT
1
1

2. DataONE: Tools and Approaches for
Supporting the Data Life Cycle
Presented by William Michener,
University of New Mexico
Professor and Director of e‐Science Initiatives for
University Libraries
DuraSpace/ARL/DLF E‐Science Institute
2

3. 3

4. Three Key Challenges
Plan
Analyze Collect
I v o
n a n
n t
o i
Integrate Assure
Discover Describe
Preserve
4

5. 1. Data Preservation and Planning
✔ DuraSpace/ARL/DLF E‐Science Institute ? 5

6. The Long Tail of Orphan Data
“Most of the bytes
are at the high end,
Specialized repositories but most of the
(e.g. GenBank, PDB) datasets are at the
Volume
low end” – Jim Gray
Orphan data
(B. Heidorn)
Rank frequency of datatype
DuraSpace/ARL/DLF E‐Science Institute
6

7. Planning ?
Metadata standard?
Data repository?
DuraSpace/ARL/DLF E‐Science Institute
7

8. DataONE and the DMPTool
Support Data Preservation
Three major components for a Member Nodes
flexible, scalable, sustainable • diverse institutions
network • serve local community
• provide resources for
managing their data
• retain copies of data
8

9. DataONE and the DMPTool
Support Data Preservation
Three major components for a Member Nodes
flexible, scalable, sustainable • diverse institutions
Coordinating Nodes
network • serve local community
• retain complete metadata
• provide resources for
catalog
managing their data
• indexing for search
• retain copies of data
• network‐wide services
• ensure content
availability (preservation)
• replication services
9

10. DataONE and the DMPTool
Support Data Preservation
Three major components for a Member Nodes
flexible, scalable, sustainable • diverse institutions
Coordinating Nodes
network • serve local community
• retain complete metadata
Investigator Toolkit
• provide resources for
catalog
managing their data
• indexing for search
• retain copies of data
• network‐wide services
• ensure content
availability (preservation)
• replication services
10

11. Dryad (>3,000 data products)
Coordinated
submission of articles
and underlying data
Handshaking with
specialized
repositories
Promotion of reuse
and incentives for
deposit
DuraSpace/ARL/DLF E‐Science Institute
11

12. Knowledge Network for Biocomplexity
(20,000+ data packages)
Data Types
• Ecological
• Environmental
• Demographic
• Social/Legal/Economic
Contributors 60
• Individual investigators 45 Data
• Field stations and networks 30 Sizes
• Government agencies %
15
• Non‐profit partnerships 0
10‐200
>200
< 1
1‐10
• Synthesis centers
MB
12

13. ✔Check for best practices
✔Create metadata
✔Connect to ONEShare
Data &
Metadata (EML)
13

14. 14

15. 15

16. DuraSpace/ARL/DLF E‐Science Institute
16

17. DuraSpace/ARL/DLF E‐Science Institute
17

18. 18

19. DuraSpace/ARL/DLF E‐Science Institute
19

20. 20

21. 21

22. 22

23. 23

24. DuraSpace/ARL/DLF E‐Science Institute
24

25. DuraSpace/ARL/DLF E‐Science Institute
25

26. 2. Data Discovery
26

27. Data Silos
27

28. The DataONE Federation
28

29. Member Node Functional Tiers
• Tier 1: Read only, public content
ping(), getLogRecords(), getCapabilities(),get(), getSystemMetadata(),
getChecksum(),listObjects(), synchronizationFailed()
• Tier 2: Read only, with access control
isAuthorized(), setAccessPolicy()
• Tier 3: Read/Write using client tools
create(), update(), delete()
• Tier 4: Able to operate as a replication target
–replicate(),getReplica()
• http://mule1.dataone.org/ArchitectureDocs‐current/apis/MN_APIs.html
DuraSpace/ARL/DLF E‐Science Institute
29

30. ORNL DAAC
as a DataONE
Member Node
NASA collectors DAAC Users (UWG)
Investigator Toolkit
DataONE Users
30

31. DuraSpace/ARL/DLF E‐Science Institute
31

32. 32

33. DuraSpace/ARL/DLF E‐Science Institute
33

34. 34

35. DuraSpace/ARL/DLF E‐Science Institute
35

36. 3. Innovation
The Fourth Paradigm:
1. Observational and
experimental
2. Theoretical research
3. Computer simulations of
natural phenomena
4. Data‐intensive research
• new tools, techniques,
and ways of working
36
36

37. “Data Intensive Science” and the “80:20 Rule”
Increasing Process Knowledge
Decreasing Spatial Coverage
Intensive science sites
and experiments
Extensive science sites
Volunteer &
education networks
Remote
sensing
Adapted from CENR‐OSTP
37

38. Investigator Toolkit Support
Plan
DMP-Tool
Analyze Collect
Kepler
Integrate Assure
Discover Describe
Preserve
38

39. Exploration, Visualization, and Analysis
Diverse bird observations and Model results
environmental data from
300,00 locations in the US Occurrence of Indigo Bunting (2008)
integrated and analyzed using
High Performance Computing
Resources
Land Cover
Jan Ap Jun Sep Dec
r
Meteorology
• Examine patterns of
migration
MODIS – Spatio‐Temporal Exploratory • Infer how climate
Remote Model identifies factors change may affect
sensing data affecting patterns of bird migration
migration
39

40. Scientific workflows
DuraSpace/ARL/DLF E‐Science Institute
40

41. Workflows Evolution with VisTrails
DuraSpace/ARL/DLF E‐Science Institute
41

42. Collaboration environments
42

43. Taverna, MyExperiment
DuraSpace/ARL/DLF E‐Science Institute
43

44. Community Engagement
44

45. User Assessments
Scientists: BL Scientists: FU
Library Policies: BL Library Policies: FU
Librarians: BL Librarians: FU
Policy Makers: BL Policy Makers: FU
Educators: BL Educators: FU
Year 1 Year 2 Year 3 Year 4 Year 5
DuraSpace/ARL/DLF E‐Science Institute
45

46. Results
• “More than half of the respondents (56%)
reported that they did not use any metadata
standard and about 22% of respondents
indicated they used their own lab metadata
standard.”
• Less than 6% of scientists are making “All” of
their data available via some mechanism.
DuraSpace/ARL/DLF E‐Science Institute
46

47. Community Engagement
DuraSpace/ARL/DLF E‐Science Institute
47

48. Best Practices and Software Tools
48

49. Best Practices and Software Tools
49

50. June 3-21, 2013
University of New Mexico 50

51. DataONE: Supporting Scientific Data
Preservation, Discovery, and Innovation
51

52. Recommendations
• 9 areas where you can help researchers
DuraSpace/ARL/DLF E‐Science Institute
52

53. 1. Plan ‐ https://dmp.cdlib.org
53

54. 2. Collect and assure the data
http://www.dataone.org/best‐practices
54

55. 3. Describe and document the data
http://metavist2.codeplex.com/
http://knb.ecoinformatics.org/morphoportal.jsp
55

56. 4. Select a repository for the data
http://databib.org/
http://www.dataone.org/best-practices
http://www.opendoar.org/
56

57. 5. Preserve the data
http://daac.ornl.gov/PI/BestPractices-2010.pdf
57

58. 6. Use the data
http://www.nutnet.umn.edu/
58

59. 7. Budget for it – 10‐>25% of total budget
59

60. 8. Communicate (early and often)
Meetings, web portals, newsletters,
phone and video conferences
60

61. 9. Train (in‐person and/or virtually)
61

62. DataONE.org
DuraSpace/ARL/DLF E‐Science Institute
62

63. DataONE Team and Sponsors
• Amber Budden, Roger Dahl, Rebecca Koskela, Bill • Ewa Deelman
Michener, Robert Nahf, Skye Roseboom, Mark
Servilla
• Deborah McGuinness
• Dave Vieglais
• Suzie Allard, Nick Dexter, Kimberly Douglass, • Jeff Horsburgh
Carol Tenopir, Robert Waltz, Bruce Wilson
• John Cobb, Bob Cook, Ranjeet Devarakonda, • Robert Sandusky
Giri Palanismy, Line Pouchard
• Patricia Cruse, John Kunze • Bertram Ludaescher
• Sky Bristol, Mike Frame, Richard Huffine, Viv • Peter Honeyman
Hutchison, Jeff Morisette, Jake Weltzin, Lisa Zolly
• Stephanie Hampton, Chris Jones, Matt • Cliff Duke
Jones, Ben Leinfelder, Andrew Pippin
• Paul Allen, Rick Bonney, Steve Kelling • Carole Goble
• Ryan Scherle, Todd Vision • Donald Hobern
• Randy Butler • David DeRoure
LEON LEVY
FOUNDATION 63

64. Questions?
DuraSpace/ARL/DLF E‐Science Institute 64