SlideShare una empresa de Scribd logo
1 de 67
clearScience
          dragging scientific communication
              into the information age



Brian M. Bot | Senior Scientist | Sage Bionetworks
Deception at Duke
“I will help you. Trust me.”
         - Anil Potti to Juliet Jacobs (pictured above)
open
open source
open data
open access
open access
access2research
access2research
accessible
clear
research scandals represent
merely the extreme of a
continuum in the culture of
academic research
research scandals represent
merely the extreme of a
continuum in the culture of
academic research
the status quo tolerates
 poor communication
 of findings




Ioannidis A. et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149-155 (2009) | doi:10.1038/ng.295
the status quo tolerates
 poor communication
 of findings                                                                        can
                                                                                   reproduce
                                                                                   partially


                                 can reproduce from                               6%
                                 processed data w/
                                 discrepancies
                                                                21%



                                                                                                               54%
                                                                                                                               cannot
                               can reproduce                    8%                                                             reproduce
                               w/discrepancies
                                                                        11%

                                                     can
                                                     reproduce in
                                                     principle




Ioannidis A. et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149-155 (2009) | doi:10.1038/ng.295
often what is in principle
                                                     reproducible, is not
                                                     practically reproducible




unidentified publication
    ‣ from journal with 5 year impact factor of 28
    ‣ article freely available for download
    ‣ data freely available for download
often what is in principle
                                                                                         reproducible, is not
                                                                                         practically reproducible

                                                                       208,294,724
                                                                       datapoints



                                                     124 pages
                                                     supplemental material

                                                                    ?? lines
                                                                    unobtainable source code

                                                                                          ?? version or architecture of
                                                                                          statistical analysis program (R)
                                                                                   enumerable R packages
                                                                                   and package dependencies

                                                                             key R package “ClaNC”
                                                                             no longer available


                                                                                               442 citations

unidentified publication
    ‣ from journal with 5 year impact factor of 28
    ‣ article freely available for download
    ‣ data freely available for download
how are we to move science forward

if we cannot understand what was done previously ?
Nature 483, 509 (29 March 2012) | doi:10.1038/483509a
Nature 483, 509 (29 March 2012) | doi:10.1038/483509a
let’s go back to basics
scientific method
scientific method
  1. define a question
scientific method
  1. define a question

   2. gather information and resources (background research)
scientific method
  1. define a question

   2. gather information and resources (background research)

     3. form a hypothesis
scientific method
  1. define a question

   2. gather information and resources (background research)

     3. form a hypothesis

       4. test hypothesis experimentally
scientific method
  1. define a question

   2. gather information and resources (background research)

     3. form a hypothesis

       4. test hypothesis experimentally

         5. analyze experimental data
scientific method
  1. define a question

   2. gather information and resources (background research)

     3. form a hypothesis

       4. test hypothesis experimentally

         5. analyze experimental data

           6. draw conclusions based on data
scientific method
  1. define a question

   2. gather information and resources (background research)

     3. form a hypothesis

       4. test hypothesis experimentally

         5. analyze experimental data

           6. draw conclusions based on data

             7. publish results
scientific method
  1. define a question

   2. gather information and resources (background research)

     3. form a hypothesis

       4. test hypothesis experimentally

         5. analyze experimental data

           6. draw conclusions based on data

             7. publish results

               8. retest (frequently done by other scientists)
scientific method
  1. define a question

   2. gather information and resources (background research)

     3. form a hypothesis

       4. test hypothesis experimentally

         5. analyze experimental data

           6. draw conclusions based on data

             7. publish results

               8. retest (frequently done by other scientists)
scientific method
  1. define a question

   2. gather information and resources (background research)
   4. test hypothesis experimentally
     3. form a hypothesis
      5. analyze experimental data
       4. test hypothesis experimentally

         5. analyze experimental data
         6. draw conclusions based on data
           6. draw conclusions based on data
           7. publish results
            7. publish results

               8. retest (frequently done by other scientists)
7. publish results
finite
infinite
          ...

 ∞
printed
                                                                  on paper



                                                 store on local
                                                 server
experimentally generate
data @ the bench or                                                      static html
from a clinical cohort                                                   representation




                                               accepted &
                                               digitally
                                               typeset
                                                                              static pdf
                                                                              representation
                          analyze on local
                          machine




                                                      sent to
     write a document                                 reviewers
                                                      as pdf
                                     rn   al
                            t to jou
                   s   ubmi
printed
                                                                  on paper



                                                 store on local
                                                 server
experimentally generate
data @ the bench or                                                      static html
from a clinical cohort                                                   representation




                                               accepted &
                                               digitally
                                               typeset
                                                                              static pdf
                                                                              representation
                          analyze on local
                          machine




                                                      sent to
     write a document                                 reviewers
                                                      as pdf
                                     rn   al
                            t to jou
                   s   ubmi
scientific claims

are being artificially uncoupled from

          science itself
science is hard
is hard
communication is hard
communication is hard
    (especially for scientists)
getting harder in an era of
getting harder in an era of

  ‘BIG DATA’
clearScience
clearScience
 re-imagining scientific communication
clearScience
 re-imagining scientific communication

  allow consumption of content at a
    variety of levels of complexity
            and abstraction
clearScience
 re-imagining scientific communication

  allow consumption of content at a
    variety of levels of complexity
            and abstraction

    leverage (open) RESTful APIs
clearScience
       RESTful APIs
clearScience
            RESTful APIs

  allow users to reassemble an entire
         analysis environment
clearScience
     analysis environment
clearScience
     analysis environment

        ‣   hardware
        ‣   software
        ‣   data
        ‣   code
scientific communication
     needs to evolve
needs to evolve
needs to evolve
along with science
make it easy to do

  good science
make it easy to do

  clearScience
Acknowledgements
Sage Bionetworks                               External Partners
David Burdick - Rockstar Engineer              Myles Axton - Nature Genetics

Stephen Friend - President and CEO             Phil Bourne - PLoS Computational Biology

Erich S. Huang - Director of Cancer Research   Josh Greenberg - Alfred P. Sloan Foundation

Mike Kellen - Director of Technology           Kelly LaMarco - Science Translational Medicine

                                               Ian Mulvaney - eLife Sciences

                                               Eric Schadt - Open Network Biology

Más contenido relacionado

Destacado

احتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوط
احتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوطاحتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوط
احتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوطHossam Hos
 
tools for reproducible research in an increasingly digital world
tools for reproducible research in an increasingly digital worldtools for reproducible research in an increasingly digital world
tools for reproducible research in an increasingly digital worldBrian Bot
 
research participation as a social contract
research participation as a social contractresearch participation as a social contract
research participation as a social contractBrian Bot
 
the beginnings of an open ecosystem in mHealth
the beginnings of an open ecosystem in mHealththe beginnings of an open ecosystem in mHealth
the beginnings of an open ecosystem in mHealthBrian Bot
 
Heart BD2K - mHealth
Heart BD2K - mHealthHeart BD2K - mHealth
Heart BD2K - mHealthBrian Bot
 
biomedical research in an increasingly digital world
biomedical research in an increasingly digital worldbiomedical research in an increasingly digital world
biomedical research in an increasingly digital worldBrian Bot
 
biomedical research in an increasingly digital world
biomedical research in an increasingly digital worldbiomedical research in an increasingly digital world
biomedical research in an increasingly digital worldBrian Bot
 
biomedical research in an increasingly digital world
biomedical research in an increasingly digital worldbiomedical research in an increasingly digital world
biomedical research in an increasingly digital worldBrian Bot
 
decentralization: a trend in biomedical research
decentralization: a trend in biomedical researchdecentralization: a trend in biomedical research
decentralization: a trend in biomedical researchBrian Bot
 
Format bahan matrikulasi matematika (teknologi) smk (3)
Format bahan matrikulasi matematika (teknologi) smk (3)Format bahan matrikulasi matematika (teknologi) smk (3)
Format bahan matrikulasi matematika (teknologi) smk (3)Novita Asri Septina Sari
 
caveat emptor: what you need to know about online journals, open access, and ...
caveat emptor: what you need to know about online journals, open access, and ...caveat emptor: what you need to know about online journals, open access, and ...
caveat emptor: what you need to know about online journals, open access, and ...Brian Bot
 

Destacado (12)

πετοσφαίριση
πετοσφαίρισηπετοσφαίριση
πετοσφαίριση
 
احتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوط
احتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوطاحتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوط
احتياطات الأمان الخاصة بدخول غرفة العلاج بالأكسجين المضغوط
 
tools for reproducible research in an increasingly digital world
tools for reproducible research in an increasingly digital worldtools for reproducible research in an increasingly digital world
tools for reproducible research in an increasingly digital world
 
research participation as a social contract
research participation as a social contractresearch participation as a social contract
research participation as a social contract
 
the beginnings of an open ecosystem in mHealth
the beginnings of an open ecosystem in mHealththe beginnings of an open ecosystem in mHealth
the beginnings of an open ecosystem in mHealth
 
Heart BD2K - mHealth
Heart BD2K - mHealthHeart BD2K - mHealth
Heart BD2K - mHealth
 
biomedical research in an increasingly digital world
biomedical research in an increasingly digital worldbiomedical research in an increasingly digital world
biomedical research in an increasingly digital world
 
biomedical research in an increasingly digital world
biomedical research in an increasingly digital worldbiomedical research in an increasingly digital world
biomedical research in an increasingly digital world
 
biomedical research in an increasingly digital world
biomedical research in an increasingly digital worldbiomedical research in an increasingly digital world
biomedical research in an increasingly digital world
 
decentralization: a trend in biomedical research
decentralization: a trend in biomedical researchdecentralization: a trend in biomedical research
decentralization: a trend in biomedical research
 
Format bahan matrikulasi matematika (teknologi) smk (3)
Format bahan matrikulasi matematika (teknologi) smk (3)Format bahan matrikulasi matematika (teknologi) smk (3)
Format bahan matrikulasi matematika (teknologi) smk (3)
 
caveat emptor: what you need to know about online journals, open access, and ...
caveat emptor: what you need to know about online journals, open access, and ...caveat emptor: what you need to know about online journals, open access, and ...
caveat emptor: what you need to know about online journals, open access, and ...
 

Similar a clearScience presentation at Strata London

Sharing massive data analysis: from provenance to linked experiment reports
Sharing massive data analysis: from provenance to linked experiment reportsSharing massive data analysis: from provenance to linked experiment reports
Sharing massive data analysis: from provenance to linked experiment reportsGaignard Alban
 
Computational Reproducibility vs. Transparency: Is It FAIR Enough?
Computational Reproducibility vs. Transparency: Is It FAIR Enough?Computational Reproducibility vs. Transparency: Is It FAIR Enough?
Computational Reproducibility vs. Transparency: Is It FAIR Enough?Bertram Ludäscher
 
Web Apollo Workshop University of Exeter
Web Apollo Workshop University of ExeterWeb Apollo Workshop University of Exeter
Web Apollo Workshop University of ExeterMonica Munoz-Torres
 
JCDL doctoral consortium 2008: Proposed Foundations for Evaluating Data Shar...
JCDL doctoral consortium 2008:  Proposed Foundations for Evaluating Data Shar...JCDL doctoral consortium 2008:  Proposed Foundations for Evaluating Data Shar...
JCDL doctoral consortium 2008: Proposed Foundations for Evaluating Data Shar...Heather Piwowar
 
Web Apollo Tutorial for the i5K copepod research community.
Web Apollo Tutorial for the i5K copepod research community.Web Apollo Tutorial for the i5K copepod research community.
Web Apollo Tutorial for the i5K copepod research community.Monica Munoz-Torres
 
Is that a scientific report or just some cool pictures from the lab? Reproduc...
Is that a scientific report or just some cool pictures from the lab? Reproduc...Is that a scientific report or just some cool pictures from the lab? Reproduc...
Is that a scientific report or just some cool pictures from the lab? Reproduc...Greg Landrum
 
Reproducibility (and the R*) of Science: motivations, challenges and trends
Reproducibility (and the R*) of Science: motivations, challenges and trendsReproducibility (and the R*) of Science: motivations, challenges and trends
Reproducibility (and the R*) of Science: motivations, challenges and trendsCarole Goble
 
Towards a Simple, Standards-Compliant, and Generic Phylogenetic Database
Towards a Simple, Standards-Compliant, and Generic Phylogenetic DatabaseTowards a Simple, Standards-Compliant, and Generic Phylogenetic Database
Towards a Simple, Standards-Compliant, and Generic Phylogenetic DatabaseHilmar Lapp
 
Apollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of GenomesApollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of GenomesMonica Munoz-Torres
 
Leyline: A provenance-based desktop search
Leyline: A provenance-based desktop searchLeyline: A provenance-based desktop search
Leyline: A provenance-based desktop searchSoroush Ghorashi
 
Reproducibility in cheminformatics and computational chemistry research: cert...
Reproducibility in cheminformatics and computational chemistry research: cert...Reproducibility in cheminformatics and computational chemistry research: cert...
Reproducibility in cheminformatics and computational chemistry research: cert...Greg Landrum
 
Munoz torres web-apollo-workshop_exeter-2014_ss
Munoz torres web-apollo-workshop_exeter-2014_ssMunoz torres web-apollo-workshop_exeter-2014_ss
Munoz torres web-apollo-workshop_exeter-2014_ssMonica Munoz-Torres
 
Reproducibility by Other Means: Transparent Research Objects
Reproducibility by Other Means: Transparent Research ObjectsReproducibility by Other Means: Transparent Research Objects
Reproducibility by Other Means: Transparent Research ObjectsTimothy McPhillips
 
Results may vary: Collaborations Workshop, Oxford 2014
Results may vary: Collaborations Workshop, Oxford 2014Results may vary: Collaborations Workshop, Oxford 2014
Results may vary: Collaborations Workshop, Oxford 2014Carole Goble
 
HealthHack_Find gene commonalities tool
HealthHack_Find gene commonalities toolHealthHack_Find gene commonalities tool
HealthHack_Find gene commonalities toolEmma Duval
 

Similar a clearScience presentation at Strata London (20)

Sharing massive data analysis: from provenance to linked experiment reports
Sharing massive data analysis: from provenance to linked experiment reportsSharing massive data analysis: from provenance to linked experiment reports
Sharing massive data analysis: from provenance to linked experiment reports
 
Computational Reproducibility vs. Transparency: Is It FAIR Enough?
Computational Reproducibility vs. Transparency: Is It FAIR Enough?Computational Reproducibility vs. Transparency: Is It FAIR Enough?
Computational Reproducibility vs. Transparency: Is It FAIR Enough?
 
Web Apollo Workshop University of Exeter
Web Apollo Workshop University of ExeterWeb Apollo Workshop University of Exeter
Web Apollo Workshop University of Exeter
 
JCDL doctoral consortium 2008: Proposed Foundations for Evaluating Data Shar...
JCDL doctoral consortium 2008:  Proposed Foundations for Evaluating Data Shar...JCDL doctoral consortium 2008:  Proposed Foundations for Evaluating Data Shar...
JCDL doctoral consortium 2008: Proposed Foundations for Evaluating Data Shar...
 
Web Apollo Tutorial for the i5K copepod research community.
Web Apollo Tutorial for the i5K copepod research community.Web Apollo Tutorial for the i5K copepod research community.
Web Apollo Tutorial for the i5K copepod research community.
 
Is that a scientific report or just some cool pictures from the lab? Reproduc...
Is that a scientific report or just some cool pictures from the lab? Reproduc...Is that a scientific report or just some cool pictures from the lab? Reproduc...
Is that a scientific report or just some cool pictures from the lab? Reproduc...
 
Reproducibility 1
Reproducibility 1Reproducibility 1
Reproducibility 1
 
Reproducibility (and the R*) of Science: motivations, challenges and trends
Reproducibility (and the R*) of Science: motivations, challenges and trendsReproducibility (and the R*) of Science: motivations, challenges and trends
Reproducibility (and the R*) of Science: motivations, challenges and trends
 
Towards a Simple, Standards-Compliant, and Generic Phylogenetic Database
Towards a Simple, Standards-Compliant, and Generic Phylogenetic DatabaseTowards a Simple, Standards-Compliant, and Generic Phylogenetic Database
Towards a Simple, Standards-Compliant, and Generic Phylogenetic Database
 
Rubric
RubricRubric
Rubric
 
Apollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of GenomesApollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
Apollo and i5K: Collaborative Curation and Interactive Analysis of Genomes
 
Introduction to Apollo for i5k
Introduction to Apollo for i5kIntroduction to Apollo for i5k
Introduction to Apollo for i5k
 
Leyline: A provenance-based desktop search
Leyline: A provenance-based desktop searchLeyline: A provenance-based desktop search
Leyline: A provenance-based desktop search
 
Reproducibility in cheminformatics and computational chemistry research: cert...
Reproducibility in cheminformatics and computational chemistry research: cert...Reproducibility in cheminformatics and computational chemistry research: cert...
Reproducibility in cheminformatics and computational chemistry research: cert...
 
Munoz torres web-apollo-workshop_exeter-2014_ss
Munoz torres web-apollo-workshop_exeter-2014_ssMunoz torres web-apollo-workshop_exeter-2014_ss
Munoz torres web-apollo-workshop_exeter-2014_ss
 
Reproducibility by Other Means: Transparent Research Objects
Reproducibility by Other Means: Transparent Research ObjectsReproducibility by Other Means: Transparent Research Objects
Reproducibility by Other Means: Transparent Research Objects
 
Results may vary: Collaborations Workshop, Oxford 2014
Results may vary: Collaborations Workshop, Oxford 2014Results may vary: Collaborations Workshop, Oxford 2014
Results may vary: Collaborations Workshop, Oxford 2014
 
NETTAB 2012
NETTAB 2012NETTAB 2012
NETTAB 2012
 
B4OS-2012
B4OS-2012B4OS-2012
B4OS-2012
 
HealthHack_Find gene commonalities tool
HealthHack_Find gene commonalities toolHealthHack_Find gene commonalities tool
HealthHack_Find gene commonalities tool
 

Más de Brian Bot

supporting communities in an increasingly decentralized biomedical research e...
supporting communities in an increasingly decentralized biomedical research e...supporting communities in an increasingly decentralized biomedical research e...
supporting communities in an increasingly decentralized biomedical research e...Brian Bot
 
20160811 Big Data for Health and Medicine
20160811 Big Data for Health and Medicine20160811 Big Data for Health and Medicine
20160811 Big Data for Health and MedicineBrian Bot
 
Seattle-Denver VA Center for Innovation
Seattle-Denver VA Center for InnovationSeattle-Denver VA Center for Innovation
Seattle-Denver VA Center for InnovationBrian Bot
 
Mozilla Science Labs Berlin Meetup
Mozilla Science Labs Berlin MeetupMozilla Science Labs Berlin Meetup
Mozilla Science Labs Berlin MeetupBrian Bot
 
evaluating the quality of open access content
evaluating the quality of open access contentevaluating the quality of open access content
evaluating the quality of open access contentBrian Bot
 
enabling transparent, reproducible research
enabling transparent, reproducible researchenabling transparent, reproducible research
enabling transparent, reproducible researchBrian Bot
 

Más de Brian Bot (6)

supporting communities in an increasingly decentralized biomedical research e...
supporting communities in an increasingly decentralized biomedical research e...supporting communities in an increasingly decentralized biomedical research e...
supporting communities in an increasingly decentralized biomedical research e...
 
20160811 Big Data for Health and Medicine
20160811 Big Data for Health and Medicine20160811 Big Data for Health and Medicine
20160811 Big Data for Health and Medicine
 
Seattle-Denver VA Center for Innovation
Seattle-Denver VA Center for InnovationSeattle-Denver VA Center for Innovation
Seattle-Denver VA Center for Innovation
 
Mozilla Science Labs Berlin Meetup
Mozilla Science Labs Berlin MeetupMozilla Science Labs Berlin Meetup
Mozilla Science Labs Berlin Meetup
 
evaluating the quality of open access content
evaluating the quality of open access contentevaluating the quality of open access content
evaluating the quality of open access content
 
enabling transparent, reproducible research
enabling transparent, reproducible researchenabling transparent, reproducible research
enabling transparent, reproducible research
 

Último

VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...Garima Khatri
 
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...chandars293
 
Call Girls Siliguri Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Siliguri Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls DelhiRussian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls DelhiAlinaDevecerski
 
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...
(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...
(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...indiancallgirl4rent
 
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...hotbabesbook
 
VIP Call Girls Indore Kirti 💚😋 9256729539 🚀 Indore Escorts
VIP Call Girls Indore Kirti 💚😋  9256729539 🚀 Indore EscortsVIP Call Girls Indore Kirti 💚😋  9256729539 🚀 Indore Escorts
VIP Call Girls Indore Kirti 💚😋 9256729539 🚀 Indore Escortsaditipandeya
 
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Top Rated Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...
Top Rated  Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...Top Rated  Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...
Top Rated Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...chandars293
 
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls JaipurRussian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipurparulsinha
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...narwatsonia7
 
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Dipal Arora
 
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls JaipurCall Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipurparulsinha
 
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...astropune
 
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...narwatsonia7
 

Último (20)

VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
 
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
 
Call Girls Siliguri Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Siliguri Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 9907093804 Top Class Call Girl Service Available
 
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls DelhiRussian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
 
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
 
(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...
(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...
(Rocky) Jaipur Call Girl - 9521753030 Escorts Service 50% Off with Cash ON De...
 
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 9907093804 Top Class Call Girl Service Available
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
 
VIP Call Girls Indore Kirti 💚😋 9256729539 🚀 Indore Escorts
VIP Call Girls Indore Kirti 💚😋  9256729539 🚀 Indore EscortsVIP Call Girls Indore Kirti 💚😋  9256729539 🚀 Indore Escorts
VIP Call Girls Indore Kirti 💚😋 9256729539 🚀 Indore Escorts
 
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Varanasi Just Call 9907093804 Top Class Call Girl Service Available
 
Top Rated Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...
Top Rated  Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...Top Rated  Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...
Top Rated Hyderabad Call Girls Erragadda ⟟ 6297143586 ⟟ Call Me For Genuine ...
 
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls JaipurRussian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
 
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
Top Rated Bangalore Call Girls Mg Road ⟟ 8250192130 ⟟ Call Me For Genuine Sex...
 
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
 
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls JaipurCall Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
 
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
 
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
 

clearScience presentation at Strata London

  • 1. clearScience dragging scientific communication into the information age Brian M. Bot | Senior Scientist | Sage Bionetworks
  • 3.
  • 4. “I will help you. Trust me.” - Anil Potti to Juliet Jacobs (pictured above)
  • 5.
  • 6.
  • 15. clear
  • 16. research scandals represent merely the extreme of a continuum in the culture of academic research
  • 17. research scandals represent merely the extreme of a continuum in the culture of academic research
  • 18. the status quo tolerates poor communication of findings Ioannidis A. et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149-155 (2009) | doi:10.1038/ng.295
  • 19. the status quo tolerates poor communication of findings can reproduce partially can reproduce from 6% processed data w/ discrepancies 21% 54% cannot can reproduce 8% reproduce w/discrepancies 11% can reproduce in principle Ioannidis A. et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149-155 (2009) | doi:10.1038/ng.295
  • 20. often what is in principle reproducible, is not practically reproducible unidentified publication ‣ from journal with 5 year impact factor of 28 ‣ article freely available for download ‣ data freely available for download
  • 21. often what is in principle reproducible, is not practically reproducible 208,294,724 datapoints 124 pages supplemental material ?? lines unobtainable source code ?? version or architecture of statistical analysis program (R) enumerable R packages and package dependencies key R package “ClaNC” no longer available 442 citations unidentified publication ‣ from journal with 5 year impact factor of 28 ‣ article freely available for download ‣ data freely available for download
  • 22. how are we to move science forward if we cannot understand what was done previously ?
  • 23. Nature 483, 509 (29 March 2012) | doi:10.1038/483509a
  • 24. Nature 483, 509 (29 March 2012) | doi:10.1038/483509a
  • 25. let’s go back to basics
  • 27. scientific method 1. define a question
  • 28. scientific method 1. define a question 2. gather information and resources (background research)
  • 29. scientific method 1. define a question 2. gather information and resources (background research) 3. form a hypothesis
  • 30. scientific method 1. define a question 2. gather information and resources (background research) 3. form a hypothesis 4. test hypothesis experimentally
  • 31. scientific method 1. define a question 2. gather information and resources (background research) 3. form a hypothesis 4. test hypothesis experimentally 5. analyze experimental data
  • 32. scientific method 1. define a question 2. gather information and resources (background research) 3. form a hypothesis 4. test hypothesis experimentally 5. analyze experimental data 6. draw conclusions based on data
  • 33. scientific method 1. define a question 2. gather information and resources (background research) 3. form a hypothesis 4. test hypothesis experimentally 5. analyze experimental data 6. draw conclusions based on data 7. publish results
  • 34. scientific method 1. define a question 2. gather information and resources (background research) 3. form a hypothesis 4. test hypothesis experimentally 5. analyze experimental data 6. draw conclusions based on data 7. publish results 8. retest (frequently done by other scientists)
  • 35. scientific method 1. define a question 2. gather information and resources (background research) 3. form a hypothesis 4. test hypothesis experimentally 5. analyze experimental data 6. draw conclusions based on data 7. publish results 8. retest (frequently done by other scientists)
  • 36. scientific method 1. define a question 2. gather information and resources (background research) 4. test hypothesis experimentally 3. form a hypothesis 5. analyze experimental data 4. test hypothesis experimentally 5. analyze experimental data 6. draw conclusions based on data 6. draw conclusions based on data 7. publish results 7. publish results 8. retest (frequently done by other scientists)
  • 39. infinite ... ∞
  • 40.
  • 41. printed on paper store on local server experimentally generate data @ the bench or static html from a clinical cohort representation accepted & digitally typeset static pdf representation analyze on local machine sent to write a document reviewers as pdf rn al t to jou s ubmi
  • 42. printed on paper store on local server experimentally generate data @ the bench or static html from a clinical cohort representation accepted & digitally typeset static pdf representation analyze on local machine sent to write a document reviewers as pdf rn al t to jou s ubmi
  • 43. scientific claims are being artificially uncoupled from science itself
  • 44.
  • 48. communication is hard (especially for scientists)
  • 49. getting harder in an era of
  • 50. getting harder in an era of ‘BIG DATA’
  • 53. clearScience re-imagining scientific communication allow consumption of content at a variety of levels of complexity and abstraction
  • 54. clearScience re-imagining scientific communication allow consumption of content at a variety of levels of complexity and abstraction leverage (open) RESTful APIs
  • 55. clearScience RESTful APIs
  • 56. clearScience RESTful APIs allow users to reassemble an entire analysis environment
  • 57. clearScience analysis environment
  • 58. clearScience analysis environment ‣ hardware ‣ software ‣ data ‣ code
  • 59.
  • 60.
  • 61.
  • 62. scientific communication needs to evolve
  • 64. needs to evolve along with science
  • 65. make it easy to do good science
  • 66. make it easy to do clearScience
  • 67. Acknowledgements Sage Bionetworks External Partners David Burdick - Rockstar Engineer Myles Axton - Nature Genetics Stephen Friend - President and CEO Phil Bourne - PLoS Computational Biology Erich S. Huang - Director of Cancer Research Josh Greenberg - Alfred P. Sloan Foundation Mike Kellen - Director of Technology Kelly LaMarco - Science Translational Medicine Ian Mulvaney - eLife Sciences Eric Schadt - Open Network Biology

Notas del editor

  1. Welcome everyone -- and thanks for sticking around with me for the Tuesday afternoon sessions -- and for making the trek down into the dungeon where they squirrel away the scientists\n\nToday I’d like to introduce you to a pilot program we have taken on at Sage Bionetworks called ‘clearScience’ -- and how we hope it will help positively disrupt scientific communication as we know it today\n
  2. In order to set the stage, I’d like to start with a story\na story at the extreme of spectrum that has become the status quo within scientific research\n\nDr. Anil Potti was a junior faculty member at Duke University where he was involved in studying genomic signatures of response to different cancer therapies\n\nhe spent 5 years carrying out this research\n\nAs explored in a 60 minutes piece this spring, Dr. Potti has since been widely accused of scientific misconduct in his work which as lead to retraction of dozens of research papers in prominent scientific journals\n\nAnd the fallout has been massive\n\nDr. Potti’s fraudulent research lead to 3 clinical trials which enrolled real patients ... patients who were already strapped with having to deal with a cancer diagnosis ... patients who were put at real risk ... unnecessarily\n\n
  3. Patients like Juliet Jacobs. Juliet was a patient of Dr. Potti’s and was enrolled in one of the clinical trials that was launched in response to his research. In a chilling recording from the 60 minutes piece, Dr. Potti is heard telling Mrs. Jacobs “I will help you. Trust me.”\nThree months after being reassured by Potti, three months after being told “trust me,” Juliet Jacobs passed on. And her husband is now suing Duke.\n\nNow, I realize that Dr. Potti is an exception -- but the fact that his research was allowed to travel as far as it did before it was finally caught is symptomatic of problems in the way our research is communicated\n\nIn fact ...\n
  4. Patients like Juliet Jacobs. Juliet was a patient of Dr. Potti’s and was enrolled in one of the clinical trials that was launched in response to his research. In a chilling recording from the 60 minutes piece, Dr. Potti is heard telling Mrs. Jacobs “I will help you. Trust me.”\nThree months after being reassured by Potti, three months after being told “trust me,” Juliet Jacobs passed on. And her husband is now suing Duke.\n\nNow, I realize that Dr. Potti is an exception -- but the fact that his research was allowed to travel as far as it did before it was finally caught is symptomatic of problems in the way our research is communicated\n\nIn fact ...\n
  5. just this morning I ran across news coverage of another study released through PNAS.\n\nThis is the kind of press science has been getting recently. And some wonder why no one trusts scientific findings anymore.\n
  6. just this morning I ran across news coverage of another study released through PNAS.\n\nThis is the kind of press science has been getting recently. And some wonder why no one trusts scientific findings anymore.\n
  7. just this morning I ran across news coverage of another study released through PNAS.\n\nThis is the kind of press science has been getting recently. And some wonder why no one trusts scientific findings anymore.\n
  8. just this morning I ran across news coverage of another study released through PNAS.\n\nThis is the kind of press science has been getting recently. And some wonder why no one trusts scientific findings anymore.\n
  9. In a 274 page report specifically in response to the Duke scandal, scientific leadership at the Institute of Medicine called for researchers to be more “open” and “transparent” with their work\n\nBut what do we, and what do they, mean by ‘open’\n
  10. usually with respect to code\n\nterm was coined in 1998 ... but concept stretches back to ‘free software movement’ in the early 1980s\n
  11. often time open data is ill-defined and simply means that the data is available for download somewhere, under some unspecified restriction, and in some unspecified format\n
  12. The UK Research Council has been a champion of this movement by their acceptance of the Finch Report earlier this year.\n\nWhich provided a number of suggestions regarding expansion of access to research publications\n\n
  13. The UK Research Council has been a champion of this movement by their acceptance of the Finch Report earlier this year.\n\nWhich provided a number of suggestions regarding expansion of access to research publications\n\n
  14. The UK Research Council has been a champion of this movement by their acceptance of the Finch Report earlier this year.\n\nWhich provided a number of suggestions regarding expansion of access to research publications\n\n
  15. similarly, the access2research petition was a grassroots movement calling for a response by the Obama Administration for free access to articles arising from US taxpayer-funded research\n\nthe petition needed 25k signatures and eclipsed that mark in less that 2 wks\n\nmost science is publicly funded and it is meant to provide a base from which others can build\n\nwe’re still awaiting President Obama’s response, but at least we have been able to demonstrate a level of support for this issue and hopefully we will be following the UK’s lead in this matter\n\nbut just because we have access to something, does not necessary make it ... accessible\n\n
  16. \n
  17. \n
  18. Venture capitalists believe that at least 50% of the studies published in top tier life science journals cannot be repeated\n\nThis has resulted in massive underfunding of biomedical startups from venture capital funds\n\nIf this were just a perception of venture capitalists, that would be one thing ...\n
  19. ... but in an analysis published in Nature Genetics, it was found that over 50% of microarray studies (also published in Nature Genetics) were not reproducible\n\ncannot reproduce includes\ndata not available\nsoftware not available\nmethods unclear\ndifferent result altogether\n\nreiterates how the status quo tolerates poor communication of science\n\nlet’s explore one example\n
  20. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  21. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  22. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  23. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  24. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  25. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  26. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  27. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  28. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  29. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  30. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  31. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  32. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  33. colleague of mine -- an MD / PhD and self described ‘former hacker’ -- tried to reproduce results\n\neven with article and data available, the methods were not described in enough detail to recapitulate the findings\n\nfrom a journal with impact factor of 28\n\nwas not able to reconstruct clusters that are now being cited widely\n\n
  34. \n
  35. great editorial in Nature discussing how too many sloppy mistakes are creeping into scientific papers.\n\n\n
  36. \n
  37. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  38. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  39. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  40. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  41. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  42. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  43. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  44. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  45. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  46. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  47. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  48. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  49. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  50. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  51. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  52. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  53. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  54. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  55. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  56. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  57. this process is repeated until sufficient evidence is in place to move on\n\nsupposed to be able to build upon previous research\n\nthe iterative cycle is most important part of the method\n\nthis is where innovation occurs\n
  58. publishing is becoming the end-all-be-all\n\nincentives drive researchers to this scientific ‘end game’\n
  59. but science is not a finite game\n\nas the scientific method spelled out years ago, it is not a finite game, but an infinite one.\n
  60. but science is not a finite game\n\nas the scientific method spelled out years ago, it is not a finite game, but an infinite one.\n
  61. but science is not a finite game\n\nas the scientific method spelled out years ago, it is not a finite game, but an infinite one.\n
  62. but science is not a finite game\n\nas the scientific method spelled out years ago, it is not a finite game, but an infinite one.\n
  63. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  64. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  65. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  66. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  67. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  68. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  69. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  70. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  71. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  72. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  73. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  74. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  75. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  76. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  77. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  78. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  79. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  80. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  81. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  82. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  83. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  84. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  85. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  86. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  87. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  88. Let’s take a closer look at our current common practice\nthe status quo, if you will\n\nGenerate data\nwhich is stored on a local server\nand analyzed on a local machine\nresults are summarized in a document\nsubmitted to a journal\nand sent to reviewers as a static image\nif the researcher is lucky enough to have their findings published, it is done so in a static representation of the work\n
  89. and, we think, needlessly so\n\nthe technology is here -- it just hasn’t been put together (‘packaged’) in a compelling enough way to force its adoption\n\n‘peer review’ in the data intensive sciences is almost non-existent\n\npieces are not currently there to truly review the science\n
  90. in particular in biomedical research, where I have done most of my work.\n\nThe human body is an amazing machine\n\nBut it is complex and an uncontrolled system\n\nThere are 10 trillion cells in the body each having their own genetic encoding\n\neach interacting with its local environment\n\nwhich is influenced by its macro environment\n\ninsights in our space are very interconnected to other experiments\n
  91. in particular in biomedical research, where I have done most of my work.\n\nThe human body is an amazing machine\n\nBut it is complex and an uncontrolled system\n\nThere are 10 trillion cells in the body each having their own genetic encoding\n\neach interacting with its local environment\n\nwhich is influenced by its macro environment\n\ninsights in our space are very interconnected to other experiments\n
  92. many scientists do not have sufficient background in communication\n\nif they were anything like me, they avoided those classes like the plague\n\n
  93. many scientists do not have sufficient background in communication\n\nif they were anything like me, they avoided those classes like the plague\n\n
  94. so we need to make it easier\n
  95. \n
  96. \n
  97. \n
  98. \n
  99. \n
  100. \n
  101. \n
  102. \n
  103. \n
  104. \n
  105. \n
  106. Mock up of a clearScience interface\npowered by Synapse -- which is an open source smart object repository through which we leverage APIs for\nCompute (in this case AWS AMI with RStudio pre-installed)\nCode (github)\nData (Synapse)\nAll of the individual pieces are currently in place within Synapse, and we have engineering support from the Sloan Foundation for engineers to work on the rendering of pages like this\n\nEnter an analysis on an abstract page -- a high level overview of the project just as in publications today\nDisplay the building blocks that made the analysis happen\nThis includes full user-defined analysis provenance through Synapse\n“Hand me your cloud computer”\nAllows users to step through an analysis at whatever level of granularity they like\ncan consume a publication as they would now\ncan step through the analysis as conducted\ncan interactively explore data as they please -- even more formally ‘fork’ an entire project\n\n
  107. ‘our’ scientific communication\n
  108. ‘our’ scientific communication\n
  109. ‘our’ science\n
  110. again, the tools and technologies are there -- we simply need to make is easy to do the right thing. To do good science. To do clearScience.\n\nThank you\n\n
  111. \n
  112. \n