SlideShare una empresa de Scribd logo
1 de 27
Descargar para leer sin conexión
1
Ewa Deelman
            Gideon Juve
            Mats Rynge
  Information Sciences Institute, USC
    John Good, Anastasia Laity
NASA Exoplanet Science Institute, Caltech
        Joe Jacob, Dan Katz
                 JPL                        2
•  Funded 2002-2005 by NASA Earth Sciences
   Technology Office Compute Technologies
   Program
•  Current release, version 3.3, available for
   download at http://montage.ipac.caltech.edu
  o Licensed through Caltech by a clickwrap
    license
•  Maintained at the Infrared Processing and
   Analysis Center, Caltech.
                                                 3
•  Over 11,000 downloads to date
•  Individual astronomers and (teams of) IT researchers
•  Spitzer Wide Area Infrared Extragalactic Survey
•  Surveying the Agents of a Galaxy’s Evolution
•  Galactic Legacy Infrared Mid-plane Survey Extraordinary
•  Isaac Newton Telescope Photometric Survey of the Northern
   Galactic Plane
•  Sloan Digital Sky Survey
•  Large Synoptic Survey Telescope
•  Bolocam Galactic Plane Survey

                                                               4
•    Expérience pour la Recherche d'Objets Sombres-2
•    Cosmic Background Imager
•    Arecibo Legacy Fast ALFA Survey
•    Atacama Large Millimeter Array
•    Las Cumbres Observatory Global Telescope E/PO
•    Galaxy Zoo/Zooniverse




                                                       5
•  Use rigorous software engineering practices to ensure well-
   organized and well-documented code, and control and manage
   interfaces.
•  Listen to your user community, and if possible have a formal
   user-advisory group. Build a community that encourages users
   to contribute to sustainability; take advantage of Web 2.0 in
   this endeavor.




                                                                   6
•  Develop when possible in an open software, open data mode,
   where source code, a set of input data, and tests are freely
   available.
•  Build software that meets specific scientific goals; don’t be a
   solution that looks for a problem. ✔
•  Make sure the software is easy to build. ✔
•  Design for sustainability, extensibility, re-use and portability
   from the outset. Use modular designs. Avoid “flavor of the
   month” new technologies. ✔




                                                                      7
8
9
3.6 µm

8.0 µm

24 µm




         10
•  Scale
•  Preserve calibration and
    positional information
•  Port to all common Unix/
    Linux platforms
•  Support all common
    coordinate systems and
    projections
•  Be easy to build
... Careful what you ask!     11
•  ANSI-compliant C       •  All software and
 •  Component Based Toolkit libraries bundled
    Design                    together
 •  Parallelizes           •  No third-party
                              dependencies

Input   Reprojection   Background Rectification   Co-addition   Output




Montage Workflow
Type “make”

              13
•  Unzip
•  Untar
•  cd into main Montage directory, type
   “make”
•  Add $INSTALL/Montage_vX.Y/bin to
   your path to run from any directory
•  Perform build test: produce test mosaic
   and compare with prebuilt mosaic          14
•  Detection of diffuse radio emission in the
   galaxy clusters A800, A910, A1550, and
   CL1446+26 Govoni et al.
•  Comparing near-infrared extinction and
   submillimeter data in the molecular cloud
   TMC-1 Malinen et al.
•  Integral Field Spectroscopy studies of 14
   early-type galaxies in the Coma cluster Scott
   et al.
•  The Dust Properties of Bubble HII Regions as
   seen by Herschel Anderson et al.

                                                   15
16
Developed by Dr Tom Robitaille, MPIA
                                  17
APLpy (the Astronomical Plotting Library in
Python) is a Python module for producing
publication-quality plots of astronomical
imaging data.
    - 600 downloads since April 2012




         Developed by Dr Tom Robitaille, MPIA
                                           18
•  1500 square degree area mapped at 21-cm as part of the
     Arecibo Legacy Fast ALFA Survey (ALFALFA)




•  Spitzer Galactic Legacy Infrared Midplane Survey Extraordinaire




                                                                     19
IRAC Instrument Data Only



                     find                           mJPEG                           mImgtbl                      mMakeHdr

            Find all the FITS images          Create grayscale JPEG            Create image metadata         Create a header
            within a galaxy dataset           previews of all FITS images      of all raw files              encompassing all data files



      Loop over
      each SINGS                                    mJPEG                                         mProjExec
      galaxy dataset                           Create 3-color JPEG Previews                   Reproject all files to the same scale,
                                               Using different bandpasses                     orientation and sky projection


 Create thumbnails of all JPEG
 files for HTML display pages
                                                     convert



Create HTML summary page per galaxy                 edit html
with all FITS images and JPEG preview links



Create image metadata for general search
engine, inventory search and image
cutouts application.
                                                    mImgtbl
                                                                              ngc4450 IRAC 3-Color             ngc4450 Optical 3-Color Preview
Used Montage components to generate 235,000 galaxies measured
by the Sloan Digital Sky Survey. Used Amazon EC2 cloud.
                                                                21
Create movies of the sky to see
how it changes with time

Use Montage to re-project
images from multiple
wavelengths on to
onto a common set of image
parameters.




                              22
•  Task scheduling in distributed environments (performance-
   focused)
•  Designing job schedulers for the grid
•  Designing fault tolerance techniques for job schedulers
•  Exploring issues of data provenance in scientific workflows
•  Exploring the cost and performance of scientific
   applications running on Clouds
•  Developing high-performance workflow restructuring
   techniques
•  Developing application performance frameworks
•  Developing workflow orchestration techniques
                                                                 23
Montage 1 degree workflow run with cleanup on OSG-PSU   24
Small 1,200 Montage Workflow




Cluster small workflow tasks for performance
Montage is maintained without funding




                                    26
•  G. B. Berriman, J. Good, E. Deelman and A. Alexov.
   “Ten years of software sustainability at the Infrared
   Processing and Analysis Center.” Phil. Trans. Roy. Soc.
   A, vol. 369, pp. 3384-3397. 2011.
•  D. S. Katz, G. B. Berriman and R. G. Mann.
   “Collaborative astronomical image mosaics.” In
   “Reshaping research and development using Web 2.0-
   based technologies.” M. Baker, ed., in press.
•  Astronomy Computing Today
   http://astrocompute.wordpress.com.
•  The Montage web page http://montage.ipac.caltech.edu
                                                       27

Más contenido relacionado

Destacado

MSBI LIVE & VIDEO TRAINING From SQL-SCHOOL
MSBI LIVE & VIDEO TRAINING From SQL-SCHOOLMSBI LIVE & VIDEO TRAINING From SQL-SCHOOL
MSBI LIVE & VIDEO TRAINING From SQL-SCHOOLSequelGate
 
BNI Educational: Using LinkedIn Groups for Better BNI Chapter Communication
BNI Educational: Using LinkedIn Groups for Better BNI Chapter CommunicationBNI Educational: Using LinkedIn Groups for Better BNI Chapter Communication
BNI Educational: Using LinkedIn Groups for Better BNI Chapter CommunicationAdam Griffith
 
Depliant LED - Convergenze
Depliant LED - ConvergenzeDepliant LED - Convergenze
Depliant LED - ConvergenzeFabio Magli
 
The Relationship Between Development Problems and Use of Software Engineering...
The Relationship Between Development Problems and Use of Software Engineering...The Relationship Between Development Problems and Use of Software Engineering...
The Relationship Between Development Problems and Use of Software Engineering...SoftwarePractice
 
Why would we want to talk to customers or them to us? TCUK 2012
Why would we want to talk to customers or them to us? TCUK 2012Why would we want to talk to customers or them to us? TCUK 2012
Why would we want to talk to customers or them to us? TCUK 2012Ian Ampleford
 

Destacado (9)

MSBI LIVE & VIDEO TRAINING From SQL-SCHOOL
MSBI LIVE & VIDEO TRAINING From SQL-SCHOOLMSBI LIVE & VIDEO TRAINING From SQL-SCHOOL
MSBI LIVE & VIDEO TRAINING From SQL-SCHOOL
 
Apple
AppleApple
Apple
 
Demo1
Demo1Demo1
Demo1
 
AIA Studio 111 Folio
AIA Studio 111 FolioAIA Studio 111 Folio
AIA Studio 111 Folio
 
BNI Educational: Using LinkedIn Groups for Better BNI Chapter Communication
BNI Educational: Using LinkedIn Groups for Better BNI Chapter CommunicationBNI Educational: Using LinkedIn Groups for Better BNI Chapter Communication
BNI Educational: Using LinkedIn Groups for Better BNI Chapter Communication
 
Depliant LED - Convergenze
Depliant LED - ConvergenzeDepliant LED - Convergenze
Depliant LED - Convergenze
 
The Relationship Between Development Problems and Use of Software Engineering...
The Relationship Between Development Problems and Use of Software Engineering...The Relationship Between Development Problems and Use of Software Engineering...
The Relationship Between Development Problems and Use of Software Engineering...
 
Create your showroom
Create your showroomCreate your showroom
Create your showroom
 
Why would we want to talk to customers or them to us? TCUK 2012
Why would we want to talk to customers or them to us? TCUK 2012Why would we want to talk to customers or them to us? TCUK 2012
Why would we want to talk to customers or them to us? TCUK 2012
 

Similar a Adoption of Software By A User Community: The Montage Image Mosaic Engine Example

Grid is Dead ? Nimrod on the Cloud
Grid is Dead ? Nimrod on the CloudGrid is Dead ? Nimrod on the Cloud
Grid is Dead ? Nimrod on the CloudAdianto Wibisono
 
The EGI Federated Cloud, 7 months of production
The EGI Federated Cloud, 7 months of productionThe EGI Federated Cloud, 7 months of production
The EGI Federated Cloud, 7 months of productionDavid Wallom
 
Object extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learningObject extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learningAly Abdelkareem
 
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web ServicesCreating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services G. Bruce Berriman
 
20072311272506
2007231127250620072311272506
20072311272506Vinod Vyas
 
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsDatabricks
 
GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada
 
g-Social - Enhancing e-Science Tools with Social Networking Functionality
g-Social - Enhancing e-Science Tools with Social Networking Functionalityg-Social - Enhancing e-Science Tools with Social Networking Functionality
g-Social - Enhancing e-Science Tools with Social Networking FunctionalityNicholas Loulloudes
 
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...Raffaele Montella
 
Laying the Foundation for Ionic Platform Insights on Spark
Laying the Foundation for Ionic Platform Insights on SparkLaying the Foundation for Ionic Platform Insights on Spark
Laying the Foundation for Ionic Platform Insights on SparkIonic Security
 
What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care? What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care? Robert Grossman
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud ComputingDavid Wallom
 
Next Technology Wave
Next Technology WaveNext Technology Wave
Next Technology WaveFalascoj
 
True Reusable Code - DevSum2016
True Reusable Code - DevSum2016True Reusable Code - DevSum2016
True Reusable Code - DevSum2016Eduard Lazar
 
Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...
Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...
Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...inside-BigData.com
 
Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...
Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...
Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...Databricks
 
Multi-component Modeling with Swift at Extreme Scale
Multi-component Modeling with Swift at Extreme ScaleMulti-component Modeling with Swift at Extreme Scale
Multi-component Modeling with Swift at Extreme ScaleDaniel S. Katz
 
SDVIs and In-Situ Visualization on TACC's Stampede
SDVIs and In-Situ Visualization on TACC's StampedeSDVIs and In-Situ Visualization on TACC's Stampede
SDVIs and In-Situ Visualization on TACC's StampedeIntel® Software
 

Similar a Adoption of Software By A User Community: The Montage Image Mosaic Engine Example (20)

Grid is Dead ? Nimrod on the Cloud
Grid is Dead ? Nimrod on the CloudGrid is Dead ? Nimrod on the Cloud
Grid is Dead ? Nimrod on the Cloud
 
The EGI Federated Cloud, 7 months of production
The EGI Federated Cloud, 7 months of productionThe EGI Federated Cloud, 7 months of production
The EGI Federated Cloud, 7 months of production
 
Object extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learningObject extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learning
 
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web ServicesCreating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services
 
20072311272506
2007231127250620072311272506
20072311272506
 
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science Workflows
 
GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020
 
APAN Cloud WG (2015/3/2)
APAN Cloud WG (2015/3/2)APAN Cloud WG (2015/3/2)
APAN Cloud WG (2015/3/2)
 
g-Social - Enhancing e-Science Tools with Social Networking Functionality
g-Social - Enhancing e-Science Tools with Social Networking Functionalityg-Social - Enhancing e-Science Tools with Social Networking Functionality
g-Social - Enhancing e-Science Tools with Social Networking Functionality
 
ApacheCon NA 2013
ApacheCon NA 2013ApacheCon NA 2013
ApacheCon NA 2013
 
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
 
Laying the Foundation for Ionic Platform Insights on Spark
Laying the Foundation for Ionic Platform Insights on SparkLaying the Foundation for Ionic Platform Insights on Spark
Laying the Foundation for Ionic Platform Insights on Spark
 
What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care? What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care?
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
 
Next Technology Wave
Next Technology WaveNext Technology Wave
Next Technology Wave
 
True Reusable Code - DevSum2016
True Reusable Code - DevSum2016True Reusable Code - DevSum2016
True Reusable Code - DevSum2016
 
Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...
Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...
Using a Widely Distributed Federated Cloud System to Support Multiple Dispara...
 
Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...
Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...
Experience of Running Spark on Kubernetes on OpenStack for High Energy Physic...
 
Multi-component Modeling with Swift at Extreme Scale
Multi-component Modeling with Swift at Extreme ScaleMulti-component Modeling with Swift at Extreme Scale
Multi-component Modeling with Swift at Extreme Scale
 
SDVIs and In-Situ Visualization on TACC's Stampede
SDVIs and In-Situ Visualization on TACC's StampedeSDVIs and In-Situ Visualization on TACC's Stampede
SDVIs and In-Situ Visualization on TACC's Stampede
 

Más de SoftwarePractice

Software Practice 12 breakout - Tracking usage and impact of software
Software Practice 12 breakout - Tracking usage and impact of softwareSoftware Practice 12 breakout - Tracking usage and impact of software
Software Practice 12 breakout - Tracking usage and impact of softwareSoftwarePractice
 
Software Practice 12 breakout - Life for Software Beyond Public Funding
Software Practice 12 breakout - Life for Software Beyond Public FundingSoftware Practice 12 breakout - Life for Software Beyond Public Funding
Software Practice 12 breakout - Life for Software Beyond Public FundingSoftwarePractice
 
Maintainable Software Practices for e-Science - Introduction to Workshop
Maintainable Software Practices for e-Science - Introduction to WorkshopMaintainable Software Practices for e-Science - Introduction to Workshop
Maintainable Software Practices for e-Science - Introduction to WorkshopSoftwarePractice
 
Overview of the TriBITS Lifecycle Model
Overview of the TriBITS Lifecycle ModelOverview of the TriBITS Lifecycle Model
Overview of the TriBITS Lifecycle ModelSoftwarePractice
 
Sustainable Software for Computational Chemistry and Materials Modeling
Sustainable Software for Computational Chemistry and Materials ModelingSustainable Software for Computational Chemistry and Materials Modeling
Sustainable Software for Computational Chemistry and Materials ModelingSoftwarePractice
 
libHPC: Software sustainability and reuse through metadata preservation
libHPC: Software sustainability and reuse through metadata preservationlibHPC: Software sustainability and reuse through metadata preservation
libHPC: Software sustainability and reuse through metadata preservationSoftwarePractice
 

Más de SoftwarePractice (6)

Software Practice 12 breakout - Tracking usage and impact of software
Software Practice 12 breakout - Tracking usage and impact of softwareSoftware Practice 12 breakout - Tracking usage and impact of software
Software Practice 12 breakout - Tracking usage and impact of software
 
Software Practice 12 breakout - Life for Software Beyond Public Funding
Software Practice 12 breakout - Life for Software Beyond Public FundingSoftware Practice 12 breakout - Life for Software Beyond Public Funding
Software Practice 12 breakout - Life for Software Beyond Public Funding
 
Maintainable Software Practices for e-Science - Introduction to Workshop
Maintainable Software Practices for e-Science - Introduction to WorkshopMaintainable Software Practices for e-Science - Introduction to Workshop
Maintainable Software Practices for e-Science - Introduction to Workshop
 
Overview of the TriBITS Lifecycle Model
Overview of the TriBITS Lifecycle ModelOverview of the TriBITS Lifecycle Model
Overview of the TriBITS Lifecycle Model
 
Sustainable Software for Computational Chemistry and Materials Modeling
Sustainable Software for Computational Chemistry and Materials ModelingSustainable Software for Computational Chemistry and Materials Modeling
Sustainable Software for Computational Chemistry and Materials Modeling
 
libHPC: Software sustainability and reuse through metadata preservation
libHPC: Software sustainability and reuse through metadata preservationlibHPC: Software sustainability and reuse through metadata preservation
libHPC: Software sustainability and reuse through metadata preservation
 

Adoption of Software By A User Community: The Montage Image Mosaic Engine Example

  • 1. 1
  • 2. Ewa Deelman Gideon Juve Mats Rynge Information Sciences Institute, USC John Good, Anastasia Laity NASA Exoplanet Science Institute, Caltech Joe Jacob, Dan Katz JPL 2
  • 3. •  Funded 2002-2005 by NASA Earth Sciences Technology Office Compute Technologies Program •  Current release, version 3.3, available for download at http://montage.ipac.caltech.edu o Licensed through Caltech by a clickwrap license •  Maintained at the Infrared Processing and Analysis Center, Caltech. 3
  • 4. •  Over 11,000 downloads to date •  Individual astronomers and (teams of) IT researchers •  Spitzer Wide Area Infrared Extragalactic Survey •  Surveying the Agents of a Galaxy’s Evolution •  Galactic Legacy Infrared Mid-plane Survey Extraordinary •  Isaac Newton Telescope Photometric Survey of the Northern Galactic Plane •  Sloan Digital Sky Survey •  Large Synoptic Survey Telescope •  Bolocam Galactic Plane Survey 4
  • 5. •  Expérience pour la Recherche d'Objets Sombres-2 •  Cosmic Background Imager •  Arecibo Legacy Fast ALFA Survey •  Atacama Large Millimeter Array •  Las Cumbres Observatory Global Telescope E/PO •  Galaxy Zoo/Zooniverse 5
  • 6. •  Use rigorous software engineering practices to ensure well- organized and well-documented code, and control and manage interfaces. •  Listen to your user community, and if possible have a formal user-advisory group. Build a community that encourages users to contribute to sustainability; take advantage of Web 2.0 in this endeavor. 6
  • 7. •  Develop when possible in an open software, open data mode, where source code, a set of input data, and tests are freely available. •  Build software that meets specific scientific goals; don’t be a solution that looks for a problem. ✔ •  Make sure the software is easy to build. ✔ •  Design for sustainability, extensibility, re-use and portability from the outset. Use modular designs. Avoid “flavor of the month” new technologies. ✔ 7
  • 8. 8
  • 9. 9
  • 11. •  Scale •  Preserve calibration and positional information •  Port to all common Unix/ Linux platforms •  Support all common coordinate systems and projections •  Be easy to build ... Careful what you ask! 11
  • 12. •  ANSI-compliant C •  All software and •  Component Based Toolkit libraries bundled Design together •  Parallelizes •  No third-party dependencies Input Reprojection Background Rectification Co-addition Output Montage Workflow
  • 14. •  Unzip •  Untar •  cd into main Montage directory, type “make” •  Add $INSTALL/Montage_vX.Y/bin to your path to run from any directory •  Perform build test: produce test mosaic and compare with prebuilt mosaic 14
  • 15. •  Detection of diffuse radio emission in the galaxy clusters A800, A910, A1550, and CL1446+26 Govoni et al. •  Comparing near-infrared extinction and submillimeter data in the molecular cloud TMC-1 Malinen et al. •  Integral Field Spectroscopy studies of 14 early-type galaxies in the Coma cluster Scott et al. •  The Dust Properties of Bubble HII Regions as seen by Herschel Anderson et al. 15
  • 16. 16
  • 17. Developed by Dr Tom Robitaille, MPIA 17
  • 18. APLpy (the Astronomical Plotting Library in Python) is a Python module for producing publication-quality plots of astronomical imaging data. - 600 downloads since April 2012 Developed by Dr Tom Robitaille, MPIA 18
  • 19. •  1500 square degree area mapped at 21-cm as part of the Arecibo Legacy Fast ALFA Survey (ALFALFA) •  Spitzer Galactic Legacy Infrared Midplane Survey Extraordinaire 19
  • 20. IRAC Instrument Data Only find mJPEG mImgtbl mMakeHdr Find all the FITS images Create grayscale JPEG Create image metadata Create a header within a galaxy dataset previews of all FITS images of all raw files encompassing all data files Loop over each SINGS mJPEG mProjExec galaxy dataset Create 3-color JPEG Previews Reproject all files to the same scale, Using different bandpasses orientation and sky projection Create thumbnails of all JPEG files for HTML display pages convert Create HTML summary page per galaxy edit html with all FITS images and JPEG preview links Create image metadata for general search engine, inventory search and image cutouts application. mImgtbl ngc4450 IRAC 3-Color ngc4450 Optical 3-Color Preview
  • 21. Used Montage components to generate 235,000 galaxies measured by the Sloan Digital Sky Survey. Used Amazon EC2 cloud. 21
  • 22. Create movies of the sky to see how it changes with time Use Montage to re-project images from multiple wavelengths on to onto a common set of image parameters. 22
  • 23. •  Task scheduling in distributed environments (performance- focused) •  Designing job schedulers for the grid •  Designing fault tolerance techniques for job schedulers •  Exploring issues of data provenance in scientific workflows •  Exploring the cost and performance of scientific applications running on Clouds •  Developing high-performance workflow restructuring techniques •  Developing application performance frameworks •  Developing workflow orchestration techniques 23
  • 24. Montage 1 degree workflow run with cleanup on OSG-PSU 24
  • 25. Small 1,200 Montage Workflow Cluster small workflow tasks for performance
  • 26. Montage is maintained without funding 26
  • 27. •  G. B. Berriman, J. Good, E. Deelman and A. Alexov. “Ten years of software sustainability at the Infrared Processing and Analysis Center.” Phil. Trans. Roy. Soc. A, vol. 369, pp. 3384-3397. 2011. •  D. S. Katz, G. B. Berriman and R. G. Mann. “Collaborative astronomical image mosaics.” In “Reshaping research and development using Web 2.0- based technologies.” M. Baker, ed., in press. •  Astronomy Computing Today http://astrocompute.wordpress.com. •  The Montage web page http://montage.ipac.caltech.edu 27