SlideShare una empresa de Scribd logo
1 de 24
The Landsat 7 Processing System
( LPS )
Level Zero-R Science Products
Michael R. Reid
Computer Sciences Corporation
Mike.Reid@gsfc.nasa.gov

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

1
The Landsat 7 Mission
•
•
•
•
•
•
•

The latest in the Landsat series
Joint operation between NASA and USGS
Global coverage in 8 bands
Sun-synchronous orbit
Landsat 7 successfully launched in April 1999
Now fully operational
Data products provided by the USGS’ EROS
Data Center (EDC) in Sioux Falls, SD

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

2
Earth Coverage
• Enhanced Thematic Mapper Plus (ETM+) is
the only science instrument
– Images the Earth in 185 km wide swaths
– Images in eight bands

• Image data are fitted onto the Worldwide
Reference System (WRS) grid
– WRS grid consists of 185 km × 170 km scenes
– ETM+ images a WRS scene with 375 scans
• WRS scenes overlap
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

3
The ETM+ Instrument Data
• Eight bands
– Six 30m-resolution spectral bands
•
•
•
•

Bands 1-5 (range λ = 0.45…1.75 µm)
Band 7 (λ = 2.09-2.35 µm)
6,600 pixels per scan data line
16 data lines per scan

– One 60m-resolution thermal band
• Band 6 (λ = 10.4-12.5 µm)
• 3,300 pixels per scan data line
• 8 data lines per scan

– One 15m-resolution panchromatic band
• Band 8 (λ = 0.52-0.90 µm)
• 13,200 pixels per data line
• 32 data lines per scan
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

4
Landsat 7 Processing System (LPS)
• Developed at NASA/GSFC for the EDC
• Part of the Landsat 7 Ground System
• Performs the first stage of Level 0 processing
– Aligns bands (forward and reverse scans)
– Does not apply corrections or calibrations
– Does not perform rectification

• Produces HDF-EOS science data products on a
subinterval basis
• Runs on a high-end SGI™ system
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

5
LPS Processing
• Divides the subintervals into sets of contiguous
WRS scenes
• Geolocates the scenes
• Produces viewable, multi-band, color browse
images on a WRS scene basis
• Performs automatic cloud cover assessment
(ACCA) on a WRS scene basis
• Displays a Moving Window Display to the user
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

6
The LPS Moving Window Display (MWD)

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

7
LPS Processing continued…
• Receives data on two channels (“format 1” and
“format 2”)
• Decodes the downlinked raw telemetry
• Processes the two formats separately
• Constructs an image in each band of the
“swath” on the Earth’s surface covered during
a contact
• Divides the swath into subintervals
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

8
The LPS Data Products
• LPS products generated on a subinterval basis
• Format 1 and Format 2 are separate file sets
• The LPS Product file sets include:
–
–
–
–
–
–

Band files (Swath files)
Internal Calibrator (IC) data files
Mirror Scan Correction Data (MSCD) files
Payload Correction Data (PCD) files
Metadata files
Multi-Band Browse files (format 1 only)

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

9
The Band Files — Swaths
• Image data stored in HDF-EOS Swaths
– One Swath per file
• Bands 1-5 & 7 files are up to about 1.2 Gb in size
• Band 6 files are up to about 295 Mb in size

• Band 8 data are huge, won’t fit in single files
– Up to about 4.6 Gb of data in a 35-scene
subinterval
– HDF 4 limits file sizes to 2 Gb
– Written to up to three separate swaths in separate
segment files
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

10
The Band Files — Geolocation
• Geolocation structures
– Uses HDF-EOS Index map to link WRS scene
corner lon/lat coordinates to the Swath
• Full scenes from 30m-res. bands are always 6,000 data
lines
• Partial scenes at the beginnings and ends of subintervals
are of irregular sizes

– Uses Time Geolocation field to temporally locate
scans in the Swaths

• HDF-EOS Geolocation structures also used to
store other ancillary data
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

11
The Internal Calibrator (IC) Files
• Contain lamp and shutter data for spectral
bands
• Contain blackbody radiance and shutter data
for thermal band (band 6)
• One file for each format
– Separate HDF-EOS Swath for each band
• One data set per scan

• Data located by Time only using HDF-EOS
Geolocation structure
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

12
Mirror Scan Correction Data (MSCD) Files
• Mainly contain data quality information
• Stored in an HDF-EOS Point
• Located by Time only using HDF-EOS
Geolocation structure
• Format 1 and Format 2 MCSD are identical
except for start and end offsets at the
beginnings and ends of the data

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

13
Other LPS Product Files
• Payload Correction Data (PCD) Files
– Contain spacecraft attitude and ephemeris information and
miscellaneous engineering data
– Native HDF Vdata, no HDF-EOS structures
– Format 1 and Format 2 are identical

• Metadata Files
– Format 1 and Format 2 similar, but not identical
– Simple text file in Object Definition Language (ODL) Syntax

• Browse Files
–
–
–
–

Format 1 only
One native HDF RIS24 true color image
Made from three of the five format 1 spectral bands
JPEG Compressed images

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

14
LPS Browse File (Hudson Bay)

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

15
Format 1
• Six Band files
– Bands 1-5 and 6L

•
•
•
•

One Internal Calibrator (IC) data file
One Payload Correction Data (PCD) file
One Mirror Scan Correction Data (MSCD) file
One Metadata file
– Includes scene cloud cover assessments

• 1 to 37 Multi-band Browse files
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

16
Format 2
• Three Bands, up to five files
– Bands 6H and 7
– Band 8 (High-Resolution Panchromatic Band)
• Written to up to three segment files due to size

•
•
•
•
•

One Internal Calibrator (IC) data file
One Payload Correction Data (PCD) file
One Mirror Scan Correction Data (MSCD) file
One Metadata file
No Browse files

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

17
The LPS Product File Set

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

18
Level Zero-R Data Subsets
• Single WRS scene products
– One 375 scan subset
– Data fitted to the WRS grid

• Multiple scene products
– Contains several contiguous WRS scenes

• Partial subinterval (a.k.a., floating scene) products
– Similar to the multiple scene products, but not aligned along
WRS rows

• Full subinterval products
– Essentially the full LPS subinterval
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

19
Subsetting the LPS Subintervals
• LPS Band and IC files contain geolocated HDF-EOS
Swaths
– Can subset band data by index-mapped WRS scene corner
geographic coordinates or time using HDF-EOS functions
• Band 8 presents a problem due to file segmentation

– Can subset IC data by time using HDF-EOS functions

• MSCD file contains an HDF-EOS Point
– Can subset by time using HDF-EOS functions

• PCD is native HDF and cannot be subsetted using
HDF-EOS functions
ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

20
LPS Subsetting Difficulties
• Band data Swaths are stored in separate files
• Format 1/Format 2 data offset
• Partial subinterval geolocation
– LPS only computes lon/lat coordinates for WRS
scene corners, not on a scan basis
– Must interpolate subset interval corner coordinates

• Band 8 segmentation
– HDF-EOS does not support file segmentation

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

21
Band 8 Subsetting Problem
• Must treat the band 8 segments as completely
separate data sets
• Subsetting out multiple scene or partial
subinterval products from band 8 is especially
complicated if the subset interval spans across
segments
• After subsetting from the two segments, the
data must be concatenated into a single array

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

22
Level Zero-R Distribution Product
• Native HDF, no HDF-EOS structures
• Contains data from both Format 1 and Format
2
• Subsets of Band and IC data written to
Scientific Data Sets (SDS)
• Subset of MSCD written to Vdatas
• Complete PCD and Metadatas written to
Vdatas
• Contains Calibration Parameter File (CPF)
• Stores all data in HDF external elements

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

23
L0R Distribution Product File Set

ESDIS HDF-EOS Workshop IV
Landover, Maryland, September 20, 2000

24

Más contenido relacionado

La actualidad más candente

Visualisation of Big Imaging Data
Visualisation of Big Imaging DataVisualisation of Big Imaging Data
Visualisation of Big Imaging DataSlava Kitaeff, PhD
 
ExtremeEarth Open Workshop - Overview and Achievements
ExtremeEarth Open Workshop - Overview and AchievementsExtremeEarth Open Workshop - Overview and Achievements
ExtremeEarth Open Workshop - Overview and AchievementsExtremeEarth
 

La actualidad más candente (20)

HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 
HDF & HDF-EOS Data & Support at NSIDC
HDF & HDF-EOS Data & Support at NSIDCHDF & HDF-EOS Data & Support at NSIDC
HDF & HDF-EOS Data & Support at NSIDC
 
HDF-EOS APIs, tools, etc.
HDF-EOS APIs, tools, etc.HDF-EOS APIs, tools, etc.
HDF-EOS APIs, tools, etc.
 
ENVI/IDL Tools for HDF
ENVI/IDL Tools for HDFENVI/IDL Tools for HDF
ENVI/IDL Tools for HDF
 
EOSDIS Status
EOSDIS StatusEOSDIS Status
EOSDIS Status
 
MODIS Reprojection Tool
MODIS Reprojection ToolMODIS Reprojection Tool
MODIS Reprojection Tool
 
HDF-EOS Development: Current Status and Tools
HDF-EOS Development: Current Status and ToolsHDF-EOS Development: Current Status and Tools
HDF-EOS Development: Current Status and Tools
 
Using IDL with Suomi NPP VIIRS Data
Using IDL with Suomi NPP VIIRS DataUsing IDL with Suomi NPP VIIRS Data
Using IDL with Suomi NPP VIIRS Data
 
Status of HDF-EOS, Related Software and Tools
 Status of HDF-EOS, Related Software and Tools Status of HDF-EOS, Related Software and Tools
Status of HDF-EOS, Related Software and Tools
 
Visualisation of Big Imaging Data
Visualisation of Big Imaging DataVisualisation of Big Imaging Data
Visualisation of Big Imaging Data
 
Usage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 data
Usage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 dataUsage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 data
Usage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 data
 
NetCDF and HDF5
NetCDF and HDF5NetCDF and HDF5
NetCDF and HDF5
 
Data Interoperability
Data InteroperabilityData Interoperability
Data Interoperability
 
Geoscience Data Analysis and Visualization Tools from NCAR
Geoscience Data Analysis and Visualization Tools from NCARGeoscience Data Analysis and Visualization Tools from NCAR
Geoscience Data Analysis and Visualization Tools from NCAR
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 
Facilitating Access to EOS Data at the NSIDC DAAC
Facilitating Access to EOS Data at the NSIDC DAACFacilitating Access to EOS Data at the NSIDC DAAC
Facilitating Access to EOS Data at the NSIDC DAAC
 
NPOESS Program Overview
NPOESS Program OverviewNPOESS Program Overview
NPOESS Program Overview
 
ExtremeEarth Open Workshop - Overview and Achievements
ExtremeEarth Open Workshop - Overview and AchievementsExtremeEarth Open Workshop - Overview and Achievements
ExtremeEarth Open Workshop - Overview and Achievements
 
HDF and HDF-EOS Experiences and Applications
HDF and HDF-EOS Experiences and ApplicationsHDF and HDF-EOS Experiences and Applications
HDF and HDF-EOS Experiences and Applications
 
HDF-EOS Tools
HDF-EOS ToolsHDF-EOS Tools
HDF-EOS Tools
 

Similar a The Landsat 7 Processing System (LPS) Level Zero-R Science Products

Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsGeneralized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsThe HDF-EOS Tools and Information Center
 
Scheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup VolumesScheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup Volumesretsamedoc
 
Scalable Storage for Massive Volume Data Systems
Scalable Storage for Massive Volume Data SystemsScalable Storage for Massive Volume Data Systems
Scalable Storage for Massive Volume Data SystemsLars Nielsen
 

Similar a The Landsat 7 Processing System (LPS) Level Zero-R Science Products (20)

HDF-EOS Development Current Status
HDF-EOS Development Current StatusHDF-EOS Development Current Status
HDF-EOS Development Current Status
 
HDF-EOS Development - Current Status and Schedule
HDF-EOS Development - Current Status and ScheduleHDF-EOS Development - Current Status and Schedule
HDF-EOS Development - Current Status and Schedule
 
ESDIS Status (2002)
ESDIS Status (2002)ESDIS Status (2002)
ESDIS Status (2002)
 
HDF-EOS Aura File Format Guidelines
HDF-EOS Aura File Format GuidelinesHDF-EOS Aura File Format Guidelines
HDF-EOS Aura File Format Guidelines
 
MODIS Land and HDF-EOS
MODIS Land and HDF-EOSMODIS Land and HDF-EOS
MODIS Land and HDF-EOS
 
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsGeneralized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
 
Using HDF5 Archive Information Package to preserve HDF-EOS2 data
Using HDF5 Archive Information Package to preserve HDF-EOS2 dataUsing HDF5 Archive Information Package to preserve HDF-EOS2 data
Using HDF5 Archive Information Package to preserve HDF-EOS2 data
 
HDF-EOS Maintenance, Current Development and Tools
HDF-EOS Maintenance, Current Development and ToolsHDF-EOS Maintenance, Current Development and Tools
HDF-EOS Maintenance, Current Development and Tools
 
NASA HDF and HDF-EOS Status - Use in EOSDIS
NASA HDF and HDF-EOS Status - Use in EOSDISNASA HDF and HDF-EOS Status - Use in EOSDIS
NASA HDF and HDF-EOS Status - Use in EOSDIS
 
Scheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup VolumesScheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup Volumes
 
Archive Information Packages for NASA HDF-EOS Data
Archive Information Packages for NASA HDF-EOS DataArchive Information Packages for NASA HDF-EOS Data
Archive Information Packages for NASA HDF-EOS Data
 
HDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFView
 
HDF-EOS Overview and Status
HDF-EOS Overview and StatusHDF-EOS Overview and Status
HDF-EOS Overview and Status
 
HDF-EOS Workshop II Introduction
HDF-EOS Workshop II IntroductionHDF-EOS Workshop II Introduction
HDF-EOS Workshop II Introduction
 
Scalable Storage for Massive Volume Data Systems
Scalable Storage for Massive Volume Data SystemsScalable Storage for Massive Volume Data Systems
Scalable Storage for Massive Volume Data Systems
 
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
GES DISC Eexperiences with HDF Formats for MEaSUREs ProjectsGES DISC Eexperiences with HDF Formats for MEaSUREs Projects
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
 
HDF-EOS Development Status and Maintenance Support
HDF-EOS Development Status and Maintenance SupportHDF-EOS Development Status and Maintenance Support
HDF-EOS Development Status and Maintenance Support
 
An Overview of HDF-EOS (Part II)
An Overview of HDF-EOS (Part II)An Overview of HDF-EOS (Part II)
An Overview of HDF-EOS (Part II)
 
Generalized Conversion of HDF-EOS Products to GIS-Compatible Formats
Generalized Conversion of HDF-EOS Products to GIS-Compatible FormatsGeneralized Conversion of HDF-EOS Products to GIS-Compatible Formats
Generalized Conversion of HDF-EOS Products to GIS-Compatible Formats
 
Hdf eos status-workshp_xi_nov_2007
Hdf eos status-workshp_xi_nov_2007Hdf eos status-workshp_xi_nov_2007
Hdf eos status-workshp_xi_nov_2007
 

Más de The HDF-EOS Tools and Information Center

STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...The HDF-EOS Tools and Information Center
 

Más de The HDF-EOS Tools and Information Center (20)

Cloud-Optimized HDF5 Files
Cloud-Optimized HDF5 FilesCloud-Optimized HDF5 Files
Cloud-Optimized HDF5 Files
 
Accessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDSAccessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDS
 
The State of HDF
The State of HDFThe State of HDF
The State of HDF
 
Highly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance FeaturesHighly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance Features
 
Creating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 FilesCreating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 Files
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance DiscussionHDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance Discussion
 
Hyrax: Serving Data from S3
Hyrax: Serving Data from S3Hyrax: Serving Data from S3
Hyrax: Serving Data from S3
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLABAccessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
 
HDF - Current status and Future Directions
HDF - Current status and Future DirectionsHDF - Current status and Future Directions
HDF - Current status and Future Directions
 
HDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and FutureHDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and Future
 
HDF - Current status and Future Directions
HDF - Current status and Future Directions HDF - Current status and Future Directions
HDF - Current status and Future Directions
 
H5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only LibraryH5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only Library
 
MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10
 
HDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDFHDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDF
 
HDF5 <-> Zarr
HDF5 <-> ZarrHDF5 <-> Zarr
HDF5 <-> Zarr
 
HDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server FeaturesHDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server Features
 
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
 
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
 
HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?
 
HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020
 

Último

Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 

Último (20)

Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 

The Landsat 7 Processing System (LPS) Level Zero-R Science Products

  • 1. The Landsat 7 Processing System ( LPS ) Level Zero-R Science Products Michael R. Reid Computer Sciences Corporation Mike.Reid@gsfc.nasa.gov ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 1
  • 2. The Landsat 7 Mission • • • • • • • The latest in the Landsat series Joint operation between NASA and USGS Global coverage in 8 bands Sun-synchronous orbit Landsat 7 successfully launched in April 1999 Now fully operational Data products provided by the USGS’ EROS Data Center (EDC) in Sioux Falls, SD ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 2
  • 3. Earth Coverage • Enhanced Thematic Mapper Plus (ETM+) is the only science instrument – Images the Earth in 185 km wide swaths – Images in eight bands • Image data are fitted onto the Worldwide Reference System (WRS) grid – WRS grid consists of 185 km × 170 km scenes – ETM+ images a WRS scene with 375 scans • WRS scenes overlap ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 3
  • 4. The ETM+ Instrument Data • Eight bands – Six 30m-resolution spectral bands • • • • Bands 1-5 (range λ = 0.45…1.75 µm) Band 7 (λ = 2.09-2.35 µm) 6,600 pixels per scan data line 16 data lines per scan – One 60m-resolution thermal band • Band 6 (λ = 10.4-12.5 µm) • 3,300 pixels per scan data line • 8 data lines per scan – One 15m-resolution panchromatic band • Band 8 (λ = 0.52-0.90 µm) • 13,200 pixels per data line • 32 data lines per scan ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 4
  • 5. Landsat 7 Processing System (LPS) • Developed at NASA/GSFC for the EDC • Part of the Landsat 7 Ground System • Performs the first stage of Level 0 processing – Aligns bands (forward and reverse scans) – Does not apply corrections or calibrations – Does not perform rectification • Produces HDF-EOS science data products on a subinterval basis • Runs on a high-end SGI™ system ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 5
  • 6. LPS Processing • Divides the subintervals into sets of contiguous WRS scenes • Geolocates the scenes • Produces viewable, multi-band, color browse images on a WRS scene basis • Performs automatic cloud cover assessment (ACCA) on a WRS scene basis • Displays a Moving Window Display to the user ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 6
  • 7. The LPS Moving Window Display (MWD) ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 7
  • 8. LPS Processing continued… • Receives data on two channels (“format 1” and “format 2”) • Decodes the downlinked raw telemetry • Processes the two formats separately • Constructs an image in each band of the “swath” on the Earth’s surface covered during a contact • Divides the swath into subintervals ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 8
  • 9. The LPS Data Products • LPS products generated on a subinterval basis • Format 1 and Format 2 are separate file sets • The LPS Product file sets include: – – – – – – Band files (Swath files) Internal Calibrator (IC) data files Mirror Scan Correction Data (MSCD) files Payload Correction Data (PCD) files Metadata files Multi-Band Browse files (format 1 only) ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 9
  • 10. The Band Files — Swaths • Image data stored in HDF-EOS Swaths – One Swath per file • Bands 1-5 & 7 files are up to about 1.2 Gb in size • Band 6 files are up to about 295 Mb in size • Band 8 data are huge, won’t fit in single files – Up to about 4.6 Gb of data in a 35-scene subinterval – HDF 4 limits file sizes to 2 Gb – Written to up to three separate swaths in separate segment files ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 10
  • 11. The Band Files — Geolocation • Geolocation structures – Uses HDF-EOS Index map to link WRS scene corner lon/lat coordinates to the Swath • Full scenes from 30m-res. bands are always 6,000 data lines • Partial scenes at the beginnings and ends of subintervals are of irregular sizes – Uses Time Geolocation field to temporally locate scans in the Swaths • HDF-EOS Geolocation structures also used to store other ancillary data ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 11
  • 12. The Internal Calibrator (IC) Files • Contain lamp and shutter data for spectral bands • Contain blackbody radiance and shutter data for thermal band (band 6) • One file for each format – Separate HDF-EOS Swath for each band • One data set per scan • Data located by Time only using HDF-EOS Geolocation structure ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 12
  • 13. Mirror Scan Correction Data (MSCD) Files • Mainly contain data quality information • Stored in an HDF-EOS Point • Located by Time only using HDF-EOS Geolocation structure • Format 1 and Format 2 MCSD are identical except for start and end offsets at the beginnings and ends of the data ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 13
  • 14. Other LPS Product Files • Payload Correction Data (PCD) Files – Contain spacecraft attitude and ephemeris information and miscellaneous engineering data – Native HDF Vdata, no HDF-EOS structures – Format 1 and Format 2 are identical • Metadata Files – Format 1 and Format 2 similar, but not identical – Simple text file in Object Definition Language (ODL) Syntax • Browse Files – – – – Format 1 only One native HDF RIS24 true color image Made from three of the five format 1 spectral bands JPEG Compressed images ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 14
  • 15. LPS Browse File (Hudson Bay) ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 15
  • 16. Format 1 • Six Band files – Bands 1-5 and 6L • • • • One Internal Calibrator (IC) data file One Payload Correction Data (PCD) file One Mirror Scan Correction Data (MSCD) file One Metadata file – Includes scene cloud cover assessments • 1 to 37 Multi-band Browse files ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 16
  • 17. Format 2 • Three Bands, up to five files – Bands 6H and 7 – Band 8 (High-Resolution Panchromatic Band) • Written to up to three segment files due to size • • • • • One Internal Calibrator (IC) data file One Payload Correction Data (PCD) file One Mirror Scan Correction Data (MSCD) file One Metadata file No Browse files ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 17
  • 18. The LPS Product File Set ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 18
  • 19. Level Zero-R Data Subsets • Single WRS scene products – One 375 scan subset – Data fitted to the WRS grid • Multiple scene products – Contains several contiguous WRS scenes • Partial subinterval (a.k.a., floating scene) products – Similar to the multiple scene products, but not aligned along WRS rows • Full subinterval products – Essentially the full LPS subinterval ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 19
  • 20. Subsetting the LPS Subintervals • LPS Band and IC files contain geolocated HDF-EOS Swaths – Can subset band data by index-mapped WRS scene corner geographic coordinates or time using HDF-EOS functions • Band 8 presents a problem due to file segmentation – Can subset IC data by time using HDF-EOS functions • MSCD file contains an HDF-EOS Point – Can subset by time using HDF-EOS functions • PCD is native HDF and cannot be subsetted using HDF-EOS functions ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 20
  • 21. LPS Subsetting Difficulties • Band data Swaths are stored in separate files • Format 1/Format 2 data offset • Partial subinterval geolocation – LPS only computes lon/lat coordinates for WRS scene corners, not on a scan basis – Must interpolate subset interval corner coordinates • Band 8 segmentation – HDF-EOS does not support file segmentation ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 21
  • 22. Band 8 Subsetting Problem • Must treat the band 8 segments as completely separate data sets • Subsetting out multiple scene or partial subinterval products from band 8 is especially complicated if the subset interval spans across segments • After subsetting from the two segments, the data must be concatenated into a single array ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 22
  • 23. Level Zero-R Distribution Product • Native HDF, no HDF-EOS structures • Contains data from both Format 1 and Format 2 • Subsets of Band and IC data written to Scientific Data Sets (SDS) • Subset of MSCD written to Vdatas • Complete PCD and Metadatas written to Vdatas • Contains Calibration Parameter File (CPF) • Stores all data in HDF external elements ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 23
  • 24. L0R Distribution Product File Set ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 24