SlideShare una empresa de Scribd logo
1 de 28
Spectral Imaging


            Ivo Ihrke
Saarland University/MPI Informatik
The spectral data cube

                         • spectrometer
Principle of Operation - Dispersion




disadvantage:
• dispersion relation is nonlinear
advantage:
• light efficient
Diffraction Grating
                                      Diffraction Order   Percentage of transmitted
                                                          Light
– At center, no diffraction           0                   25%

                                      1                   20.26%
– For higher orders, diffraction is   2                   10.13%

                                      3                    2.25%
  taking place
                                      4                    0%

                                      remainder            9.72%



 disadvantage:
 • low light efficiency
 advantage:
 • linear relation
   pixel pos. <-> wavelength
Diffraction-Based Systems

– Diffraction-based example ->
– Spectrometer calibration (all types)
1. mapping
  pixel <–> wavelength
2. relative intensity of wavelengths
The spectral data cube

• Spatial Scanning        • E.g. in satellite imaging
 (2D sensor)                – Pushbroom scanning
Spatial Scanning
 • Generalized Mosaics [Schechner & Nayar]




 • linear filter
 • each pixel column filtered differently
 • rotational motion & registration to assemble image stack
The spectral data cube

• Spectral scanning
Frequency Scanning

                     • Michelson Interferometer with
                       moving mirror - Fourier Transform
                       Imaging Spectroscopy (FTIS)
Imaging Spectrometers
The quest for the instantaneous spectral data cube
                  (4D Imaging)
Multiplexing - Image slicers




[WiFeS – Wide Field
Spectrometer]
Multiplexing - Image slicers




[SPIFFI - SPectrometer for
Infrared Faint Field Imaging]
Fiber Optical cables (OKSI)

300 “pixels”




2D -> 1D reformatting
Multiplexing: Prism-Mask Based System




            [Du’09]
Computational Imaging Spectrometers
The quest for the instantaneous spectral data cube
CTIS –
Computed Tomography Imaging Spectrometry
 • Original method [Descour’95]
 • Image a full diffraction pattern
 • Perform “CT”




                  spectral image      diffraction pattern
CTIS in graphics




  • HDR imaging
    for CTIS                                 [Habel’12]
  (not snapshot due to HDR exposure stack)
CTIS in graphics


  • Spatial resolution 124x124, 54 bands




                                           [Habel’12]
CASSI – Coded Aperture Snapshot Spectral Imaging
CASSI – Coded Aperture Snapshot Spectral Imaging




               Implementation with prisms
CASSI – Coded Aperture Snapshot Spectral Imaging

 • Resolution: spatial ~200 x 200 pixels
                spectral ~30 bands




 projection       reconstruction (stack)   spectra
Spectral Transfer

 • Transfer low-res spectra to high res RGB
    image [Rump’10,Cao’11]
Applications
Applications
  • automatic white balancing
Spatially uniform illumination




raw from RGB   tungsten WB   `greyworld WB   spectral WB   spectra




 Spatially varying illumination                             [Cao11]
Applications
  • improved tracking



               RGB –           spectral –
               tracking lost   tracking OK




  • real and fake skin detection             [Cao11]
Applications


  • analyze / restore paintings




                                  [Calit]
Applications


  • Satellite-Based Remote Sensing




vegetation mapping   urban land use   pollution monitoring

                                         [DigitalGlobe’10]
• Multispectral at Siggraph’12
  – Kim, Harvey, Kittle, Rushmeier, Dorsey, O’Prum, and Brady “3D
    Imaging Spectroscopy for Measuring Hyperspectral Patterns on
    Solid Objects”, Monday, 3:45 - 5:35 – “Appearance”
  – Hosek and Wilkie, “An Analytic Model for Full Spectral Sky-Dome
    Radiance”, Wednesday 3:45-5:35 pm – “Physics and Mathematics
    for Light”

Más contenido relacionado

La actualidad más candente

RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterRIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterKevin Nouri
 
Lytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million businessLytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million businessWeili Shi
 
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019StanfordComputationalImaging
 
HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast Barco
 
Digital Radiography
Digital RadiographyDigital Radiography
Digital Radiographyricksw78
 
Particle image velocimetry
Particle image velocimetryParticle image velocimetry
Particle image velocimetryMohsin Siddique
 
3 d imaging super resolution
3 d imaging super resolution3 d imaging super resolution
3 d imaging super resolutionredsea3h
 
194Martin LeungUnerd Poster
194Martin LeungUnerd Poster194Martin LeungUnerd Poster
194Martin LeungUnerd PosterMartin Leung
 
Single photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor FusionSingle photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor FusionDavid Lindell
 
Improved single image dehazing by fusion
Improved single image dehazing by fusionImproved single image dehazing by fusion
Improved single image dehazing by fusioneSAT Publishing House
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)Matthew O'Toole
 
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Barco
 
Object Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online LearningObject Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online LearningJui-Hsin (Larry) Lai
 

La actualidad más candente (20)

Coded Photography - Ramesh Raskar
Coded Photography - Ramesh RaskarCoded Photography - Ramesh Raskar
Coded Photography - Ramesh Raskar
 
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterRIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
 
Raskar Banff
Raskar BanffRaskar Banff
Raskar Banff
 
CORNAR: Looking Around Corners using Trillion FPS Imaging
CORNAR: Looking Around Corners using Trillion FPS ImagingCORNAR: Looking Around Corners using Trillion FPS Imaging
CORNAR: Looking Around Corners using Trillion FPS Imaging
 
Lytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million businessLytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million business
 
Introduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh RaskarIntroduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh Raskar
 
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
 
HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast
 
Digital Radiography
Digital RadiographyDigital Radiography
Digital Radiography
 
Particle image velocimetry
Particle image velocimetryParticle image velocimetry
Particle image velocimetry
 
3 d imaging super resolution
3 d imaging super resolution3 d imaging super resolution
3 d imaging super resolution
 
194Martin LeungUnerd Poster
194Martin LeungUnerd Poster194Martin LeungUnerd Poster
194Martin LeungUnerd Poster
 
Single photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor FusionSingle photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor Fusion
 
Dual photography
Dual photographyDual photography
Dual photography
 
Digital Imaging
Digital ImagingDigital Imaging
Digital Imaging
 
Improved single image dehazing by fusion
Improved single image dehazing by fusionImproved single image dehazing by fusion
Improved single image dehazing by fusion
 
Digital Holography
Digital HolographyDigital Holography
Digital Holography
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
 
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
 
Object Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online LearningObject Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online Learning
 

Destacado

SIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionSIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionMatt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionSIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionGordon Wetzstein
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingSIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingGordon Wetzstein
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...Gordon Wetzstein
 
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysSIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysMatt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...Matt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...Matt Hirsch - MIT Media Lab
 

Destacado (7)

SIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionSIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introduction
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionSIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingSIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
 
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysSIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
 
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
 
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
 

Similar a Spectral Imaging Techniques

Physics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generationsPhysics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generationsNeetuMeena56
 
12intraoral digital radiography
12intraoral digital radiography12intraoral digital radiography
12intraoral digital radiographyNarmathaN2
 
RS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptxRS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptxDrAbhishekPandey9
 
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technologyDIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technologyDilshanDillu1
 
Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Adrian Waltho
 
Digital Radiography PHYSICS
Digital Radiography PHYSICSDigital Radiography PHYSICS
Digital Radiography PHYSICSShubhankar Mitra
 
Rendering Algorithms.pptx
Rendering Algorithms.pptxRendering Algorithms.pptx
Rendering Algorithms.pptxSherinRappai
 
5.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,20135.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,2013Bhargav Veepuri
 
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...Christian Gabriel Gomez
 
Digital Image Fundamentals
Digital Image FundamentalsDigital Image Fundamentals
Digital Image FundamentalsKalyan Acharjya
 
Cone beam computed tomography
Cone beam computed tomographyCone beam computed tomography
Cone beam computed tomographyVashi Narula
 
Radiometric Calibration of Digital Images
Radiometric Calibration of Digital ImagesRadiometric Calibration of Digital Images
Radiometric Calibration of Digital ImagesSean Thibert
 
Digital Image Correlation Presentation
Digital Image Correlation PresentationDigital Image Correlation Presentation
Digital Image Correlation Presentationtrilionqualitysystems
 
Cloud shadow detection over water
Cloud shadow detection over waterCloud shadow detection over water
Cloud shadow detection over waterDivyansh Jha
 

Similar a Spectral Imaging Techniques (20)

Cbct
CbctCbct
Cbct
 
Cbct
CbctCbct
Cbct
 
Voxel based global-illumination
Voxel based global-illuminationVoxel based global-illumination
Voxel based global-illumination
 
Physics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generationsPhysics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generations
 
12intraoral digital radiography
12intraoral digital radiography12intraoral digital radiography
12intraoral digital radiography
 
RS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptxRS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptx
 
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technologyDIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
 
Summerresearch2011
Summerresearch2011Summerresearch2011
Summerresearch2011
 
Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3
 
Digital Radiography PHYSICS
Digital Radiography PHYSICSDigital Radiography PHYSICS
Digital Radiography PHYSICS
 
Rendering Algorithms.pptx
Rendering Algorithms.pptxRendering Algorithms.pptx
Rendering Algorithms.pptx
 
5.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,20135.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,2013
 
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
 
Dr,system abhishek
Dr,system abhishekDr,system abhishek
Dr,system abhishek
 
Digital Image Fundamentals
Digital Image FundamentalsDigital Image Fundamentals
Digital Image Fundamentals
 
Radar Image Processing
Radar Image ProcessingRadar Image Processing
Radar Image Processing
 
Cone beam computed tomography
Cone beam computed tomographyCone beam computed tomography
Cone beam computed tomography
 
Radiometric Calibration of Digital Images
Radiometric Calibration of Digital ImagesRadiometric Calibration of Digital Images
Radiometric Calibration of Digital Images
 
Digital Image Correlation Presentation
Digital Image Correlation PresentationDigital Image Correlation Presentation
Digital Image Correlation Presentation
 
Cloud shadow detection over water
Cloud shadow detection over waterCloud shadow detection over water
Cloud shadow detection over water
 

Último

Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...RKavithamani
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 

Último (20)

Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 

Spectral Imaging Techniques

  • 1. Spectral Imaging Ivo Ihrke Saarland University/MPI Informatik
  • 2. The spectral data cube • spectrometer
  • 3. Principle of Operation - Dispersion disadvantage: • dispersion relation is nonlinear advantage: • light efficient
  • 4. Diffraction Grating Diffraction Order Percentage of transmitted Light – At center, no diffraction 0 25% 1 20.26% – For higher orders, diffraction is 2 10.13% 3 2.25% taking place 4 0% remainder 9.72% disadvantage: • low light efficiency advantage: • linear relation pixel pos. <-> wavelength
  • 5. Diffraction-Based Systems – Diffraction-based example -> – Spectrometer calibration (all types) 1. mapping pixel <–> wavelength 2. relative intensity of wavelengths
  • 6. The spectral data cube • Spatial Scanning • E.g. in satellite imaging (2D sensor) – Pushbroom scanning
  • 7. Spatial Scanning • Generalized Mosaics [Schechner & Nayar] • linear filter • each pixel column filtered differently • rotational motion & registration to assemble image stack
  • 8. The spectral data cube • Spectral scanning
  • 9. Frequency Scanning • Michelson Interferometer with moving mirror - Fourier Transform Imaging Spectroscopy (FTIS)
  • 10. Imaging Spectrometers The quest for the instantaneous spectral data cube (4D Imaging)
  • 11. Multiplexing - Image slicers [WiFeS – Wide Field Spectrometer]
  • 12. Multiplexing - Image slicers [SPIFFI - SPectrometer for Infrared Faint Field Imaging]
  • 13. Fiber Optical cables (OKSI) 300 “pixels” 2D -> 1D reformatting
  • 14. Multiplexing: Prism-Mask Based System [Du’09]
  • 15. Computational Imaging Spectrometers The quest for the instantaneous spectral data cube
  • 16. CTIS – Computed Tomography Imaging Spectrometry • Original method [Descour’95] • Image a full diffraction pattern • Perform “CT” spectral image diffraction pattern
  • 17. CTIS in graphics • HDR imaging for CTIS [Habel’12] (not snapshot due to HDR exposure stack)
  • 18. CTIS in graphics • Spatial resolution 124x124, 54 bands [Habel’12]
  • 19. CASSI – Coded Aperture Snapshot Spectral Imaging
  • 20. CASSI – Coded Aperture Snapshot Spectral Imaging Implementation with prisms
  • 21. CASSI – Coded Aperture Snapshot Spectral Imaging • Resolution: spatial ~200 x 200 pixels spectral ~30 bands projection reconstruction (stack) spectra
  • 22. Spectral Transfer • Transfer low-res spectra to high res RGB image [Rump’10,Cao’11]
  • 24. Applications • automatic white balancing Spatially uniform illumination raw from RGB tungsten WB `greyworld WB spectral WB spectra Spatially varying illumination [Cao11]
  • 25. Applications • improved tracking RGB – spectral – tracking lost tracking OK • real and fake skin detection [Cao11]
  • 26. Applications • analyze / restore paintings [Calit]
  • 27. Applications • Satellite-Based Remote Sensing vegetation mapping urban land use pollution monitoring [DigitalGlobe’10]
  • 28. • Multispectral at Siggraph’12 – Kim, Harvey, Kittle, Rushmeier, Dorsey, O’Prum, and Brady “3D Imaging Spectroscopy for Measuring Hyperspectral Patterns on Solid Objects”, Monday, 3:45 - 5:35 – “Appearance” – Hosek and Wilkie, “An Analytic Model for Full Spectral Sky-Dome Radiance”, Wednesday 3:45-5:35 pm – “Physics and Mathematics for Light”

Notas del editor

  1. Table: formulas from Born &amp; Wolf “Principles of Optics”, 7th ed., p. 450s = slit widthd = spacing between slitsAssume s/d = ¼ as in their figurek = 2pi / lambdaMaxima of diffraction pattern are at p = m lambda / d Evaluate Fig. 8.19 (b) at position of the maximaI = const. * Sin^2(ksp/2) / (ksp/2)^2ksp = 2pi/lambda * s * m lambda /d = pi *s/d * m = pi * ¼ * mThis gives a sequence of numbers S_m and lim_{m \\goesto \\infty } \\sum_{-m..m} S_m = 4The limit lim_{s/d \\goesto 0} I = 1.The percentages in the table are computed w.r.t. this limit. They will change if the ratio of slit width to slit spacing (s/d) is changed. In particular, the diffraction order 4 with 0 intensity results from s/d being a proper fraction 1/4.You can achieve higher light efficiency by moving the peaks closer together , i.e. letting the fraction s/d go to zero, however, then the orders m=1..N move closer together and consequently there is less space for the spectrum -&gt; spectral resolution is decreased.
  2. Pushbroom illustration from http://www.laserfocusworld.com/articles/print/volume-40/issue-8/features/imaging-spectroscopy/spectral-data-adds-a-new-dimension-to-remote-imaging-of-earth.html
  3. 6-filter wheel – Thorlabs Inc. CFW6Big filter wheel – MPI Astronomy – part of the James Web Space telescope(http://www.jwst.nasa.gov/) is MIRI http://www.roe.ac.uk/ukatc/consortium/miri/overview/instrument_design.htmlLCTF (Liquid Crystal Tunable Filter) = programmable wavelength bandpass filter – LOT-Oriel group: http://www.lot-oriel.com/uk/en/home/tunable-filters/
  4. Wiki page: http://en.wikipedia.org/wiki/Fourier_transform_spectroscopyMain purpose – increase light throughput – multiplexing advantage
  5. Example: WiFES Wide Field Spectrograph - 3 degrees of an arc fov, extremely large for telesopesImages from http://rsaa.anu.edu.au/research/highlights/wifes-and-fine-art-spectroscopy
  6. SPIFFI: SPectrometer for Infrared Faint Field Imaginghttp://www.eso.org/sci/facilities/paranal/instruments/sinfoni/inst/instrument.htmlSlicer closeup from:http://www.astro.ufl.edu/~raines/snr-fisica.html
  7. Development of four-dimensional imaging spectrometers (4D-IS)Nahum Gat, Gordon Scriven, John Garman, Ming De Li, Jingyi ZhangOpto-Knowledge Systems, Inc. (OKSI)
  8. Also Bodkin design 2006 (res 100x100x20)Snapshot Hyperspectral Imaging – the Hyperpixel Array™ CameraAndrew Bodkin, A. Sheinis, A. Norton, J. Daly, S. Beaven and J. WeinheimerHao Du, Xin Tong, Xun Cao and Stephen Lin. A Prism-based System for Multispectral Video Acquisition. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 2009http://www.cs.washington.edu/homes/duhao/Projects/MultiSpectral/MultiSpectralwebsite.html
  9. Computed-tomography imaging spectrometer: experimental calibration and reconstruction resultsDescour, M. Dereniak, E. APPLIED OPTICS,1995, VOL 34; NUMBER 22, pages 4817Example from:http://www.optics.arizona.edu/descour/computed.htmRaw image 1024x1024; result 75x75 spatial resolution, 30 spectral bands (around 1997/1998), computed on Pentium II 450 MHz. spectral resolution: \\Delta\\lambda = (710-420) / 30 = 9.6Max R = 74 (at 710)
  10. 54 slices computed, assuming they are resolved, this gives a max. resolution at 700 nm of \\Delta\\lambda = (666-422) / 54 = 4.5 nmR = 700 / 4.5 = 156
  11. Gehm et al., &quot;Single-shot compressive spectral imaging with a dual-disperser architecture,&quot; Optics Express, October 2007.Wagadarikar et al. &quot;Single disperser design for coded aperture snapshot spectral imaging,&quot; feature issue on Computational Optical Sensing and Imaging, Applied Optics 47 (10), B44-51 (2008). 
  12. 35 bands, spatial approx. 200x200 pixels (judging from image qaulity, actual resolution appears to be lower be a factor at least two), no specifics provided in paper. SDCASSI (Wagadarikar’08) input image resolution 1040 x 1392 pixels. Result: 128 x 128 x 28 is claimed to be higher spectral res. than DDCASSI above, lower spatial res.
  13. Spectralization: Reconstructing spectra from sparse dataMartin Rump and Reinhard KleinIn proceedings of SR &apos;10 Rendering Techniques, pages 1347-1354, Eurographics Association, June 2010Xun Cao, Xin Tong, Qionghai Dai and Stephen Lin, &quot;High Resolution Multispectral Video Capture with a Hybrid Camera System&quot;, IEEE international Conference on Computer Vision and Pattern Recognition (CVPR), 2011