SlideShare una empresa de Scribd logo
1 de 29
Descargar para leer sin conexión
Motivation Original Simplified Conclusion




  Object counting in high resolution remote
          sensing images with OTB

                      E. Christophe1 , J. Inglada2

        1 C ENTRE FOR   R EMOTE I MAGING , S ENSING AND P ROCESSING ,
                     N ATIONAL U NIVERSITY OF S INGAPORE
       2 C ENTRE   N ATIONAL D ’É TUDES S PATIALES , TOULOUSE , F RANCE




                        IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion


Outline

   Motivation

   Original solution
      Workflow
      Pan Sharpening
      Classification
      Segmentation: Mean shift
      Vector data

   Simplified versions
      Trade-off
      Description
      Results

   Conclusion
                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion


Motivation

   Object counting
       Correspond to a wide range of problems for remote
       sensing data users
       Often have to be performed on large area
       Time consuming

   Examples
       Houses in a city: particularly for country where urban
       planning data is not available
       Tents in refugee camp
       Tree stands in a field

                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion




PRRS 2008 algorithm performance contest
    Time constraints: can’t spend months refining the
    algorithm
    Deliver a result: whole processing chain required
    Each step can be improved
    Goal: illustrate the on the shelf approach

Contest
    Count the building from a Quickbird scene over Legaspi,
    Philippines
    XS and Pan images were provided

   Aksoy et al., ”Performance evaluation of building detection and digital surface model extraction algorithms:
   Outcomes of the PRRS 2008 algorithm performance contest,” in 5th IAPR Workshop on Pattern Recognition
   in Remote Sensing, Tampa, Florida, Dec. 2008.
                               IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Outline

   Motivation

   Original solution
      Workflow
      Pan Sharpening
      Classification
      Segmentation: Mean shift
      Vector data

   Simplified versions
      Trade-off
      Description
      Results

   Conclusion
                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Algorithm description




    Pan




     Mul




                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Algorithm description




    Pan

             Pan sharpening

     Mul




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion      Workflow PanSharp Classif. Segment. Vector data


Algorithm description




                                   Classification
    Pan

             Pan sharpening

     Mul




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion      Workflow PanSharp Classif. Segment. Vector data


Algorithm description




                                   Classification
    Pan

             Pan sharpening        Segmentation

     Mul




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion      Workflow PanSharp Classif. Segment. Vector data


Algorithm description




                                   Classification
    Pan

             Pan sharpening        Segmentation        Vectorization

     Mul




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion      Workflow PanSharp Classif. Segment. Vector data


Algorithm description




                                   Classification
    Pan

             Pan sharpening        Segmentation        Vectorization

     Mul
                                   Edge dectect.




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion      Workflow PanSharp Classif. Segment. Vector data


Algorithm description




                                   Classification
    Pan

             Pan sharpening        Segmentation        Vectorization     Refinement

     Mul
                                   Edge dectect.




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion      Workflow PanSharp Classif. Segment. Vector data


Algorithm description




                                   Classification
    Pan

             Pan sharpening        Segmentation        Vectorization     Refinement        Obj

     Mul
                                   Edge dectect.




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion         Workflow PanSharp Classif. Segment. Vector data


Preprocessing

  Pansharpening
      The pansharpening is the first step to perform to take
      advantage of the high resolution of the Panchromatic band
      (61 cm) with the four spectral bands of the multispectral.




         Pan                                   Mul                         Pan Shapening


                            IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Classification


   Obvious sources of errors
       There is some obvious sources of error: boat in the middle of the water which
       look like houses, cars in the middle of the street
       Classification (used as a mask) can help remove these sources of error


   Classification
       Here we used a simple classification by SVM
       Non classification specialists just provided a few samples per class (water,
       vegetation, road, shadows, 4 colors of buildings)
       Only a pixel classification: no use of texture here (that was before all the textures
       were introduces in OTB)




                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data




           QB scene                                 Land cover classification




                        IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion            Workflow PanSharp Classif. Segment. Vector data


Segmentation: Mean shift



  Too much details
      Higher resolution is better but. . . sometimes, you would like
      less details (roof superstructures, cars)
      What details to remove?
      Mean shift algorithm

     D. Commaniciu,“Mean shift: A robust approach toward feature space analysis,”IEEE Transactions on Pattern
     Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603–619, May 2002.




                                IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data




        Pan Sharpened                                 Mean shift clustering




                        IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Refining the boundaries

  Simplification
      Easier to handle vector data than raster: vectorization
      The vectorization led to too many contour point:
      simplification of the points which are roughly aligned

  Fine adjustment
      Using an image contour as an input, an energy is
      computed along the polygon contour
      Introducing a random perturbation in the position of each
      point, the energy is maximized
      Only a very basic optimization used here (ground for
      improvement)
                            IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Filtering




   Filtering on compacity
       Buildings are usually compact
              A
       C = 4π L2




                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Performances on the contest

  Results
      Two results were submitted with a difference mainly in the classification
      One result was very close with 3600 building detected for 3065 in the ground
      truth
      Interesting to see that most other algorithms tend to underdetection while the
      proposed algorithm tends to overdetect.


  Evaluation criteria
      {Correct, over, under, missed} detection and false alarm rates based on
      Overlapping Area Matrix
      Maximum-weight bipartite graph matching
      Normalized Hamming distance
      Clustering indices (Fowlkes-Mallows and Jaccard index)



                            IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Workflow PanSharp Classif. Segment. Vector data


Performances on the contest



  Conclusion on these results
      Particularly hard to conclude given the wide variety of
      criteria: organizer of the contest have been careful not to
      declare an overall winner
      However, the proposed methods provided good
      performances (particularly on the clusterings indices
      criteria) with a bias towards over segmentation.




                            IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Trade-off Description Results


Outline

   Motivation

   Original solution
      Workflow
      Pan Sharpening
      Classification
      Segmentation: Mean shift
      Vector data

   Simplified versions
      Trade-off
      Description
      Results

   Conclusion
                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Trade-off Description Results


Trade-off of the previous method


   Drawbacks
   The previous method relies on the classification of the image
       require a good understanding of the algorithm that follow
       influence significantly the output

   Simplified version
       different trade-offs on complexity-performance
       remove the classification step
       just require the operator to click on several (2 to 5)
       examples of objects


                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Trade-off Description Results


Simplified version


   Algorithm
       Produce a likelihood map of the region containing the
       objects of interest
       Followed by the same step as the previous algorithm:
       segmentation, vectorization,. . .

   Likelihood map: 2 choices
       Spectral angle
       One class SVM


                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion      Trade-off Description Results


Algorithm description



                                  One class SVM

                                  Spectral angle
    Pan

             Pan sharpening        Segmentation        Vectorization       Refinement   Obj

     Mul
                                   Edge dectect.




                              IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion   Trade-off Description Results


Results of the simplified version


   Poorer preformances
       Not as good as the original one (expected) ⇒ required to
       understand the algorithm

   Advice
       Spectral angle: spectral characteristics of the objects are
       stable
       SVM: better when object have radiometric differences but
       more samples are required



                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion


Outline

   Motivation

   Original solution
      Workflow
      Pan Sharpening
      Classification
      Segmentation: Mean shift
      Vector data

   Simplified versions
      Trade-off
      Description
      Results

   Conclusion
                             IGARSS 2009, Cape Town
Motivation Original Simplified Conclusion


Conclusion


 Modular processing chain
    An application with GUI is
    available
    It can be used for processing
    remote sensing images (no
    constraint on the size)
    Can be easily modified and
    improved as the steps are
    modular and follow the pipeline
    philosophy.


                             IGARSS 2009, Cape Town

Más contenido relacionado

Destacado

POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...
POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...
POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...gueste1a32de7
 
Mobile World Congress 2016 Trend Recap
Mobile World Congress 2016 Trend RecapMobile World Congress 2016 Trend Recap
Mobile World Congress 2016 Trend RecapTom Edwards
 
數位行銷應用分析 蘇貞昌 台北超越台北
數位行銷應用分析   蘇貞昌 台北超越台北數位行銷應用分析   蘇貞昌 台北超越台北
數位行銷應用分析 蘇貞昌 台北超越台北Jimmy
 
Prezentacja EnterMedia DST Warszawa 2010 Small Size
Prezentacja EnterMedia DST Warszawa 2010 Small SizePrezentacja EnterMedia DST Warszawa 2010 Small Size
Prezentacja EnterMedia DST Warszawa 2010 Small SizeEnterMedia
 
Corporate Brochure Single Page Ed[1]
Corporate Brochure Single Page Ed[1]Corporate Brochure Single Page Ed[1]
Corporate Brochure Single Page Ed[1]lmturk
 
Grand Lake 2014 Year End 10 year charts - Real Estate Trends
Grand Lake 2014 Year End   10 year charts - Real Estate TrendsGrand Lake 2014 Year End   10 year charts - Real Estate Trends
Grand Lake 2014 Year End 10 year charts - Real Estate TrendsRE/MAX Grand Lake
 
Ingles Oral Presentation
Ingles Oral PresentationIngles Oral Presentation
Ingles Oral PresentationSvalent
 
Grand Lake OK 2005 - 2010 First Half of Year Real Estate Market Analysis
Grand Lake OK 2005 - 2010 First Half of Year Real Estate Market AnalysisGrand Lake OK 2005 - 2010 First Half of Year Real Estate Market Analysis
Grand Lake OK 2005 - 2010 First Half of Year Real Estate Market AnalysisRE/MAX Grand Lake
 
Remax Best Fest Presentation - Get to Know Your Market
Remax Best Fest  Presentation - Get to Know Your MarketRemax Best Fest  Presentation - Get to Know Your Market
Remax Best Fest Presentation - Get to Know Your MarketRE/MAX Grand Lake
 
Romanian questionnaire 5 8-2011
Romanian questionnaire 5 8-2011Romanian questionnaire 5 8-2011
Romanian questionnaire 5 8-2011Petros Michailidis
 
Texas S Ta R Chart Presentation
Texas S Ta R Chart PresentationTexas S Ta R Chart Presentation
Texas S Ta R Chart Presentationdbalder1
 
St. patrick's day
St. patrick's daySt. patrick's day
St. patrick's dayBEATRIZ9
 
llegenda sant medir
llegenda sant medirllegenda sant medir
llegenda sant medirarubiovalls
 
Gevanim
GevanimGevanim
Gevanimrel10
 
Profile
ProfileProfile
Profileewen27
 

Destacado (20)

POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...
POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...
POLS 7050 HKBU/ MPA, HKBU Public Administration, HKBU/CASS - Ways To Optimize...
 
A união europeia
A união europeiaA união europeia
A união europeia
 
Mobile World Congress 2016 Trend Recap
Mobile World Congress 2016 Trend RecapMobile World Congress 2016 Trend Recap
Mobile World Congress 2016 Trend Recap
 
History of meaning
History of meaningHistory of meaning
History of meaning
 
數位行銷應用分析 蘇貞昌 台北超越台北
數位行銷應用分析   蘇貞昌 台北超越台北數位行銷應用分析   蘇貞昌 台北超越台北
數位行銷應用分析 蘇貞昌 台北超越台北
 
Spec Ads Promo
Spec Ads PromoSpec Ads Promo
Spec Ads Promo
 
Prezentacja EnterMedia DST Warszawa 2010 Small Size
Prezentacja EnterMedia DST Warszawa 2010 Small SizePrezentacja EnterMedia DST Warszawa 2010 Small Size
Prezentacja EnterMedia DST Warszawa 2010 Small Size
 
Corporate Brochure Single Page Ed[1]
Corporate Brochure Single Page Ed[1]Corporate Brochure Single Page Ed[1]
Corporate Brochure Single Page Ed[1]
 
Gvl Berkeley Bristol University Canagarajah
Gvl Berkeley Bristol University CanagarajahGvl Berkeley Bristol University Canagarajah
Gvl Berkeley Bristol University Canagarajah
 
Grand Lake 2014 Year End 10 year charts - Real Estate Trends
Grand Lake 2014 Year End   10 year charts - Real Estate TrendsGrand Lake 2014 Year End   10 year charts - Real Estate Trends
Grand Lake 2014 Year End 10 year charts - Real Estate Trends
 
Ingles Oral Presentation
Ingles Oral PresentationIngles Oral Presentation
Ingles Oral Presentation
 
Grand Lake OK 2005 - 2010 First Half of Year Real Estate Market Analysis
Grand Lake OK 2005 - 2010 First Half of Year Real Estate Market AnalysisGrand Lake OK 2005 - 2010 First Half of Year Real Estate Market Analysis
Grand Lake OK 2005 - 2010 First Half of Year Real Estate Market Analysis
 
Remax Best Fest Presentation - Get to Know Your Market
Remax Best Fest  Presentation - Get to Know Your MarketRemax Best Fest  Presentation - Get to Know Your Market
Remax Best Fest Presentation - Get to Know Your Market
 
Romanian questionnaire 5 8-2011
Romanian questionnaire 5 8-2011Romanian questionnaire 5 8-2011
Romanian questionnaire 5 8-2011
 
Key to success
Key to successKey to success
Key to success
 
Texas S Ta R Chart Presentation
Texas S Ta R Chart PresentationTexas S Ta R Chart Presentation
Texas S Ta R Chart Presentation
 
St. patrick's day
St. patrick's daySt. patrick's day
St. patrick's day
 
llegenda sant medir
llegenda sant medirllegenda sant medir
llegenda sant medir
 
Gevanim
GevanimGevanim
Gevanim
 
Profile
ProfileProfile
Profile
 

Similar a Object counting in high resolution remote sensing images with OTB

CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...
CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...
CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...Xiaoyu Shi
 
Deep Learning in Computer Vision
Deep Learning in Computer VisionDeep Learning in Computer Vision
Deep Learning in Computer VisionSungjoon Choi
 
1998 - Thesis JL Pacherie Parallel perators
1998 - Thesis JL Pacherie Parallel perators1998 - Thesis JL Pacherie Parallel perators
1998 - Thesis JL Pacherie Parallel peratorsJean-Lin Pacherie, Ph.D.
 
PCACONFUSIONMATRIX.pptx
PCACONFUSIONMATRIX.pptxPCACONFUSIONMATRIX.pptx
PCACONFUSIONMATRIX.pptxTechohiT
 
Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016
Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016
Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016MLconf
 
MLConf 2016 SigOpt Talk by Scott Clark
MLConf 2016 SigOpt Talk by Scott ClarkMLConf 2016 SigOpt Talk by Scott Clark
MLConf 2016 SigOpt Talk by Scott ClarkSigOpt
 
深度學習在AOI的應用
深度學習在AOI的應用深度學習在AOI的應用
深度學習在AOI的應用CHENHuiMei
 
Bias and Variance in Continuous EDA: massively parallel continuous optimization
Bias and Variance in Continuous EDA: massively parallel continuous optimizationBias and Variance in Continuous EDA: massively parallel continuous optimization
Bias and Variance in Continuous EDA: massively parallel continuous optimizationOlivier Teytaud
 
IEEE 2015 Matlab Projects
IEEE 2015 Matlab ProjectsIEEE 2015 Matlab Projects
IEEE 2015 Matlab ProjectsVijay Karan
 
Multi-Objective Evolutionary Algorithms
Multi-Objective Evolutionary AlgorithmsMulti-Objective Evolutionary Algorithms
Multi-Objective Evolutionary AlgorithmsSong Gao
 
Forecast of long term wind speed based on optimized support vector regression...
Forecast of long term wind speed based on optimized support vector regression...Forecast of long term wind speed based on optimized support vector regression...
Forecast of long term wind speed based on optimized support vector regression...Aboul Ella Hassanien
 
GECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced DatasetsGECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced DatasetsAlbert Orriols-Puig
 
Using Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning ModelsUsing Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning ModelsScott Clark
 
Using Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning ModelsUsing Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning ModelsSigOpt
 
On the value of Sampling and Pruning for SBSE
On the value of Sampling and Pruning for SBSEOn the value of Sampling and Pruning for SBSE
On the value of Sampling and Pruning for SBSEJianfeng Chen
 
IEEE 2015 Matlab Projects
IEEE 2015 Matlab ProjectsIEEE 2015 Matlab Projects
IEEE 2015 Matlab ProjectsVijay Karan
 
Clustering (from Google)
Clustering (from Google)Clustering (from Google)
Clustering (from Google)Sri Prasanna
 

Similar a Object counting in high resolution remote sensing images with OTB (20)

CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...
CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...
CSBP: A Fast Circuit Similarity-Based Placement for FPGA Incremental Design a...
 
Real Time Geodemographics
Real Time GeodemographicsReal Time Geodemographics
Real Time Geodemographics
 
Deep Learning in Computer Vision
Deep Learning in Computer VisionDeep Learning in Computer Vision
Deep Learning in Computer Vision
 
1998 - Thesis JL Pacherie Parallel perators
1998 - Thesis JL Pacherie Parallel perators1998 - Thesis JL Pacherie Parallel perators
1998 - Thesis JL Pacherie Parallel perators
 
PCACONFUSIONMATRIX.pptx
PCACONFUSIONMATRIX.pptxPCACONFUSIONMATRIX.pptx
PCACONFUSIONMATRIX.pptx
 
Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016
Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016
Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016
 
MLConf 2016 SigOpt Talk by Scott Clark
MLConf 2016 SigOpt Talk by Scott ClarkMLConf 2016 SigOpt Talk by Scott Clark
MLConf 2016 SigOpt Talk by Scott Clark
 
深度學習在AOI的應用
深度學習在AOI的應用深度學習在AOI的應用
深度學習在AOI的應用
 
Bias and Variance in Continuous EDA: massively parallel continuous optimization
Bias and Variance in Continuous EDA: massively parallel continuous optimizationBias and Variance in Continuous EDA: massively parallel continuous optimization
Bias and Variance in Continuous EDA: massively parallel continuous optimization
 
IEEE 2015 Matlab Projects
IEEE 2015 Matlab ProjectsIEEE 2015 Matlab Projects
IEEE 2015 Matlab Projects
 
Prez Test
Prez TestPrez Test
Prez Test
 
Multi-Objective Evolutionary Algorithms
Multi-Objective Evolutionary AlgorithmsMulti-Objective Evolutionary Algorithms
Multi-Objective Evolutionary Algorithms
 
Forecast of long term wind speed based on optimized support vector regression...
Forecast of long term wind speed based on optimized support vector regression...Forecast of long term wind speed based on optimized support vector regression...
Forecast of long term wind speed based on optimized support vector regression...
 
[Download] rev chapter-8-june26th
[Download] rev chapter-8-june26th[Download] rev chapter-8-june26th
[Download] rev chapter-8-june26th
 
GECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced DatasetsGECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
 
Using Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning ModelsUsing Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning Models
 
Using Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning ModelsUsing Bayesian Optimization to Tune Machine Learning Models
Using Bayesian Optimization to Tune Machine Learning Models
 
On the value of Sampling and Pruning for SBSE
On the value of Sampling and Pruning for SBSEOn the value of Sampling and Pruning for SBSE
On the value of Sampling and Pruning for SBSE
 
IEEE 2015 Matlab Projects
IEEE 2015 Matlab ProjectsIEEE 2015 Matlab Projects
IEEE 2015 Matlab Projects
 
Clustering (from Google)
Clustering (from Google)Clustering (from Google)
Clustering (from Google)
 

Más de melaneum

Implementing kohonen's som with missing data in OTB
Implementing kohonen's som with missing data in OTBImplementing kohonen's som with missing data in OTB
Implementing kohonen's som with missing data in OTBmelaneum
 
Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...
Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...
Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...melaneum
 
Toward a gui remote-sensing environment built over OTB
Toward a gui remote-sensing environment built over OTBToward a gui remote-sensing environment built over OTB
Toward a gui remote-sensing environment built over OTBmelaneum
 
Urban area detection and segmentation using OTB
Urban area detection and segmentation using OTBUrban area detection and segmentation using OTB
Urban area detection and segmentation using OTBmelaneum
 
The use of Orfeo Toolbox in the context of map updating
The use of Orfeo Toolbox in the context of map updatingThe use of Orfeo Toolbox in the context of map updating
The use of Orfeo Toolbox in the context of map updatingmelaneum
 
Assessment of interest points detection algorithms in OTB
Assessment of interest points detection algorithms in OTBAssessment of interest points detection algorithms in OTB
Assessment of interest points detection algorithms in OTBmelaneum
 
Image semantic coding using OTB
Image semantic coding using OTBImage semantic coding using OTB
Image semantic coding using OTBmelaneum
 
Reference algorithm implementations in OTB: textbook cases
Reference algorithm implementations in OTB: textbook casesReference algorithm implementations in OTB: textbook cases
Reference algorithm implementations in OTB: textbook casesmelaneum
 
The Orfeo Toolbox remote sensing image processing software
The Orfeo Toolbox remote sensing image processing softwareThe Orfeo Toolbox remote sensing image processing software
The Orfeo Toolbox remote sensing image processing softwaremelaneum
 

Más de melaneum (9)

Implementing kohonen's som with missing data in OTB
Implementing kohonen's som with missing data in OTBImplementing kohonen's som with missing data in OTB
Implementing kohonen's som with missing data in OTB
 
Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...
Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...
Overview of the PolSARpro V4.0 software. The open source toolbox for polarime...
 
Toward a gui remote-sensing environment built over OTB
Toward a gui remote-sensing environment built over OTBToward a gui remote-sensing environment built over OTB
Toward a gui remote-sensing environment built over OTB
 
Urban area detection and segmentation using OTB
Urban area detection and segmentation using OTBUrban area detection and segmentation using OTB
Urban area detection and segmentation using OTB
 
The use of Orfeo Toolbox in the context of map updating
The use of Orfeo Toolbox in the context of map updatingThe use of Orfeo Toolbox in the context of map updating
The use of Orfeo Toolbox in the context of map updating
 
Assessment of interest points detection algorithms in OTB
Assessment of interest points detection algorithms in OTBAssessment of interest points detection algorithms in OTB
Assessment of interest points detection algorithms in OTB
 
Image semantic coding using OTB
Image semantic coding using OTBImage semantic coding using OTB
Image semantic coding using OTB
 
Reference algorithm implementations in OTB: textbook cases
Reference algorithm implementations in OTB: textbook casesReference algorithm implementations in OTB: textbook cases
Reference algorithm implementations in OTB: textbook cases
 
The Orfeo Toolbox remote sensing image processing software
The Orfeo Toolbox remote sensing image processing softwareThe Orfeo Toolbox remote sensing image processing software
The Orfeo Toolbox remote sensing image processing software
 

Último

DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 

Último (20)

DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 

Object counting in high resolution remote sensing images with OTB

  • 1. Motivation Original Simplified Conclusion Object counting in high resolution remote sensing images with OTB E. Christophe1 , J. Inglada2 1 C ENTRE FOR R EMOTE I MAGING , S ENSING AND P ROCESSING , N ATIONAL U NIVERSITY OF S INGAPORE 2 C ENTRE N ATIONAL D ’É TUDES S PATIALES , TOULOUSE , F RANCE IGARSS 2009, Cape Town
  • 2. Motivation Original Simplified Conclusion Outline Motivation Original solution Workflow Pan Sharpening Classification Segmentation: Mean shift Vector data Simplified versions Trade-off Description Results Conclusion IGARSS 2009, Cape Town
  • 3. Motivation Original Simplified Conclusion Motivation Object counting Correspond to a wide range of problems for remote sensing data users Often have to be performed on large area Time consuming Examples Houses in a city: particularly for country where urban planning data is not available Tents in refugee camp Tree stands in a field IGARSS 2009, Cape Town
  • 4. Motivation Original Simplified Conclusion PRRS 2008 algorithm performance contest Time constraints: can’t spend months refining the algorithm Deliver a result: whole processing chain required Each step can be improved Goal: illustrate the on the shelf approach Contest Count the building from a Quickbird scene over Legaspi, Philippines XS and Pan images were provided Aksoy et al., ”Performance evaluation of building detection and digital surface model extraction algorithms: Outcomes of the PRRS 2008 algorithm performance contest,” in 5th IAPR Workshop on Pattern Recognition in Remote Sensing, Tampa, Florida, Dec. 2008. IGARSS 2009, Cape Town
  • 5. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Outline Motivation Original solution Workflow Pan Sharpening Classification Segmentation: Mean shift Vector data Simplified versions Trade-off Description Results Conclusion IGARSS 2009, Cape Town
  • 6. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Pan Mul IGARSS 2009, Cape Town
  • 7. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Pan Pan sharpening Mul IGARSS 2009, Cape Town
  • 8. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Classification Pan Pan sharpening Mul IGARSS 2009, Cape Town
  • 9. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Classification Pan Pan sharpening Segmentation Mul IGARSS 2009, Cape Town
  • 10. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Classification Pan Pan sharpening Segmentation Vectorization Mul IGARSS 2009, Cape Town
  • 11. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Classification Pan Pan sharpening Segmentation Vectorization Mul Edge dectect. IGARSS 2009, Cape Town
  • 12. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Classification Pan Pan sharpening Segmentation Vectorization Refinement Mul Edge dectect. IGARSS 2009, Cape Town
  • 13. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Algorithm description Classification Pan Pan sharpening Segmentation Vectorization Refinement Obj Mul Edge dectect. IGARSS 2009, Cape Town
  • 14. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Preprocessing Pansharpening The pansharpening is the first step to perform to take advantage of the high resolution of the Panchromatic band (61 cm) with the four spectral bands of the multispectral. Pan Mul Pan Shapening IGARSS 2009, Cape Town
  • 15. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Classification Obvious sources of errors There is some obvious sources of error: boat in the middle of the water which look like houses, cars in the middle of the street Classification (used as a mask) can help remove these sources of error Classification Here we used a simple classification by SVM Non classification specialists just provided a few samples per class (water, vegetation, road, shadows, 4 colors of buildings) Only a pixel classification: no use of texture here (that was before all the textures were introduces in OTB) IGARSS 2009, Cape Town
  • 16. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data QB scene Land cover classification IGARSS 2009, Cape Town
  • 17. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Segmentation: Mean shift Too much details Higher resolution is better but. . . sometimes, you would like less details (roof superstructures, cars) What details to remove? Mean shift algorithm D. Commaniciu,“Mean shift: A robust approach toward feature space analysis,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603–619, May 2002. IGARSS 2009, Cape Town
  • 18. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Pan Sharpened Mean shift clustering IGARSS 2009, Cape Town
  • 19. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Refining the boundaries Simplification Easier to handle vector data than raster: vectorization The vectorization led to too many contour point: simplification of the points which are roughly aligned Fine adjustment Using an image contour as an input, an energy is computed along the polygon contour Introducing a random perturbation in the position of each point, the energy is maximized Only a very basic optimization used here (ground for improvement) IGARSS 2009, Cape Town
  • 20. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Filtering Filtering on compacity Buildings are usually compact A C = 4π L2 IGARSS 2009, Cape Town
  • 21. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Performances on the contest Results Two results were submitted with a difference mainly in the classification One result was very close with 3600 building detected for 3065 in the ground truth Interesting to see that most other algorithms tend to underdetection while the proposed algorithm tends to overdetect. Evaluation criteria {Correct, over, under, missed} detection and false alarm rates based on Overlapping Area Matrix Maximum-weight bipartite graph matching Normalized Hamming distance Clustering indices (Fowlkes-Mallows and Jaccard index) IGARSS 2009, Cape Town
  • 22. Motivation Original Simplified Conclusion Workflow PanSharp Classif. Segment. Vector data Performances on the contest Conclusion on these results Particularly hard to conclude given the wide variety of criteria: organizer of the contest have been careful not to declare an overall winner However, the proposed methods provided good performances (particularly on the clusterings indices criteria) with a bias towards over segmentation. IGARSS 2009, Cape Town
  • 23. Motivation Original Simplified Conclusion Trade-off Description Results Outline Motivation Original solution Workflow Pan Sharpening Classification Segmentation: Mean shift Vector data Simplified versions Trade-off Description Results Conclusion IGARSS 2009, Cape Town
  • 24. Motivation Original Simplified Conclusion Trade-off Description Results Trade-off of the previous method Drawbacks The previous method relies on the classification of the image require a good understanding of the algorithm that follow influence significantly the output Simplified version different trade-offs on complexity-performance remove the classification step just require the operator to click on several (2 to 5) examples of objects IGARSS 2009, Cape Town
  • 25. Motivation Original Simplified Conclusion Trade-off Description Results Simplified version Algorithm Produce a likelihood map of the region containing the objects of interest Followed by the same step as the previous algorithm: segmentation, vectorization,. . . Likelihood map: 2 choices Spectral angle One class SVM IGARSS 2009, Cape Town
  • 26. Motivation Original Simplified Conclusion Trade-off Description Results Algorithm description One class SVM Spectral angle Pan Pan sharpening Segmentation Vectorization Refinement Obj Mul Edge dectect. IGARSS 2009, Cape Town
  • 27. Motivation Original Simplified Conclusion Trade-off Description Results Results of the simplified version Poorer preformances Not as good as the original one (expected) ⇒ required to understand the algorithm Advice Spectral angle: spectral characteristics of the objects are stable SVM: better when object have radiometric differences but more samples are required IGARSS 2009, Cape Town
  • 28. Motivation Original Simplified Conclusion Outline Motivation Original solution Workflow Pan Sharpening Classification Segmentation: Mean shift Vector data Simplified versions Trade-off Description Results Conclusion IGARSS 2009, Cape Town
  • 29. Motivation Original Simplified Conclusion Conclusion Modular processing chain An application with GUI is available It can be used for processing remote sensing images (no constraint on the size) Can be easily modified and improved as the steps are modular and follow the pipeline philosophy. IGARSS 2009, Cape Town