SlideShare a Scribd company logo
1 of 92
Download to read offline
DIGITAL IMAGE
              CLASSIFICATION

                         Photogrammetry & RS division
Digital Classification               iirs
Main lecture topics
• What is it and why use it?
• Image space versus feature space
• Distances in feature space
• Decision boundaries in feature space
• Unsupervised versus supervised training
• Classification algorithms
• Validation (how good is the result?)
• Problems




                                      Photogrammetry & RS division
  Digital Classification                          iirs
What is Digital Image Classification
· Multispectral classification is the process of sorting pixels into
a finite number of individual classes, or categories of data,
based on their data file values. If a pixel satisfies a certain set of
criteria , the pixel is assigned to the class that corresponds to
that criteria.
 Multispectral classification may be performed using a variety
of algorithms
•Hard classification        using   supervised    or    unsupervised
approaches.
• Classification using fuzzy logic, and/or
• Hybrid approaches often involving use of ancillary
information.
                                                 Photogrammetry & RS division
   Digital Classification                                    iirs
What is Digital Image
                        Classification
• grouping of similar
  features
• separation of dissimilar
  ones
• assigning class label to
  pixels
• resulting in manageable
  size of classes




                                       Photogrammetry & RS division
    Digital Classification                         iirs
CLASSIFICATION METHODS
MANUAL
• visual interpretation
• combination of spectral and spatial information

COMPUTER ASSISTED
• mainly spectral information

STRATIFIED
• using GIS functionality to incorporate
• knowledge from other sources of information


                                  Photogrammetry & RS division
 Digital Classification                       iirs
Why use it?
• To translate continuous variability of image
  data into map patterns that provide meaning
  to the user.
• To obtain insight in the data with respect to
  ground cover and surface characteristics.
• To find anomalous patterns in the image data
  set.




                                          Photogrammetry & RS division
   Digital Classification                             iirs
Why use it? (advantages)

• Cost efficient in the analyses of large data
  sets
• Results can be reproduced
• More objective then visual interpretation
• Effective analysis of complex multi-band
  (spectral) interrelationships



                                Photogrammetry & RS division
 Digital Classification                     iirs
Dimensionality of
                         Data

• Spectral Dimensionality is determined by
  the number of sets of values being used in
  a process.
• In image processing, each band of data is
  a set of values. An image with four bands
  of data is said to be four-dimensional
  (Jensen, 1996).

                                   Photogrammetry & RS division
   Digital Classification                      iirs
Measurement Vector
• The measurement vector of a pixel is the
  set of data file values for one pixel in all n
  bands.
• Although image data files are stored band-
  by-band, it is often necessary to extract the
  measurement vectors for individual pixels.



                                 Photogrammetry & RS division
  Digital Classification                     iirs
Photogrammetry & RS division
Digital Classification               iirs
Mean Vector
•When the measurement vectors of several pixels are analyzed,
a mean vector is often calculated.
•This is the vector of the means of the data file values in each
band. It has n elements.




        Mean Vector µI =


                                                Photogrammetry & RS division
  Digital Classification                                    iirs
Image space




           Single-band Image                             Multi-band Image


•         Image space (col,row)
•         array of elements corresponding to reflected
          or emitted energy from IFOV
•         spatial arrangement of the measurements of
          the reflected or emitted energy




                                                         Photogrammetry & RS division
    Digital Classification                                           iirs
Feature Space:
• A feature space image is simply a graph of
  the data file values of one band of data
  against the values of another band.

  ANALYZING PATTERNS IN MULTISPECTRAL DATA

       PIXEL A: 34,25,117
       PIXEL B: 34,24,119
       PIXEL C: 11,77,51




                                             Photogrammetry & RS division
   Digital Classification                                iirs
One-dimensional feature space

   Input layer



                          No distinction between classes




                                                     Distinction between classes



                                                             Photogrammetry & RS division
 Digital Classification                                                  iirs
Feature Space Multi-dimensional




                         Feature vectors




                                           Photogrammetry & RS division
Digital Classification                                 iirs
Feature space (scattergram)


                             Low frequency




                                  High
                                  frequency




         Two/three     dimensional      graph     or   scattered    diagram
         formation of clusters of points representing DN values in two/three
         spectral                                                     bands

         each cluster of points corresponds to a certain cover type on ground
                                                                 Photogrammetry & RS division
Digital Classification                                                       iirs
Distances and clusters in feature space



   band y
   (units of 5 DN)                           .                     ..
                          .
                                                   Max y

                                                                .
                                                               ... .
                (0,0)     band x (units of 5 DN)   Min y       ..
                         Euclidian distance
                                                     (0,0)    Min x   Max x


                                                                      Cluster


                                                           Photogrammetry & RS division
Digital Classification                                                 iirs
Spectral Distance
Euclidean Spectral distance is distance in n- dimensional
spectral space. It is a number that allows two measurement
vectors to be compared for similarity. The spectral distance
between two pixels can be calculated as follows:




Where:
D = spectral distance
n = number of bands (dimensions)
i = a particular band
di = data file value of pixel d in band i
ei = data file value of pixel e in band i
This is the equation for Euclidean distance—in two dimensions (when n = 2), it
can be simplified to the Pythagorean Theorem (c2 = a2 + b2), or in this case:
D2 = (di - ei)2 + (dj - ej)2
                                                      Photogrammetry & RS division
   Digital Classification                                         iirs
General steps used to extract information from
                 General steps used to extract information from
                              Remotely sensed data
                             Remotely sensed data


        State the nature of classification problem
       State the nature of classification problem
              •Define region of interest
            •Define region of interest
              •Identify classes of interest
            •Identify classes of interest
        Acquire appropriate Remotely sensed and ground reference data
       Acquire appropriate Remotely sensed and ground reference data
        Image processing of Remotely sensed data to extract thematic
       Image processing of Remotely sensed data to extract thematic
        information
       information
              •Radiometric correction
             •Radiometric correction
              •Geometric correction
             •Geometric correction
        •Select appropriate image classification logic and algorithm
       •Select appropriate image classification logic and algorithm
                   oSupervised
                  oSupervised
                         -Parallelepiped and/or minimum distance
                        -Parallelepiped and/or minimum distance
                         -Maximum likelihood
                        -Maximum likelihood
                         -others
                        -others
                       oUnsupervised
                     oUnsupervised
                            -Chain method
                           -Chain method
                            -Multipass isodata
                           -Multipass isodata
                            -others
                           -others
                       oHybrid
                     oHybrid
                •Extract data from training sites.
               •Extract data from training sites.
         •Select most appropriate bands
        •Select most appropriate bands
         •Extract training statistics from final band selection
        •Extract training statistics from final band selection
         •Extract thematic information.
        •Extract thematic information.
         Error evaluation of classification map
        Error evaluation of classification map
         Output
        Output                                                    Photogrammetry & RS division
Digital Classification                                                        iirs
Image classification process
                                      2          4      Definition of the clusters in
    Selection of the
                                                        the feature space
1   image data


                             3




                      5      Validation of the result

                                                                 Photogrammetry & RS division
    Digital Classification                                                   iirs
• It is also important for the analyst to realize that
  there is a fundamental difference between
  information classes and spectral classes.

• * Information classes are those that human
  beings define.

• * Spectral classes are those that are inherent in
  the remote sensor data and must be identified
  and then labeled by the analyst.


                                     Photogrammetry & RS division
  Digital Classification                         iirs
SUPERVISED CLASSIFICATION :

•   The identity and location of some of the land cover types such as
    urban, agriculture, wetland are known a priori through a combination
    of field work and experience.

•   The analyst attempts to locate specific sites in the remotely sensed
    data that represent homogenous examples of these known land
    cover types known as training sites.

•   Multivariate statistical parameters are calculated for these training
    sites.

•   Every pixel both inside and outside the training sites is evaluated
    and assigned to the class of which it has the highest likelihood of
    being a member.


                                                  Photogrammetry & RS division
    Digital Classification                                    iirs
Supervised image classification
Steps in supervised
classification
    • Identification of sample
    areas (training areas)
    • Partitioning of the         A class sample
    feature space                     • Is a number of
                                      training pixels
                                      •Forms a cluster in
                                      feature space

A cluster
    • Is the representative for
    a class
    • Includes a minimum
    number of observations
    (30*n)
    • Is distinct
                                               Photogrammetry & RS division
 Digital Classification                                    iirs
UNSUPERVISED CLASSIFICATION :

• The identities of land cover types to be specified
  as classes within a scene are generally not
  known a priori because ground reference
  information is lacking or surface features within
  the scene are not well defined.
• The computer is required to group pixels with
  similar spectral characteristics into unique
  clusters according to some statistically
  determined criteria.
• Analyst then combine and relabels the spectral
  clusters into information classes.
                                   Photogrammetry & RS division
  Digital Classification                       iirs
Unsupervised image classification
•   Clustering algorithm
•    User defined cluster parameters
•    Class mean vectors are arbitrarily
      set by algorithm (iteration 0)
•    Class allocation of feature vectors
•    Compute new class mean vectors
•    Class allocation (iteration 2)
•    Re-compute class mean vectors
•    Iterations        continue       until
    convergence threshold has been
    reached
•    Final class allocation
•    Cluster statistics reporting



                                              Photogrammetry & RS division
     Digital Classification                               iirs
Supervised vs.
                      Unsupervised Training
•   In supervised training, it is important to have a set of desired classes
    in mind, and then create the appropriate signatures from the data.

•   Supervised classification is usually appropriate when you want to
    identify relatively few classes, when you have selected training sites
    that can be verified with ground truth data, or when you can identify
    distinct, homogeneous regions that represent each class.

•   On the other hand, if you want the classes to be determined by
    spectral distinctions that are inherent in the data so that you can
    define the classes later, then the application is better suited to
    unsupervised training. Unsupervised training enables you to define
    many classes easily, and identify classes that are not in contiguous,
    easily recognized regions.




                                                      Photogrammetry & RS division
      Digital Classification                                      iirs
UNSUPERVISED APPROACH

•      based on spectral groupings
•      considers only spectral
       distance measures
•      minimum user interaction
•      requires interpretation after
       classification

                                   SUPERVISED APPROACH

                                   •   based on spectral groupings
                                   •   incorporates prior knowledge
                                   •   maximum user interaction




                                                   Photogrammetry & RS division
    Digital Classification                                     iirs
SUPERVISED CLASSIFICATION
• In supervised training, you rely on your own
  pattern recognition skills and a priori
  knowledge of the data to help the system
  determine the statistical criteria (signatures)
  for data classification.
• To select reliable samples, you should know
  some      information—either       spatial   or
  spectral—about the pixels that you want to
  classify.

                                 Photogrammetry & RS division
  Digital Classification                     iirs
The challenge:

   The problem is that all pixels, or
   rather their feature vector, must be
   compared to predifined clusters,
   and that rules for that comparison
   must be set up. The clusters have
   to be defined with the help of
   training sets

                                Photogrammetry & RS division
Digital Classification                      iirs
Partition of a feature space


        class a

                                                  • decide on
                                                  decision
                                   class c        boundaries

     class b                                 • assign a class
                                             to each pixel
                         class d



                                              Photogrammetry & RS division
Digital Classification                                    iirs
Training Samples and
                   Feature Space Objects

• Training samples (also called samples)
  are sets of pixels that represent what is
  recognized as a discernible pattern, or
  potential class. The system calculates
  statistics from the sample pixels to create
  a parametric signature for the class.




                                      Photogrammetry & RS division
   Digital Classification                         iirs
Selecting Training
                                Samples

• Training data for a class should be
  collected from homogeneous environment.
• Each site is usually composed of many
  pixels-the general rule is that if training
  data is being collected from n bands then
  >10n pixels of training data is to be
  collected for each class. This is sufficient
  to compute variance-covariance matrices
  required by some classification algorithms.

                                                 Photogrammetry & RS division
   Digital Classification                                    iirs
There are a number of ways to collect training site data-

      •using a vector layer
      • defining a polygon in the image
      • identifying a training sample of contiguous pixels with
      similar spectral characteristics
      • identifying a training sample of contiguous pixels within a
      certain area, with or without similar spectral characteristics
      • using a class from a thematic raster layer from an image
      file of the same area (i.e., the result of an unsupervised
      classification)


      Once the training sites are collected, The mean ,standard
      deviation, variance etc. are computed for each class.



                                                 Photogrammetry & RS division
Digital Classification                                       iirs
Evaluating
                             Signatures

• There are tests to perform that can help
  determine whether the signature data are a true
  representation of the pixels to be classified for
  each class. You can evaluate signatures that
  were created either from supervised or
  unsupervised training.




                                          Photogrammetry & RS division
    Digital Classification                            iirs
Evaluation of Signatures

• Ellipse—view ellipse diagrams and scatterplots of data file
  values for every pair of bands.




                                           Photogrammetry & RS division
    Digital Classification                             iirs
Evaluation of Signatures…………..
Signature separability is a statistical measure of distance between
   two signatures. Separability can be calculated for any combination
   of bands that is used in the classification, enabling you to rule out
   any bands that are not useful in the results of the classification.

1. Euclidian Distance:




 Where:
 D = spectral distance
 n = number of bands (dimensions)
 i = a particular band
 di = data file value of pixel d in band i
 ei = data file value of pixel e in band i

                                               Photogrammetry & RS division
 Digital Classification                                    iirs
Signature Seperability………

2. Divergence




                                      Photogrammetry & RS division
 Digital Classification                           iirs
Signature Seperability………
3. Transformed Divergence




The scale of the divergence values can range from 0 to 2,000. As a
general rule, if the result is greater than 1,900, then the classes can be
separated. Between 1,700 and 1,900, the separation is fairly good. Below
1,700, the separation is poor (Jensen, 1996).

                                                 Photogrammetry & RS division
   Digital Classification                                    iirs
Signature Seperability………
4. Jeffries-Matusita Distance




 Range of JM is between 0 and 1414. The JM distance has a saturating
behavior with increasing class separation like transformed divergence.
However, it is not as computationally efficient as transformed divergence”
(Jensen, 1996).

                                                     Photogrammetry & RS division
    Digital Classification                                       iirs
SELECTING APPROPRIATE
     CLASSIFICATION ALGORITHM
• Various supervised classification algorithms may be
  used to assign an unknown pixel to one of the classes.
• The choice of particular classifier depends on nature of
  input data and output required.
• Parametric classification algorithms assume that the
  observed measurement vectors Xc , obtained for each
  class in each spectral band during the training phase are
  Gaussian in nature.
• Non Parametric classification algorithms make no such
  assumptions.
• There are many classification algorithms i.e.
  Parallelepiped, Minimum distance, Maximum Likelihood
  etc.


                                        Photogrammetry & RS division
  Digital Classification                            iirs
PARALLELEPIPED CLASSIFICATION
         ALGORITHM
   In the parallelepiped decision rule, the data file values of the
   candidate pixel are compared to upper and lower limits. These
   limits can be either:
1. the minimum and maximum data file values of each band in the
   signature,
2. the mean of each band, plus and minus a number of standard
   deviations, or
3. any limits that you specify, based on your knowledge of the data
   and signatures.
    There are high and low limits for every signature in
    every band. When a pixel’s data file values are between
    the limits for every band in a signature, then the pixel is
    assigned to that signature’s class.


                                              Photogrammetry & RS division
 Digital Classification                                   iirs
• Therefore, if the low and high decision
  boundaries are defined as
Lck= µck - Sck
and
 Hck= µck + Sck
• The parallelepiped algorithm becomes
Lck ≤ BVijk ≤ Hck



                             Photogrammetry & RS division
Digital Classification                   iirs
Means and Standard Deviations                  Partitioned Feature Space
   255                                     255

Band 2                                  Band 2




     0                                       0
         0                 Band 1 255             0               Band 1 255


             Feature Space Partitioning - Box classifier


                                                           Photogrammetry & RS division
  Digital Classification                                               iirs
Class “unknown”




                         Photogrammetry & RS division
Digital Classification               iirs
Points a and b are pixels in
                         the image to be classified.
                         Pixel a has a brightness value
                         of 40 in band 4 and 40 in
                         band 5. Pixel b has a
                         brightness value of 10 in band
                         4 and 40 in band 5. The boxes
                         represent the parallelepiped
                         decision rule associated with
                         a ±1s classification. The
                         vectors (arrows) represent the
                         distance from a and b to the
                         mean of all classes in a
                         minimum distance to means
                         classification algorithm.




                              Photogrammetry & RS division
Digital Classification                    iirs
Photogrammetry & RS division
Digital Classification               iirs
Overlap Region

In cases where a pixel may fall into the overlap region of
   two or more parallelepipeds, you must define how the
   pixel can be classified.

• The pixel can be classified by the order of the
  signatures.

• The pixel can be classified by the defined parametric
  decision rule.

• The pixel can be left unclassified.



                                        Photogrammetry & RS division
 Digital Classification                             iirs
ADVANTAGES:
  Fast and simple.
  Gives a broad classification thus narrows down the number of
possible classes to which each pixel can be assigned before more
time consuming calculations are made.
  Not dependent on normal distributions.

DISADVANTAGES:
  Since parallelepiped has corners, pixels that are actually quite far,
spectrally from the mean of the signature may be classified



                                          Parallelepiped Corners
                                          Compared to the
                                          Signature Ellipse




                                                Photogrammetry & RS division
Digital Classification                                      iirs
MINIMUM DISTANCE TO MEANS
    CLASSIFICATION ALGORITHM
   This decision rule is computationally simple and commonly
   used.
   Requires mean vectors for each class in each band µck from
   the training data.
   Euclidean distance is calculated for all the pixels with all the
   signature means
                  D = √ (BVijk- µck)2 + (BVijl- µcl)2
Where
µck and µcl represent the mean vectors for class c measured in
   bands k and l
   Any unknown pixel will definitely be assigned to one of any
   classes, there will be no unclassified pixel.



                                             Photogrammetry & RS division
 Digital Classification                                  iirs
MINIMUM DISTANCE TO MEANS


                                                Histogram of training set


                            300

                            200

                            100

                            0

                                  0   31   63     95   127    159   191     223   255




Decision rule:
Priority to the shortest distance to the class mean

                                                               Photogrammetry & RS division
   Digital Classification                                                  iirs
Feature Space Partitioning - Minimum Distance
              to Mean Classifier

                                                255


                           "Unknown"


                      Mean vectors           Band 2
                255




                                                  0
             Band 2                                   0       Band 1     255


                                                255




                 0
                      0       Band 1   255

                                             Band 2




                                                 0
                                                          0     Band 1    255


                                                      Threshold Distance

                                                                 Photogrammetry & RS division
 Digital Classification                                                      iirs
ADVANTAGES:
• Since every pixel is spectrally closer to
  either one sample mean or other so there
  are no unclassified pixels.
• Fastest after parallelepiped decision rule.
DISADVANTAGES:
• Pixels which should be unclassified will
  become classified.
• Does not consider class variability.


                             Photogrammetry & RS division
Digital Classification                   iirs
Mahalanobis Decision Rule
•   Mahalanobis distance is similar to minimum distance, except that
    the covariance matrix is used in the equation. Variance and
    covariance are figured in so that clusters that are highly varied lead
    to similarly varied classes,




                                                    Photogrammetry & RS division
    Digital Classification                                      iirs
Advantages
• Takes the variability of classes into account, unlike
  minimum distance or parallelepiped.
• May be more useful than minimum distance in cases
  where statistical criteria (as expressed in the covariance
  matrix) must be taken into account
Disadvantages
• Tends to overclassify signatures with relatively large
  values in the covariance matrix.
• Slower to compute than parallelepiped or minimum
  distance.
• Mahalanobis distance is parametric, meaning that it
  relies heavily on a normal distribution of the data in each
  input band.


                                          Photogrammetry & RS division
   Digital Classification                             iirs
Maximum Likelihood/Bayesian
           Decision Rule
• The maximum likelihood decision rule is based on the
  probability that a pixel belongs to a particular class. The
  basic equation assumes that these probabilities are
  equal for all classes, and that the input bands have
  normal distributions.
• If you have a priori knowledge that the probabilities are
  not equal for all classes, you can specify weight factors
  for particular classes. This variation of the maximum
  likelihood decision rule is known as the Bayesian
  decision rule (Hord, 1982).



                                           Photogrammetry & RS division
    Digital Classification                             iirs
•   The equation for the maximum likelihood/Bayesian classifier is as
    follows:




     The pixel is assigned to the class, c, for which D is the lowest.

                                                     Photogrammetry & RS division
     Digital Classification                                      iirs
Photogrammetry & RS division
Digital Classification               iirs
Advantages
•   The most accurate of the classifiers (if the input samples/clusters
    have a normal distribution), because it takes the most variables into
    consideration.
•   Takes the variability of classes into account by using the covariance
    matrix, as does Mahalanobis distance.
Disadvantages
•   An extensive equation that takes a long time to compute. The
    computation time increases with the number of input bands.
•   Maximum likelihood is parametric, meaning that it relies heavily on a
    normal distribution of the data in each input band.
• Tends to overclassify signatures with relatively large
  values in the covariance matrix.



                                                  Photogrammetry & RS division
    Digital Classification                                    iirs
UNSUPERVISED CLASSIFICATION
• It requires only a minimum amount of initial input from the
  analyst.
• Numerical operations are performed that search for natural
  groupings of the spectral properties of pixels.
• User allows computer to select the class means and
  covariance matrices to be used in the classification.
• Once the data are classified, the analyst attempts a posteriori
  to assign these natural or spectral classes to the information
  classes of interest.
• Some clusters may be meaningless because they represent
  mixed classes.
• Clustering algorithm used for the unsupervised classification
  generally vary according to the efficiency with which the
  clustering takes place.
• Two commonly used methods are-
   – Chain method
   – Isodata clustering

                                            Photogrammetry & RS division
  Digital Classification                                iirs
CHAIN METHOD
• Operates in two pass mode( it passes through the
  registered multispectral dataset two times).
• In the first pass the program reads through the dataset
  and sequentially builds clusters.
• A mean vector is associated with each cluster.
• In the second pass a minimum distance to means
  classification algorithm is applied to whole dataset on a
  pixel by pixel basis whereby each pixel is assigned to
  one of the mean vectors created in pass 1.
• The first pass automatically creates the cluster
  signatures to be used by supervised classifier.



                                        Photogrammetry & RS division
  Digital Classification                            iirs
PASS 1: CLUSTER BUILDING

• During the first pass the analyst is required to
  supply four types of information-
• R , the radius distance in spectral space used to
  determine when a new cluster should be formed.
• C, a spectral space distance parameter used
  when merging clusters when N is reached.
• N , the number of pixels to be evaluated between
  each major merging of clusters.
• Cmax maximum no. of clusters to be identified.

PASS 2: Assignment of pixels to one of the Cmax
  clusters using minimum distance classification logic


                                    Photogrammetry & RS division
   Digital Classification                       iirs
Original brightness values of pixels 1, 2, and
        3 as measured in Bands 4 and 5 of the
           hypothetical remote sensed data.

                                             Photogrammetry & RS division
Digital Classification                                   iirs
The distance (D) in 2-dimensional spectral space between pixel 1
(cluster 1) and pixel 2 (potential cluster 2) in the first iteration is
computed and tested against the value of R=15, the minimum
acceptable radius. In this case, D does not exceed R. Therefore, we
merge clusters 1 and 2 as shown in the next illustration.

                                                  Photogrammetry & RS division
Digital Classification                                        iirs
Pixels 1 and 2 now represent cluster #1. Note that the location of cluster 1 has
migrated from 10,10 to 15,15 after the first iteration. Now, pixel 3 distance
(D=15.81) is computed to see if it is greater than the minimum threshold, R=15. It
is, so pixel location 3 becomes cluster #2. This process continues until all 20
clusters are identified. Then the 20 clusters are evaluated using a distance measure,
C (not shown), to merge the clusters that are closest to one another.


                                                          Photogrammetry & RS division
 Digital Classification                                               iirs
How clusters migrate during the several iterations of a clustering
 algorithm. The final ending point represents the mean vector that
 would be used in phase 2 of the clustering process when the
 minimum distance classification is performed.

                                               Photogrammetry & RS division
Digital Classification                                     iirs
• Note: As more points are added to a cluster, the mean
shifts less dramatically since the new computed mean is
weighted by the number of pixels currently in a cluster.
The ending point is the spectral location of the final
mean vector that is used as a signature in the minimum
distance classifier applied in pass 2.

• Some clustering algorithms allow the analyst to
initially seed the mean vector for several of the
important classes. The seed data are usually obtained in
a supervised fashion, as discussed previously. Others
allow the analyst to use a priori information to direct the
clustering process.


                                            Photogrammetry & RS division
Digital Classification                                  iirs
Pass 2: Assignment of Pixels to One of the Cmax Clusters Using
  Minimum Distance Classification Logic

  The final cluster mean data vectors are used in a
  minimum distance to means classification algorithm to
  classify all the pixels in the image into one of the Cmax
  clusters.




                                                Photogrammetry & RS division
Digital Classification                                      iirs
ISODATA Clustering
The Iterative Self-Organizing Data Analysis Technique (ISODATA)
represents a comprehensive set of heuristic (rule of thumb) procedures that
have been incorporated into an iterative classification algorithm.

The ISODATA algorithm is a modification of the k-means clustering
algorithm, which includes a) merging clusters if their separation distance in
multispectral feature space is below a user-specified threshold and b) rules
for splitting a single cluster into two clusters.

ISODATA is iterative because it makes a large number of passes
through the remote sensing dataset until specified results are
obtained, instead of just two passes.

ISODATA does not allocate its initial mean vectors based on the
analysis of pixels rather, an initial arbitrary assignment of all Cmax
clusters takes place along an n-dimensional vector that runs between
very specific points in feature space.
                                                       Photogrammetry & RS division
   Digital Classification                                          iirs
ISODATA algorithm normally requires the analyst
  to specify-
       Cmax : maximum no. of clusters to be identified.
       T:maximum % of pixels whose class values are
       allowed to be unchanged between iterations.
       M :maximum no. of times isodata is to classify pixels
       and recalculate cluster mean vectors.
       Minimum members in a cluster
       Maximum standard deviation for a cluster.
       Split separation value (if the valuse is changed from 0.0, it takes
       the place of S.D. )
       Minimum distance between cluster means.


                                                  Photogrammetry & RS division
 Digital Classification                                       iirs
Phase 1: ISODATA Cluster Building using many
passes through the dataset.
                             a)   ISODATA initial distribution of five
                                  hypothetical mean vectors using ±1s standard
                                  deviations in both bands as beginning and
                                  ending points.
                             b)   In the first iteration, each candidate pixel is
                                  compared to each cluster mean and assigned
                                  to the cluster whose mean is closest in
                                  Euclidean distance.
                             c)   During the second iteration, a new mean is
                                  calculated for each cluster based on the actual
                                  spectral locations of the pixels assigned to
                                  each cluster, instead of the initial arbitrary
                                  calculation. This involves analysis of several
                                  parameters to merge or split clusters. After
                                  the new cluster mean vectors are selected,
                                  every pixel in the scene is assigned to one of
                                  the new clusters.
                             d)   This split–merge–assign process continues
                                  until there is little change in class assignment
                                  between iterations (the T threshold is
                                  reached) or the maximum number of
                                  iterations is reached (M).



                                            Photogrammetry & RS division
   Digital Classification                               iirs
a) Distribution of 20 ISODATA
                            mean vectors after just one
                            iteration
                         b) Distribution of 20 ISODATA
                            mean vectors after 20 iterations.
                            The bulk of the important
                            feature     space      (the    gray
                            background) is partitioned rather
                            well after just 20 iterations.




                                       Photogrammetry & RS division
Digital Classification                             iirs
Sources of Uncertainty in Image
 Classification

1.Non-representative training areas

2. High variability in the spectral
  signatures for a land cover class

3. Mixed land cover within the pixel area


                             Photogrammetry & RS division
Digital Classification                   iirs
Evaluating
                          Classification

• After a classification is performed, these
  methods are available for testing the accuracy of
  the classification:

• Thresholding—Use a probability image file to
  screen out misclassified pixels.
• Accuracy Assessment —Compare the
  classification to ground truth or other data.


                                           Photogrammetry & RS division
 Digital Classification                                iirs
Accuracy Assessment
Accuracy assessment is a general term for
comparing the classification to geographical data
that are assumed to be true, in order to determine
the accuracy of the classification process. Usually,
the assumed-true data are derived from ground
truth data.




                                  Photogrammetry & RS division
 Digital Classification                       iirs
Accuracy Assesement……


• Assessing accuracy of a remote sensing
  output is one of the most important steps
  in any classification exercise!!
• Without an accuracy assessment the
  output or results is of little value.




                                      Photogrammetry & RS division
  Digital Classification                          iirs
There are a number of issues relevant to the generation
and assessment of errors in a classification.

These include:

• the nature of the classification;
• Sample design and
• assessment sample size.




                                       Photogrammetry & RS division
 Digital Classification                            iirs
Nature of Classification:

– 1) Class definition problems occur when trying to extract information
   from a image, such as tree height, which is unrealistic. If this
   happens the error rate will increase.

– 2) A common problem is classifying remotely sensed data is to use
   inappropriate class labels, such as cliff, lake or river all of which are
   landforms and not cover-types. Similarly a common error is that of
   using class labels which define land-uses. These features are
   commonly made up of several cover classes.

– 3) The final point here, in terms of the potential for generation of error
   is the mislabeling of classes. The most obvious example of this is to
   label a training site water when in fact it is something else. This will
   result in, at best a skewing of your class statistics if your training site
   samples are sufficiently large, or at worst shifting the training
   statistics entirely if your sites are relatively small.


                                                        Photogrammetry & RS division
      Digital Classification                                        iirs
Sample Design:
•   In addition to being independent of the original training sample the sample used must be
       of a design that will insure consistency and objectivity.

• A number of sampling techniques can be used. Some of these include random,
   systematic, and stratified random.

• Of the three the systematic sample is the least useful. This approach to sampling may
    result in a sample distribution which favours a particular class depending on the
    distribution of the classes within the map.

• Only random sample designs can guarantee an unbiased sample.

• The truly random strategy however may not yield a sample design that covers the entire
    map area, and so may be less than ideal.

• In many instances the stratified random sampling strategy is the most useful tool to use.
    In this case the map area is stratified based on either a systematic breakdown followed
    by a random sample design in each of the systematic subareas, or alternatively
    through the application of a random sample within each of the map classes. The use of
    this approach will ensure that one has an adequate cover for the entire map as well as
    generating a sufficient number of samples for each of the classes on the map


                                                                Photogrammetry & RS division
        Digital Classification                                              iirs
Sample Size:

• The size of the sample used must be sufficiently large to be
   statistically representative of the map area. The number of
   points considered necessary varies, depending on the
   method used to estimate.

• What this means is that when using a systematic or random
  sample size, the number of points are kept to a
  manageable number. Because the number of points
  contained within a stratified area is usually high, that is
  greater than 10000, the number of samples used to test
  the accuracy of the classes through a stratified random
  sample will be high as well, so the cost for using a highly
  accurate sampling strategy is a large number of samples

                                           Photogrammetry & RS division
   Digital Classification                              iirs
ERROR MATRIX

Once a classification has been sampled a
  contingency table (also referred to as an
  error matrix or confusion matrix) is
  developed.
• This table is used to properly analyze the
  validity of each class as well as the
  classification as a whole.
• In this way the we can evaluate in more
  detail the efficacy of the classification.



                                 Photogrammetry & RS division
  Digital Classification                     iirs
One way to assess accuracy is to go out in the field and observe the
   actual land class at a sample of locations, and compare to the
   land classification it was assigned on the thematic map.
• There are a number of ways to quantitatively express the amount
   of agreement between the ground truth classes and the remote
   sensing classes.
• One way is to construct a confusion error matrix, alternatively
   called a error matrix
• This is a row by column table, with as many rows as columns.
• Each row of the table is reserved for one of the information, or
   remote sensing classes used by the classification algorithm.
• Each column displays the corresponding ground truth classes in
   an identical order.




                                              Photogrammetry & RS division
 Digital Classification                                   iirs
OVERALL ACCURACY

•   The diagonal elements tally the number of pixels classified
    correctly in each class.




•   But just because 83% classifications were accurate overall, does
    not mean that each category was successfully classified at that
    rate.
                                                   Photogrammetry & RS division
       Digital Classification                                  iirs
USERS ACCURACY
• A user of the imagery who is particularly interested
   in class A, say, might wish to know what proportion
   of pixels assigned to class A were correctly
   assigned.
• In this example 35 of the 39 pixels were correctly
   assigned to class A, and the user accuracy in this
   category of 35/39 = 90%




                                        Photogrammetry & RS division
  Digital Classification                            iirs
In general terms, for a particular category is user    accuracy
   computed as:




• which, for an error matrix set up with the row and column
   assignments as stated, is computed as the user accuracy




• Evidently, a user accuracy can be computed for each row.



                                             Photogrammetry & RS division
 Digital Classification                                  iirs
PRODUCERS ACCURACY

• Contrasted to user accuracy is producer accuracy, which
    has a slightly different interpretation.
• Producers accuracy is a measure of how much of the land in
    each category was classified correctly.
• It is found, for each class or category, as




   The Producer’s accuracy for class A is 35/50 = 70%

                                                        Photogrammetry & RS division
    Digital Classification                                          iirs
So from this assessment we have three measures
  of accuracy which address subtly different issues:

– overall accuracy : takes no account of source of
  error
(errors of omission or commission)

– user accuracy : measures the proportion of each
  TM class which is correct.

– producer accuracy : measures the proportion of
  the land base which is correctly classified.


                                  Photogrammetry & RS division
  Digital Classification                      iirs
KAPPA COEFFICENT
•   Another measure of map accuracy is the kappa coefficient, which is a measure
      of the proportional (or percentage) improvement by the classifier over a
      purely random assignment to classes.

For an error matrix with r rows, and hence the same number of columns, let
         – A = the sum of r diagonal elements, which is the numerator in the
   computation of overall accuracy
   – Let B = sum of the r products (row total x column total).


• Then




• where N is the number of pixels in the error matrix
(the sum of all r individual cell values).

                                                        Photogrammetry & RS division
      Digital Classification                                        iirs
For the above error matrix,
  – A = 35 + 37 + 41 = 113
  – B = (39 * 50) + (50 * 40) + (47 * 46) = 6112
  – N = 136


  Thus




  This can be tested statistically.

                                               Photogrammetry & RS division
Digital Classification                                     iirs
Fuzzy Classification
• The Fuzzy Classification method takes into account that
  there are pixels of mixed make-up, that is, a pixel cannot
  be definitively assigned to one category.
• Fuzzy classification is designed to help you work with
  data that may not fall into exactly one category or
  another. Fuzzy classification works using a membership
  function, wherein a pixel’s value is determined by
  whether it is closer to one class than another.
• Like traditional classification, fuzzy classification still
  uses training, but the biggest difference is that “it is also
  possible to obtain information on the various constituent
  classes found in a mixed pixel. . .”



                                            Photogrammetry & RS division
    Digital Classification                              iirs
Photogrammetry & RS division
Digital Classification               iirs
Expert
                           Classification

• The expert classification provides a rules-based
  approach to multispectral image classification, post-
  classification refinement, and GIS modeling. In essence,
  an expert classification system is a hierarchy of rules, or
  a decision tree, that describes the conditions under
  which a set of low level constituent information gets
  abstracted into a set of high level informational classes.




                                            Photogrammetry & RS division
  Digital Classification                                iirs
Components of a Typical Rule-based Expert System




                                               Photogrammetry & RS division
Digital Classification                                     iirs

More Related Content

What's hot

Digital image processing 1
Digital  image processing 1Digital  image processing 1
Digital image processing 1Dhaval Jalalpara
 
Digital Elevation Models
Digital Elevation ModelsDigital Elevation Models
Digital Elevation ModelsBernd Flmla
 
Introduction and Application of GIS
Introduction and Application of GISIntroduction and Application of GIS
Introduction and Application of GISSatish Taji
 
07 Image classification.pptx
07 Image classification.pptx07 Image classification.pptx
07 Image classification.pptxeshitaakter2
 
Digital image processing
Digital image processingDigital image processing
Digital image processingVandana Verma
 
Thermal remote sensing
Thermal remote sensingThermal remote sensing
Thermal remote sensingSakthivel R
 
Gis powerpoint
Gis powerpointGis powerpoint
Gis powerpointkaushdave
 
Change detection using remote sensing and GIS
Change detection using remote sensing and GISChange detection using remote sensing and GIS
Change detection using remote sensing and GISTilok Chetri
 
Orthorectification and triangulation
Orthorectification and triangulationOrthorectification and triangulation
Orthorectification and triangulationMesfin Yeshitla
 
Remote sensing and digital image processing
Remote sensing and digital image processingRemote sensing and digital image processing
Remote sensing and digital image processingDocumentStory
 
Image enhancement technique digital image analysis, in remote sensing ,P K MANI
Image enhancement technique  digital image analysis, in remote sensing ,P K MANIImage enhancement technique  digital image analysis, in remote sensing ,P K MANI
Image enhancement technique digital image analysis, in remote sensing ,P K MANIP.K. Mani
 
Remote sensing: Accuracy Assesment
Remote sensing: Accuracy AssesmentRemote sensing: Accuracy Assesment
Remote sensing: Accuracy AssesmentKamlesh Kumar
 
hyperspectral remote sensing and its geological applications
hyperspectral remote sensing and its geological applicationshyperspectral remote sensing and its geological applications
hyperspectral remote sensing and its geological applicationsabhijeet_banerjee
 
Introduction to Landsat
Introduction to LandsatIntroduction to Landsat
Introduction to LandsatNizam GIS
 
Arc gis introduction-ppt
Arc gis introduction-pptArc gis introduction-ppt
Arc gis introduction-pptAshok Peddi
 

What's hot (20)

Digital image processing 1
Digital  image processing 1Digital  image processing 1
Digital image processing 1
 
Digital Elevation Models
Digital Elevation ModelsDigital Elevation Models
Digital Elevation Models
 
Introduction and Application of GIS
Introduction and Application of GISIntroduction and Application of GIS
Introduction and Application of GIS
 
Geographic information system
Geographic information systemGeographic information system
Geographic information system
 
07 Image classification.pptx
07 Image classification.pptx07 Image classification.pptx
07 Image classification.pptx
 
Digital image processing
Digital image processingDigital image processing
Digital image processing
 
Thermal remote sensing
Thermal remote sensingThermal remote sensing
Thermal remote sensing
 
Introduction to gis
Introduction to gisIntroduction to gis
Introduction to gis
 
Gis powerpoint
Gis powerpointGis powerpoint
Gis powerpoint
 
Change detection using remote sensing and GIS
Change detection using remote sensing and GISChange detection using remote sensing and GIS
Change detection using remote sensing and GIS
 
Orthorectification and triangulation
Orthorectification and triangulationOrthorectification and triangulation
Orthorectification and triangulation
 
Remote sensing and digital image processing
Remote sensing and digital image processingRemote sensing and digital image processing
Remote sensing and digital image processing
 
Image enhancement technique digital image analysis, in remote sensing ,P K MANI
Image enhancement technique  digital image analysis, in remote sensing ,P K MANIImage enhancement technique  digital image analysis, in remote sensing ,P K MANI
Image enhancement technique digital image analysis, in remote sensing ,P K MANI
 
Remote sensing: Accuracy Assesment
Remote sensing: Accuracy AssesmentRemote sensing: Accuracy Assesment
Remote sensing: Accuracy Assesment
 
hyperspectral remote sensing and its geological applications
hyperspectral remote sensing and its geological applicationshyperspectral remote sensing and its geological applications
hyperspectral remote sensing and its geological applications
 
Introduction to Landsat
Introduction to LandsatIntroduction to Landsat
Introduction to Landsat
 
Raster data and Vector data
Raster data and Vector dataRaster data and Vector data
Raster data and Vector data
 
remote sensing
remote sensingremote sensing
remote sensing
 
Arc gis introduction-ppt
Arc gis introduction-pptArc gis introduction-ppt
Arc gis introduction-ppt
 
Basic Gis
Basic GisBasic Gis
Basic Gis
 

Viewers also liked

Digital image classification22oct
Digital image classification22octDigital image classification22oct
Digital image classification22octAleemuddin Abbasi
 
Image classification in remote sensing
Image classification in remote sensingImage classification in remote sensing
Image classification in remote sensingAlexander Decker
 
Supervised and unsupervised classification techniques for satellite imagery i...
Supervised and unsupervised classification techniques for satellite imagery i...Supervised and unsupervised classification techniques for satellite imagery i...
Supervised and unsupervised classification techniques for satellite imagery i...gaup_geo
 
Image classification and land cover mapping
Image classification and land cover mappingImage classification and land cover mapping
Image classification and land cover mappingKabir Uddin
 
Unsupervised Classification of Images: A Review
Unsupervised Classification of Images: A ReviewUnsupervised Classification of Images: A Review
Unsupervised Classification of Images: A ReviewCSCJournals
 
Principle of aerial photography and types.ppt
Principle of aerial photography and types.pptPrinciple of aerial photography and types.ppt
Principle of aerial photography and types.pptsrinivas2036
 
Photogrammetry- Surveying
Photogrammetry- SurveyingPhotogrammetry- Surveying
Photogrammetry- SurveyingGokul Saud
 
Introduction to aerial photography and photogrammetry.ppt
Introduction to aerial photography and photogrammetry.pptIntroduction to aerial photography and photogrammetry.ppt
Introduction to aerial photography and photogrammetry.pptsrinivas2036
 
Digital Image Processing
Digital Image ProcessingDigital Image Processing
Digital Image ProcessingSahil Biswas
 
Building a GeoKnowledge Community
Building a GeoKnowledge CommunityBuilding a GeoKnowledge Community
Building a GeoKnowledge CommunityGail Millin-Chalabi
 
Pereira_IGARSS2011_#3199.pptx
Pereira_IGARSS2011_#3199.pptxPereira_IGARSS2011_#3199.pptx
Pereira_IGARSS2011_#3199.pptxgrssieee
 
Flower Classification Using Neural Network Based Image Processing
Flower Classification Using Neural Network Based Image ProcessingFlower Classification Using Neural Network Based Image Processing
Flower Classification Using Neural Network Based Image ProcessingIOSR Journals
 
Data clustering a review
Data clustering a reviewData clustering a review
Data clustering a reviewunyil96
 
Photogrametry_3D_Modelling[1]
Photogrametry_3D_Modelling[1]Photogrametry_3D_Modelling[1]
Photogrametry_3D_Modelling[1]Joachim Nkendeys
 
Using the Frame-Chapter 1
Using the Frame-Chapter 1Using the Frame-Chapter 1
Using the Frame-Chapter 1alorino
 
A supervised lung nodule classification method using patch based context anal...
A supervised lung nodule classification method using patch based context anal...A supervised lung nodule classification method using patch based context anal...
A supervised lung nodule classification method using patch based context anal...ASWATHY VG
 

Viewers also liked (20)

Digital image classification22oct
Digital image classification22octDigital image classification22oct
Digital image classification22oct
 
Image classification in remote sensing
Image classification in remote sensingImage classification in remote sensing
Image classification in remote sensing
 
Supervised and unsupervised classification techniques for satellite imagery i...
Supervised and unsupervised classification techniques for satellite imagery i...Supervised and unsupervised classification techniques for satellite imagery i...
Supervised and unsupervised classification techniques for satellite imagery i...
 
Image classification and land cover mapping
Image classification and land cover mappingImage classification and land cover mapping
Image classification and land cover mapping
 
Unsupervised Classification of Images: A Review
Unsupervised Classification of Images: A ReviewUnsupervised Classification of Images: A Review
Unsupervised Classification of Images: A Review
 
Principle of aerial photography and types.ppt
Principle of aerial photography and types.pptPrinciple of aerial photography and types.ppt
Principle of aerial photography and types.ppt
 
Photogrammetry- Surveying
Photogrammetry- SurveyingPhotogrammetry- Surveying
Photogrammetry- Surveying
 
Introduction to aerial photography and photogrammetry.ppt
Introduction to aerial photography and photogrammetry.pptIntroduction to aerial photography and photogrammetry.ppt
Introduction to aerial photography and photogrammetry.ppt
 
Digital Image Processing
Digital Image ProcessingDigital Image Processing
Digital Image Processing
 
Building a GeoKnowledge Community
Building a GeoKnowledge CommunityBuilding a GeoKnowledge Community
Building a GeoKnowledge Community
 
Pereira_IGARSS2011_#3199.pptx
Pereira_IGARSS2011_#3199.pptxPereira_IGARSS2011_#3199.pptx
Pereira_IGARSS2011_#3199.pptx
 
Flower Classification Using Neural Network Based Image Processing
Flower Classification Using Neural Network Based Image ProcessingFlower Classification Using Neural Network Based Image Processing
Flower Classification Using Neural Network Based Image Processing
 
Erdas image analysis for arcgis
Erdas   image analysis for arcgisErdas   image analysis for arcgis
Erdas image analysis for arcgis
 
Data clustering a review
Data clustering a reviewData clustering a review
Data clustering a review
 
ERDAS IMAGINE
ERDAS IMAGINEERDAS IMAGINE
ERDAS IMAGINE
 
Photogrametry_3D_Modelling[1]
Photogrametry_3D_Modelling[1]Photogrametry_3D_Modelling[1]
Photogrametry_3D_Modelling[1]
 
Photogrammetry amir
Photogrammetry amirPhotogrammetry amir
Photogrammetry amir
 
Using the Frame-Chapter 1
Using the Frame-Chapter 1Using the Frame-Chapter 1
Using the Frame-Chapter 1
 
Intro photo
Intro photoIntro photo
Intro photo
 
A supervised lung nodule classification method using patch based context anal...
A supervised lung nodule classification method using patch based context anal...A supervised lung nodule classification method using patch based context anal...
A supervised lung nodule classification method using patch based context anal...
 

Similar to Digital image classification

Different Image Segmentation Techniques for Dental Image Extraction
Different Image Segmentation Techniques for Dental Image ExtractionDifferent Image Segmentation Techniques for Dental Image Extraction
Different Image Segmentation Techniques for Dental Image ExtractionIJERA Editor
 
Depth Fusion from RGB and Depth Sensors III
Depth Fusion from RGB and Depth Sensors  IIIDepth Fusion from RGB and Depth Sensors  III
Depth Fusion from RGB and Depth Sensors IIIYu Huang
 
Lecture 4 Digital Image Processing (1).pptx
Lecture 4 Digital Image Processing (1).pptxLecture 4 Digital Image Processing (1).pptx
Lecture 4 Digital Image Processing (1).pptxsivan96
 
DIP Notes Unit-1 PPT , engineering, computer Science
DIP Notes Unit-1 PPT , engineering, computer ScienceDIP Notes Unit-1 PPT , engineering, computer Science
DIP Notes Unit-1 PPT , engineering, computer Sciencebaaburao4200
 
DIP Notes Unit-1 PPT.pdf
DIP Notes Unit-1 PPT.pdfDIP Notes Unit-1 PPT.pdf
DIP Notes Unit-1 PPT.pdfGaurav Sharma
 
Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...
Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...
Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...NopphawanTamkuan
 
A Novel Edge Detection Technique for Image Classification and Analysis
A Novel Edge Detection Technique for Image Classification and AnalysisA Novel Edge Detection Technique for Image Classification and Analysis
A Novel Edge Detection Technique for Image Classification and AnalysisIOSR Journals
 
12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.ppt12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.pptAJAYMALIK97
 
Digital_Image_Classification.pptx
Digital_Image_Classification.pptxDigital_Image_Classification.pptx
Digital_Image_Classification.pptxBivaYadav3
 
image_enhancement-NDVI-5.pptx
image_enhancement-NDVI-5.pptximage_enhancement-NDVI-5.pptx
image_enhancement-NDVI-5.pptxGemedaBedasa
 
Intro+Imaging.ppt
Intro+Imaging.pptIntro+Imaging.ppt
Intro+Imaging.pptshohel rana
 
P.maria sheeba 15 mco010
P.maria sheeba 15 mco010P.maria sheeba 15 mco010
P.maria sheeba 15 mco010W3Edify
 
Understanding neural radiance fields
Understanding neural radiance fieldsUnderstanding neural radiance fields
Understanding neural radiance fieldsVarun Bhaseen
 
Images Analysis  in matlab
Images Analysis  in matlabImages Analysis  in matlab
Images Analysis  in matlabmustafa_92
 
An Introduction to digital image processing
An Introduction to digital image processingAn Introduction to digital image processing
An Introduction to digital image processingnastaranEmamjomeh1
 

Similar to Digital image classification (20)

Basic image processing techniques
Basic image processing techniquesBasic image processing techniques
Basic image processing techniques
 
GIS fundamentals - raster
GIS fundamentals - rasterGIS fundamentals - raster
GIS fundamentals - raster
 
L12 GIS (a).pdf
L12 GIS (a).pdfL12 GIS (a).pdf
L12 GIS (a).pdf
 
Different Image Segmentation Techniques for Dental Image Extraction
Different Image Segmentation Techniques for Dental Image ExtractionDifferent Image Segmentation Techniques for Dental Image Extraction
Different Image Segmentation Techniques for Dental Image Extraction
 
Depth Fusion from RGB and Depth Sensors III
Depth Fusion from RGB and Depth Sensors  IIIDepth Fusion from RGB and Depth Sensors  III
Depth Fusion from RGB and Depth Sensors III
 
Lecture 4 Digital Image Processing (1).pptx
Lecture 4 Digital Image Processing (1).pptxLecture 4 Digital Image Processing (1).pptx
Lecture 4 Digital Image Processing (1).pptx
 
DIP Notes Unit-1 PPT , engineering, computer Science
DIP Notes Unit-1 PPT , engineering, computer ScienceDIP Notes Unit-1 PPT , engineering, computer Science
DIP Notes Unit-1 PPT , engineering, computer Science
 
DIP Notes Unit-1 PPT.pdf
DIP Notes Unit-1 PPT.pdfDIP Notes Unit-1 PPT.pdf
DIP Notes Unit-1 PPT.pdf
 
Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...
Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...
Data Processing Using THEOS Satellite Imagery for Disaster Monitoring (Case S...
 
A Novel Edge Detection Technique for Image Classification and Analysis
A Novel Edge Detection Technique for Image Classification and AnalysisA Novel Edge Detection Technique for Image Classification and Analysis
A Novel Edge Detection Technique for Image Classification and Analysis
 
12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.ppt12-Image enhancement and filtering.ppt
12-Image enhancement and filtering.ppt
 
Digital_Image_Classification.pptx
Digital_Image_Classification.pptxDigital_Image_Classification.pptx
Digital_Image_Classification.pptx
 
image_enhancement-NDVI-5.pptx
image_enhancement-NDVI-5.pptximage_enhancement-NDVI-5.pptx
image_enhancement-NDVI-5.pptx
 
Intro+Imaging.ppt
Intro+Imaging.pptIntro+Imaging.ppt
Intro+Imaging.ppt
 
P.maria sheeba 15 mco010
P.maria sheeba 15 mco010P.maria sheeba 15 mco010
P.maria sheeba 15 mco010
 
J017426467
J017426467J017426467
J017426467
 
Understanding neural radiance fields
Understanding neural radiance fieldsUnderstanding neural radiance fields
Understanding neural radiance fields
 
Images Analysis  in matlab
Images Analysis  in matlabImages Analysis  in matlab
Images Analysis  in matlab
 
An Introduction to digital image processing
An Introduction to digital image processingAn Introduction to digital image processing
An Introduction to digital image processing
 
Cj36511514
Cj36511514Cj36511514
Cj36511514
 

Recently uploaded

GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 

Recently uploaded (20)

GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 

Digital image classification

  • 1. DIGITAL IMAGE CLASSIFICATION Photogrammetry & RS division Digital Classification iirs
  • 2. Main lecture topics • What is it and why use it? • Image space versus feature space • Distances in feature space • Decision boundaries in feature space • Unsupervised versus supervised training • Classification algorithms • Validation (how good is the result?) • Problems Photogrammetry & RS division Digital Classification iirs
  • 3. What is Digital Image Classification · Multispectral classification is the process of sorting pixels into a finite number of individual classes, or categories of data, based on their data file values. If a pixel satisfies a certain set of criteria , the pixel is assigned to the class that corresponds to that criteria. Multispectral classification may be performed using a variety of algorithms •Hard classification using supervised or unsupervised approaches. • Classification using fuzzy logic, and/or • Hybrid approaches often involving use of ancillary information. Photogrammetry & RS division Digital Classification iirs
  • 4. What is Digital Image Classification • grouping of similar features • separation of dissimilar ones • assigning class label to pixels • resulting in manageable size of classes Photogrammetry & RS division Digital Classification iirs
  • 5. CLASSIFICATION METHODS MANUAL • visual interpretation • combination of spectral and spatial information COMPUTER ASSISTED • mainly spectral information STRATIFIED • using GIS functionality to incorporate • knowledge from other sources of information Photogrammetry & RS division Digital Classification iirs
  • 6. Why use it? • To translate continuous variability of image data into map patterns that provide meaning to the user. • To obtain insight in the data with respect to ground cover and surface characteristics. • To find anomalous patterns in the image data set. Photogrammetry & RS division Digital Classification iirs
  • 7. Why use it? (advantages) • Cost efficient in the analyses of large data sets • Results can be reproduced • More objective then visual interpretation • Effective analysis of complex multi-band (spectral) interrelationships Photogrammetry & RS division Digital Classification iirs
  • 8. Dimensionality of Data • Spectral Dimensionality is determined by the number of sets of values being used in a process. • In image processing, each band of data is a set of values. An image with four bands of data is said to be four-dimensional (Jensen, 1996). Photogrammetry & RS division Digital Classification iirs
  • 9. Measurement Vector • The measurement vector of a pixel is the set of data file values for one pixel in all n bands. • Although image data files are stored band- by-band, it is often necessary to extract the measurement vectors for individual pixels. Photogrammetry & RS division Digital Classification iirs
  • 10. Photogrammetry & RS division Digital Classification iirs
  • 11. Mean Vector •When the measurement vectors of several pixels are analyzed, a mean vector is often calculated. •This is the vector of the means of the data file values in each band. It has n elements. Mean Vector µI = Photogrammetry & RS division Digital Classification iirs
  • 12. Image space Single-band Image Multi-band Image • Image space (col,row) • array of elements corresponding to reflected or emitted energy from IFOV • spatial arrangement of the measurements of the reflected or emitted energy Photogrammetry & RS division Digital Classification iirs
  • 13. Feature Space: • A feature space image is simply a graph of the data file values of one band of data against the values of another band. ANALYZING PATTERNS IN MULTISPECTRAL DATA PIXEL A: 34,25,117 PIXEL B: 34,24,119 PIXEL C: 11,77,51 Photogrammetry & RS division Digital Classification iirs
  • 14. One-dimensional feature space Input layer No distinction between classes Distinction between classes Photogrammetry & RS division Digital Classification iirs
  • 15. Feature Space Multi-dimensional Feature vectors Photogrammetry & RS division Digital Classification iirs
  • 16. Feature space (scattergram) Low frequency High frequency Two/three dimensional graph or scattered diagram formation of clusters of points representing DN values in two/three spectral bands each cluster of points corresponds to a certain cover type on ground Photogrammetry & RS division Digital Classification iirs
  • 17. Distances and clusters in feature space band y (units of 5 DN) . .. . Max y . ... . (0,0) band x (units of 5 DN) Min y .. Euclidian distance (0,0) Min x Max x Cluster Photogrammetry & RS division Digital Classification iirs
  • 18. Spectral Distance Euclidean Spectral distance is distance in n- dimensional spectral space. It is a number that allows two measurement vectors to be compared for similarity. The spectral distance between two pixels can be calculated as follows: Where: D = spectral distance n = number of bands (dimensions) i = a particular band di = data file value of pixel d in band i ei = data file value of pixel e in band i This is the equation for Euclidean distance—in two dimensions (when n = 2), it can be simplified to the Pythagorean Theorem (c2 = a2 + b2), or in this case: D2 = (di - ei)2 + (dj - ej)2 Photogrammetry & RS division Digital Classification iirs
  • 19. General steps used to extract information from General steps used to extract information from Remotely sensed data Remotely sensed data State the nature of classification problem State the nature of classification problem •Define region of interest •Define region of interest •Identify classes of interest •Identify classes of interest Acquire appropriate Remotely sensed and ground reference data Acquire appropriate Remotely sensed and ground reference data Image processing of Remotely sensed data to extract thematic Image processing of Remotely sensed data to extract thematic information information •Radiometric correction •Radiometric correction •Geometric correction •Geometric correction •Select appropriate image classification logic and algorithm •Select appropriate image classification logic and algorithm oSupervised oSupervised -Parallelepiped and/or minimum distance -Parallelepiped and/or minimum distance -Maximum likelihood -Maximum likelihood -others -others oUnsupervised oUnsupervised -Chain method -Chain method -Multipass isodata -Multipass isodata -others -others oHybrid oHybrid •Extract data from training sites. •Extract data from training sites. •Select most appropriate bands •Select most appropriate bands •Extract training statistics from final band selection •Extract training statistics from final band selection •Extract thematic information. •Extract thematic information. Error evaluation of classification map Error evaluation of classification map Output Output Photogrammetry & RS division Digital Classification iirs
  • 20. Image classification process 2 4 Definition of the clusters in Selection of the the feature space 1 image data 3 5 Validation of the result Photogrammetry & RS division Digital Classification iirs
  • 21. • It is also important for the analyst to realize that there is a fundamental difference between information classes and spectral classes. • * Information classes are those that human beings define. • * Spectral classes are those that are inherent in the remote sensor data and must be identified and then labeled by the analyst. Photogrammetry & RS division Digital Classification iirs
  • 22. SUPERVISED CLASSIFICATION : • The identity and location of some of the land cover types such as urban, agriculture, wetland are known a priori through a combination of field work and experience. • The analyst attempts to locate specific sites in the remotely sensed data that represent homogenous examples of these known land cover types known as training sites. • Multivariate statistical parameters are calculated for these training sites. • Every pixel both inside and outside the training sites is evaluated and assigned to the class of which it has the highest likelihood of being a member. Photogrammetry & RS division Digital Classification iirs
  • 23. Supervised image classification Steps in supervised classification • Identification of sample areas (training areas) • Partitioning of the A class sample feature space • Is a number of training pixels •Forms a cluster in feature space A cluster • Is the representative for a class • Includes a minimum number of observations (30*n) • Is distinct Photogrammetry & RS division Digital Classification iirs
  • 24. UNSUPERVISED CLASSIFICATION : • The identities of land cover types to be specified as classes within a scene are generally not known a priori because ground reference information is lacking or surface features within the scene are not well defined. • The computer is required to group pixels with similar spectral characteristics into unique clusters according to some statistically determined criteria. • Analyst then combine and relabels the spectral clusters into information classes. Photogrammetry & RS division Digital Classification iirs
  • 25. Unsupervised image classification • Clustering algorithm • User defined cluster parameters • Class mean vectors are arbitrarily set by algorithm (iteration 0) • Class allocation of feature vectors • Compute new class mean vectors • Class allocation (iteration 2) • Re-compute class mean vectors • Iterations continue until convergence threshold has been reached • Final class allocation • Cluster statistics reporting Photogrammetry & RS division Digital Classification iirs
  • 26. Supervised vs. Unsupervised Training • In supervised training, it is important to have a set of desired classes in mind, and then create the appropriate signatures from the data. • Supervised classification is usually appropriate when you want to identify relatively few classes, when you have selected training sites that can be verified with ground truth data, or when you can identify distinct, homogeneous regions that represent each class. • On the other hand, if you want the classes to be determined by spectral distinctions that are inherent in the data so that you can define the classes later, then the application is better suited to unsupervised training. Unsupervised training enables you to define many classes easily, and identify classes that are not in contiguous, easily recognized regions. Photogrammetry & RS division Digital Classification iirs
  • 27. UNSUPERVISED APPROACH • based on spectral groupings • considers only spectral distance measures • minimum user interaction • requires interpretation after classification SUPERVISED APPROACH • based on spectral groupings • incorporates prior knowledge • maximum user interaction Photogrammetry & RS division Digital Classification iirs
  • 28. SUPERVISED CLASSIFICATION • In supervised training, you rely on your own pattern recognition skills and a priori knowledge of the data to help the system determine the statistical criteria (signatures) for data classification. • To select reliable samples, you should know some information—either spatial or spectral—about the pixels that you want to classify. Photogrammetry & RS division Digital Classification iirs
  • 29. The challenge: The problem is that all pixels, or rather their feature vector, must be compared to predifined clusters, and that rules for that comparison must be set up. The clusters have to be defined with the help of training sets Photogrammetry & RS division Digital Classification iirs
  • 30. Partition of a feature space class a • decide on decision class c boundaries class b • assign a class to each pixel class d Photogrammetry & RS division Digital Classification iirs
  • 31. Training Samples and Feature Space Objects • Training samples (also called samples) are sets of pixels that represent what is recognized as a discernible pattern, or potential class. The system calculates statistics from the sample pixels to create a parametric signature for the class. Photogrammetry & RS division Digital Classification iirs
  • 32. Selecting Training Samples • Training data for a class should be collected from homogeneous environment. • Each site is usually composed of many pixels-the general rule is that if training data is being collected from n bands then >10n pixels of training data is to be collected for each class. This is sufficient to compute variance-covariance matrices required by some classification algorithms. Photogrammetry & RS division Digital Classification iirs
  • 33. There are a number of ways to collect training site data- •using a vector layer • defining a polygon in the image • identifying a training sample of contiguous pixels with similar spectral characteristics • identifying a training sample of contiguous pixels within a certain area, with or without similar spectral characteristics • using a class from a thematic raster layer from an image file of the same area (i.e., the result of an unsupervised classification) Once the training sites are collected, The mean ,standard deviation, variance etc. are computed for each class. Photogrammetry & RS division Digital Classification iirs
  • 34. Evaluating Signatures • There are tests to perform that can help determine whether the signature data are a true representation of the pixels to be classified for each class. You can evaluate signatures that were created either from supervised or unsupervised training. Photogrammetry & RS division Digital Classification iirs
  • 35. Evaluation of Signatures • Ellipse—view ellipse diagrams and scatterplots of data file values for every pair of bands. Photogrammetry & RS division Digital Classification iirs
  • 36. Evaluation of Signatures………….. Signature separability is a statistical measure of distance between two signatures. Separability can be calculated for any combination of bands that is used in the classification, enabling you to rule out any bands that are not useful in the results of the classification. 1. Euclidian Distance: Where: D = spectral distance n = number of bands (dimensions) i = a particular band di = data file value of pixel d in band i ei = data file value of pixel e in band i Photogrammetry & RS division Digital Classification iirs
  • 37. Signature Seperability……… 2. Divergence Photogrammetry & RS division Digital Classification iirs
  • 38. Signature Seperability……… 3. Transformed Divergence The scale of the divergence values can range from 0 to 2,000. As a general rule, if the result is greater than 1,900, then the classes can be separated. Between 1,700 and 1,900, the separation is fairly good. Below 1,700, the separation is poor (Jensen, 1996). Photogrammetry & RS division Digital Classification iirs
  • 39. Signature Seperability……… 4. Jeffries-Matusita Distance Range of JM is between 0 and 1414. The JM distance has a saturating behavior with increasing class separation like transformed divergence. However, it is not as computationally efficient as transformed divergence” (Jensen, 1996). Photogrammetry & RS division Digital Classification iirs
  • 40. SELECTING APPROPRIATE CLASSIFICATION ALGORITHM • Various supervised classification algorithms may be used to assign an unknown pixel to one of the classes. • The choice of particular classifier depends on nature of input data and output required. • Parametric classification algorithms assume that the observed measurement vectors Xc , obtained for each class in each spectral band during the training phase are Gaussian in nature. • Non Parametric classification algorithms make no such assumptions. • There are many classification algorithms i.e. Parallelepiped, Minimum distance, Maximum Likelihood etc. Photogrammetry & RS division Digital Classification iirs
  • 41. PARALLELEPIPED CLASSIFICATION ALGORITHM In the parallelepiped decision rule, the data file values of the candidate pixel are compared to upper and lower limits. These limits can be either: 1. the minimum and maximum data file values of each band in the signature, 2. the mean of each band, plus and minus a number of standard deviations, or 3. any limits that you specify, based on your knowledge of the data and signatures. There are high and low limits for every signature in every band. When a pixel’s data file values are between the limits for every band in a signature, then the pixel is assigned to that signature’s class. Photogrammetry & RS division Digital Classification iirs
  • 42. • Therefore, if the low and high decision boundaries are defined as Lck= µck - Sck and Hck= µck + Sck • The parallelepiped algorithm becomes Lck ≤ BVijk ≤ Hck Photogrammetry & RS division Digital Classification iirs
  • 43. Means and Standard Deviations Partitioned Feature Space 255 255 Band 2 Band 2 0 0 0 Band 1 255 0 Band 1 255 Feature Space Partitioning - Box classifier Photogrammetry & RS division Digital Classification iirs
  • 44. Class “unknown” Photogrammetry & RS division Digital Classification iirs
  • 45. Points a and b are pixels in the image to be classified. Pixel a has a brightness value of 40 in band 4 and 40 in band 5. Pixel b has a brightness value of 10 in band 4 and 40 in band 5. The boxes represent the parallelepiped decision rule associated with a ±1s classification. The vectors (arrows) represent the distance from a and b to the mean of all classes in a minimum distance to means classification algorithm. Photogrammetry & RS division Digital Classification iirs
  • 46. Photogrammetry & RS division Digital Classification iirs
  • 47. Overlap Region In cases where a pixel may fall into the overlap region of two or more parallelepipeds, you must define how the pixel can be classified. • The pixel can be classified by the order of the signatures. • The pixel can be classified by the defined parametric decision rule. • The pixel can be left unclassified. Photogrammetry & RS division Digital Classification iirs
  • 48. ADVANTAGES: Fast and simple. Gives a broad classification thus narrows down the number of possible classes to which each pixel can be assigned before more time consuming calculations are made. Not dependent on normal distributions. DISADVANTAGES: Since parallelepiped has corners, pixels that are actually quite far, spectrally from the mean of the signature may be classified Parallelepiped Corners Compared to the Signature Ellipse Photogrammetry & RS division Digital Classification iirs
  • 49. MINIMUM DISTANCE TO MEANS CLASSIFICATION ALGORITHM This decision rule is computationally simple and commonly used. Requires mean vectors for each class in each band µck from the training data. Euclidean distance is calculated for all the pixels with all the signature means D = √ (BVijk- µck)2 + (BVijl- µcl)2 Where µck and µcl represent the mean vectors for class c measured in bands k and l Any unknown pixel will definitely be assigned to one of any classes, there will be no unclassified pixel. Photogrammetry & RS division Digital Classification iirs
  • 50. MINIMUM DISTANCE TO MEANS Histogram of training set 300 200 100 0 0 31 63 95 127 159 191 223 255 Decision rule: Priority to the shortest distance to the class mean Photogrammetry & RS division Digital Classification iirs
  • 51. Feature Space Partitioning - Minimum Distance to Mean Classifier 255 "Unknown" Mean vectors Band 2 255 0 Band 2 0 Band 1 255 255 0 0 Band 1 255 Band 2 0 0 Band 1 255 Threshold Distance Photogrammetry & RS division Digital Classification iirs
  • 52. ADVANTAGES: • Since every pixel is spectrally closer to either one sample mean or other so there are no unclassified pixels. • Fastest after parallelepiped decision rule. DISADVANTAGES: • Pixels which should be unclassified will become classified. • Does not consider class variability. Photogrammetry & RS division Digital Classification iirs
  • 53. Mahalanobis Decision Rule • Mahalanobis distance is similar to minimum distance, except that the covariance matrix is used in the equation. Variance and covariance are figured in so that clusters that are highly varied lead to similarly varied classes, Photogrammetry & RS division Digital Classification iirs
  • 54. Advantages • Takes the variability of classes into account, unlike minimum distance or parallelepiped. • May be more useful than minimum distance in cases where statistical criteria (as expressed in the covariance matrix) must be taken into account Disadvantages • Tends to overclassify signatures with relatively large values in the covariance matrix. • Slower to compute than parallelepiped or minimum distance. • Mahalanobis distance is parametric, meaning that it relies heavily on a normal distribution of the data in each input band. Photogrammetry & RS division Digital Classification iirs
  • 55. Maximum Likelihood/Bayesian Decision Rule • The maximum likelihood decision rule is based on the probability that a pixel belongs to a particular class. The basic equation assumes that these probabilities are equal for all classes, and that the input bands have normal distributions. • If you have a priori knowledge that the probabilities are not equal for all classes, you can specify weight factors for particular classes. This variation of the maximum likelihood decision rule is known as the Bayesian decision rule (Hord, 1982). Photogrammetry & RS division Digital Classification iirs
  • 56. The equation for the maximum likelihood/Bayesian classifier is as follows: The pixel is assigned to the class, c, for which D is the lowest. Photogrammetry & RS division Digital Classification iirs
  • 57. Photogrammetry & RS division Digital Classification iirs
  • 58. Advantages • The most accurate of the classifiers (if the input samples/clusters have a normal distribution), because it takes the most variables into consideration. • Takes the variability of classes into account by using the covariance matrix, as does Mahalanobis distance. Disadvantages • An extensive equation that takes a long time to compute. The computation time increases with the number of input bands. • Maximum likelihood is parametric, meaning that it relies heavily on a normal distribution of the data in each input band. • Tends to overclassify signatures with relatively large values in the covariance matrix. Photogrammetry & RS division Digital Classification iirs
  • 59. UNSUPERVISED CLASSIFICATION • It requires only a minimum amount of initial input from the analyst. • Numerical operations are performed that search for natural groupings of the spectral properties of pixels. • User allows computer to select the class means and covariance matrices to be used in the classification. • Once the data are classified, the analyst attempts a posteriori to assign these natural or spectral classes to the information classes of interest. • Some clusters may be meaningless because they represent mixed classes. • Clustering algorithm used for the unsupervised classification generally vary according to the efficiency with which the clustering takes place. • Two commonly used methods are- – Chain method – Isodata clustering Photogrammetry & RS division Digital Classification iirs
  • 60. CHAIN METHOD • Operates in two pass mode( it passes through the registered multispectral dataset two times). • In the first pass the program reads through the dataset and sequentially builds clusters. • A mean vector is associated with each cluster. • In the second pass a minimum distance to means classification algorithm is applied to whole dataset on a pixel by pixel basis whereby each pixel is assigned to one of the mean vectors created in pass 1. • The first pass automatically creates the cluster signatures to be used by supervised classifier. Photogrammetry & RS division Digital Classification iirs
  • 61. PASS 1: CLUSTER BUILDING • During the first pass the analyst is required to supply four types of information- • R , the radius distance in spectral space used to determine when a new cluster should be formed. • C, a spectral space distance parameter used when merging clusters when N is reached. • N , the number of pixels to be evaluated between each major merging of clusters. • Cmax maximum no. of clusters to be identified. PASS 2: Assignment of pixels to one of the Cmax clusters using minimum distance classification logic Photogrammetry & RS division Digital Classification iirs
  • 62. Original brightness values of pixels 1, 2, and 3 as measured in Bands 4 and 5 of the hypothetical remote sensed data. Photogrammetry & RS division Digital Classification iirs
  • 63. The distance (D) in 2-dimensional spectral space between pixel 1 (cluster 1) and pixel 2 (potential cluster 2) in the first iteration is computed and tested against the value of R=15, the minimum acceptable radius. In this case, D does not exceed R. Therefore, we merge clusters 1 and 2 as shown in the next illustration. Photogrammetry & RS division Digital Classification iirs
  • 64. Pixels 1 and 2 now represent cluster #1. Note that the location of cluster 1 has migrated from 10,10 to 15,15 after the first iteration. Now, pixel 3 distance (D=15.81) is computed to see if it is greater than the minimum threshold, R=15. It is, so pixel location 3 becomes cluster #2. This process continues until all 20 clusters are identified. Then the 20 clusters are evaluated using a distance measure, C (not shown), to merge the clusters that are closest to one another. Photogrammetry & RS division Digital Classification iirs
  • 65. How clusters migrate during the several iterations of a clustering algorithm. The final ending point represents the mean vector that would be used in phase 2 of the clustering process when the minimum distance classification is performed. Photogrammetry & RS division Digital Classification iirs
  • 66. • Note: As more points are added to a cluster, the mean shifts less dramatically since the new computed mean is weighted by the number of pixels currently in a cluster. The ending point is the spectral location of the final mean vector that is used as a signature in the minimum distance classifier applied in pass 2. • Some clustering algorithms allow the analyst to initially seed the mean vector for several of the important classes. The seed data are usually obtained in a supervised fashion, as discussed previously. Others allow the analyst to use a priori information to direct the clustering process. Photogrammetry & RS division Digital Classification iirs
  • 67. Pass 2: Assignment of Pixels to One of the Cmax Clusters Using Minimum Distance Classification Logic The final cluster mean data vectors are used in a minimum distance to means classification algorithm to classify all the pixels in the image into one of the Cmax clusters. Photogrammetry & RS division Digital Classification iirs
  • 68. ISODATA Clustering The Iterative Self-Organizing Data Analysis Technique (ISODATA) represents a comprehensive set of heuristic (rule of thumb) procedures that have been incorporated into an iterative classification algorithm. The ISODATA algorithm is a modification of the k-means clustering algorithm, which includes a) merging clusters if their separation distance in multispectral feature space is below a user-specified threshold and b) rules for splitting a single cluster into two clusters. ISODATA is iterative because it makes a large number of passes through the remote sensing dataset until specified results are obtained, instead of just two passes. ISODATA does not allocate its initial mean vectors based on the analysis of pixels rather, an initial arbitrary assignment of all Cmax clusters takes place along an n-dimensional vector that runs between very specific points in feature space. Photogrammetry & RS division Digital Classification iirs
  • 69. ISODATA algorithm normally requires the analyst to specify- Cmax : maximum no. of clusters to be identified. T:maximum % of pixels whose class values are allowed to be unchanged between iterations. M :maximum no. of times isodata is to classify pixels and recalculate cluster mean vectors. Minimum members in a cluster Maximum standard deviation for a cluster. Split separation value (if the valuse is changed from 0.0, it takes the place of S.D. ) Minimum distance between cluster means. Photogrammetry & RS division Digital Classification iirs
  • 70. Phase 1: ISODATA Cluster Building using many passes through the dataset. a) ISODATA initial distribution of five hypothetical mean vectors using ±1s standard deviations in both bands as beginning and ending points. b) In the first iteration, each candidate pixel is compared to each cluster mean and assigned to the cluster whose mean is closest in Euclidean distance. c) During the second iteration, a new mean is calculated for each cluster based on the actual spectral locations of the pixels assigned to each cluster, instead of the initial arbitrary calculation. This involves analysis of several parameters to merge or split clusters. After the new cluster mean vectors are selected, every pixel in the scene is assigned to one of the new clusters. d) This split–merge–assign process continues until there is little change in class assignment between iterations (the T threshold is reached) or the maximum number of iterations is reached (M). Photogrammetry & RS division Digital Classification iirs
  • 71. a) Distribution of 20 ISODATA mean vectors after just one iteration b) Distribution of 20 ISODATA mean vectors after 20 iterations. The bulk of the important feature space (the gray background) is partitioned rather well after just 20 iterations. Photogrammetry & RS division Digital Classification iirs
  • 72. Sources of Uncertainty in Image Classification 1.Non-representative training areas 2. High variability in the spectral signatures for a land cover class 3. Mixed land cover within the pixel area Photogrammetry & RS division Digital Classification iirs
  • 73. Evaluating Classification • After a classification is performed, these methods are available for testing the accuracy of the classification: • Thresholding—Use a probability image file to screen out misclassified pixels. • Accuracy Assessment —Compare the classification to ground truth or other data. Photogrammetry & RS division Digital Classification iirs
  • 74. Accuracy Assessment Accuracy assessment is a general term for comparing the classification to geographical data that are assumed to be true, in order to determine the accuracy of the classification process. Usually, the assumed-true data are derived from ground truth data. Photogrammetry & RS division Digital Classification iirs
  • 75. Accuracy Assesement…… • Assessing accuracy of a remote sensing output is one of the most important steps in any classification exercise!! • Without an accuracy assessment the output or results is of little value. Photogrammetry & RS division Digital Classification iirs
  • 76. There are a number of issues relevant to the generation and assessment of errors in a classification. These include: • the nature of the classification; • Sample design and • assessment sample size. Photogrammetry & RS division Digital Classification iirs
  • 77. Nature of Classification: – 1) Class definition problems occur when trying to extract information from a image, such as tree height, which is unrealistic. If this happens the error rate will increase. – 2) A common problem is classifying remotely sensed data is to use inappropriate class labels, such as cliff, lake or river all of which are landforms and not cover-types. Similarly a common error is that of using class labels which define land-uses. These features are commonly made up of several cover classes. – 3) The final point here, in terms of the potential for generation of error is the mislabeling of classes. The most obvious example of this is to label a training site water when in fact it is something else. This will result in, at best a skewing of your class statistics if your training site samples are sufficiently large, or at worst shifting the training statistics entirely if your sites are relatively small. Photogrammetry & RS division Digital Classification iirs
  • 78. Sample Design: • In addition to being independent of the original training sample the sample used must be of a design that will insure consistency and objectivity. • A number of sampling techniques can be used. Some of these include random, systematic, and stratified random. • Of the three the systematic sample is the least useful. This approach to sampling may result in a sample distribution which favours a particular class depending on the distribution of the classes within the map. • Only random sample designs can guarantee an unbiased sample. • The truly random strategy however may not yield a sample design that covers the entire map area, and so may be less than ideal. • In many instances the stratified random sampling strategy is the most useful tool to use. In this case the map area is stratified based on either a systematic breakdown followed by a random sample design in each of the systematic subareas, or alternatively through the application of a random sample within each of the map classes. The use of this approach will ensure that one has an adequate cover for the entire map as well as generating a sufficient number of samples for each of the classes on the map Photogrammetry & RS division Digital Classification iirs
  • 79. Sample Size: • The size of the sample used must be sufficiently large to be statistically representative of the map area. The number of points considered necessary varies, depending on the method used to estimate. • What this means is that when using a systematic or random sample size, the number of points are kept to a manageable number. Because the number of points contained within a stratified area is usually high, that is greater than 10000, the number of samples used to test the accuracy of the classes through a stratified random sample will be high as well, so the cost for using a highly accurate sampling strategy is a large number of samples Photogrammetry & RS division Digital Classification iirs
  • 80. ERROR MATRIX Once a classification has been sampled a contingency table (also referred to as an error matrix or confusion matrix) is developed. • This table is used to properly analyze the validity of each class as well as the classification as a whole. • In this way the we can evaluate in more detail the efficacy of the classification. Photogrammetry & RS division Digital Classification iirs
  • 81. One way to assess accuracy is to go out in the field and observe the actual land class at a sample of locations, and compare to the land classification it was assigned on the thematic map. • There are a number of ways to quantitatively express the amount of agreement between the ground truth classes and the remote sensing classes. • One way is to construct a confusion error matrix, alternatively called a error matrix • This is a row by column table, with as many rows as columns. • Each row of the table is reserved for one of the information, or remote sensing classes used by the classification algorithm. • Each column displays the corresponding ground truth classes in an identical order. Photogrammetry & RS division Digital Classification iirs
  • 82. OVERALL ACCURACY • The diagonal elements tally the number of pixels classified correctly in each class. • But just because 83% classifications were accurate overall, does not mean that each category was successfully classified at that rate. Photogrammetry & RS division Digital Classification iirs
  • 83. USERS ACCURACY • A user of the imagery who is particularly interested in class A, say, might wish to know what proportion of pixels assigned to class A were correctly assigned. • In this example 35 of the 39 pixels were correctly assigned to class A, and the user accuracy in this category of 35/39 = 90% Photogrammetry & RS division Digital Classification iirs
  • 84. In general terms, for a particular category is user accuracy computed as: • which, for an error matrix set up with the row and column assignments as stated, is computed as the user accuracy • Evidently, a user accuracy can be computed for each row. Photogrammetry & RS division Digital Classification iirs
  • 85. PRODUCERS ACCURACY • Contrasted to user accuracy is producer accuracy, which has a slightly different interpretation. • Producers accuracy is a measure of how much of the land in each category was classified correctly. • It is found, for each class or category, as The Producer’s accuracy for class A is 35/50 = 70% Photogrammetry & RS division Digital Classification iirs
  • 86. So from this assessment we have three measures of accuracy which address subtly different issues: – overall accuracy : takes no account of source of error (errors of omission or commission) – user accuracy : measures the proportion of each TM class which is correct. – producer accuracy : measures the proportion of the land base which is correctly classified. Photogrammetry & RS division Digital Classification iirs
  • 87. KAPPA COEFFICENT • Another measure of map accuracy is the kappa coefficient, which is a measure of the proportional (or percentage) improvement by the classifier over a purely random assignment to classes. For an error matrix with r rows, and hence the same number of columns, let – A = the sum of r diagonal elements, which is the numerator in the computation of overall accuracy – Let B = sum of the r products (row total x column total). • Then • where N is the number of pixels in the error matrix (the sum of all r individual cell values). Photogrammetry & RS division Digital Classification iirs
  • 88. For the above error matrix, – A = 35 + 37 + 41 = 113 – B = (39 * 50) + (50 * 40) + (47 * 46) = 6112 – N = 136 Thus This can be tested statistically. Photogrammetry & RS division Digital Classification iirs
  • 89. Fuzzy Classification • The Fuzzy Classification method takes into account that there are pixels of mixed make-up, that is, a pixel cannot be definitively assigned to one category. • Fuzzy classification is designed to help you work with data that may not fall into exactly one category or another. Fuzzy classification works using a membership function, wherein a pixel’s value is determined by whether it is closer to one class than another. • Like traditional classification, fuzzy classification still uses training, but the biggest difference is that “it is also possible to obtain information on the various constituent classes found in a mixed pixel. . .” Photogrammetry & RS division Digital Classification iirs
  • 90. Photogrammetry & RS division Digital Classification iirs
  • 91. Expert Classification • The expert classification provides a rules-based approach to multispectral image classification, post- classification refinement, and GIS modeling. In essence, an expert classification system is a hierarchy of rules, or a decision tree, that describes the conditions under which a set of low level constituent information gets abstracted into a set of high level informational classes. Photogrammetry & RS division Digital Classification iirs
  • 92. Components of a Typical Rule-based Expert System Photogrammetry & RS division Digital Classification iirs