SlideShare una empresa de Scribd logo
1 de 10
RECOGNIZING HANDWRITTEN DIGIT
USING K-NEAREST NEIGHBOUR
CLASSIFIER
By-
Vineet Raj
INTRODUCTION
Handwritten digit recognition is the process of
receiving and correctly interpreting a legible
hand-drawn digit from an input source (paper or
photographs) by comparing it with previously
trained data.
APPLICATIONS
• Postal mail sorting
• Courtesy amounts on cheques
• Formation of data entry etc.
Recognition of
legal amounts
on bank cheques
Currency
Recognition
Number Plate
Recognition
House no.
Recognition
Postal mail
sorting
PROBLEM STATEMENT
Given a set of greyscale isolated numerical images taken from
MNIST database.
The objectives are:-
 To recognize handwritten digits correctly.
 To improve the accuracy of detection.
 To develop a method which is independent of digit size and
writer style/ink independent.
LITERATURE SURVEY
 Hand Written Character Recognition using Star-Layered Histogram Features
Stephen Karungaru, Kenji Terada and Minoru Fukumi
In this method, a character recognition method using features extracted from a
star layered histogram is presented and trained using neural networks. After
several image preprocessing steps, the character region is extracted. Its contour is
then used to determine the center of gravity (COG). This CoG point is used as the
origin to create a histogram using equally spaced lines extending from the CoG to
the contour.
The first point the line touches the character represents the first layer of the
histogram. If the line extension has not reached the region boundary, the next hit
represents the second layer of the histogram. This process is repeated until the
line touches the boundary of the character’s region. After normalization, these
features are used to train a neural network.
Result
This method achieves an accuracy of about 93% using the MNIST database of
handwritten digits.
 A Novel Feature Selection and Extraction Technique for Classification
We present a versatile technique for the purpose of feature selection and extraction -
Class Dependent Features (CDFs). CDFs identify the features innate to a class and
extract them accordingly. The features thus extracted are relevant to the entire class
and not just to the individual data item. This paper focuses on using CDFs to improve
the accuracy of classification and at the same time control computational expense by
tackling the curse of dimensionality.
Result-
This method achieves an accuracy of about 92%
EXISTING MODELS
Feature extraction methods
• Star layered histogram feature extraction algorithm
requires thinning operation
many inner details can not be captured using outer polygons
• Class Dependent feature selection and extraction
expensive in terms of computation
Classification Algorithms
• Linear Classifier
error rate is 12.0%
• Neural Networks
requires thousands of training examples and huge
computation time
PROPOSED MODEL
ISOLATED
NUMERAL IMAGES
FROM MNIST
DATABASE
PRE-PROCESSING
FEATURE
EXTRACTION
CLASSIFICATION
ALGORITHM
The proposed method uses k-nearest neighbour(k-NN)
classification algorithm for classifying the MNIST digit images.
Accuracy of about 96% can be achieved.
Less number of computations required.
No thinning operation required.
REFERENCES
Hand Written Character Recognition using Star-Layered Histogram
Features
Stephen Karungaru, Kenji Terada and Minoru Fukumi
A Novel Feature Selection and Extraction Technique for Classification
Kratarth Goel, Raunaq Vohra and Ainesh Bakshi
Handwritten Digit Recognition Using K-Nearest Neighbour Classifier
U Ravi Babu, Dr. Y Venkateswarlu and Aneel Kumar Chintha
Y. LeCun, et al., Comparison of learning algorithms for handwritten
digit recognition
F. Fogelman-Souli e, P. Gallinari (Eds.)
Yann LeCun,”THE MNIST database of handwritten digits” Courant
Institute, NYU Corinna Cortes, Google Labs, NewYork

Más contenido relacionado

La actualidad más candente

Hand Written Character Recognition Using Neural Networks
Hand Written Character Recognition Using Neural Networks Hand Written Character Recognition Using Neural Networks
Hand Written Character Recognition Using Neural Networks
Chiranjeevi Adi
 
Handwritten Text Recognition and Digital Text Conversion
Handwritten Text Recognition and Digital Text ConversionHandwritten Text Recognition and Digital Text Conversion
Handwritten Text Recognition and Digital Text Conversion
ijtsrd
 

La actualidad más candente (20)

Ocr abstract
Ocr abstractOcr abstract
Ocr abstract
 
Optical Character Recognition (OCR) System
Optical Character Recognition (OCR) SystemOptical Character Recognition (OCR) System
Optical Character Recognition (OCR) System
 
Hand Written Character Recognition Using Neural Networks
Hand Written Character Recognition Using Neural Networks Hand Written Character Recognition Using Neural Networks
Hand Written Character Recognition Using Neural Networks
 
Vector quantization
Vector quantizationVector quantization
Vector quantization
 
Handwritten Character Recognition
Handwritten Character RecognitionHandwritten Character Recognition
Handwritten Character Recognition
 
Handwritten Text Recognition and Digital Text Conversion
Handwritten Text Recognition and Digital Text ConversionHandwritten Text Recognition and Digital Text Conversion
Handwritten Text Recognition and Digital Text Conversion
 
Image recognition
Image recognitionImage recognition
Image recognition
 
Face recognition technology
Face recognition technologyFace recognition technology
Face recognition technology
 
Image recognition
Image recognitionImage recognition
Image recognition
 
Handwritten Digit Recognition using Convolutional Neural Networks
Handwritten Digit Recognition using Convolutional Neural  NetworksHandwritten Digit Recognition using Convolutional Neural  Networks
Handwritten Digit Recognition using Convolutional Neural Networks
 
Image recognition
Image recognitionImage recognition
Image recognition
 
AGE AND GENDER DETECTION.pptx
AGE AND GENDER DETECTION.pptxAGE AND GENDER DETECTION.pptx
AGE AND GENDER DETECTION.pptx
 
Fingerprint recognition
Fingerprint recognitionFingerprint recognition
Fingerprint recognition
 
Brain Tumor Detection using CNN
Brain Tumor Detection using CNNBrain Tumor Detection using CNN
Brain Tumor Detection using CNN
 
Digit recognition using mnist database
Digit recognition using mnist databaseDigit recognition using mnist database
Digit recognition using mnist database
 
Fingerprint recognition presentation
Fingerprint recognition presentationFingerprint recognition presentation
Fingerprint recognition presentation
 
CHARACTER RECOGNITION USING NEURAL NETWORK WITHOUT FEATURE EXTRACTION FOR KAN...
CHARACTER RECOGNITION USING NEURAL NETWORK WITHOUT FEATURE EXTRACTION FOR KAN...CHARACTER RECOGNITION USING NEURAL NETWORK WITHOUT FEATURE EXTRACTION FOR KAN...
CHARACTER RECOGNITION USING NEURAL NETWORK WITHOUT FEATURE EXTRACTION FOR KAN...
 
Facial Emotion Recognition: A Deep Learning approach
Facial Emotion Recognition: A Deep Learning approachFacial Emotion Recognition: A Deep Learning approach
Facial Emotion Recognition: A Deep Learning approach
 
Fingerprint recognition
Fingerprint recognitionFingerprint recognition
Fingerprint recognition
 
Optical Character Recognition (OCR) based Retrieval
Optical Character Recognition (OCR) based RetrievalOptical Character Recognition (OCR) based Retrieval
Optical Character Recognition (OCR) based Retrieval
 

Similar a HANDWRITTEN DIGIT RECOGNITION USING k-NN CLASSIFIER

Palmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interestPalmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interest
Dakshina Kisku
 
Palmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interestPalmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interest
Dakshina Kisku
 

Similar a HANDWRITTEN DIGIT RECOGNITION USING k-NN CLASSIFIER (20)

Representation and recognition of handwirten digits using deformable templates
Representation and recognition of handwirten digits using deformable templatesRepresentation and recognition of handwirten digits using deformable templates
Representation and recognition of handwirten digits using deformable templates
 
Segmentation and recognition of handwritten digit numeral string using a mult...
Segmentation and recognition of handwritten digit numeral string using a mult...Segmentation and recognition of handwritten digit numeral string using a mult...
Segmentation and recognition of handwritten digit numeral string using a mult...
 
Assignment-1-NF.docx
Assignment-1-NF.docxAssignment-1-NF.docx
Assignment-1-NF.docx
 
Comparative study of two methods for Handwritten Devanagari Numeral Recognition
Comparative study of two methods for Handwritten Devanagari Numeral RecognitionComparative study of two methods for Handwritten Devanagari Numeral Recognition
Comparative study of two methods for Handwritten Devanagari Numeral Recognition
 
Fake currency detection using knn algorithm.pptx
Fake currency detection using knn algorithm.pptxFake currency detection using knn algorithm.pptx
Fake currency detection using knn algorithm.pptx
 
Introduction to image processing and pattern recognition
Introduction to image processing and pattern recognitionIntroduction to image processing and pattern recognition
Introduction to image processing and pattern recognition
 
Plant Disease Detection.pptx
Plant Disease Detection.pptxPlant Disease Detection.pptx
Plant Disease Detection.pptx
 
journal paper publication
journal paper publicationjournal paper publication
journal paper publication
 
Automated_attendance_system_project.pptx
Automated_attendance_system_project.pptxAutomated_attendance_system_project.pptx
Automated_attendance_system_project.pptx
 
Artificial Neural Network For Recognition Of Handwritten Devanagari Character
Artificial Neural Network For Recognition Of Handwritten Devanagari CharacterArtificial Neural Network For Recognition Of Handwritten Devanagari Character
Artificial Neural Network For Recognition Of Handwritten Devanagari Character
 
L017116064
L017116064L017116064
L017116064
 
Support Vector Machines ( SVM )
Support Vector Machines ( SVM ) Support Vector Machines ( SVM )
Support Vector Machines ( SVM )
 
Handwritten mathematical symbol recognition
Handwritten mathematical symbol recognitionHandwritten mathematical symbol recognition
Handwritten mathematical symbol recognition
 
A Novel Framework For Numerical Character Recognition With Zoning Distance Fe...
A Novel Framework For Numerical Character Recognition With Zoning Distance Fe...A Novel Framework For Numerical Character Recognition With Zoning Distance Fe...
A Novel Framework For Numerical Character Recognition With Zoning Distance Fe...
 
Palmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interestPalmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interest
 
Palmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interestPalmprint verification using lagrangian decomposition and invariant interest
Palmprint verification using lagrangian decomposition and invariant interest
 
­­­­Cursive Handwriting Recognition System using Feature Extraction and Artif...
­­­­Cursive Handwriting Recognition System using Feature Extraction and Artif...­­­­Cursive Handwriting Recognition System using Feature Extraction and Artif...
­­­­Cursive Handwriting Recognition System using Feature Extraction and Artif...
 
ppt 20BET1024.pptx
ppt 20BET1024.pptxppt 20BET1024.pptx
ppt 20BET1024.pptx
 
pydataPointCloud.pptx
pydataPointCloud.pptxpydataPointCloud.pptx
pydataPointCloud.pptx
 
Generating LaTeX Code for Handwritten Mathematical Equations using Convolutio...
Generating LaTeX Code for Handwritten Mathematical Equations using Convolutio...Generating LaTeX Code for Handwritten Mathematical Equations using Convolutio...
Generating LaTeX Code for Handwritten Mathematical Equations using Convolutio...
 

Último

FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
dollysharma2066
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.ppt
MsecMca
 

Último (20)

Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 
Employee leave management system project.
Employee leave management system project.Employee leave management system project.
Employee leave management system project.
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
Unit 2- Effective stress & Permeability.pdf
Unit 2- Effective stress & Permeability.pdfUnit 2- Effective stress & Permeability.pdf
Unit 2- Effective stress & Permeability.pdf
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
22-prompt engineering noted slide shown.pdf
22-prompt engineering noted slide shown.pdf22-prompt engineering noted slide shown.pdf
22-prompt engineering noted slide shown.pdf
 
Block diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.pptBlock diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.ppt
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
 
Minimum and Maximum Modes of microprocessor 8086
Minimum and Maximum Modes of microprocessor 8086Minimum and Maximum Modes of microprocessor 8086
Minimum and Maximum Modes of microprocessor 8086
 
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
 
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptx
 
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
 
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.ppt
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 

HANDWRITTEN DIGIT RECOGNITION USING k-NN CLASSIFIER

  • 1. RECOGNIZING HANDWRITTEN DIGIT USING K-NEAREST NEIGHBOUR CLASSIFIER By- Vineet Raj
  • 2. INTRODUCTION Handwritten digit recognition is the process of receiving and correctly interpreting a legible hand-drawn digit from an input source (paper or photographs) by comparing it with previously trained data.
  • 3. APPLICATIONS • Postal mail sorting • Courtesy amounts on cheques • Formation of data entry etc. Recognition of legal amounts on bank cheques Currency Recognition Number Plate Recognition House no. Recognition Postal mail sorting
  • 4. PROBLEM STATEMENT Given a set of greyscale isolated numerical images taken from MNIST database. The objectives are:-  To recognize handwritten digits correctly.  To improve the accuracy of detection.  To develop a method which is independent of digit size and writer style/ink independent.
  • 5. LITERATURE SURVEY  Hand Written Character Recognition using Star-Layered Histogram Features Stephen Karungaru, Kenji Terada and Minoru Fukumi In this method, a character recognition method using features extracted from a star layered histogram is presented and trained using neural networks. After several image preprocessing steps, the character region is extracted. Its contour is then used to determine the center of gravity (COG). This CoG point is used as the origin to create a histogram using equally spaced lines extending from the CoG to the contour. The first point the line touches the character represents the first layer of the histogram. If the line extension has not reached the region boundary, the next hit represents the second layer of the histogram. This process is repeated until the line touches the boundary of the character’s region. After normalization, these features are used to train a neural network. Result This method achieves an accuracy of about 93% using the MNIST database of handwritten digits.  A Novel Feature Selection and Extraction Technique for Classification
  • 6. We present a versatile technique for the purpose of feature selection and extraction - Class Dependent Features (CDFs). CDFs identify the features innate to a class and extract them accordingly. The features thus extracted are relevant to the entire class and not just to the individual data item. This paper focuses on using CDFs to improve the accuracy of classification and at the same time control computational expense by tackling the curse of dimensionality. Result- This method achieves an accuracy of about 92%
  • 7. EXISTING MODELS Feature extraction methods • Star layered histogram feature extraction algorithm requires thinning operation many inner details can not be captured using outer polygons • Class Dependent feature selection and extraction expensive in terms of computation
  • 8. Classification Algorithms • Linear Classifier error rate is 12.0% • Neural Networks requires thousands of training examples and huge computation time
  • 9. PROPOSED MODEL ISOLATED NUMERAL IMAGES FROM MNIST DATABASE PRE-PROCESSING FEATURE EXTRACTION CLASSIFICATION ALGORITHM The proposed method uses k-nearest neighbour(k-NN) classification algorithm for classifying the MNIST digit images. Accuracy of about 96% can be achieved. Less number of computations required. No thinning operation required.
  • 10. REFERENCES Hand Written Character Recognition using Star-Layered Histogram Features Stephen Karungaru, Kenji Terada and Minoru Fukumi A Novel Feature Selection and Extraction Technique for Classification Kratarth Goel, Raunaq Vohra and Ainesh Bakshi Handwritten Digit Recognition Using K-Nearest Neighbour Classifier U Ravi Babu, Dr. Y Venkateswarlu and Aneel Kumar Chintha Y. LeCun, et al., Comparison of learning algorithms for handwritten digit recognition F. Fogelman-Souli e, P. Gallinari (Eds.) Yann LeCun,”THE MNIST database of handwritten digits” Courant Institute, NYU Corinna Cortes, Google Labs, NewYork