SlideShare una empresa de Scribd logo
1 de 39
Machine Learning A large and fascinating field;  there’s much more than what you’ll see in this class!
What should we try to learn, if we want to… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What should we try to learn, if we want to… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],This stuff has got to be an important part of the future  … …  beats trying to program all the special cases directly …  and there are “intelligent” behaviors you can’t imagine programming directly.  (Most of the stuff now in your brain wasn’t programmed in advance, either!)
The simplest problem: Supervised binary classification of vectors ,[object Object],[object Object],[object Object],[object Object]
Linear Separators slide thanks to Ray Mooney
Linear Separators slide thanks to Ray Mooney
Nonlinear Separators slide thanks to Ray Mooney (modified)
Nonlinear Separators Note: A more complex function requires more data to generate an accurate model  (sample complexity) slide thanks to Kevin Small (modified) x y
Encoding and decoding for learning ,[object Object],[object Object]
Features for recognizing a chair?
Features for recognizing childhood autism? (from DSM IV, the Diagnostic and Statistical Manual) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Features for recognizing childhood autism? (from DSM IV, the Diagnostic and Statistical Manual) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Features for recognizing a prime number? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Features for recognizing masculine vs. feminine words in French? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Features for recognizing when the user who’s typing isn’t the usual user? ,[object Object]
Measuring performance ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Encoding and decoding for learning ,[object Object],[object Object],[object Object]
Multiclass Classification Many binary classifiers (“one versus all”) slide thanks to Kevin Small (modified) One multiway classifier
Regression: predict a number, not a class ,[object Object],[object Object]
Inference: Predict a whole pattern ,[object Object],[object Object],[object Object],[object Object],[object Object]
Defining Learning Problems ,[object Object],[object Object],[object Object],[object Object],slide thanks to Kevin Small (modified)
Context Sensitive Spelling ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],slide thanks to Kevin Small (modified)
Sentence Representation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],slide thanks to Kevin Small (modified)
Sentence Representation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],slide thanks to Kevin Small (modified) 1 2 3
Embedding ,[object Object],[object Object],slide thanks to Kevin Small (modified) Peace Piece
Sparse Representation ,[object Object],[object Object],[object Object],[object Object],[object Object],slide thanks to Kevin Small (modified)
Types of Sparsity ,[object Object],[object Object],[object Object],[object Object],[object Object],slide thanks to Kevin Small (modified)
Training paradigms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Training and test sets ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Overfitting and underfitting ,[object Object],[object Object],[object Object],[object Object]
“ Feature Engineering” Workshop in 2005 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
“ Feature Engineering” Workshop in 2005 ,[object Object],[object Object],[object Object],[object Object]
“ Feature Engineering” Workshop in 2005 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
A Machine Learning System slide thanks to Kevin Small (modified) Preprocessing Raw Text Formatted Text
Preprocessing Text ,[object Object],[object Object],slide thanks to Kevin Small (modified) They recently recovered a small piece of a live Elvis concert recording. He was singing gospel songs, including “Peace in the Valley.”  0  0  0  They 0  0  1  recently 0  0  2  recovered 0  0  3  a 0  0  4  small piece  0  5  piece 0  0  6  of : 0  1  6  including 0  1  7  QUOTE peace 1  8  Peace 0  1  9  in 0  1  10  the 0  1  11  Valley 0  1  12  . 0  1  13  QUOTE
A Machine Learning System Feature Vectors slide thanks to Kevin Small (modified) Preprocessing Feature Extraction Raw Text Formatted Text
Feature Extraction ,[object Object],[object Object],slide thanks to Kevin Small (modified) 0  0  0  They 0  0  1  recently 0  0  2  recovered 0  0  3  a 0  0  4  small piece  0  5  piece 0  0  6  of : 0  1  6  including 0  1  7  QUOTE peace 1  8  Peace 0  1  9  in 0  1  10  the 0  1  11  Valley 0  1  12  . 0  1  13  QUOTE 0, 1001, 1013, 1134, 1175, 1206 1, 1021, 1055, 1085, 1182, 1252 Lexicon File
A Machine Learning System Testing Examples Feature Vectors Training Examples slide thanks to Kevin Small (modified) Preprocessing Feature Extraction Machine Learner Classifier Postprocessing Raw Text Formatted Text Function Parameters Labels Annotated Text
A Machine Learning System Testing Examples Feature Vectors Training Examples slide thanks to Kevin Small (modified) Preprocessing Feature Extraction Machine Learner Classifier Postprocessing Raw Text Formatted Text Function Parameters Labels Annotated Text

Más contenido relacionado

La actualidad más candente

Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...
Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...
Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...
Simplilearn
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machines
nextlib
 

La actualidad más candente (20)

Machine Learning with Decision trees
Machine Learning with Decision treesMachine Learning with Decision trees
Machine Learning with Decision trees
 
Perceptron (neural network)
Perceptron (neural network)Perceptron (neural network)
Perceptron (neural network)
 
Unsupervised learning
Unsupervised learningUnsupervised learning
Unsupervised learning
 
Adaptive Resonance Theory
Adaptive Resonance TheoryAdaptive Resonance Theory
Adaptive Resonance Theory
 
Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...
Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...
Random Forest Algorithm - Random Forest Explained | Random Forest In Machine ...
 
Deep neural networks
Deep neural networksDeep neural networks
Deep neural networks
 
Support Vector Machines ( SVM )
Support Vector Machines ( SVM ) Support Vector Machines ( SVM )
Support Vector Machines ( SVM )
 
MACHINE LEARNING - GENETIC ALGORITHM
MACHINE LEARNING - GENETIC ALGORITHMMACHINE LEARNING - GENETIC ALGORITHM
MACHINE LEARNING - GENETIC ALGORITHM
 
Artificial Neural Networks Lect3: Neural Network Learning rules
Artificial Neural Networks Lect3: Neural Network Learning rulesArtificial Neural Networks Lect3: Neural Network Learning rules
Artificial Neural Networks Lect3: Neural Network Learning rules
 
Training Neural Networks
Training Neural NetworksTraining Neural Networks
Training Neural Networks
 
Classification and Regression
Classification and RegressionClassification and Regression
Classification and Regression
 
Data mining Measuring similarity and desimilarity
Data mining Measuring similarity and desimilarityData mining Measuring similarity and desimilarity
Data mining Measuring similarity and desimilarity
 
PAC Learning
PAC LearningPAC Learning
PAC Learning
 
Artificial Neural Networks 1
Artificial Neural Networks 1Artificial Neural Networks 1
Artificial Neural Networks 1
 
K Nearest Neighbor Algorithm
K Nearest Neighbor AlgorithmK Nearest Neighbor Algorithm
K Nearest Neighbor Algorithm
 
K mean-clustering algorithm
K mean-clustering algorithmK mean-clustering algorithm
K mean-clustering algorithm
 
Regularization in deep learning
Regularization in deep learningRegularization in deep learning
Regularization in deep learning
 
Ensemble learning
Ensemble learningEnsemble learning
Ensemble learning
 
Artificial Neural Networks Lect5: Multi-Layer Perceptron & Backpropagation
Artificial Neural Networks Lect5: Multi-Layer Perceptron & BackpropagationArtificial Neural Networks Lect5: Multi-Layer Perceptron & Backpropagation
Artificial Neural Networks Lect5: Multi-Layer Perceptron & Backpropagation
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machines
 

Similar a Using binary classifiers

Machine Learning and Inductive Inference
Machine Learning and Inductive InferenceMachine Learning and Inductive Inference
Machine Learning and Inductive Inference
butest
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.ppt
butest
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.ppt
butest
 
notes as .ppt
notes as .pptnotes as .ppt
notes as .ppt
butest
 
Machine Learning ICS 273A
Machine Learning ICS 273AMachine Learning ICS 273A
Machine Learning ICS 273A
butest
 
Artificial intelligency full_ppt_persentation_way2project_in
Artificial intelligency full_ppt_persentation_way2project_inArtificial intelligency full_ppt_persentation_way2project_in
Artificial intelligency full_ppt_persentation_way2project_in
Sumit Sharma
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
yham manansala
 
Peter Norvig - NYC Machine Learning 2013
Peter Norvig - NYC Machine Learning 2013Peter Norvig - NYC Machine Learning 2013
Peter Norvig - NYC Machine Learning 2013
Michael Scovetta
 
DL Classe 0 - You can do it
DL Classe 0 - You can do itDL Classe 0 - You can do it
DL Classe 0 - You can do it
Gregory Renard
 
AML_030607.ppt
AML_030607.pptAML_030607.ppt
AML_030607.ppt
butest
 
Mathematics and technology(2)
Mathematics and technology(2)Mathematics and technology(2)
Mathematics and technology(2)
Jonathan Martin
 

Similar a Using binary classifiers (20)

09learning.ppt
09learning.ppt09learning.ppt
09learning.ppt
 
Machine Learning and Inductive Inference
Machine Learning and Inductive InferenceMachine Learning and Inductive Inference
Machine Learning and Inductive Inference
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.ppt
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.ppt
 
notes as .ppt
notes as .pptnotes as .ppt
notes as .ppt
 
Analyse de sentiment et classification par approche neuronale en Python et Weka
Analyse de sentiment et classification par approche neuronale en Python et WekaAnalyse de sentiment et classification par approche neuronale en Python et Weka
Analyse de sentiment et classification par approche neuronale en Python et Weka
 
Machine Learning ICS 273A
Machine Learning ICS 273AMachine Learning ICS 273A
Machine Learning ICS 273A
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
 
L1
L1L1
L1
 
Artificial intelligency full_ppt_persentation_way2project_in
Artificial intelligency full_ppt_persentation_way2project_inArtificial intelligency full_ppt_persentation_way2project_in
Artificial intelligency full_ppt_persentation_way2project_in
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Peter Norvig - NYC Machine Learning 2013
Peter Norvig - NYC Machine Learning 2013Peter Norvig - NYC Machine Learning 2013
Peter Norvig - NYC Machine Learning 2013
 
Deep Learning Class #0 - You Can Do It
Deep Learning Class #0 - You Can Do ItDeep Learning Class #0 - You Can Do It
Deep Learning Class #0 - You Can Do It
 
DL Classe 0 - You can do it
DL Classe 0 - You can do itDL Classe 0 - You can do it
DL Classe 0 - You can do it
 
AML_030607.ppt
AML_030607.pptAML_030607.ppt
AML_030607.ppt
 
Mathematics and technology(2)
Mathematics and technology(2)Mathematics and technology(2)
Mathematics and technology(2)
 
GDSC ML-1.pptx
GDSC ML-1.pptxGDSC ML-1.pptx
GDSC ML-1.pptx
 
Machine learning-in-details-with-out-python-code
Machine learning-in-details-with-out-python-codeMachine learning-in-details-with-out-python-code
Machine learning-in-details-with-out-python-code
 
The Role Of Ontology In Modern Expert Systems Dallas 2008
The Role Of Ontology In Modern Expert Systems   Dallas   2008The Role Of Ontology In Modern Expert Systems   Dallas   2008
The Role Of Ontology In Modern Expert Systems Dallas 2008
 
AI and ML Skills for the Testing World Tutorial
AI and ML Skills for the Testing World TutorialAI and ML Skills for the Testing World Tutorial
AI and ML Skills for the Testing World Tutorial
 

Más de butest

EL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEEL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBE
butest
 
1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同
butest
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
butest
 
Timeline: The Life of Michael Jackson
Timeline: The Life of Michael JacksonTimeline: The Life of Michael Jackson
Timeline: The Life of Michael Jackson
butest
 
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
butest
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
butest
 
Com 380, Summer II
Com 380, Summer IICom 380, Summer II
Com 380, Summer II
butest
 
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet JazzThe MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
butest
 
MICHAEL JACKSON.doc
MICHAEL JACKSON.docMICHAEL JACKSON.doc
MICHAEL JACKSON.doc
butest
 
Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1
butest
 
Facebook
Facebook Facebook
Facebook
butest
 
Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...
butest
 
Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...
butest
 
NEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTNEWS ANNOUNCEMENT
NEWS ANNOUNCEMENT
butest
 
C-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docC-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.doc
butest
 
MAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docMAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.doc
butest
 
Mac OS X Guide.doc
Mac OS X Guide.docMac OS X Guide.doc
Mac OS X Guide.doc
butest
 
WEB DESIGN!
WEB DESIGN!WEB DESIGN!
WEB DESIGN!
butest
 

Más de butest (20)

EL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEEL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBE
 
1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
 
Timeline: The Life of Michael Jackson
Timeline: The Life of Michael JacksonTimeline: The Life of Michael Jackson
Timeline: The Life of Michael Jackson
 
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
 
Com 380, Summer II
Com 380, Summer IICom 380, Summer II
Com 380, Summer II
 
PPT
PPTPPT
PPT
 
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet JazzThe MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
 
MICHAEL JACKSON.doc
MICHAEL JACKSON.docMICHAEL JACKSON.doc
MICHAEL JACKSON.doc
 
Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1
 
Facebook
Facebook Facebook
Facebook
 
Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...
 
Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...
 
NEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTNEWS ANNOUNCEMENT
NEWS ANNOUNCEMENT
 
C-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docC-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.doc
 
MAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docMAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.doc
 
Mac OS X Guide.doc
Mac OS X Guide.docMac OS X Guide.doc
Mac OS X Guide.doc
 
hier
hierhier
hier
 
WEB DESIGN!
WEB DESIGN!WEB DESIGN!
WEB DESIGN!
 

Using binary classifiers

  • 1. Machine Learning A large and fascinating field; there’s much more than what you’ll see in this class!
  • 2.
  • 3.
  • 4.
  • 5. Linear Separators slide thanks to Ray Mooney
  • 6. Linear Separators slide thanks to Ray Mooney
  • 7. Nonlinear Separators slide thanks to Ray Mooney (modified)
  • 8. Nonlinear Separators Note: A more complex function requires more data to generate an accurate model (sample complexity) slide thanks to Kevin Small (modified) x y
  • 9.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18. Multiclass Classification Many binary classifiers (“one versus all”) slide thanks to Kevin Small (modified) One multiway classifier
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34. A Machine Learning System slide thanks to Kevin Small (modified) Preprocessing Raw Text Formatted Text
  • 35.
  • 36. A Machine Learning System Feature Vectors slide thanks to Kevin Small (modified) Preprocessing Feature Extraction Raw Text Formatted Text
  • 37.
  • 38. A Machine Learning System Testing Examples Feature Vectors Training Examples slide thanks to Kevin Small (modified) Preprocessing Feature Extraction Machine Learner Classifier Postprocessing Raw Text Formatted Text Function Parameters Labels Annotated Text
  • 39. A Machine Learning System Testing Examples Feature Vectors Training Examples slide thanks to Kevin Small (modified) Preprocessing Feature Extraction Machine Learner Classifier Postprocessing Raw Text Formatted Text Function Parameters Labels Annotated Text

Notas del editor

  1. Add function formula
  2. pictures of a 4 class classifier...with the OvA definition
  3. Well-posed learning problems
  4. Framing the classification task
  5. note that the sentence changed
  6. note that the sentence changed
  7. Text categorization
  8. Word tagging
  9. Without algorithmic details as Dan says
  10. A machine learning system
  11. Preprocessing text
  12. A machine learning system
  13. Feature Generation (Kernels)
  14. A machine learning system
  15. A machine learning system