Recomendados
Más contenido relacionado
Similar a ML-02.pdf
Similar a ML-02.pdf (20)
Último
Último (20)
ML-02.pdf
- 1. Machine Learning LEC 01: Welcome Machine Learning L E C 0 2 TA1 Mohammad Akbari Instructor TAs 00-00 Time Introduction to Machine Learning
- 2. Machine Learning LEC 01: Welcome What is Machine Learning?
- 3. Machine Learning LEC 01: Welcome What is Machine Learning (speech recognition)? “Hi” “How are you” “Good bye” You said “Hello” A large amount of audio data You write the program for learning. Learning ......
- 4. Machine Learning LEC 01: Welcome “monkey” “cat” “dog” What is Machine Learning? This is “cat” A large amount of images You write the program for learning. Learning ......
- 5. Machine Learning LEC 01: Welcome Machine Learning ≈ Looking for a Function • Speech Recognition • Image Recognition • Playing Go • Dialogue System ( )= f ( )= f ( )= f ( )= f “Cat” “How are you” “5-5” “Hello” “Hi” (what the user said) (system response) (next move)
- 6. Machine Learning LEC 01: Welcome Framework A set of function ! 2 1, f f ( )= 1 f “cat” ( )= 1 f “dog” ( )= 2 f “monkey” ( )= 2 f “snake” Model ( )= f “cat” Image Recognition:
- 7. Machine Learning LEC 01: Welcome Framework A set of function ! 2 1, f f ( )= f “cat” Image Recognition: Model Training Data Goodness of function f Better! “monkey” “cat” “dog” function input: function output:
- 8. Machine Learning LEC 01: Welcome Framework A set of function ! 2 1, f f ( )= f “cat” Image Recognition: Model Training Data Goodness of function f “monkey” “cat” “dog” * f Pick the “Best” Function Using * f “cat” Training Testing Step 1 Step 2 Step 3
- 9. Machine Learning LEC 01: Welcome Step 1: define a set of function Step 2: goodness of function Step 3: pick the best function Machine Learning is so simple …… Similar to put an elephant into a refrigerator ……
- 10. Machine Learning LEC 01: Welcome Learning Map
- 11. Machine Learning LEC 01: Welcome Supervised Learning Regression Linear Model Structured Learning Semi-supervised Learning Transfer Learning Unsupervised Learning Reinforcement Learning Classification Deep Learning SVM, decision tree, K-NN … Non-linear Model scenario method task Learning Map Learning Theory
- 12. Machine Learning LEC 01: Welcome Learning Map Regression The output of the target function ! is “scalar”. f Today’s morning PM2.5 Yesterday’s morning PM2.5 ……. Tomorrow’s morning PM2.5 (scalar) 9/01 morning PM2.5 = 63 9/02 morning PM2.5 = 65 9/03 morning PM2.5 = 100 Training Data: 9/12 morning PM2.5 = 30 9/13 morning PM2.5 = 25 9/14 morning PM2.5 = 20 Input: Input: Output: Output: Predict: PM2.5
- 13. Machine Learning LEC 01: Welcome Learning Map Regression Classification
- 14. Machine Learning LEC 01: Welcome Classification • Binary Classification • Multi-class Classification Function f Function f Input Input Yes or No Class 1, Class 2, … Class N
- 15. Machine Learning LEC 01: Welcome Binary Classification Spam filtering (http://spam-filter-review.toptenreviews.com/) Function Yes/No Yes No Training Data
- 16. Machine Learning LEC 01: Welcome Multi-class Classification http://top-breaking-news.com/ Function Policy Sports Econ Sport Policy Econ Training Data Document Classification
- 17. Machine Learning LEC 01: Welcome Learning Map Regression Linear Model Classification Deep Learning Non-linear Model
- 18. Machine Learning LEC 01: Welcome Classification - Deep Learning • Image Recognition Function “monkey” “cat” “dog” “monkey” “cat” “dog” Training Data Each possible object is a class Hierarchical Structure
- 19. Machine Learning LEC 01: Welcome Classification - Deep Learning • Playing GO Function (19 x 19 classes) Next move Each position is a class Training Data
- 20. Machine Learning LEC 01: Welcome Learning Map Supervised Learning Regression Linear Model Semi-supervised Learning Classification Deep Learning SVM, decision tree, K-NN … Non-linear Model Training Data: Input/output pair of target function Function output = label Hard to collect a large amount of labelled data
- 21. Machine Learning LEC 01: Welcome Semi-supervised Learning Labelled data Unlabeled data cat dog (Images of cats and dogs) For example, recognizing cats and dogs
- 22. Machine Learning LEC 01: Welcome Learning Map Supervised Learning Regression Linear Model Structured Learning Semi-supervised Learning Transfer Learning Classification Deep Learning SVM, decision tree, K-NN … Non-linear Model
- 23. Machine Learning LEC 01: Welcome Transfer Learning Labelled data cat dog Data not related to the task considered (can be either labeled or unlabeled) elephant Haruhi For example, recognizing cats and dogs
- 24. Machine Learning LEC 01: Welcome Learning Map Supervised Learning Regression Linear Model Structured Learning Semi-supervised Learning Transfer Learning Unsupervised Learning Classification Deep Learning SVM, decision tree, K-NN … Non-linear Model
- 25. Machine Learning LEC 01: Welcome http://top-breaking-news.com/ Unsupervised Learning • Machine Reading: Machine learns the meaning of words from reading a lot of documents
- 26. Machine Learning LEC 01: Welcome Unsupervised Learning • Machine Reading: Machine learns the meaning of words from reading a lot of documents Function Apple https://garavato.files.wordpress.com/ 2011/11/stacksdocuments.jpg?w=490 Training data is a lot of text ?
- 27. Machine Learning LEC 01: Welcome Unsupervised Learning Draw something! http://ttic.uchicago.edu/~ klivescu/MLSLP2016/ (slides of Ian Goodfellow)
- 28. Machine Learning LEC 01: Welcome Unsupervised Learning • Machine Drawing Function ? Training data is a lot of images code
- 29. Machine Learning LEC 01: Welcome Learning Map Supervised Learning Regression Linear Model Structured Learning Semi-supervised Learning Transfer Learning Unsupervised Learning Classification Deep Learning SVM, decision tree, K-NN … Non-linear Model
- 30. Machine Learning LEC 01: Welcome Structured Learning - Beyond Classification “機器學習” “Welcome to Machine Learning” “Machine Learning” f Speech Recognition f Machine Translation Face Recognition
- 31. Machine Learning LEC 01: Welcome Structured Learning - Beyond Classification Face Recognition https://github.com/yu4 u/age-gender- estimation
- 32. Machine Learning LEC 01: Welcome Learning Map Supervised Learning Regression Linear Model Structured Learning Semi-supervised Learning Transfer Learning Unsupervised Learning Reinforcement Learning Classification Deep Learning SVM, decision tree, K-NN … Non-linear Model
- 33. Machine Learning LEC 01: Welcome Transfer Learning - Machine Learning's Next Frontier http://ruder.io/transfer-learning/
- 34. Machine Learning LEC 01: Welcome Transfer Learning - Machine Learning's Next Frontier http://ruder.io/transfer-learning/
- 35. Machine Learning LEC 01: Welcome Transfer Learning - Machine Learning's Next Frontier http://ruder.io/transfer-learning/
- 36. Machine Learning LEC 01: Welcome Reinforcement Learning
- 37. Machine Learning LEC 01: Welcome Reinforcement learning https://www.marutitech.com/businesses-reinforcement-learning/
- 38. Machine Learning LEC 01: Welcome Reinforcement learning https://becominghuman.ai/the-very-basics-of-reinforcement-learning-154f28a79071
- 39. Machine Learning LEC 01: Welcome Face Aging https://medium.com/syncedreview/face-aging-with-conditional-generative- adversarial-networks-d41076379047
- 40. Machine Learning LEC 01: Welcome Face Aging
- 41. Machine Learning LEC 01: Welcome Supervised v.s. Reinforcement • Supervised • Reinforcement Hello J Agent …… Agent ……. ……. …… Bad “Hello” Say “Hi” “Bye bye” Say “Good bye” Learning from teacher Learning from critics
- 42. Machine Learning LEC 01: Welcome Supervised v.s. Reinforcement • Supervised: • Reinforcement Learning Next move: “5-5” Next move: “3-3” First move …… many moves …… Win! Alpha Go is supervised learning + reinforcement learning.
- 43. Machine Learning LEC 01: Welcome Supervised Learning Regression Linear Model Structured Learning Semi-supervised Learning Transfer Learning Unsupervised Learning Reinforcement Learning Classification Deep Learning SVM, decision tree, K-NN … Non-linear Model scenario method task Learning Map Learning Theory
- 44. Machine Learning LEC 01: Welcome Why we need to learn Machine Learning? http://www.express.co.uk/news/science/651202/First-step-towards-The-Terminator- becoming-reality-AI-beats-champ-of-world-s-oldest-game New job：AI trainer Will AI replace our jobs?
- 45. Machine Learning LEC 01: Welcome Questions?