Enviar búsqueda
Cargar
Restricted Boltzmann Machines (RBM)
•
0 recomendaciones
•
230 vistas
L
Luis Serrano
Seguir
Slides for this video https://www.youtube.com/watch?v=Fkw0_aAtwIw
Leer menos
Leer más
Datos y análisis
Denunciar
Compartir
Denunciar
Compartir
1 de 139
Descargar ahora
Descargar para leer sin conexión
Recomendados
Logistic regression
Logistic regression
Luis Serrano
Generative Adversarial Networks (GANs)
Generative Adversarial Networks (GANs)
Luis Serrano
Object detection and Instance Segmentation
Object detection and Instance Segmentation
Hichem Felouat
Singular value decomposition (SVD)
Singular value decomposition (SVD)
Luis Serrano
Naive Bayes Classifier | Naive Bayes Algorithm | Naive Bayes Classifier With ...
Naive Bayes Classifier | Naive Bayes Algorithm | Naive Bayes Classifier With ...
Simplilearn
What is Machine Learning | Introduction to Machine Learning | Machine Learnin...
What is Machine Learning | Introduction to Machine Learning | Machine Learnin...
Simplilearn
SVM Algorithm Explained | Support Vector Machine Tutorial Using R | Edureka
SVM Algorithm Explained | Support Vector Machine Tutorial Using R | Edureka
Edureka!
Convolutional Neural Network (CNN)
Convolutional Neural Network (CNN)
Abdulrazak Zakieh
Recomendados
Logistic regression
Logistic regression
Luis Serrano
Generative Adversarial Networks (GANs)
Generative Adversarial Networks (GANs)
Luis Serrano
Object detection and Instance Segmentation
Object detection and Instance Segmentation
Hichem Felouat
Singular value decomposition (SVD)
Singular value decomposition (SVD)
Luis Serrano
Naive Bayes Classifier | Naive Bayes Algorithm | Naive Bayes Classifier With ...
Naive Bayes Classifier | Naive Bayes Algorithm | Naive Bayes Classifier With ...
Simplilearn
What is Machine Learning | Introduction to Machine Learning | Machine Learnin...
What is Machine Learning | Introduction to Machine Learning | Machine Learnin...
Simplilearn
SVM Algorithm Explained | Support Vector Machine Tutorial Using R | Edureka
SVM Algorithm Explained | Support Vector Machine Tutorial Using R | Edureka
Edureka!
Convolutional Neural Network (CNN)
Convolutional Neural Network (CNN)
Abdulrazak Zakieh
Mask-RCNN for Instance Segmentation
Mask-RCNN for Instance Segmentation
Dat Nguyen
Naive Bayes Classifier in Python | Naive Bayes Algorithm | Machine Learning A...
Naive Bayes Classifier in Python | Naive Bayes Algorithm | Machine Learning A...
Edureka!
Machine Learning - Introduction to Convolutional Neural Networks
Machine Learning - Introduction to Convolutional Neural Networks
Andrew Ferlitsch
Object Detection and Recognition
Object Detection and Recognition
Intel Nervana
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
NAVER Engineering
Deep Learning in Computer Vision
Deep Learning in Computer Vision
Sungjoon Choi
Naive bayes
Naive bayes
umeskath
Bayes theorem and Naive Bayes algorithm
Bayes theorem and Naive Bayes algorithm
Luis Serrano
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
Edureka!
CNN Attention Networks
CNN Attention Networks
Taeoh Kim
Graph Neural Network for Phenotype Prediction
Graph Neural Network for Phenotype Prediction
tuxette
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Simplilearn
Pythonistaで始めるiOSプロトタイプ開発
Pythonistaで始めるiOSプロトタイプ開発
Yusuke Muraoka
Stable Diffusion path
Stable Diffusion path
Vitaly Bondar
Introduction to Grad-CAM (complete version)
Introduction to Grad-CAM (complete version)
Hsing-chuan Hsieh
Pr057 mask rcnn
Pr057 mask rcnn
Taeoh Kim
Naive Bayes Classifier
Naive Bayes Classifier
Arunabha Saha
Introduction to Deep Learning, Keras, and TensorFlow
Introduction to Deep Learning, Keras, and TensorFlow
Sri Ambati
Artificial Neural Network | Deep Neural Network Explained | Artificial Neural...
Artificial Neural Network | Deep Neural Network Explained | Artificial Neural...
Simplilearn
Naive Bayes Classifier
Naive Bayes Classifier
Yiqun Hu
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
gajnagarg
Anomaly detection and data imputation within time series
Anomaly detection and data imputation within time series
Paris Women in Machine Learning and Data Science
Más contenido relacionado
La actualidad más candente
Mask-RCNN for Instance Segmentation
Mask-RCNN for Instance Segmentation
Dat Nguyen
Naive Bayes Classifier in Python | Naive Bayes Algorithm | Machine Learning A...
Naive Bayes Classifier in Python | Naive Bayes Algorithm | Machine Learning A...
Edureka!
Machine Learning - Introduction to Convolutional Neural Networks
Machine Learning - Introduction to Convolutional Neural Networks
Andrew Ferlitsch
Object Detection and Recognition
Object Detection and Recognition
Intel Nervana
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
NAVER Engineering
Deep Learning in Computer Vision
Deep Learning in Computer Vision
Sungjoon Choi
Naive bayes
Naive bayes
umeskath
Bayes theorem and Naive Bayes algorithm
Bayes theorem and Naive Bayes algorithm
Luis Serrano
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
Edureka!
CNN Attention Networks
CNN Attention Networks
Taeoh Kim
Graph Neural Network for Phenotype Prediction
Graph Neural Network for Phenotype Prediction
tuxette
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Simplilearn
Pythonistaで始めるiOSプロトタイプ開発
Pythonistaで始めるiOSプロトタイプ開発
Yusuke Muraoka
Stable Diffusion path
Stable Diffusion path
Vitaly Bondar
Introduction to Grad-CAM (complete version)
Introduction to Grad-CAM (complete version)
Hsing-chuan Hsieh
Pr057 mask rcnn
Pr057 mask rcnn
Taeoh Kim
Naive Bayes Classifier
Naive Bayes Classifier
Arunabha Saha
Introduction to Deep Learning, Keras, and TensorFlow
Introduction to Deep Learning, Keras, and TensorFlow
Sri Ambati
Artificial Neural Network | Deep Neural Network Explained | Artificial Neural...
Artificial Neural Network | Deep Neural Network Explained | Artificial Neural...
Simplilearn
Naive Bayes Classifier
Naive Bayes Classifier
Yiqun Hu
La actualidad más candente
(20)
Mask-RCNN for Instance Segmentation
Mask-RCNN for Instance Segmentation
Naive Bayes Classifier in Python | Naive Bayes Algorithm | Machine Learning A...
Naive Bayes Classifier in Python | Naive Bayes Algorithm | Machine Learning A...
Machine Learning - Introduction to Convolutional Neural Networks
Machine Learning - Introduction to Convolutional Neural Networks
Object Detection and Recognition
Object Detection and Recognition
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
Deep Learning in Computer Vision
Deep Learning in Computer Vision
Naive bayes
Naive bayes
Bayes theorem and Naive Bayes algorithm
Bayes theorem and Naive Bayes algorithm
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
CNN Attention Networks
CNN Attention Networks
Graph Neural Network for Phenotype Prediction
Graph Neural Network for Phenotype Prediction
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Pythonistaで始めるiOSプロトタイプ開発
Pythonistaで始めるiOSプロトタイプ開発
Stable Diffusion path
Stable Diffusion path
Introduction to Grad-CAM (complete version)
Introduction to Grad-CAM (complete version)
Pr057 mask rcnn
Pr057 mask rcnn
Naive Bayes Classifier
Naive Bayes Classifier
Introduction to Deep Learning, Keras, and TensorFlow
Introduction to Deep Learning, Keras, and TensorFlow
Artificial Neural Network | Deep Neural Network Explained | Artificial Neural...
Artificial Neural Network | Deep Neural Network Explained | Artificial Neural...
Naive Bayes Classifier
Naive Bayes Classifier
Último
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
gajnagarg
Anomaly detection and data imputation within time series
Anomaly detection and data imputation within time series
Paris Women in Machine Learning and Data Science
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
karishmasinghjnh
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
michael115558
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
Call Girls in Nagpur High Profile Call Girls
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
amitlee9823
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
amitlee9823
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
amitlee9823
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
only4webmaster01
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
Elaine Werffeli
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
gajnagarg
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Pooja Nehwal
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
Último
(20)
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Anomaly detection and data imputation within time series
Anomaly detection and data imputation within time series
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls Bellary Escorts ☎️9352988975 Two shot with one girl ...
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Restricted Boltzmann Machines (RBM)
1.
A friendly introduction
to Restricted Boltzmann Machines (RBM) Luis Serrano
2.
The mystery
3.
Aisha Beto Cameron Mystery
4.
Aisha Mystery
5.
Beto Mystery
6.
Cameron Mystery
7.
Aisha Cameron Mystery
8.
Beto Cameron Mystery
9.
Beto Cameron Mystery Aisha Don’t like
himUgh, Beto… Aisha and Cameron? Nope
10.
Beto Cameron Mystery Aisha Aisha? Beto?Who
are they? No clue who they are.
11.
Beto Cameron Solution Aisha Descartes Euler WOOF
YEAH!DOGS!!! I LOVE CATS!
12.
Beto Cameron Weights Aisha Descartes Euler 4
-2 2 2 -2 -4 1 1 1 12 Hidden Layer Visible Layer
13.
Restricted Boltzmann Machine
(RBM) 4 -2 2 2 -2 -4 1 1 1 12 Hidden Layer Visible Layer
14.
Scores
15.
Beto Cameron Scores Aisha Descartes Euler 4
-2 2 2 -2 -4 1 1 1 12 Participants Score B CA D E4 -2 2 2 -2 -4 1 1 1 12
16.
Beto Cameron Scores Aisha Descartes Euler 4
-2 2 2 -2 -4 1 1 1 12 Participants Score B CA D E 4 -222 -2 -4 1 1 112 6
17.
Cameron Scores Aisha Descartes 2 2 1 1 2 Participants Score 2 2 1 1 2 B
CA D E
18.
Cameron Scores Aisha Descartes 2 2 1 1 2 Participants Score 22 1 12 8 B
CA D E
19.
Beto Scores Descartes -4 1 2 Participants Score -4 1 2 B CA D
E
20.
Beto Scores Descartes -4 1 2 Participants Score -4 12 B CA D
E -1
21.
Scenario Score None 0 A
1 B 1 C 1 D 2 E 1 AB 2 AC 2 AD 5 AE 0 BC 2 BD -2 BE 7 CD 5 CE 0 DE 3 ABC 3 ABD 1 ABE 6 ACD 8 ACE -1 ADE 4 BCD 1 BCE 6 BDE 4 CDE 4 ABCD 4 ABCE 5 ABDE 5 ACDE 5 BCDE 5 ABCDE 6 Beto Cameron Scores Aisha Descartes Euler 4 -2 2 2 -2 -4 1 1 1 12
22.
Scenario Score None 0 A
1 B 1 C 1 D 2 E 1 AB 2 AC 2 AD 5 AE 0 BC 2 BD -2 BE 7 CD 5 CE 0 DE 3 ABC 3 ABD 1 ABE 6 ACD 8 ACE -1 ADE 4 BCD 1 BCE 6 BDE 4 CDE 4 ABCD 4 ABCE 5 ABDE 5 ACDE 5 BCDE 5 ABCDE 6 Beto Cameron Scores Aisha Descartes Euler 4 -2 2 2 -2 -4 1 1 1 12
23.
Restricted Boltzmann Machine
(RBM) 4 -2 2 2 -2 -4 1 1 1 12 Hidden Layer Visible Layer E = − ∑ i bivi − ∑ i aihi − ∑ i,j Wijvihj Energy = -Score
24.
Probabilities
25.
Scores to probabilities Sum
= 6 Score Probability 3 1/2 2 1/3 1 1/6 Sum = 1
26.
Scores to probabilities Sum
= 0 Score Probability 1 1/0 0 0/0 -1 -1/0
27.
Scores to probabilities Sum
= 4.086 Score escore Normalize 1 e1 = 2.718 0.665 0 e0 = 1 0.245 -1 e-1 = 0.368 0.09 Sum = 1
28.
Beto CameronAisha Descartes Euler 4
-2 2 2 -2 -4 1 1 1 12 Scenario Score eScore Probability None 0 1 0 A 1 2.72 0 B 1 2.72 0 C 1 2.72 0 D 2 7.38 0 E 1 2.72 0 AB 2 7.38 0 AC 2 7.38 0 AD 5 148.41 0.02 AE 0 2.72 0 BC 2 7.38 0 BD -2 0.14 0 BE 7 1096.63 0.17 CD 5 148.41 0.02 CE 0 1 0 DE 3 20.08 0 ABC 3 20.08 0 ABD 1 2.72 0 ABE 6 403.43 0.06 ACD 8 2980.96 0.45 ACE -1 0.37 0 ADE 4 54.6 0 BCD 1 2.72 0 BCE 6 403.43 0.06 BDE 4 54.6 0 CDE 4 54.6 0 ABCD 4 54.6 0.02 ABCE 5 148.41 0.02 ABDE 5 148.41 0.02 ACDE 5 148.41 0.02 BCDE 5 148.41 0.02 ABCDE 6 403.43 0.06
29.
Energy to probability 4
-2 2 2 -2 -4 1 1 1 12 Hidden Layer Visible Layer E = − ∑ i bivi − ∑ i aihi − ∑ i,j Wijvihj p(v, h) = 1 Z e−E(v,h) Z = ∑ v,h e−E(v,h)
30.
How to train
an RBM? What exactly do we want?
31.
0 0 0 0 0 0 0 0
0 00 A B C D E Scenario Score eScore Probability None 0 1 1/32 A 0 1 1/32 B 0 1 1/32 C 0 1 1/32 D 0 1 1/32 E 0 1 1/32 AB 0 1 1/32 AC 0 1 1/32 AD 0 1 1/32 AE 0 1 1/32 BC 0 1 1/32 BD 0 1 1/32 BE 0 1 1/32 CD 0 1 1/32 CE 0 1 1/32 DE 0 1 1/32 Scenario Score eScore Probability ABC 0 1 1/32 ABD 0 1 1/32 ABE 0 1 1/32 ACD 0 1 1/32 ACE 0 1 1/32 ADE 0 1 1/32 BCD 0 1 1/32 BCE 0 1 1/32 BDE 0 1 1/32 CDE 0 1 1/32 ABCD 0 1 1/32 ABCE 0 1 1/32 ABDE 0 1 1/32 ACDE 0 1 1/32 BCDE 0 1 1/32 ABCDE 0 1 1/32
32.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE 0 0 0 0 0 0 0 0
0 00 A B C D E
33.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
34.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
35.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
36.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
37.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
38.
How to train
an RBM? Contrastive divergence
39.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE A, C, and
no B
40.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
41.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
42.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE All scenarios
43.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
44.
B and no
A,C None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
45.
B and no
A,C None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
46.
B and no
A,C None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE All scenarios
47.
B and no
A,C None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE All scenarios
48.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
49.
Maximizing the probability
of the data 4 -2 2 2 -2 -4 1 1 1 12 Hidden Layer Visible Layer arg max W 𝔼[log P(v)]Maximize ∂ ∂W log P(vn)Derivative: = 𝔼 [ ∂ ∂W − E(v, h)|v = vn] − 𝔼 [ ∂ ∂W − E(v, h) ] arg max W ∏ v∈V P(v) Find
50.
The end? nope…
51.
Small problem
52.
There are way
too many possibilities! Problem None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE 32 = 25
53.
How many? … … 100 nodes 200
nodes 2300 configurations
54.
55.
Partition function is
intractable 4 -2 2 2 -2 -4 1 1 1 12 Hidden Layer Visible Layer p(v, h) = 1 Z e−E(v,h) Z = ∑ v,h e−E(v,h) Intractable
56.
Problem What can we
do? None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
57.
Solution: Gibbs sampling
58.
59.
60.
61.
62.
63.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
64.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
65.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
66.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE All scenarios
67.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE All scenarios
68.
A, C, and
no B None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE All scenarios
69.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
70.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
71.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
72.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
73.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
74.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
75.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
76.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
77.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
78.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
79.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Aisha Cameron Beto Any other scenario
80.
Aisha Cameron Beto None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Any other scenario
81.
Aisha Cameron Beto None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Any other scenario
82.
Aisha Cameron Beto None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Any other scenario
83.
Aisha Cameron Beto None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Any other scenario
84.
Aisha Cameron Beto None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Any other scenario
85.
Aisha Cameron Beto None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Any other scenario
86.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE 4 -2 2 2 -2 -4 1 1
1 12 A B C D E
87.
How to increase
(or decrease) the probability of a configuration?
88.
A B C ED RBM
89.
A B C ED Increase
probability of
90.
A B C ED Increase
probability of
91.
Beto CameronAisha Descartes Euler 0 0 0 0 0 0 0
0 0 00 Increase probability of
92.
Beto CameronAisha Descartes Euler 0 0 0 0 0 0 0
0 0 00 Increase probability of Learning rate = 0.1
93.
Beto CameronAisha Descartes Euler 0
0.1 0 0 0.1 0 0.1 0 0.1 0.10 Increase probability of Learning rate = 0.1
94.
Beto CameronAisha Descartes Euler 0
0.1 0 0 0.1 0 0.1 0 0.1 0.10 Decrease probability of
95.
Beto CameronAisha Descartes Euler 0
0.1 0 0 0.1 0 0.1 0 0.1 0.10 Decrease probability of
96.
Beto CameronAisha Descartes Euler 0
0.1 -0.1 0 0.1 0 0.1 0 0 0.1-0.1 Decrease probability of
97.
Beto CameronAisha Descartes Euler 4 -2 2 2 -2 -4 1
1 1 12 None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE
98.
Are we done
now? Still no…
99.
Sampling problems
100.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE A, C, and
no B
101.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE A, C, and
no B All other scenarios
102.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Picking random items from
here is really hard! How to pick a random one with conditions How to pick a completely random one
103.
How to pick
a sample that agrees with our data point?
104.
Gibbs Sampling
105.
Independent sampling
106.
BetoAisha Descartes 1 1 1 Euler Fernando
-2 Gloria -1 Igor 0 2 1 Hypatia 3 Cameron
107.
BetoAisha 1 1
1 Fernando -2 Gloria -1 Igor 0 Descartes Euler2 1 Hypatia 3 Cameron
108.
Beto CameronAisha 1
1 1 Fernando Gloria Igor Hypatia -2 -1 0 3 2 -3 1 -2 P( ) =
109.
Beto CameronAisha 1
1 1 Fernando Gloria Igor Hypatia -2 -1 0 3 2 -3 1 -2P( ) =
110.
Beto CameronAisha 1
1 1 Fernando Gloria Igor Hypatia -2 -1 0 32-31-2P( ) = 1σ( ) = 0.73 σ(x) = 1 1 + e−x 1 1 0.73
111.
Descartes Fernando Euler Hypatia -2 2 1
3 BetoAisha 1 1 1 Gloria Igor-1 0Cameron P( ) =
112.
Descartes Fernando Euler Hypatia -2 2 1
3 -1-1 P( ) =
113.
Descartes Fernando Euler Hypatia -2 2 1
3 -1-1P( ) =
114.
Descartes Fernando Euler Hypatia -2 2 1
3 -1-1P( ) = σ( ) = 0.018 -4
115.
How do we
pick random samples?
116.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE How to pick
a random one with conditions How to pick a completely random one
117.
BetoAisha Descartes Euler -0.5 -0.4 0.5 -1 1 0.8 0.5
0.3 10.9 -0.8 Cameron
118.
BetoAisha Descartes -0.4 0.5 1 0.8 0.5 0.3 0.9 Cameron
119.
Aisha Descartes -0.4 0.5 0.9 Cameron -0.4 0.5 0.9 P( ) =
120.
0.50.9-0.4 Aisha Descartes P( ) = -0.4 0.5 0.9 Cameron =
0.731σ( )
121.
σ( = 0.731
)P( ) = Aisha Euler -1 1 -0.8 σ( = 0.31-0.8 )P( ) = Cameron
122.
BetoAisha Descartes Euler Cameron P =
0.73 P = 0.31
123.
Gibbs Sampling
124.
How to pick
a completely random sample?
125.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE How to pick
a random one with conditions How to pick a completely random one
126.
Pick a random
spot in the world
127.
None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE Gibbs Sampling How to pick
a totally random sample from this distribution
128.
A B C ED A
B C ED A B C ED A B C ED A B C ED A B C ED None AC BC DED A D BC DE None DD
129.
A B C ED A
B C ED A B C ED A B C ED None BC DE A B C ED AC D D BC DE None D A B C ED A D
130.
A B C ED AC D Increase
scores Decrease scores A B C ED A D
131.
Summary
132.
Data None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE ProbabilitiesRestricted Boltzmann Machine 4
-2 2 2 -2 -4 1 1 1 12 A B C D E
133.
Generated Data None A B C D E AB AC AD AE BC BD BE CD CE DE ABC ABD ABE ACD ACE ADE BCD BCE BDE CDE ABCD ABCE ABDE ACDE BCDE ABCDE ProbabilitiesRestricted Boltzmann
Machine 4 -2 2 2 -2 -4 1 1 1 12 A B C D E
134.
Visible Layer Hidden Layer Images https://www.pyimagesearch.com/2014/06/23/applying-deep-learning-rbm-mnist-using-python/
135.
Thank you!
136.
Images https://www.freepik.com/free-photos-vectors/people https://www.freepik.com/free-photos-vectors/dog https://www.freepik.com/free-photos-vectors/banner https://www.freepik.com/free-photos-vectors/background https://www.freepik.com/free-photos-vectors/background
137.
This presentation was
done on Keynote
138.
https://www.manning.com/books/grokking-machine-learning Discount code: serranoyt Grokking
Machine Learning By Luis G. Serrano
139.
Links @luis_likes_math Subscribe, like, share, comment! youtube.com/c/LuisSerrano http://serrano.academy
Descargar ahora