Enviar búsqueda
Cargar
20190417 畳み込みニューラル ネットワークの基礎と応用
•
1 recomendación
•
324 vistas
K
Kazuki Motohashi
Seguir
for 実践者向けディープラーニング勉強会 第二回 2019-04-17 https://dl4-practitioners.connpass.com/event/124498/
Leer menos
Leer más
Tecnología
Denunciar
Compartir
Denunciar
Compartir
1 de 80
Descargar ahora
Descargar para leer sin conexión
Recomendados
The quantum computers are coming - VoxxedDays Cluj-Napoca 2018
The quantum computers are coming - VoxxedDays Cluj-Napoca 2018
Alasdair Collinson
The quantum computers are coming - Karlsruher Entwicklertag 2018
The quantum computers are coming - Karlsruher Entwicklertag 2018
Alasdair Collinson
Ilsvrc2015 deep residual_learning_kaiminghe
Ilsvrc2015 deep residual_learning_kaiminghe
pramod naik
Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Olivia Klose
Deep Neural Networks for Computer Vision
Deep Neural Networks for Computer Vision
Alex Conway
"Deep Learning" Chap.6 Convolutional Neural Net
"Deep Learning" Chap.6 Convolutional Neural Net
Ken'ichi Matsui
Find nuclei in images with U-net
Find nuclei in images with U-net
Ding Li
[第34回 WBA若手の会勉強会] Microsoft AI platform
[第34回 WBA若手の会勉強会] Microsoft AI platform
Naoki (Neo) SATO
Recomendados
The quantum computers are coming - VoxxedDays Cluj-Napoca 2018
The quantum computers are coming - VoxxedDays Cluj-Napoca 2018
Alasdair Collinson
The quantum computers are coming - Karlsruher Entwicklertag 2018
The quantum computers are coming - Karlsruher Entwicklertag 2018
Alasdair Collinson
Ilsvrc2015 deep residual_learning_kaiminghe
Ilsvrc2015 deep residual_learning_kaiminghe
pramod naik
Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Olivia Klose
Deep Neural Networks for Computer Vision
Deep Neural Networks for Computer Vision
Alex Conway
"Deep Learning" Chap.6 Convolutional Neural Net
"Deep Learning" Chap.6 Convolutional Neural Net
Ken'ichi Matsui
Find nuclei in images with U-net
Find nuclei in images with U-net
Ding Li
[第34回 WBA若手の会勉強会] Microsoft AI platform
[第34回 WBA若手の会勉強会] Microsoft AI platform
Naoki (Neo) SATO
Back To The Future
Back To The Future
Bill Scott
Discovering Your AI Super Powers - Tips and Tricks to Jumpstart your AI Projects
Discovering Your AI Super Powers - Tips and Tricks to Jumpstart your AI Projects
Wee Hyong Tok
SaturdaysAI: CNN in Underwater Robotics and eHealth
SaturdaysAI: CNN in Underwater Robotics and eHealth
Yolanda Gonzalez-Cid
Pr045 deep lab_semantic_segmentation
Pr045 deep lab_semantic_segmentation
Taeoh Kim
Panoramic Video in Environmental Monitoring Software Development and Applica...
Panoramic Video in Environmental Monitoring Software Development and Applica...
pycontw
Convolutional neural networks for image classification — evidence from Kaggle...
Convolutional neural networks for image classification — evidence from Kaggle...
Dmytro Mishkin
Machine Learning Tokyo - Deep Neural Networks for Video - NumberBoost
Machine Learning Tokyo - Deep Neural Networks for Video - NumberBoost
Alex Conway
Le Song, Assistant Professor, College of Computing, Georgia Institute of Tech...
Le Song, Assistant Professor, College of Computing, Georgia Institute of Tech...
MLconf
[系列活動] 一日搞懂生成式對抗網路
[系列活動] 一日搞懂生成式對抗網路
台灣資料科學年會
Convolution Neural Network Lecture Slides
Convolution Neural Network Lecture Slides
AdnanHaider234505
教師なし画像特徴表現学習の動向 {Un, Self} supervised representation learning (CVPR 2018 完全読破...
教師なし画像特徴表現学習の動向 {Un, Self} supervised representation learning (CVPR 2018 完全読破...
cvpaper. challenge
Bootstrap Custom Image Classification using Transfer Learning by Danielle Dea...
Bootstrap Custom Image Classification using Transfer Learning by Danielle Dea...
Wee Hyong Tok
Deep Learning and Design Thinking
Deep Learning and Design Thinking
Yen-lung Tsai
Neural networks across space & time : Deep learning in java
Neural networks across space & time : Deep learning in java
Dave Snowdon
Deeplabv1, v2, v3, v3+
Deeplabv1, v2, v3, v3+
Sungchul Kim
My presentation at University of Nottingham "Fast low-rank methods for solvin...
My presentation at University of Nottingham "Fast low-rank methods for solvin...
Alexander Litvinenko
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
RootedCON
Causal inference-for-profit | Dan McKinley | DN18
Causal inference-for-profit | Dan McKinley | DN18
DataconomyGmbH
DN18 | A/B Testing: Lessons Learned | Dan McKinley | Mailchimp
DN18 | A/B Testing: Lessons Learned | Dan McKinley | Mailchimp
Dataconomy Media
Tears for quantum fears
Tears for quantum fears
Mark Carney
20190619 オートエンコーダーと異常検知入門
20190619 オートエンコーダーと異常検知入門
Kazuki Motohashi
20190407 第7章 事例研究:自然言語処理における素性
20190407 第7章 事例研究:自然言語処理における素性
Kazuki Motohashi
Más contenido relacionado
Similar a 20190417 畳み込みニューラル ネットワークの基礎と応用
Back To The Future
Back To The Future
Bill Scott
Discovering Your AI Super Powers - Tips and Tricks to Jumpstart your AI Projects
Discovering Your AI Super Powers - Tips and Tricks to Jumpstart your AI Projects
Wee Hyong Tok
SaturdaysAI: CNN in Underwater Robotics and eHealth
SaturdaysAI: CNN in Underwater Robotics and eHealth
Yolanda Gonzalez-Cid
Pr045 deep lab_semantic_segmentation
Pr045 deep lab_semantic_segmentation
Taeoh Kim
Panoramic Video in Environmental Monitoring Software Development and Applica...
Panoramic Video in Environmental Monitoring Software Development and Applica...
pycontw
Convolutional neural networks for image classification — evidence from Kaggle...
Convolutional neural networks for image classification — evidence from Kaggle...
Dmytro Mishkin
Machine Learning Tokyo - Deep Neural Networks for Video - NumberBoost
Machine Learning Tokyo - Deep Neural Networks for Video - NumberBoost
Alex Conway
Le Song, Assistant Professor, College of Computing, Georgia Institute of Tech...
Le Song, Assistant Professor, College of Computing, Georgia Institute of Tech...
MLconf
[系列活動] 一日搞懂生成式對抗網路
[系列活動] 一日搞懂生成式對抗網路
台灣資料科學年會
Convolution Neural Network Lecture Slides
Convolution Neural Network Lecture Slides
AdnanHaider234505
教師なし画像特徴表現学習の動向 {Un, Self} supervised representation learning (CVPR 2018 完全読破...
教師なし画像特徴表現学習の動向 {Un, Self} supervised representation learning (CVPR 2018 完全読破...
cvpaper. challenge
Bootstrap Custom Image Classification using Transfer Learning by Danielle Dea...
Bootstrap Custom Image Classification using Transfer Learning by Danielle Dea...
Wee Hyong Tok
Deep Learning and Design Thinking
Deep Learning and Design Thinking
Yen-lung Tsai
Neural networks across space & time : Deep learning in java
Neural networks across space & time : Deep learning in java
Dave Snowdon
Deeplabv1, v2, v3, v3+
Deeplabv1, v2, v3, v3+
Sungchul Kim
My presentation at University of Nottingham "Fast low-rank methods for solvin...
My presentation at University of Nottingham "Fast low-rank methods for solvin...
Alexander Litvinenko
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
RootedCON
Causal inference-for-profit | Dan McKinley | DN18
Causal inference-for-profit | Dan McKinley | DN18
DataconomyGmbH
DN18 | A/B Testing: Lessons Learned | Dan McKinley | Mailchimp
DN18 | A/B Testing: Lessons Learned | Dan McKinley | Mailchimp
Dataconomy Media
Tears for quantum fears
Tears for quantum fears
Mark Carney
Similar a 20190417 畳み込みニューラル ネットワークの基礎と応用
(20)
Back To The Future
Back To The Future
Discovering Your AI Super Powers - Tips and Tricks to Jumpstart your AI Projects
Discovering Your AI Super Powers - Tips and Tricks to Jumpstart your AI Projects
SaturdaysAI: CNN in Underwater Robotics and eHealth
SaturdaysAI: CNN in Underwater Robotics and eHealth
Pr045 deep lab_semantic_segmentation
Pr045 deep lab_semantic_segmentation
Panoramic Video in Environmental Monitoring Software Development and Applica...
Panoramic Video in Environmental Monitoring Software Development and Applica...
Convolutional neural networks for image classification — evidence from Kaggle...
Convolutional neural networks for image classification — evidence from Kaggle...
Machine Learning Tokyo - Deep Neural Networks for Video - NumberBoost
Machine Learning Tokyo - Deep Neural Networks for Video - NumberBoost
Le Song, Assistant Professor, College of Computing, Georgia Institute of Tech...
Le Song, Assistant Professor, College of Computing, Georgia Institute of Tech...
[系列活動] 一日搞懂生成式對抗網路
[系列活動] 一日搞懂生成式對抗網路
Convolution Neural Network Lecture Slides
Convolution Neural Network Lecture Slides
教師なし画像特徴表現学習の動向 {Un, Self} supervised representation learning (CVPR 2018 完全読破...
教師なし画像特徴表現学習の動向 {Un, Self} supervised representation learning (CVPR 2018 完全読破...
Bootstrap Custom Image Classification using Transfer Learning by Danielle Dea...
Bootstrap Custom Image Classification using Transfer Learning by Danielle Dea...
Deep Learning and Design Thinking
Deep Learning and Design Thinking
Neural networks across space & time : Deep learning in java
Neural networks across space & time : Deep learning in java
Deeplabv1, v2, v3, v3+
Deeplabv1, v2, v3, v3+
My presentation at University of Nottingham "Fast low-rank methods for solvin...
My presentation at University of Nottingham "Fast low-rank methods for solvin...
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
Causal inference-for-profit | Dan McKinley | DN18
Causal inference-for-profit | Dan McKinley | DN18
DN18 | A/B Testing: Lessons Learned | Dan McKinley | Mailchimp
DN18 | A/B Testing: Lessons Learned | Dan McKinley | Mailchimp
Tears for quantum fears
Tears for quantum fears
Más de Kazuki Motohashi
20190619 オートエンコーダーと異常検知入門
20190619 オートエンコーダーと異常検知入門
Kazuki Motohashi
20190407 第7章 事例研究:自然言語処理における素性
20190407 第7章 事例研究:自然言語処理における素性
Kazuki Motohashi
20190324 第6章 テキストデータのための素性
20190324 第6章 テキストデータのための素性
Kazuki Motohashi
深層学習の基礎と導入
深層学習の基礎と導入
Kazuki Motohashi
20180110 AI&ロボット勉強会 Deeplearning4J と時系列データの異常検知について
20180110 AI&ロボット勉強会 Deeplearning4J と時系列データの異常検知について
Kazuki Motohashi
R-CNNの原理とここ数年の流れ
R-CNNの原理とここ数年の流れ
Kazuki Motohashi
Más de Kazuki Motohashi
(6)
20190619 オートエンコーダーと異常検知入門
20190619 オートエンコーダーと異常検知入門
20190407 第7章 事例研究:自然言語処理における素性
20190407 第7章 事例研究:自然言語処理における素性
20190324 第6章 テキストデータのための素性
20190324 第6章 テキストデータのための素性
深層学習の基礎と導入
深層学習の基礎と導入
20180110 AI&ロボット勉強会 Deeplearning4J と時系列データの異常検知について
20180110 AI&ロボット勉強会 Deeplearning4J と時系列データの異常検知について
R-CNNの原理とここ数年の流れ
R-CNNの原理とここ数年の流れ
Último
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Neo4j
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
Paola De la Torre
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
The Digital Insurer
How to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
naman860154
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
Results
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Drew Madelung
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
Delhi Call girls
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
Malak Abu Hammad
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
Anna Loughnan Colquhoun
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
Enterprise Knowledge
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
Delhi Call girls
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Igalia
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Radu Cotescu
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
The Digital Insurer
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Katpro Technologies
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Martijn de Jong
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
Sinan KOZAK
Último
(20)
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
How to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
20190417 畳み込みニューラル ネットワークの基礎と応用
1.
畳み込みニューラル ネットワークの基礎と応⽤ 実践者向けディープラーニング勉強会 第⼆回 https://dl4-practitioners.connpass.com/event/124498/ 2019-04-17 (Wed) @
SB C&S
2.
Agenda 19:00 〜 19:05
opening 19:05 〜 19:20 機械学習の導⼊ 19:20 〜 19:30 walkthrough Kerasを⽤いたコーディングサンプル 19:30 〜 19:45 畳み込みニューラルネットワークの基礎 19:45 〜 20:00 walkthrough CNNのフィルタの理解 20:00 〜 20:10 休憩 20:10 〜 20:25 breakout CNNアーキテクチャの紹介 20:25 〜 20:40 Skymind Intelligent Layer (SKIL) の解説 20:40 〜 20:55 walkthrough SKILを⽤いたモデルのデプロイ 20:55 〜 21:00 closing !2
3.
!3 15
4.
ニューラルネットワークの基礎 !4
5.
!5 https://www.coursera.org/learn/introduction-tensorflow
6.
Activity Recognition !6 https://www.coursera.org/learn/introduction-tensorflow
7.
Activity Recognition !7 https://www.coursera.org/learn/introduction-tensorflow
8.
Activity Recognition !8 https://www.coursera.org/learn/introduction-tensorflow
9.
Activity Recognition !9 https://www.coursera.org/learn/introduction-tensorflow
10.
!10 https://www.coursera.org/learn/introduction-tensorflow
11.
Activity Recognition !11 https://www.coursera.org/learn/introduction-tensorflow
12.
機械学習の"Hello World” !12 x =
-2, -1, 0, 1, 2, 3, 4 y = -3, -1, 1, 3, 5, 7, 9 y = f(x)
13.
機械学習の"Hello World” !13 x =
-2, -1, 0, 1, 2, 3, 4 y = -3, -1, 1, 3, 5, 7, 9 y = f(x) = 2x + 1
14.
機械学習のアプローチ •適当にモデルを初期化 (y_=ax+b) !14
15.
機械学習のアプローチ • 適当にモデルを初期化 (y_=ax+b) •誤差(損失)を計算
(L=1/N Σ(y-y_)2) !15
16.
機械学習のアプローチ • 適当にモデルを初期化 (y_=ax+b) •
誤差(損失)を計算 (L=1/N Σ(y-y_)2) •誤差が⼩さくなるようにパラメータ (a, b) を少し更新 (a ← a - η ∂L/∂a) !16
17.
機械学習のアプローチ !17 • 適当にモデルを初期化 (y_=ax+b) •
誤差(損失)を計算 (L=1/N Σ(y-y_)2) • 誤差が⼩さくなるようにパラメータ (a, b) を少し更新 (a ← a - η ∂L/∂a) •誤差(損失)を計算 (L=1/N Σ(y-y_)2)
18.
機械学習のアプローチ !18 • 適当にモデルを初期化 (y_=ax+b) •
誤差(損失)を計算 (L=1/N Σ(y-y_)2) • 誤差が⼩さくなるようにパラメータ (a, b) を少し更新 (a ← a - η ∂L/∂a) • 誤差(損失)を計算 (L=1/N Σ(y-y_)2) •誤差が⼩さくなるようにパラメータ (a, b) を少し更新 (a ← a - η ∂L/∂a) • …
19.
!19
20.
!20 x a + b y_
21.
!21
22.
!22
23.
勾配降下法 !23 「⽬隠しで⾜元の勾配情報のみを使って⼭の頂上を⽬指すようなもの」 学習率 η は歩幅のイメージ(η⼩=すり⾜、η⼤=巨⼈の⼀歩) https://twitter.com/momiji_fullmoon/status/1110316960611368960 https://www.yamakei-online.com/journal/detail.php?id=3185
24.
Fashion MNIST Dataset •
7万画像 • 10カテゴリ • 28×28 pixels • 実験⽤データセット !24 https://github.com/zalandoresearch/fashion-mnist
25.
!25
26.
!26
27.
!27
28.
!28 … ………… … … Flatten: (28, 28)
=> (784) 0 1 2 3 4 5 6 7 125 126 127 0 1 2 3 4 5 6 7 8 9
29.
Dense Layer の⽋点 •
⼊⼒のベクトルの全要素の相関をみている > 住宅価格予測みたいな話ならまだいい > もう作ってる特徴量と特徴量の組み合わせ - 例)東京墨⽥区 & 床⾯積 30m2 & 1K & ⾵呂トイレ別 & 新築 => 家賃⽉10万円 • 「画像の特徴量」を抽出してからDense Layerに渡せば効率的 !29 畳込みニューラルネットワーク (Convolutional Neural Network; CNN)
30.
畳み込みニューラルネットワークの基礎 !30
31.
畳み込み (Convolution) CURRENT_PIXEL_VALUE =
82 NEW_PIXEL_VALUE = (-1 * 144) + (0 * 60) + (-2 * 19) + (0.5 * 188) + (4.5 * 82) + (-1.5 * 32) + (1.5 * 156) + (2 * 55) + (-3 * 27) !31 144 60 19 188 82 32 156 55 27 -1 0 -2 0.5 4.5 -1.5 1.5 2 -3 uijm = K 1X k=0 W 1X p=0 H 1X q=0 z (l 1) i+p,j+q,khpqkm + bijm <latexit sha1_base64="bp48ep/Dp5jA49Knv3mGnitdbqk=">AAACwnichVHLShxBFD12Xjp5OEk2ATfiYDCMDreNoAiCGBdCNj4yjqBj090ptaaf048BbfsH/IEsXBkIIfgZbvIDWfgJkp0jZOPCO91NQiJJbtNV55y659atKsO3ZRgRnfcpd+7eu/+gf6D08NHjJ4Plp8/WQy8OTFE3PdsLNgw9FLZ0RT2SkS02/EDojmGLhmG96a03OiIIpee+i/Z90XT0XVfuSFOPWNLKzVhLZMtJ57bC2NlO3k6oqZZYc5TmvJFx/ydfynib+cF2MmZPqK+Yyqo/3qq2x610j3PblpNWjbyqVq5QjbIYvg3UAlRQxLJX/owtvIcHEzEcCLiIGNvQEfK3CRUEn7UmEtYCRjJbF0hRYm/MWYIzdFYtHneZbRaqy7xXM8zcJu9i8x+wcxij9I2+UJe+0ild0PVfayVZjV4v+zwbuVf42uDRi7Uf/3U5PEfY++X6Z88RdjCT9Sq5dz9Teqcwc3/n4EN3bXZ1NHlJH+k7939C53TGJ3A7V+anFbF6jBI/gPrndd8G65M19XVtcmWqMr9QPEU/hjCCMb7vacxjCcuo875nuMAlusqi0lLaSpinKn2F5zl+C+XwBo4trvM=</latexit> https://news.yahoo.co.jp/byline/yuasamakoto/20190403-00120722/
32.
!32 1 2 1 0 0 0 -1 -2 -1 -1 -2 -1 0 0 0 1 2 1 -2 0 2 -1 0 -1 -1 0 1 https://www.bbkong.net/fs/alleyoop/molten_BGL7
33.
stride=(1, 1), padding=ʻvalidʼ !33
34.
stride=(1, 1), padding=ʻvalidʼ !34
35.
stride=(1, 1), padding=ʻvalidʼ !35
36.
stride=(1, 1), padding=ʻvalidʼ !36
37.
stride=(1, 1), padding=ʻvalidʼ !37
38.
stride=(1, 1), padding=ʻvalidʼ !38
39.
stride=(1, 1), padding=ʻvalidʼ !39
40.
stride=(2, 2), padding=ʻvalidʼ !40
41.
stride=(2, 2), padding=ʻvalidʼ !41
42.
stride=(2, 2), padding=ʻvalidʼ !42
43.
stride=(1, 1), padding=ʻsameʼ !43
44.
stride=(1, 1), padding=ʻsameʼ !44
45.
stride=(1, 1), padding=ʻsameʼ !45
46.
stride=(1, 1), padding=ʻsameʼ !46
47.
Max Pooling !47 https://www.coursera.org/learn/introduction-tensorflow
48.
AlexNet !48
49.
!49slide from Keynote
Speech by Laurence Moroney at Deep Learning Day 2019
50.
!50 https://medium.com/@lmoroney_40129/codelabs-from-googlemlsummit-f9d53cac8d24
51.
!51 https://medium.com/@lmoroney_40129/codelabs-from-googlemlsummit-f9d53cac8d24
52.
応⽤的なCNNアーキテクチャの紹介 !52
53.
ImageNet コンペの優勝モデル !53 https://www.slideshare.net/ren4yu/ss-84282514
54.
ResNet • 2015年のImageNetコンペ (ILSVRC)
優勝モデル • Residualモジュール(ショートカット機構)の導⼊ !54 http://image-net.org/challenges/talks/ilsvrc2015_deep_residual_learning_kaiminghe.pdf Revolution of Depth 3.57 6.7 7.3 11.7 16.4 25.8 28.2 ILSVRC'15 ResNet ILSVRC'14 GoogleNet ILSVRC'14 VGG ILSVRC'13 ILSVRC'12 AlexNet ILSVRC'11 ILSVRC'10 ImageNet Classification top-5 error (%) shallow8 layers 19 layers22 layers 152 layers Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. “Deep Residual Learning for Image Recognition”. arXiv 2015. 8 layers
55.
!55 Revolution of Depth ResNet,
152 layers 1x1 conv, 64 3x3 conv, 64 1x1 conv, 256 1x1 conv, 64 3x3 conv, 64 1x1 conv, 256 1x1 conv, 64 3x3 conv, 64 1x1 conv, 256 1x2 conv, 128, /2 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 256, /2 3x3 conv, 256 7x7 conv, 64, /2, pool/2 Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. “Deep Residual Learning for Image Recognition”. arXiv 2015. (there was an animation here)
56.
!56 Revolution of Depth ResNet,
152 layers 1x1 conv, 512 1x1 conv, 128 3x3 conv, 128 1x1 conv, 512 1x1 conv, 256, /2 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. “Deep Residual Learning for Image Recognition”. arXiv 2015. (there was an animation here)
57.
!57 Revolution of Depth ResNet,
152 layers 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. “Deep Residual Learning for Image Recognition”. arXiv 2015. (there was an animation here)
58.
!58 Revolution of Depth ResNet,
152 layers 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 256 3x3 conv, 256 1x1 conv, 1024 1x1 conv, 512, /2 3x3 conv, 512 1x1 conv, 2048 1x1 conv, 512 3x3 conv, 512 1x1 conv, 2048 1x1 conv, 512 3x3 conv, 512 1x1 conv, 2048 ave pool, fc 1000 Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. “Deep Residual Learning for Image Recognition”. arXiv 2015. (there was an animation here)
59.
ResNet !59 Deep Residual Learning •
Plaint net Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. “Deep Residual Learning for Image Recognition”. arXiv 2015. any two stacked layers 𝑥 𝐻(𝑥) weight layer weight layer relu relu 𝐻 𝑥 is any desired mapping, hope the 2 weight layers fit 𝐻(𝑥) Deep Residual Learning • Residual net Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian 𝐻 hop hopweight layer weight layer relu relu 𝑥 𝐻 𝑥 = 𝐹 𝑥 + 𝑥 identity 𝑥 𝐹(𝑥) http://image-net.org/challenges/talks/ilsvrc2015_deep_residual_learning_kaiminghe.pdf
60.
!60 CIFAR-10 experiments 0 1
2 3 4 5 6 0 5 10 20 iter. (1e4) error(%) plain-20 plain-32 plain-44 plain-56 20-layer 32-layer 44-layer 56-layer CIFAR-10 plain nets 0 1 2 3 4 5 6 0 5 10 20 iter. (1e4) error(%) ResNet-20 ResNet-32 ResNet-44 ResNet-56 ResNet-110 CIFAR-10 ResNets 56-layer 44-layer 32-layer 20-layer 110-layer • Deep ResNets can be trained without difficulties • Deeper ResNets have lower training error, and also lower test error solid: test dashed: train Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. “Deep Residual Learning for Image Recognition”. arXiv 2015.
61.
Further Reading • ⼀年半前
(2017-12) の資料ですが素晴らしいスライドです • 畳み込みニューラルネットワークの研究動向 by DeNA 内⽥さん • https://www.slideshare.net/ren4yu/ss-84282514 !61
62.
YOLO (You Only
Look Once) !62 https://www.youtube.com/watch?v=MPU2HistivI
63.
YOLOのアーキテクチャ !63
64.
Labeling / Annotation !64 https://github.com/Microsoft/VoTT
65.
AIモデルの運⽤・デプロイ !65
66.
!66 https://www.programming-fun.net/article/article_40.html
67.
!67 https://www.youtube.com/watch?v=-UYyyeYJAoQ
68.
モデルの利⽤ !68 n月間ラムダノートVol.1, No.1より
69.
モデルの利⽤ !69 n月間ラムダノートVol.1, No.1より
70.
!70
71.
!71
72.
!72
73.
!73
74.
!74
75.
CNNモデルのデプロイ !75
76.
!76
77.
!77
78.
!78 curl --request POST
--url http://<SKILhostIP>:9008/login --header 'accept: application/json' --header 'content-type: application/json' --data '{"userId":"<userId>","password":"<password>"}'
79.
Links • SKIL Download
Page • https://skymind.ai/download • SKIL Documentation • https://docs.skymind.ai/docs • SKIL REST API reference • https://docs.skymind.ai/reference?newApiExplorer=true • SKIL Clients • https://github.com/SkymindIO/skil-clients !79
80.
まとめ !80
Descargar ahora