講師簡介： 孫民助理教授│清華大學電機系 孫民博士目前任教於國立清華大學電機系，他畢業於國立交通大學電子工程學系後，取得史坦福電機碩士、密西根安雅堡電機系統組博士、以及西雅圖華盛頓大學計算機工程博士後的經歷。他的研究興趣在電腦視覺、機器學習、以及人機互動領域，近年來基於深度學習在電腦視覺的突破，他致力於開發橫跨人工智慧不同子領域的系統，如自動影片文字描述(視覺x自然語言)、以及與人類行為互動的智慧機器(視覺 x 控制)。

2. Artificial Intelligence:
The Next Big Thing
from a computer vision perspective
VSLab
清大電機
孫民

3. AlphaGo
2016 by Google DeepMind
Are these what AI all about?

4. 2014
Subfields of AI

5. 2015
Artifical General Intelligence (AGI)

6. 2016

7. Deep Learning (DL)
• Data
• GPU Computing
• Talents

8. Data:
• 開始於 2007 @ Princeton
• 初登場於 2009 @ CVPR
• 照片停止搜集於 2010
總共類別：21841
總共圖片：1千4百萬
• ILSVR Challenge 從2010到現今
Jia Deng Fei-Fei Li
Info from http://www.image-net.org/

9. 1K Image Classification
Figure from Olga Russakovsky ECCV'14 workshop
Deep Learning
深度學習
Label = f(Image)

10. GPU: NVIDIA CUDA
Tesla P100 With Over 20 TFLOPS Of FP16
Read more: http://wccftech.com/nvidia-pascal-gpu-gtc-2016/#ixzz456KT75Jf

11. Talents:
DNNresearch acquired by Google
Geoffrey Hinton (right: Professor) Alex Krizhevsky (middle; PhD student), and Ilya
Sutskever (left; Postdoc)
A story in computer Vision!

12. DL Fuses AI-subfields
• Vision and Language
• Vision and Control
http://mscoco.org/
Atari Breakout game & AlphaGo, DeepMind.
-> AGI
• Multiple Encoding and Decoding

13. Image Captioning
f( ) =
The man at bat is
ready to swing
at the pitch
Vision Language
Recurrent Neuron Network (RNN)
credit: Nature
convolutions
Convolution Neuron Network (CNN)
credit: wiki

14. Video Captioning/Titling
Zhen et al. ECCV 2016 from VSLab and Stanford AI Lab

15. Big Video Data with Titles
• Pairs of
Raw Video
CNN CNN CNN CNN
Title

16. Viral Videos

17. Huge Video Repository
Currently 28740 videos and keep growing

18. Vision and Control
https://gym.openai.com/
• Learning to play game with weak supervision:
Reinforcement Learning (RL)

19. Where It All Begins …
by DeepMind in NIPS 2013 Deep Learning Wrokshop
Playing Atari with
Deep Reinforcement Learning
slides by
Yen-Chen Lin

20. Self-driving Car:
Trigger Accident Warning
VSLab Under Submission

21. Fusing Multiple Sensors
Ke# le%
Medium+wrap%
Ke# le%
Medium+wrap%
thumb+4+finger%
Manipula7on%
Region%
Side+view%
Chan et al. ECCV 2015 from VSLab

22. Real-time Wearable Demo
Fisheye camera NVIDIA TK1

23. Real-time Wearable Demo
cellphone, bottle, keyboard, mouse, free hand

24. Deep Learning (DL)
• Data
• GPU Computing
• Talents

25. Talents
• Teach as many/early as possible
• Open! Open! Open!
• Critical mass

26. How to Find Talents
• Our students know deep learning is HOT!
[ 2015 Deep Learning Workshop 中研院 ] 500 位參加者

27. Deep Learning Courses
• NTU
– http://speech.ee.ntu.edu.tw/~tlkagk/courses_MLSD1
5_2.html
– https://www.csie.ntu.edu.tw/~yvchen/f105-
adl/syllabus
• NTHU
– https://thecedl.github.io/
– http://www.cs.nthu.edu.tw/~shwu/courses/ml/
• NCTU
– https://course.nctu.edu.tw/Course/CrsOutline/show.a
sp?Acy=105&Sem=2&CrsNo=5259&lang=zh-tw

28. Teach As Early As Possible

29. Case Study: Fu-Hsiang Chan
NTHU Master Student
https://github.com/smallcorgi/Faster-RCNN_TF
https://github.com/smallcorgi/Faster-RCNN_TF/issues/17

30. Case Study: YenChen Lin
NTHU Undergraduate
https://github.com/yenchenlin1994/DeepLearningFlappyBird

31. http://www.victoria.ac.nz/design/about/staff/tom-white

32. Start Doing Research Early!

33. Case Study: UNIST@Korean Undergraduate

34. Comment from Andrej Karpathy

35. Use Github in Class
• https://github.com/NTHU-EE-CV-2016-Fall/homework2
• https://github.com/NTHU-EE-CV-2016-Fall/homework2/pull/8

36. Open Paper Review
https://openreview.net/
https://openreview.net/forum?id=BkjLkSqxg&noteId=BkjLkSqxg
https://openreview.net/forum?id=r1Cy5yrKx&noteId=r1Cy5yrKx

37. Arxiv
• http://arxiv-sanity.com/

38. Critical Mass
• Google Brain
• Google Deepmind
• Facebook AI Lab
• Microsoft Research
• Baidu Research

39. A Team of Talents
Most of them fresh PhDs
1 Billion Pledged USD

40. A Team of Talents

41. A Team of Talents

42. Taiwan Issues
• Critical mass
• Collaboration
• Not open

43. Taiwan’s Opportunities
• Factory Automation
– Manufacture Data
• Intelligent of Things (IoT)
– Sensors: AI for sensor fusion
• Smart Cities
– Government Open Data (http://index.okfn.org/place/taiwan/)
• Health Care
– Causality
• VR
– Content Generation

44. Thanks!