3. Where are we headed?
• Plateau in performance improvements with Single Threaded Architecture
Image: Courtesy Nvidia GTC 2017 Keynote
June 3, 2017 3
4. Picking up the slack
Image: Courtesy Nvidia GTC 2017 KeynoteJune 3, 2017 4
5. Key Trigger applications
• Bitcoin Mining
• AMD’s Radeon cards being used for mining on the cheap
• Temporary shortage of graphics cards
• Geoffrey Hinton, Univ of Toronto applying Neural Networks on an massive
scale using GPUs --- Origin of Deep Learning
• Limited adoption of NN until 2004. Invented in 1948 (Hebb, Rosenblatt).
• Popular Machine Learning method even prior to 2004. Small scale – CPU based
• Also, Kaggle winners in 2012 – NNs to run on GPUs using CUDA
• http://blog.kaggle.com/2012/11/01/deep-learning-how-i-did-it-merck-1st-place-interview/
• https://arxiv.org/pdf/1702.07800.pdf (Origin of Deep Learning)
June 3, 2017 5
27. Thank you!
• Image credits: Nvidia Keynote GTC 2017 and CSCSCH talk on CUDA by
Paul Bessmer
June 3, 2017 27
Editor's Notes
More and more transistors running at a faster performance
ResNet – 7 seconds for every single super computer in the world – to process this network.
One CPU only server will take 2 years to run through the server 1 time – Baidu Deep Speech 2