Get started with deep learning on your desktop PC with an NVIDIA TITAN GPU. This presentation includes: 1) Best practices for configuring your PC for deep learning with an NVIDIA TITAN GPU 2) How to get access to the top deep learning software using NVIDIA GPU Cloud 3) Step-by-step directions to get started doing deep learning with your desktop PC

1. DEEP LEARNING ON YOUR
DESKTOP WITH NVIDIA GPU CLOUD
AND NVIDIA TITAN
Chris Kawalek
Sr. Product Marketing Manager, NVIDIA GPU Cloud, NVIDIA
Adam Beberg
Principal Architect, Distributed Systems, NVIDIA

2. 2
AGENDA
Challenges when working with complex software
NVIDIA GPU Cloud (NGC) overview
Using NGC on your desktop PC with TITAN V
Desktop PC best practices and configuration tips
Next steps
GTC 2018
Q&A

3. 3
CHALLENGES WITH COMPLEX SOFTWARE
Current DIY GPU-accelerated AI
and HPC deployments can be
complex and time consuming
to build, test and maintain
Development of software by the
community is moving very fast
Requires high level of expertise
to manage driver, library,
framework/application
dependencies
NVIDIA Libraries
NVIDIA Container
Runtime
NVIDIA Driver
NVIDIA GPU
Open Source
Frameworks

4. 4
NVIDIA GPU CLOUD
Simple access to a comprehensive catalog of GPU-accelerated software

5. 5
GPU-ACCELERATED
DEEP LEARNING SOFTWARE CONTAINERS
Innovation for Every Industry
Quickly tap into the power of NVIDIA AI, from
automotive, to healthcare, to fintech, and
more
Say Goodbye to DIY
Ready-to-run deep learning software
containers, tuned, tested, and certified by
NVIDIA
Stay Up To Date
Monthly updates to deep learning containers
Deep learning everywhere, for everyone
NVIDIA GPU Cloud integrates GPU-optimized
deep learning frameworks, runtimes,
libraries, and OS into a ready-to-run
container, available at no charge

6. 6
WHY CONTAINERS?
Benefits of Containers:
Simplify deployment of
GPU-accelerated software, eliminating
time-consuming software integration work
Isolate individual deep learning frameworks
and applications
Share, collaborate,
and test applications across
different environments
6
NVIDIA CONTAINER RUNTIME

7. 7
DEEP LEARNING ACROSS PLATFORMS
NVIDIA TITAN (powered by
NVIDIA Volta or NVIDIA
Pascal)
NVIDIA DGX-1 and
DGX Station
Amazon EC2 P3 instances
with NVIDIA Volta

8. 8
NVIDIA GPU CLOUD AND TITAN V
Deep learning on your desktop, easier than ever

9. 9
GPU-OPTIMIZED DEEP LEARNING SOFTWARE
NVCaffe
Caffe2
Microsoft Cognitive
Toolkit (CNTK)
DIGITS
MXNet
PyTorch
TensorFlow
Theano
Torch
CUDA (base level
container for developers)
NEW! – NVIDIA TensorRT
inference accelerator with
ONNX support
Tuned, tested, certified, and maintained by NVIDIA

10. 10
Containerized Applications
TF Tuned SW CNTK Tuned SW Caffe2 Tuned SW PyTorch Tuned SW
CUDA RTCUDA RTCUDA RTCUDA RT
Linux Kernel + CUDA Driver
Tuned SW
CUDA RT
Other
Frameworks
and Apps. . .
ALWAYS UP-TO-DATE
Monthly updates from NVIDIA to deep learning containers
NVIDIA Container
Runtime
NVIDIA Container
Runtime
NVIDIA Container
Runtime
NVIDIA Container
Runtime
NVIDIA Container
Runtime

11. 11
HOW TO USE NVIDIA GPU CLOUD
WITH NVIDIA TITAN V

12. 12
NGC WITH TITAN V DEMONSTRATION VIDEO
https://youtu.be/sU-dLSWNTMc

13. 13
DESKTOP PC BEST PRACTICES
NVIDIA Volta or Pascal-powered TITAN GPU
(supported), or other Volta/Pascal GPU
Linux OS - Ubuntu 16.04 recommended
Containers do not add much RAM or CPU
overhead of their own, but deep learning can
be RAM and CPU intensive
Latest CUDA drivers, Docker, and NVIDIA
Container Runtime
Requirements and configuration tips

14. 14
NVIDIA GPU CLOUD AND NVIDIA TITAN V
NVIDIA optimized deep learning software containers
Containers remove DIY complexity and are always up to date
Tuned, tested, and certified for NVIDIA TITAN (powered by NVIDIA Volta and Pascal),
NVIDIA DGX Systems, and in the cloud
NVIDIA GPU Cloud and NVIDIA TITAN let you develop on your desktop and scale out
GPU-optimized deep learning on your desktop

15. 15
NEXT STEPS
If you’re ready to jump into deep learning with NGC and TITAN V:
Sign up for NGC at no charge www.nvidia.com/ngcsignup
Download and try NGC containers ngc.nvidia.com
Check out TITAN V on nvidia.com www.nvidia.com/titanv
If you want to learn more:
Watch NVIDIA webinars www.nvidia.com/object/webinar-portal.html
e.g. Deep Learning Demystified, Deep Learning for Everyone with NVIDIA GPU Cloud
Deep Learning Institute online training www.nvidia.com/dli
Deep learning on developer.nvidia.com developer.nvidia.com/deep-learning

16. 16
NVIDIA DEEP LEARNING INSTITUTE
Helping the world to solve challenging
problems using AI and deep learning
On-site workshops and online courses
presented by certified instructors
Covering complete workflows for
proven application use cases
Self-Driving Cars, Healthcare, Intelligent Video
Analytics, IoT/Robotics, Finance and more
Hands-on training for data scientists and software engineers
www.nvidia.com/dli

17. 17
March 26—29, 2018 | Silicon Valley | #GTC18
www.gputechconf.com
Register with code NVCKAWALEK for a 25% discount at www.nvidia.com/gtc
DISCOVER
See how GPU technologies
are creating amazing
breakthroughs in important
fields such as deep learning
CONNECT
Connect with technology experts
from NVIDIA and other leading
organizations
LEARN
Gain insight and valuable
hands-on training through
hundreds of sessions and
research posters
INNOVATE
Hear about disruptive
innovations as early-stage
companies and startups present
their work
ADVANCE YOUR DEEP LEARNING TRAINING AT GTC
Don’t miss the world’s most important event for GPU developers

18. 18
S8497 Inside NVIDIA GPU Cloud Deep Learning Framework Containers (Mon 3/26, 10:30 AM)
S8669 Deep Learning Demystified (Mon 3/26, 10:00 AM)
S8276 How to Use NGC Containers on AWS (Tues 3/26, 4:00 PM)
S8286 Quick and Easy DL Workflow Proof of Concept (Mon 3/27, 9:00 AM)
S8622 Predicting 4G Wireless Network Quality with Deep-Learning Algorithm (Wed Mar 28, 11:00 AM)
S8849 GE's Evolution from HPC to AI in Healthcare (Tue Mar 27, 2:00 PM)
CE8117 Connect with the NVIDIA GPU Cloud Deep Learning Experts (Wed Mar 28, 2:00 PM)
NVIDIA GPU Cloud Meetup (Tue, Mar 27, 7:00 PM)
Please RSVP: http://info.nvidia.com/nvidia-gpu-cloud-meetup-gtc18.html