Objetivo do Webinar: Venha saber como a plataforma NVIDIA Jetson e suas ferramentas habilitam você a desenvolver e implantar robôs, drones, aplicativos de IVA e outras máquinas autônomas com tecnologia AI que pensam por conta própria.
Apoio: Arrow e NVIDIA.
Convidado: Marcel Saraiva
Gerente de Contas Enterprise da NVIDIA, executivo com 20 anos de expereincia no mercado de TI, teve na sua carreia passagens pela SGI (Silicon Graphics), Intel e Scansource. Engenheiro eletrico formado pela FEI, com pós-graduação em Marketing pela FAAP e MBA em Gestão Empresarial pela FGV.
Link para o Webinar: https://www.embarcados.com.br/webinars/nvidia-jetson-a-inteligencia-artificial-na-palma-de-sua-mao/
2. 2
AGENDA
• NVIDIA – PLATAFORMA INTELIGENCIA ARTIFICIAL
• ECOSSITEMA NVIDIA JETSON
• FAMILIA JETSON EM DETALHES
• FERRAMENTAS DE DESENVOLVIMENTO
• MODELOS DE USO
PLATAFORMA JETSON
3. 3
MASS-MARKET EDGE SYSTEMS NEED AI
HOME/SERVICE ROBOTS
175 billion hours per year on
household chores (US)
MACHINE VISION/AOI
1 trillion product units per
year require visual inspection
NETWORK VIDEO RECORDER
200 million 1080p streams
AIOT
80% of Enterprise IOT
projects will use AI by 2022
4. 4
AI – EDGE TO CLOUD PLATFORM
JETSON TESLA DGX
TENSORRT DEEPSTREAM JETPACK NVIDIA GPU CLOUD DIGITS
Edge device Server
CLOUD
Training and Inference
EDGE AND ON-PREMISES
Inference
5. 5
Artificial Intelligence Computer Vision Accelerated Computing Multimedia
Gesture recObj detectPath planningDepth est
NVIDIA JETSON
SOFTWARE-DEFINED AUTONOMOUS MACHINES
Powerful and efficient AI, CV, HPC | Rich Software Development Platform
Open Platform
Pose est Speech rec
Sensors
JETSON COMPUTER
JETPACK SDK
ACCELERATED MODULES
ECOSYSTEM
BSP • Linux • Security Architecture
AI/Systems Software Design Services
7. 7
THE JETSON FAMILY
for AI at the Edge and Autonomous System designs
Same software
Full specs at developer.nvidia.com/jetson * TX2i: 10-20W
7.5 – 15W*
50mm x 87mm
JETSON TX2 series
1.3 TFLOPS (FP16)
5 - 10W
45mm x 70mm
JETSON NANO
0.5 TFLOPS (FP16)
10 – 30W
100mm x 87mm
JETSON AGX XAVIER series
11 TFLOPS (FP16)
32 TOPS (INT8)
10 - 15W
45mm x 70mm
JETSON Xavier NX
6 TFLOPS (FP16)
21 TOPS (INT8)
Mainstream Autonomous machinesEntry
8. 8
JETSON NANO
Low Cost AI Computer Module
Heterogeneous CPU Complex
Quad Cores A57 with 2MB L2
for multi-threaded operation
1.43Ghz
Maxwell Tensor Core GPU
128 CUDA Cores
472 GFLOPS (FP16)
Multimedia Engines
Encode 4k, 4x1080p, 8x720p up to 120fps
Decode 4k60, 2x4k, 8x1080p, 16x720p up to 240fps
JPEG encode & decode 600 MP/s
H.264, H.265, VP9, VP8, VC-1, MPEG-2
HDMI, DP and eDP Display support
Computer Vision Engines
ISP
Video Image Compositor
Boot, Power & Security
Boot and power management
ARM TrustZone Secure
Industry Standard IO
GPIO, I2C, I2S, SDIO, SPI, UART
Support up to 12 CSI @1.5Gbps
Industry Standard High-Speed IO
PCle Gen2 rootport x1 | x2 | x4
12 lanes MIPI CSI-2 (D-Phy)
RGMII Ethernet
USB 3.0 and 2.0
USB 3.0 Gen2 Host and Device
Memory
4GB 64-Bit LPDDR4
Bandwidth 25.6 GB/s
16GB eMMC
Jetson Nano
Quad A57 CPU Complex
Boot, Power &
Security
Sensor IO
Maxwell GPU
High Performance
IO
Multimedia
Complex
Memory
System
Computer Vision
Engines
10. 10
JETSON XAVIER NX
World’s Smallest Supercomputer
Carmel ARM V8.2 CPU
6 Cores 4x2MB L2, 4MB L3
10-wide Superscalar
Cache coherent CPU complex
Volta Tensor Core GPU
FP32/FP16/INT8 Multi-Precision
384 CUDA Cores
2.8 TFLOPS (FP16)
12 DL TOPS (INT8)
Multimedia Engines
Encode, Decode,
Video Image Compositor
H.264, H.265, VP9
HDMI and DP Display support
DLA – Designed for Inference
5.5 TFLOPS FP16
9 TOPS INT8
Boot, Power & Security
Boot and power management processor
TEE + ARM TrustZone
AES, RSA, SHA
Industry Standard IO
Always on Sensor processor engine (AON/SPE)
CAN, DMIC, GPIO, I2C, I2S, PMC, SPI, UART
Industry Standard High-Speed IO
PCle Gen3 Root and Endpoint
12 lanes MIPI CSI-2 | 6 lanes SLVS-EC
Support C-Phy and D-Phy
RGMII Ethernet
USB 3.1 and 2.0
USB 3.1 Gen2 Host and Device
Memory
128-Bit LPDDR4X
8GB, 51.2 GB/s
19. 19
JETSON SOFTWARE
for AI Edge Devices
FactoryCity Logistics Healthcare Agriculture
Ecosystem
AI Software and Services
Ecosystem
Machine Vision Cameras & Sensors
Ecosystem
System Software & Developer Tools
Jetson
DeepStream SDK Isaac SDK
DeveloperTools
Computer Vision
VPI
VisionWorks
OpenCV
Sensors
Drivers
Ecosystem
Deep Learning
TensorRT
cuDNN
Multimedia
libargus
Video API
Accelerated Computing
cuBLAS
cuFFT
CUDA-X
CUDA • Linux • RTOS
JetPackSDK
20. 20
CLOUD NATIVE ON JETSON
Easier and Faster Deployment
- Eliminates complex, time-consuming builds and installs
Agile and Easier Development
- Update specific modules not the whole system
Scalability
- Push the right container to the right platform
Portable
- Deploy across various environments, from test to
production with minimal changes
Consistency Across Portfolio
- Update once and push broadly
Containers & Micro Services
22. 22
TRANSFER LEARNING TOOLKIT
Faster and efficient deep
learning training workflow
Leverages prior investment in
pretrained models
Output optimized and ready for
deployment
High level SDK for tuning of domain specific DNNs
23. 23
NVIDIA TensorRT
From Every Framework, Optimized For Each Target Platform
TX2
Nano
AGX Xavier
Xavier NX
NVIDIA Products
TensorRT
24. 24
JETSON DEVELOPER TOOLS
System wide application tuning and optimization
Workload balancing across GPU, CPU, DLA
Multi-platform development
Comprehensive tool suite to accelerate development
CUDA-aware editor CPU/GPU debugger
Compute and graphics
Visual profiler and system trace
Develop → Profile → Analyze → Optimize
https://developer.nvidia.com/nsight-systems
27. 27
JETSON INFORMATION RESOURCES
Most Critical Nvidia Resources For Jetson Information
docs.nvidia.com
Jetson SW Documentation
JetPack Overview
L4T Development Guide
L4T Multimedia
developer.nvidia.com
Autonomous Machines
Support Resources page
Download Center
Module Datasheet
Product Design Guide
Adaptation and Bring-up
Guide
Jetson FAQ
Nvidia.com – Platforms
Autonomous Machines
Jetson Product Overview
Industries – Application
Examples
Autonomous Machines
Blog
Forums
Search
Answer questions
AIOT GitHub
Examples
Tutorials
28. 28
JETSON INFORMATION RESOURCES
Internet Resources For Jetson Information
elinux.org/jetson
Useful collection of information around Jetson
Guides & Tutorials
Links to tools and examples
Components and add-on’s for devkits
JetsonHacks
Developer focused tips&tricks
Product reviews
Articles and How-To’s
Tools and application example
29. 29
DEEP LEARNING INSTITUTE
Training Labs Nanodegrees
nvidia.com/DLI
TWO DAYS TO A DEMO
Create your first demo today
developer.nvidia.com/
embedded/twodaystoademo
JETSON DEVELOPER KIT
Start developing now
Starting at $299
developer.nvidia.com/
buy-jetson
GTC
Largest event for GPU
developers
gputechconf.com
JETSON - START NOW
31. 31
INTELLIGENT VIDEO ANALYTICS
Logistics
Public Transit
Public Safety
Critical Infrastructure
Traffic Engineering
Retail Analytics
Parking Management
Access Control
— Increase operational efficiency and safety across many industries using AI
$2T INDUSTRY
32. 32
NVIDIA METROPOLIS
A Powerful Application Framework for Intelligent Video Analytics & IoT
https://www.nvidia.com/en-us/autonomous-machines/intelligent-video-analytics-platform/
EGX SOFTWARE STACK
METROPOLIS SOFTWARE STACK
DEEPSTREAM TRT, TRITON TLT VIDEOCODEC
NGC NVIDIA PARTNERS
NVIDIA EGX HARDWARE
T4 JETSON
CUDA-X
Kubernetes Networking Storage Security
33. 33
GETTING STARTED APPLICATIONS
Available in C and Python
Name Function
deepstream-test1
DeepStream Hello world. Single video from
file to on screen display with bounding box
deepstream-test2
Builds on test1 and adds secondary object
classification on detected objects
deepstream-test3
Builds on test1 and adds multiple video
inputs
deepstream-test4
Builds on test1 and adds connections to IoT
services thru the nvmsgbroker plugin
Object
detection
Classific-
ation
BatchingDecode
Object
detection
BatchingDecode
Object
detection
Object
detection
Message
Broker
Native C apps: sources/apps/sample_apps/
Python apps: https://github.com/NVIDIA-AI-IOT/deepstream_python_apps
Message
Converter