Supermicro X12 Performance Update

X12 Performance Update –
Webinar (Nov. 2, 2021)
Michael Schulman
michaels@supermicro.com
Better Faster Greener™ © 2021 Supermicro

X12 Performance Update
11/2/2021 Better Faster Greener™ © 2021 Supermicro
2
Michael Schulman
Supermicro
Rick Smith
Intel
Siva Yarramaneni
Supermicro

3
Michael Schulman
Supermicro

X12 Performance Update - Agenda
4
• Introduction
• 3rd Gen Intel Xeon Scalable Processors – Comparisons to Previous
• Workload Performance
• 5G and Edge
• Cloud – SPECpower_ssj2008
• Storage – IO500
• HPC and AI – SPEC and ML Perf
• Summary
• Additional Information

Why Is Improved Performance Important ?
5
• Reduction in Time To Solution (HPC, AI)
• Can run more simulations (scenarios), resulting in more optimized products
• Bring products to market faster than competitors (make more money)
• Higher Resolution simulations
• Faster Response to Queries (Enterprise)
• Better decisions – Employees with faster analytics
• Response time for customers (shopping)
• More Work Per Watt
• Perhaps not need as many CPUs

X12 Performance Update - Workloads
6
5G and Edge Cloud Storage HPC/AI

Generation to Generation to Generation
7
2017 2019 2021

X12 Performance Basics – Gen over Gen over Gen
8
1st Gen Intel Xeon
Scalable Processors
(x1xx)
2nd Gen Intel Xeon
Scalable Processors
(x2xx)
3rd Gen Intel Xeon
Scalable Processors
(x3xx)
51xx, 61xx 82xx, 62xx 83xx % Increase 1st to 3rd
Max Cores 28 28 40 +43%
Max GHz x Max Cores =28 * 2.5 = 70 =28 * 2.7 = 75.6 =40 * 2.3 = 92 +31%
Max Memory
(TB)/socket
768 GB 1 TB 4TB , 6TB w/PMem +418%
Max Memory Speed
(MHz)
2666 2933 3200 +20%
Max PCI-E Lanes 48 48 64 +33%
Max PCI-E Lanes x
Speed (Throughput)
= 48 * .985 GB/s
47.28 GB/s
= 48 * .985 GB/s
47.28 GB/s
= 64 * 1.969 GB/s
126.02 GB/s
+166%

Hierarchy of Performance Metrics
9
Absolute Performance (Peak)
LINPACK – 80% – 90% of Peak
(Used for Top500 list)
SPEC – Sample Applications (Relative)
Customer Applications
Higher
Peak
Performance
More
Applicable
to
Customer
AI Tests

10

11
3rd Gen Intel® Xeon® Scalable Processors
Performance Made Flexible
Only x86 data center processor with
built-in Artificial Intelligence
Scalable, flexible, customizable
Advanced security solutions
Targeted for 1S-2S systems
Next-gen Xeon Scalable Platform Faster, Flexible, Data Scale
Breakthrough Data Performance
Memory Capacity
Increase vs.
2nd Gen Xeon
Scalable
DDR4-3200
2 DPC
(Per Socket)
System Memory
Capacity
(Per Socket)
DRAM + PMem
Up to
6TB
Up to
8CH
Up to
2.6X
Lanes
PCI Express 4
(per Socket)
Up to
64
Intel
Crypto
Acceleration
Intel Platform
Firmware
Resilience
Intel Total Memory
Encryption
Intel Software
Guard Extensions
Optimized
Software
Intel Speed Select
Technology
Intel
AVX-512
Intel Deep
Learning Boost
Intel®
Optane™
persistent
memory 200
series
Intel®
Optane™ SSD
P5800X series
Intel® Ethernet
800 series
network adapters
Intel® SSD
D series
Intel® Agilex™
FPGA
solutions

3rd Gen Intel® Xeon® Scalable Processor
(Code-named Ice Lake-SP)
Scalable and balanced architecture delivered
through advancements in all technology
pillars
• Compute: Next generation core with
significant IPC improvements and new ISA
instructions
• Memory: Significant improvement in DDR
and Intel® Optane™ persistent memory
performance
• IO: 64 lanes PCIe Gen4 and 3 high-speed UPI
links
• Intra/Inter Node Scaling: Consistent low
latencies to cache, memory and inter socket
Whitley 2-socket Platform
UPI
Lewisburg-R
DMI
64 lanes
PCIe Gen4
64 lanes
PCIe Gen4
3rd Gen Intel
Xeon processor
3rd Gen Intel
Xeon processor
DDR4 DIMMs
DDR4/Intel® Optane™ Persistent Memory 200 Series
Lewisburg-R
DMI

Compute Architecture - New Instructions
Cryptography
• Big-Number Arithmetic (AVX-512 Integer
IFMA)
• Vector AES and Vector Carry-less
Multiply Instructions
• Galois Field New Instructions (GFNI)
• SHA-NI
Compression/Decompression and
Special SIMD
• Bit Algebra
• VBMI – Vector Bit Manipulation
Instruction
Performance varies by use, configuration and other factors. Learn more at www.Intel.com/PerformanceIndex. See appendix for workloads and configurations. Results may vary.

Processor Architecture, Cache & Memory Latencies, Capacity
Latency Intel Xeon Platinum
8280 Processor
(Cascade Lake)
Intel Xeon Platinum 8380
Processor
(Ice Lake)
L1 hit cache, cycles 4 5
L2 hit cache, cycles 14 14
L3 hit cache (same socket), ns 20.2 21.7
L3 hit cache (remote socket), ns 180 118
3rd Gen Intel Xeon Scalable processors have consistent and low latencies to local cache and the second
socket, and provide lower latencies to DRAM and support larger memory capacity
3rd Gen Intel Xeon Scalable Processors
Local Socket
Memory Latency
85 ns
Remote Socket
Memory Latency
139 ns
Memory Controller On Die – 6ch On Die – 8ch
Max DIMM Capability
(SKU dependent)
1 DPC 2933
2 DPC 2666
2 DPC 3200/2933/2666
DRAM read latency local
socket, ns
81 85
DRAM read latency (remote
socket), ns
138 139
Max Memory Capacity per
Socket
4.5 TB (DDR+PMem)
3TB (DDR)
6TB (DDR+PMem)
4TB (DDR)

Instructions providing workload acceleration
Application Usage/Workloads
3rd Gen Intel® Xeon®
Scalable Processors
2nd Gen Intel® Xeon® Scalable
Processors
VNNI Accelerated 8-bit integer processing AI workload performance acceleration Yes Yes
Intel AVX-512 Vector acceleration for computational
demanding tasks
HPC and other compute intensive applications Yes Yes
Vector AES
(Advanced Encryption
Standard)
Vector CLMUL
Encryption (CTR, CBC, XTS) and
authenticated encryption (AES-GCM)
Data move to/from disk or across AES. Ex.
Database encryption, cloud encryption (Hadoop,
etc.)
Yes
AVX-512 (light)
No
VPMADD52 Public key crypto generation (RSA & DH)
SSL Front End Web Server connections (NGINX,
HA-Proxy, WordPress)
Yes No
SHA
(Secure Hash Algorithm)
Extensions
SHA-1 & SHA-256 Hashing Algorithms
Hashing, SSL, TLS, IPSec, Data Dedup,
Blockchain, Bitcoin
Yes No
VBMI
AVX 512 (Vector Byte
Manipulation Instructions)
In line compression while feeding small
chunks of data to algorithms for
immediate operation
In-Memory Database (IMDB) workloads;
improves decompression/compression
performance
Yes No
3rd Gen Xeon® provides differentiated instructions that enable outstanding performance on leading edge workloads

Linpack – Solve a Set of Linear Equations
16
Extremely Scalable
(E5-2699) 1st Gen
8180
2nd Gen
8280
3rd Gen
8380
32.4% 69.0% 72.3 % 100 %

X12 Workloads
17

Flexible Performance for Most Demanding Workloads
Outstanding gen-on-gen performance from intelligent edge & vRAN
5G
1.62x
Improvement
in Network and
Communications
Workloads1
UP TO
1See [90, 91, 92] at www.intel.com/3gen-xeon-config. Results may vary.

Built-in Crypto Acceleration for Encryption-Intensive Workloads
Encryption Made Flexible
Encrypted Web Server
More TLS encrypted web server connections per second;
more content delivered per server1
Vector Packet Processing
More encrypted packets processed per second;
higher network and VPN capacity per node1
4.2x 1.94x
▪ New instructions and architectural features parallelize execution of encryption functions
▪ Reduces penalty of implementing pervasive data encryption
▪ Higher throughput with fast and strong encryption for AVX-512 ISA
▪ Increases performance of encryption-intensive workloads such as SSL web server, 5G infrastructure and
VPN/firewalls
Intel Crypto Acceleration

X12 Workloads
20

SPEC - SPECpower_ssj 2008
21
• SPECpower_ssj 2008 is an industry-standard SPEC benchmark that
evaluates the power and performance characteristics of volume server class
computers. The initial benchmark addresses the performance of server-side
Java.
System Result Max Published (ICX) Max Tier 1 (ICX)
SuperServer SYS-
620C-TN12R
13544 13544 (Supermicro) 13544 (Supermicro)
Source: www.spec.org

X12 Workloads
22

23
Siva Yarramaneni
Supermicro

X12 Performance – IO500
25
• Consists of Data and Meta-Data
Goal
Capture User-Experience (Real-
World) Performance
• Representative
• Understandable
• Scalable
• Portable
• Inclusive
• Lightweight
• Trustworthy
Workloads
Single Score
• IOEasy – Well optimized I/O
patterns
• IOHard – Random workload
• MDEasy – Metadata/small
objects
• MDHard – Small files in a
shared directory
• Find: Find relevant objects
based on patterns

X12 Performance – IO500
26
System CPU
SYS-120U-TNR 3rd Gen Intel Xeon® Scalable Processor
6330 28c 205W 2.0 GHz

IO500 Per Node Performance-Supermicro
© 2021 Supermicro
27
Pengcheng Intel Intel Lenovo Intel National
Argonne
National
Laboratory
Supermicro DDN BSC & JGU
Score/Node 51.92 46.49 25.29 51.07 33.93 12.48 55.08 103.76 24.95 7.72
KIOPS/Node 695.55 216.79 116.45 297.32 218.10 64.55 253.35 383.91 71.58 40.37
BW/Node 3.88 9.97 5.49 8.77 5.28 2.41 11.98 28.04 8.70 1.48
51.92
46.49
25.29
51.07
33.93
12.48
55.08
103.76
24.95
7.72
695.55
216.79
116.45
297.32
218.10
64.55
253.35
383.91
71.58
40.37
3.88
9.97
5.49 8.77
5.28 2.41
11.98
28.04
8.70
1.48 0.00
20.00
40.00
60.00
80.00
100.00
120.00
0.00
100.00
200.00
300.00
400.00
500.00
600.00
700.00
800.00
BW
SCORE&KIOPS
INSTITUTION
#1 Score/node & BW/Node, and #2 in KIOPS/Node
Score/Node KIOPS/Node BW/Node
The goal for the benchmark is to capture user-experienced performance.

X12 Workloads
28

SPEC – CPU 1st Gen to 2nd Gen to 3rd Gen – Intel Xeon-SP
29
Benchmark SMCI 1st Gen Intel
(6/2017)
SMCI 2nd Gen Intel
(4/2019)
SMCI 3rd Gen Intel
(4/2021)
1st Gen to 3rd Gen 2nd Gen to 3rd Gen
CPU2017 Integer
Speed
9.31 (8180) 10.5 (8280) 12.9 (8368Q) 39 % 23%
CPU2017 Floating
Point Speed
131 (8180) 160 (8280) 237 (8368Q) 81% 48%
CPU2017 Integer
Rate
298 (8180) 351 (8280) 573 (8368Q) 92% 63%
CPU2017 Floating
Point Rate
250 (8180) 290 (8280) 484 (8368Q) 94% 67%
Many Customers Skip a Generation – 1st Gen to 3rd Gen Intel Xeon-SP is a skip
Source: www.spec.org

Built-in Acceleration
DDIO
enabled vs. disabled
Up to
1.3x
higher
DPDK L3 Packet Forwarding
6338N
Intel AVX-512
vs. AVX2
Intel DL Boost (VNNI)
int8 vs. fp32
Intel Crypto Acceleration
enabled vs. disabled
Up to
1.62x
higher
LINPACK
8380
Up to
4.3x
higher
ResNet50-v1.5
8380
Up to
4.2x
higher
NGINX ECDHE-X25519-RSA2K
6338N v 6252N

Improved Performance1 per Core Across Various Workloads
Delivers Significant Customer Value in the Cloud & On-Premise
Web DB & Analytics
Infrastructure
Virtualization Web Microservices
(CloudXPRT)
Database
MySQL
DPDK L3 Forwarding
(Packet Processing)
JAVA Throughput under
SLA
Data Analytics
(CloudXPRT)
8380 v 8280 8380 v 8280
8380 v 8280 8380 v 8280
8380 v 8280
6338N v 6252N
57%
higher performance
AVX-512
64%
higher performance
PCIe 4.0 SSD
62%
higher performance
Core & Cache Arch
65%
higher performance
XGBoost
72%
higher performance
PCIe 4.0
88%
higher performance
PCIe 4.0 NIC
10%
higher performance/core
15%
20%
13%
15%
41%
1See [81, 84, 91, 97, 98, 99, 108, 122, 123] at www.intel.com/3gen-xeon-config. Results may vary.
Weather Forecast
(WRF)
Object Recognition
Mobilenet-v1
Financial Services
(Monte Carlo)
Language Processing
BERT
HPC AI
8380 v 8280 8380 v 8280
8380 v 8280 8380 v 8280
58%
higher performance
8-ch DDR4
66%
higher performance
DL Boost
70%
higher performance
AVX-512
74%
higher performance
DL Boost
11%
16%
19%
22%

3rd Gen Intel® Xeon® Scalable Processor with Intel AVX-512
Delivers Big Boost for HPC Customers
1.00
1.38 1.41 1.47
1.58
1.28
1.67 1.70
1.51
1.57 1.60 1.61 1.64
0
1
2
2S Intel® Xeon®
Platinum 8280
HPL HPCG Stream Triad WRF
(Geomean of 3)
Binomial
Options
Black
Scholes
Monte
Carlo
OpenFOAM
(Geomean of 2)
NAMD
(Geomean of 3)
LAMMPS
(Geomean of 4)
RELION
Plasmodium Ribosome
GROMACS
(Geomean of 4)
1.53x higher average HPC Performance1 with Intel® Xeon® Platinum 8380 vs. prior generation
featuring Intel® AVX-512 and 8 channels of DDR4-3200 across a broad set of HPC codes
Industry Standard Earth System
Model
Financial Services Manufacturing Life and Material Science
Relative
performance
higher
is
better
1See [108] at www.intel.com/3gen-xeon-config. Results may vary.
OpenFOAM Disclaimer: This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark

AI Performance Gains
3rd Gen Intel® Xeon® Scalable processors with Intel Deep Learning Boost
Image
Recognition
Mobilenet-v1
Image
Classification
ResNet-50-v1.5
Language
Processing
BERT-large
Real Time Inference1
8380 vs. 8280
Batch
Inference1
8380 vs. 8280
up to 1.59x up to 1.66x
up to 1.52x
up to
1.56x
up to 1.45x up to 1.74x
Deep Learning
Machine Learning
SciKit Learn & XGBoost1
8380 vs. 8280
Kmeans
Fit
up
to 1.36x
Linear Regression Fit
up
to 1.44x
Kmeans
Inference
up
to 1.44x
Linear Regression
Inference
up
to 1.60x
XGBoost
Fit
up
to 1.44x
XGBoost
Predict
up
to 1.30x
Performance varies by use, configuration and other factors. Learn more at www.Intel.com/PerformanceIndex. See appendix for workloads and configurations.

MLPerf ™
MLPerf Inference 1.1 Results

X12 Performance – Server Specs
35
# BenchMark System CPU GPU
2 ML Perf inference v1.1 SYS-420GP-TNR 3rd Gen Intel® Xeon® Scalable Processor Platinum 8360Y 10x A100-PCIe-40GB
3 ML Perf inference v1.1 SYS-420GP-TNR 3rd Gen Intel® Xeon® Scalable Processor Platinum 8360Y 8x A100-PCIe-80GB
4 ML Perf inference v1.1 SYS-120GQ-TNRT 3rd Gen Intel® Xeon® Scalable Processor Gold 6354 4x A100-PCIe-80GB, TensorRT
5 ML Perf inference v1.1 4029GP-TRT-OTO-28 3rd Gen Intel® Xeon® Scalable Processor Platinum 8280 8x A10, TensorRT
6 ML Perf inference v1.1 4029GP-TRT-OTO-28 3rd Gen Intel® Xeon® Scalable Processor Platinum 8280 8x A10, TensorRT, Triton
7 ML Perf inference v1.1 SYS-240P-TNRT 3rd Gen Intel® Xeon® Scalable Processor Gold 8380H (Cooper Lake running Triton)

AI - MLPerf
36
Image Classification – Is there a Cat in this image?
Object Classification – Where is the Cat in this image?
Speech Recognition – Take my speech and turn it into readable text.
Natural Language Processing – I want to talk to my computer and get a voice response.
BERT – Talking to my computer, can it get context based conversion? (a language model
which is bidirectionally trained)

X12 Performance MLPerf Inference 1.1 Results
37
• Results
• 2nd Place:
• Speech Recognition Offline
• Object Detection Offline
• 3rd Place:
• Object Detection Server
• BERT 99.9 Server
• Natural Language Processing 99 Offline
• 4th Place:
• Image Recognition Offline
MLPerf Inference measures the
performance of applying a trained
machine learning model to new data for a
wide variety of applications and form
factors

Intel® Optane™ Persistent Memory 200 Series
Persistent memory made flexible
Average of
32% higher
memory bandwidth
compared to 100 series
Up to
8 TB total memory
per socket
for faster analysis of the largest
data sets
eADR (Enhanced Asynchronous DRAM Refresh) improves
performance of apps that use persistent memory by
eliminating “cache flushes”
Persistent memory ecosystem continues to grow
Computes up to 2X faster graph analytics
algorithms used in search, social networks,
and fraud detection
Lower infrastructure costs by up 25% per
VM while delivering the same performance
Performance varies by use, configuration and other factors. Learn more at https://edc.intel.com/content/www/us/en/products/performance/benchmarks/intel-optane-persistent-memory/. Results may vary.

Intel® Ethernet 800 Series Network Adapters
Connectivity made flexible
Prioritizes application traffic to help deliver the performance
required for high-priority, network intensive workloads
Fully programmable pipeline to enable frame classification for
advanced and proprietary protocols
Supports RDMA over iWARP or RoCEv2 protocols and NVMe
over TCP with ADQ for high throughput, low latency storage,
cloud and HPC clusters
New E810-2CQDA2 adapter targets high-performance
workloads such as vRAN, NFV forwarding plane, storage, HPC,
cloud and content delivery networks
Up to
2X more
resources
for greater VM and container density
Up to
200
Gbps per
adapter
with new E810-2CQDA2 adapter
100 Gbps per port
and
PCIe 3.0,
PCIe 4.0 and OCP
NIC 3.0
Source: 2x more resources from 100Gbps to 200Gpbs

X12 Product Families
Rackmounts Multi-Node
Ultra
Cloud DC Mainstream
BigTwin
FatTwin SuperBlade
TwinPro
Storage
General Purpose
UP
Mainstream
WIO
Storage
GPU Optimized
Hyper/Hyper-E
40
Top Loading

X12 Performance Update - Summary
41
• Supermicro X12 Product Line with 3rd Gen Intel Xeon Scalable Processors
• Range of Performance Leadership – From Edge to Cloud
• Different Workloads Use Different Intel processors
• Significant Performance Jump from 1st Gen Intel Xeon to 2nd Gen Intel Xeon
to 3rd Gen Intel Xeon
• Adjacent Technologies for Wide Range of Workloads
• Hardware Advances, Software Advances

X12 Performance Update – More Info
42
www.supermicro.com/X12

Appendix
Configuration Details

Configuration Appendix (1 of 2)
Compute Architecture - New instructions
3.34x higher IPSec AES-GCM performance,3.78x higher IPSec AES-CMAC performance,3.84x higher IPSec AES-CTR performance,1.5x higher IPSec ZUC performance: 8380: 1-node, 2x Intel® Xeon® Platinum 8380 CPU
on M50CYP2SB2U with 512 GB (16 slots/ 32GB/ 3200) total DDR4 memory, ucode 0x8d055260, HT On, Turbo Off, Ubuntu 20.04.2 LTS, 5.4.0-66-generic, 1x Intel 1.8TB SSD OS Drive, intel-ipsec-mb v0.55, gcc 9.3.0, Glibc 2.31,
test by Intel on 3/17/2021. 8280M: 1-node, 2x Intel® Xeon® Platinum 8280M CPU on S2600WFT with 384 GB (12 slots/ 32GB/ 2933) total DDR4 memory, ucode 0x4003003, HT On, Turbo Off, Ubuntu 20.04.2 LTS, 5.4.0-66-generic,
1x Intel 1.8TB SSD OS Drive, intel-ipsec-mb v0.55, gcc 9.3.0, Glibc 2.31, test by Intel on 3/8/2021.
3.5x higher ISA-L AES-XTS performance, 2.30x higher ISA-L CRC performance: ISA-L: 8380: 1-node, 2x Intel® Xeon® Platinum 8380 Processor, 40 cores HT On Turbo OFF Total Memory 512 GB (16 slots/ 32GB/ 3200 MHz),
Data protection (Reed Solomon EC (10+4)), Data integrity (CRC64), Hashing (Multibuffer MD5),Data encryption (AES-XTS 128 Expanded Key), Data Compression (Level 3 Compression (Calgary Corpus)), BIOS:
SE5C6200.86B.3021.D40.2103160200 (ucode: 0x8d05a260), Ubuntu 20.04.2, 5.4.0-67-generic, gcc 9.3.0 compiler, yasm 1.3.0, nasm 2.14.02, isal 2.30, isal_crypto 2.23, OpenSSL 1.1.1.i, zlib 1.2.11, Test by Intel as of 03/19/2021.
8280: 1-node, 2x Intel® Xeon® Platinum 8280 Processor, 28 cores HT On Turbo OFF Total Memory 384 GB (12 slots/ 32GB/ 2933 MHz), BIOS: SE5C620.86B.02.01.0013.121520200651 (ucode:0x4003003), Ubuntu 20.04.2, 5.4.0-
67-generic,, gcc 9.3.0 compiler, yasm 1.3.0, nasm 2.14.02, isal 2.30, isal_crypto 2.23, OpenSSL 1.1.1.i, zlib 1.2.11 Test by Intel as of 2/9/2021. Performance measured on single core.
5.63x higher OpenSSL RSA Sign 2048 performance,1.90x higher OpenSSL ECDSA Sign p256 performance,4.12x higher OpenSSL ECDHE x25519 performance,2.73x higher OpenSSL ECDHE p256 performance,
8280M:1-node, 2x Intel® Xeon® Platinum 8280M CPU on S2600WFT with 384 GB (12 slots/ 32GB/ 2933) total DDR4 memory, ucode 0x5003003, HT On, Turbo Off, Ubuntu 20.04.1 LTS, 5.4.0-65-generic, 1x INTEL_SSDSC2KG01,
OpenSSL 1.1.1j, GCC 9.3.0, test by Intel on 3/5/2021. 8380: 1-node, 2x Intel® Xeon® Platinum 8380 CPU on M50CYP2SB2U with 512 GB (16 slots/ 32GB/ 3200) total DDR4 memory, ucode 0xd000270, HT On, Turbo Off, Ubuntu
20.04.1 LTS, 5.4.0-65-generic, 1x INTEL_SSDSC2KG01, OpenSSL 1.1.1j, GCC 9.3.0, QAT Engine v0.6.4, test by Intel on 3/24/2021. 8380: 1-node, 2x Intel® Xeon® Platinum 8380 CPU on M50CYP2SB2U with 512 GB (16 slots/
32GB/ 3200) total DDR4 memory, ucode 0xd000270, HT On, Turbo Off, Ubuntu 20.04.1 LTS, 5.4.0-65-generic, 1x INTEL_SSDSC2KG01, OpenSSL 1.1.1j, GCC 9.3.0, QAT Engine v0.6.5, test by Intel on 3/24/2021
Processor Architecture, Cache, Memory Latencies
Cache and memory latency comparisons: Cascade Lake: 2-socket Intel® Xeon® 8280 (2.7GHz, 28C, 205W TDP) on Intel Software Development Platform, HT on, Turbo on, SNC off, prefetchers disabled, 384 GB (12x32GB
DDR4-2933), ucode 0x5000024, Ubuntu 19.04, 5.3.0-rc3-custom, kernel patched for security mitigations, Latencies using Intel Memory Latency Checker version 3.7, https://software.intel.com/en-us/articles/intelr-memory-latency-
checker. Tested by Intel as of and results as of October 2019. Ice Lake: 2-socket Intel® Xeon® 8380 (40C/2.3GHz, 270W TDP) on Intel Software Development, HT on, Turbo on, SNC off, prefetchers disabled, 512GB
(16x32GB DDR4-3200), ucode 0xd0001e0, Ubuntu 20.04 LTS, 5.4.0-65-generic, Latencies using Intel Memory Latency Checker version 3.9, https://software.intel.com/en-us/articles/intelr-memory-latency-checker. Tested by Intel
and results as of March 2021.

1.3x DDIO on/off with DPDK L3 Packet Forwarding: 1-node, 2(1 socket used)x Intel® Xeon® Gold 6338N on Intel* Whitley with 128 GB (8 slots/ 16GB/ 2666) total DDR4 memory, ucode 0x261, HT on, Turbo off, Ubuntu 20.04 LTS
(Focal Fossa), 5.4.0-40-generic, 1x INTEL* 240G SSD, 1x E810-2CQDA2 (Chapman Beach), v20.08.0, Gcc 9.3.0, DPDKL3FWD (4c8t), PCIe Writes=Non-Allocating for DDIO off case, test by Intel on 3/24/2021
1.62x AVX-512 vs. AVX2 on LINPACK: 1-node, 2x Intel® Xeon® Platinum 8380 on Coyote Pass with 512 GB (12 slots/ 32GB/ 3200) total DDR4 memory, ucode 0x270, HT off, Turbo on, Ubuntu 20.04.2 LTS, 5.4.0-67-generic, 1x
INTEL_SSDSC2BB80, 1x X710, Intel distribution of LINPACK with AVX-512, AVX2, test by Intel on 3/24/2021
4.2x NGINX (TLS 1.2 Handshake) web server connections/sec with ECDHE-X25519-RSA2K Multi-buffer: 6338N: 1-node, 2x Intel® Xeon® Gold 6338N processor on Coyote Pass with 256 GB (16 slots/ 16GB/ 2666) total DDR4
memory, ucode x261, HT on, Turbo off, Ubuntu 20.04.1 LTS, 5.4.0-65-generic, x 3 x Quad Ethernet Controller E810-C for SFP 25 GBE, Async NGINX v0.4.3, OpenSSL 1.1.1h, QAT Engine v0.6.4, Crypto MB-ippcp_2020u3, GCC
9.3.0, GLIBC 2.31, test by Intel on 3/22/2021. 6252N: 1-node, 2x Intel® Xeon® Gold 6252N processor on Supermicro X11DPG-QT with 192 GB (12 slots/ 16GB/ 2933) total DDR4 memory, ucode 0x5003003, HT on, Turbo off, Ubuntu
20.04.1 LTS, 5.4.0-65-generic, x 2 x Quad Ethernet Controller XXV710 for 25GbE SFP28, 1 x Dual Ethernet Controller XXV710 for 25GbE SFP28, Async NGINX v0.4.3, OpenSSL 1.1.1h, GCC 9.3.0, GLIBC 2.31, test by Intel on
1/17/2021.
4.3x Intel DL Boost FP32 to INT8: 1-node, 2x Intel® Xeon® Platinum 8380 processor on Coyote Pass with 512 GB (16 slots/ 32GB/ 3200) total DDR4 memory, ucode 0x261, HT on, Turbo on, Ubuntu 20.04 LTS, 5.4.0-64-generic, 1x
Intel® SSDSC2KG960G7, 1x Intel® SSDSC2KG960G7, ResNet-50 v1.5, gcc-9.3.0, oneDNN 1.6.4, BS=128, FP32/INT8, TensorFlow- 2.5 (container- intel/intel-optimized-tensorflow:tf-r2.5-icx-b631821f), Model zoo:
https://github.com/IntelAI/models/tree/icx-launch-public/quickstart/, test by Intel on 3/19/2021.
Built-in Crypto Acceleration
4.2x NGINX (TLS 1.2 Handshake) web server connections/sec with ECDHE-X25519-RSA2K Multi-buffer: 6338N: 1-node, 2x Intel® Xeon® Gold 6338N processor on Coyote Pass with 256 GB (16 slots/ 16GB/ 2666) total DDR4
memory, ucode x261, HT on, Turbo off, Ubuntu 20.04.1 LTS, 5.4.0-65-generic, x 3 x Quad Ethernet Controller E810-C for SFP 25 GBE, Async NGINX v0.4.3, OpenSSL 1.1.1h, QAT Engine v0.6.4, Crypto MB-ippcp_2020u3, GCC
9.3.0, GLIBC 2.31 , test by Intel on 3/22/2021. 6252N: 1-node, 2x Intel® Xeon® Gold 6252N processor on Supermicro X11DPG-QT with 192 GB (12 slots/ 16GB/ 2933) total DDR4 memory, ucode 0x5003003, HT on, Turbo off,
Ubuntu 20.04.1 LTS, 5.4.0-65-generic, x 2 x Quad Ethernet Controller XXV710 for 25GbE SFP28, 1 x Dual Ethernet Controller XXV710 for 25GbE SFP28, Async NGINX v0.4.3 , OpenSSL 1.1.1h, GCC 9.3.0, GLIBC 2.31 , test by Intel
on 1/17/2021.
1.94x Vector Packet Processing - IP Security 1420B: 1-node, 2(1 socket used)x Intel® Xeon® Gold 6338N on Intel* Whitley with 128 GB (8 slots/ 16GB/ 2666) total DDR4 memory, ucode 0x261, HT on, Turbo off, Ubuntu 20.04
LTS (Focal Fossa), 5.4.0-40-generic, 1x INTEL* 240G SSD , 1x E810-2CQDA2 (Chapman Beach), v21.01-release, Gcc 9.3.0, VPPIPSEC(24c24t) test by Intel on 3/17/2021 .1-node, 2(1 socket used)x Intel® Xeon® Gold 6252N on
SuperMicro* X11DPG-QT with 96 GB (6 slots/ 16GB/ 2933) total DDR4 memory, ucode 0x5002f01, HT off, Turbo off, Ubuntu 20.04 LTS (Focal Fossa), 5.4.0-40-generic, 1x INTEL* 240G SSD , 1x E810-CQDA2 (Tacoma Rapids),
v21.01-release, Gcc 9.3.0, VPPIPSEC(18c18t) test by Intel on 2/2/2021.
AI Performance Gains
1.44x XGBoost fit, 1.30x XGBoost predict, 1.36x Kmeans fit, 1.44x Kmeans inference, 1.44x Linear Regression fit, 1.60x Linear Regression inference: 8380: 1-node, 2x Intel® Xeon® Platinum 8380 processor on Coyote Pass
with 512 GB (16 slots/ 32GB/ 3200) total DDR4 memory, ucode 0x261, HT on, Turbo on, Ubuntu 20.04 LTS, 5.4.0-64-generic, 1x Intel® SSDSC2KG960G7, 1x Intel® SSDSC2KG960G7, Python 3.7.9, Sklearn 0.24.1
(github.com/IntelPython/scikit-learn_bench), Daal4py 2021.2, XGBoost 1.3.3, test by Intel on 3/19/2021. 8280: 1-node, 2x Intel® Xeon® Platinum 8280L processor on S2600WFT with 384 GB (12 slots/ 32GB/ 2933) total DDR4
memory, ucode 0x5003003, HT on, Turbo on, Ubuntu 20.04 LTS, 5.4.0-65-generic, 1x Intel® SSDSC2BB800G7, 1x Intel® SSDSC2BB800G7, Python 3.7.9, Sklearn 0.24.1(https://github.com/IntelPython/scikit-learn_bench), Daal4py
2021.2, XGBoost 1.3.3, test by Intel on 2/5/2021.
Intel contributes to the development of benchmarks by participating in, sponsoring, and/or contributing technical support to various benchmarking groups, including the BenchmarkXPRT Development Community administered by
Principled Technologies.
Configuration Appendix (2 of 2)
Built-in Acceleration

Supermicro Leads in 3rd Gen Intel Xeon Scalable
processor - SPEC
47
• SPECspeed2017_int_base 2 Socket Intel world record among top 5 server vendors per
IDC(https://www.idc.com/getdoc.jsp?containerId=prUS47961621) with 3rd Gen Intel Xeon Scalable
processors on SuperServer SYS-420GP-TNR.
• SPECspeed2017_fp_base 2 Socket Intel world record among top 5 server vendors per IDC
(https://www.idc.com/getdoc.jsp?containerId=prUS47961621 ) with 3rd Gen Intel Xeon Scalable processors
on SuperServer SYS-420GP-TNR.
• SPECrate2017_int_base 2 Socket Intel world record among top 5 server vendors per IDC
on SuperServer SYS-420GP-TNR
• SPECrate2017_fp_base 2 Socket Intel world record among top 5 server vendor per IDC
on SYS-420GP-TNR.

DISCLAIMER
Super Micro Computer, Inc. may make changes to specifications and product descriptions at any time, without notice. The
information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions
and typographical errors. Any performance tests and ratings are measured using systems that reflect the approximate
performance of Super Micro Computer, Inc. products as measured by those tests. Any differences in software or hardware
configuration may affect actual performance, and Super Micro Computer, Inc. does not control the design or implementation of
third party benchmarks or websites referenced in this document. The information contained herein is subject to change and may
be rendered inaccurate for many reasons, including but not limited to any changes in product and/or roadmap, component and
hardware revision changes, new model and/or product releases, software changes, firmware changes, or the like. Super Micro
Computer, Inc. assumes no obligation to update or otherwise correct or revise this information.
SUPER MICRO COMPUTER, INC. MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE
CONTENTS HEREOF AND ASSUMES NO RESPONSIBILITY FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT
MAY APPEAR IN THIS INFORMATION.
SUPER MICRO COMPUTER, INC. SPECIFICALLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR
FITNESS FOR ANY PARTICULAR PURPOSE. IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE TO ANY
PERSON FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF
ANY INFORMATION CONTAINED HEREIN, EVEN IF SUPER MICRO COMPUTER, Inc. IS EXPRESSLY ADVISED OF THE
POSSIBILITY OF SUCH DAMAGES.
ATTRIBUTION
© 2021 Super Micro Computer, Inc. All rights reserved.
48

Supermicro X12 Performance Update

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a Supermicro X12 Performance Update

Similar a Supermicro X12 Performance Update (20)

Más de Rebekah Rodriguez

Más de Rebekah Rodriguez (20)

Último

Último (20)

Supermicro X12 Performance Update