Koichi Hirai, Fujitsu
Post-K use Arm based super computer. But there are not too many Arm based servers for HPC.
Therefore we think to need to build Arm HPC Ecosystem until Post-K release.
In this presentation, we describe our collaboration efforts to build the Arm HPC Ecosystem.
The Ultimate Guide to Choosing WordPress Pros and Cons
Post-K: Building the Arm HPC Ecosystem
1. Copyright 2017 FUJITSU LIMITED
Arm HPC Workshop
Application Development Tools
for Post-K Supercomputer
13th December 2017
Tomotake NAKAMURA
Performance Analysis Dept. Compiler Development Div.
Next Generation Technical Computing Unit
FUJITSU LIMITED
0
2. Copyright 2017 FUJITSU LIMITED
Profiler, debugger and IDE for K computer
Direction of tools’ enhancements for Post-K
Cases of collaboration with OSS
mpiP
Eclipse PTP
Exporting profilers’ data in XML format
Summary
Outline
1
3. Copyright 2017 FUJITSU LIMITED
Mainly provided by FUJITSU
With support for K’s original hardware
Profiler: rich performance counters in CPU &
Tofu interconnect
Debugger: extension of SIMD instructions,
increased # of registers
Good reputation, especially for the profiler
Applicable to optimized executables
Detailed performance report for precise analysis
•Leads to loop transformations, data prefetching, ...
But, Post-K adopt Armv8-A with SVE
Not “only one” architecture
Software ecosystem will help application
development more
Profiler, Debugger and IDE for K computer
2
4. Copyright 2017 FUJITSU LIMITED
Many OSS middleware on K computer
Linux OS, Lustre file system (customized), Open MPI (customized), GCC, ...
As profilers: mpiP (customized), VampirTrace (integrated), Score-P, TAU, ...
Advantages of OSS-based development tools
Lowering barrier for new users by compatibility and existing know-how
Various attempts in user interfaces for usability
For Post-K, while enhancing own profilers’ capability,
Fujitsu will integrate OSS technologies for the above advantages
Direction of Tools’ Enhancements for Post-K
3
IDE for K computer
Eclipse PTP
5. Copyright 2017 FUJITSU LIMITED
mpiP: lightweight profiling library for MPI applications
Generates simple report in text format, in contrast to much info. by Fujitsu’s one
Customized and provided by Fujitsu since PRIMEHPC FX100
Enhancement: additional MPI_Barrier before/after collective communications
•To distinguish wasted time caused by load imbalance among processes
More than one choice is reasonable for profilers
Degree of richness of generated reports
Various attempts in user interfaces for performance analysis
Cases of Collaboration with OSS: mpiP
4
Communication Statistics by Fujitsu’s Profiler Example of mpiP Report
6. Copyright 2017 FUJITSU LIMITED
Eclipse PTP: IDE for development of parallel applications
Editing source code, job submission & monitoring, …
Adopted to simplify workflow of development & perf. analysis
Key feature: “synchronized project” functionality
Switching from WWW-based framework, offline work becomes easy
Integration of profilers is under development
Cases of Collaboration with OSS: Eclipse PTP
5
(Source: Eclipse PTP Tutorial)
7. Copyright 2017 FUJITSU LIMITED
Fujitsu’s profilers gather much data and generate detailed reports
But, there could be too many analysis views to be covered by the
product
On Post-K, profilers’ data can be exported in XML as well as text
and CSV formats
Tool developers and perf. engineers are welcome to collaborate on UIs
Exporting Profilers’ Data in XML Format
6
Performance Report by Fujitsu’s Profiler
Breakdown of execution time
OPRT_divergence:1634 OPRT_gradient:1741 OPRT_divdamp:2779
OPRT3D_divdamp:218 advlim_thuburn_v:801 Others
Example of User-defined Report
Colored according to bottlenecks
red: cache&memory blue: calculation
green: well-executed
8. Copyright 2017 FUJITSU LIMITED
For Post-K, Fujitsu will provide enhanced application development
tools with integration of OSS technologies
Lowering barrier for new users, various attempts in UIs
Also we expect the success of OpenHPC activity in terms of
development tools, which will satisfy basic needs of many users
Score-P, TAU and other tools are ready to use by RPM-provided packages
Summary
7