Kunpeng HPC Progressive Knowledge
High Performance Computing (HPC) is a clustered computing architecture that integrates multiple systems through high-speed interconnects. By harnessing collective processing power to solve large-scale computational challenges, this architecture is commonly known as an HPC cluster.
Scenarios & Components
Cluster Foundation Preparation
- Basic Environment Setup Guide
Prepare the essential foundation for porting HPC industry applications to the Kunpeng computing platform.
- GNU 9.1 Installation Guide
Deploy the GNU development toolchain, featuring the GCC compiler, assembler, and linker.
- HTCondor 8.9.2 Installation Guide
Configure the high-throughput computing framework to parallelize compute-intensive tasks.
- Lustre 2.12.2 Installation Guide
Implement the parallel file system designed for large-scale clusters and cluster computing.
- OpenHPC 1.3.8 Installation Guide
Integrate the community-driven FOSS toolset for Linux-based HPC environments.
- OpenMPI 4.0.1 Installation Guide
Deploy the high-performance message-passing library to enable efficient parallel processing.
- Slurm 18.08.7 Installation Guide
Utilize the open-source, scalable cluster management and job scheduling system for Linux clusters of any scale.
Performance Benchmarking
- IMB Testing Guide
Measure MPI performance benchmarks across various message sizes for point-to-point and collective communication operations.
- IOR Testing Guide
Evaluate parallel I/O performance at POSIX and MPI-IO levels by measuring read/write throughput under diverse conditions.
- Stream Testing Guide
Assess practical memory bandwidth using industry-standard metrics, including Copy, Scale, Add, and Triad operations.
Industry Application Porting
- Meteorology
Port key weather and climate modeling applications, including WRF, CAMx, CESM, NEMO, and ROMS.
- Manufacturing
Port industrial engineering and simulation software such as OpenFOAM, SU2, PALABOS, deal.II, and AMG.
- Education & Research
Port essential scientific computing tools and libraries, including UDUNITS, GROMACS, LAMMPS, QUANTUM ESPRESSO, and NAMD.
- Life Sciences
Port core genomic and bioinformatics applications such as BLAST, BWA, CNVnator, Cufflinks, and GATK.
- General Applications
Access porting guides for versatile tools such as Hadoop, SGE, Conda, NPB, and double-conversion.
Performance Optimization
- Optimization Overview
Leverage the Kunpeng processor's NUMA architecture for optimized system performance.
- Hardware Baseline Optimization
Fine-tune system efficiency by configuring memory, high-speed network interfaces, and server BIOS settings.
- System Baseline Optimization
Enhance stability and throughput by configuring OS kernels, adjusting page sizes, and enabling huge pages.
- I/O Performance Tuning
Boost data throughput by refining dirty data flush policies, drive prefetching, I/O scheduling, and XFS mounting.
- Foundational Software Tuning
Maximize computational efficiency through specialized compilers, math libraries, and MPI/OpenMP core pinning.
- Application Tuning
Refine software performance using parallel I/O adjustments and top-down model analysis.
- Hardware Acceleration Tuning
Utilize dedicated on-chip accelerators for high-speed encryption/decryption and compression/decompression.