Installing HPCKit (Interactive)
Interactive installation allows you to select the HPCKit components to be installed as required.
Procedure
- Use PuTTY to log in to the node where HPCKit is installed.
- (Optional) If you need to install KuLitho, run the following commands to go to the directory where the KuLitho software package is stored and decompress the package:
cd Directory_hosting_the_KuLitho_software_package
tar xvf HPCKit_KuLitho_26.1.RC1_Linux-aarch64.tar.gz - (Optional) If you need to install KuRTM, run the following commands to go to the directory where the KuRTM software package is stored and decompress the package:
cd Directory_hosting_the_KuRTM_software_package
tar xvf HPCKit_KuRTM_26.1.RC1_Linux-aarch64.tar.gz - Run the following command to go to the directory where the HPCKit software package is stored:
cd Directory_hosting_the_HPCKit_software_package
To install HPCKit in a shared directory, obtain the installation directory by referring to Basic Project Info > Shared Storage Directory Plan > HPCKit Installation Directory in the Kunpeng HPC Solution 26.1.RC1 LLD Template.
- Run the following command to decompress the HPCKit software package:
tar xvf HPCKit_26.1.RC1_Linux-aarch64.tar.gz - Install HPCKit.
- Run the following command to start the installation:
sh HPCKit_26.1.RC1_Linux-aarch64/install.sh - Enter the HPCKit installation directory as prompted.
1Enter the installation path (default: /opt): HPCKit_installation_directory
If the command output contains the following information, the installation directory has been configured. In this case, go to 6.c. Otherwise, rectify the fault based on the error message, configure the installation directory, and then go to 6.c.
1You have selected: /opt
- If you have the write permission on the HPCKit installation directory entered in 6.b, HPCKit can be installed in this directory.
- If you do not have the write permission on the HPCKit installation directory entered in 6.b, information similar to the following will be displayed and you will be prompted to enter the installation directory again. If you do not enter the installation directory but directly press Enter, HPCKit will be installed in the ~ directory by default. The ~ directory is the $HOME directory of the user.
1Error: You do not have permission to write to HPCKit_installation_directory. Please choose another path.
- If the space of the configured installation directory is less than 10 GB, the following information will be displayed. In this case, you are advised to replan the installation directory or clear the directory.
1 2 3
The space of the HPCKit installation directory is insufficient. About 10 GB space is required for installing HPCKit. Run the 'df -h /opt' command to check the space of the installation directory.
- Select the compiler to be installed as prompted.
- To install all components (default), press Enter.
- To select specific components for installation, toggle each option by entering its corresponding number. For example, 1 indicates BiSheng Compiler (installed by default). To deselect BiSheng Compiler, enter 1 and press Enter to confirm the change. To select BiSheng Compiler for installation, enter 1 again and press Enter to confirm the change. Press Enter again to confirm the installation.
KuTACC supports only BiSheng Compiler.
1 2 3 4 5 6
Start installing Compiler... Please Enter (1-2) to switch compiler selection, only checked compiler(s) will be installed. Enter 'q' to quit, 'y' or enter to confirm compiler installation. Number Option Choice Descriptions 1 Bisheng-Compiler [v] Bisheng Compiler 2 GCC-Compiler [v] GCC Compiler
[v] indicates that the component is selected for installation, while [x] indicates that the component is not selected for installation. The same applies below. If the following information is displayed (for example, all components are installed), the installation is successful. In this case, go to 6.d. Otherwise, rectify the fault based on the error message, install the compiler, and then go to 6.d.1 2 3 4 5
Confirm Installation. Start Installing Bisheng Compiler Bisheng Compiler Installation Finished. Start Installing Gcc For openEuler Gcc For openEuler Installation Finished.
- Select KML, KUPL, HMPI, KuLitho, KuTACC, KuRTM, KuDNN, and KuQCD for installation.
- If both BiSheng Compiler and GCC are used, install the components compiled by BiSheng Compiler first and then those compiled by GCC as prompted.
- If only BiSheng Compiler or GCC is used, install the corresponding components as prompted.
- If BiSheng Compiler is used, the following prompt will be displayed:
1 2 3 4 5 6 7 8 9 10 11 12
Start Installing Bisheng Compiled Component... Please Enter (1-3) to switch component selection, only checked component(s) will be installed. Enter 'q' to quit, 'y' or enter to confirm component installation. Number Option Choice Descriptions 1 KML [v] Kunpeng Math Library (Bisheng compiled) 2 KUPL [v] Kunpeng Unified Parallel Library (Bisheng compiled) 3 HMPI [v] Hyper Message Passing Interface (Bisheng compiled) 4 KuLitho [x] Kunpeng Lithography Library (Bisheng compiled) 5 KuTACC [v] Kunpeng Unified Transformer Accelerator (Bisheng compiled) 6 KuRTM [x] Kunpeng Unified Reverse Time Migration (Bisheng compiled) 7 KuDNN [v] Kunpeng Unified Deep Neural Networks (Bisheng compiled) 8 KuQCD [v] Kunpeng Unified Quantum Chromodynamics Library (Bisheng compiled)
- To install all components except KuLitho and KuRTM (default), press Enter.
- To select specific components for installation, toggle each option by entering its corresponding number. For example, 1 indicates KML (installed by default). Press 1 to deselect KML and press Enter to confirm the change. Press 1 again to select KML and press Enter to confirm the change. Press Enter again to confirm the installation.
- If you do not want to install any component, enter q and press Enter.
- Enter hns or mlx to select the corresponding HMPI version. The default HMPI version is hns. If the following information is displayed, the installation is successful and no further action is required. If you enter an invalid value, enter the HMPI version again.
1 2 3 4 5
Start Installing gcc compiled Hyper MPI Please enter the type of HMPI: 'hns'(default) or 'mlx'. hns HMPI Release Version Installation Finished. HMPI Debug Version Installation Finished.
- Kylin Linux Advanced Server V10 SP2 AArch64 and openEuler 20.03 LTS SP3 AArch64 support only HMPI of the mlx version.
- If the Huawei-developed NIC driver is used, select hns. If the Mellanox NIC driver is used, select mlx. Run the following command to query the NIC driver type:
rpm -qa | grep rdma-core
If the command output contains mlnx, use --hmpi_type=mlx. The following is an example of the command output:rdma-core-58mlnx43-1.58112.aarch64 rdma-core-devel-58mlnx43-1.58112.aarch64
Otherwise, use the default setting --hmpi_type=hns. The following is an example of the command output:rdma-core-41.0-36.oe2203sp4.aarch64 rdma-core-devel-41.0-36.oe2203sp4.aarch64
- To install KuRTM, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuRTM installation package is decompressed. Otherwise, KuRTM will fail to install.
1 2
Enter the KuRTM install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuRTM KuRTM Installation Finished.
- To install KuLitho, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuLitho installation package is decompressed. Otherwise, KuLitho will fail to install.
1 2
Enter the KuLitho install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuLitho KuLitho Installation Finished.
If the following information is displayed (for example, all components are installed), KML, KUPL, HMPI, KuLitho, KuTACC, KuRTM, KuDNN, and KuQCD are successfully installed. Otherwise, rectify the fault based on the error message and then install the components.1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21
Confirm Installation. Start Installing bisheng compiled KML KML Installation Finished Start Installing bisheng compiled KUPL KUPL Installation Finished. Start Installing bisheng compiled Hyper MPI Please enter the type of HMPI: 'hns'(default) or 'mlx'. hns HMPI Release Version Installation Finished. HMPI Debug Version Installation Finished. Start Installing bisheng compiled KuLitho Enter the KuLitho install package path (default: /home/xxx/HPCKit_26.1.RC1_Linux-aarch64/package): KuLitho Installation Finished. Start Installing bisheng compiled KuTACC KuTACC Installation Finished. Start Installing bisheng compiled KuRTM KuRTM Installation Finished. Start Installing bisheng compiled KuDNN KuDNN Installation Finished. Start Installing bisheng compiled KuQCD KuQCD Installation Finished.
- If GCC is used, the following prompt will be displayed:
1 2 3 4 5 6 7 8 9 10 11
Start installing GCC Compiled Component... Please Enter (1-3) to switch component selection, only checked component(s) will be installed. Enter 'q' to quit, 'y' or enter to confirm component installation. Number Option Choice Descriptions 1 KML [v] Kunpeng Math Library (GCC compiled) 2 KUPL [v] Kunpeng Unified Parallel Library (GCC compiled) 3 HMPI [v] Hyper Message Passing Interface (GCC compiled) 4 KuLitho [x] Kunpeng Lithography Library (GCC compiled) 5 KuRTM [x] Kunpeng Unified Reverse Time Migration (GCC compiled) 6 KuDNN [v] Kunpeng Unified Deep Neural Networks (GCC compiled) 7 KuQCD [v] Kunpeng Unified Quantum Chromodynamics Library (GCC compiled)
- To install all components except KuLitho and KuRTM (default), press Enter.
- To select specific components for installation, toggle each option by entering its corresponding number.
- If you do not want to install any component, enter q and press Enter.
- Enter hns or mlx to select the corresponding HMPI version. The default HMPI version is hns. If the following information is displayed, the installation is successful and no further action is required. If you enter an invalid value, enter the HMPI version again.
1 2 3 4 5
Start Installing gcc compiled Hyper MPI Please enter the type of HMPI: 'hns'(default) or 'mlx'. hns HMPI Release Version Installation Finished. HMPI Debug Version Installation Finished.
- Kylin Linux Advanced Server V10 SP2 AArch64 and openEuler 20.03 LTS SP3 AArch64 support only HMPI of the mlx version.
- If the Huawei-developed NIC driver is used, select hns. If the Mellanox NIC driver is used, select mlx. Run the following command to query the NIC driver type:
rpm -qa | grep rdma-core
If the command output contains mlnx, use --hmpi_type=mlx. The following is an example of the command output:rdma-core-58mlnx43-1.58112.aarch64 rdma-core-devel-58mlnx43-1.58112.aarch64
Otherwise, use the default setting --hmpi_type=hns. The following is an example of the command output:rdma-core-41.0-36.oe2203sp4.aarch64 rdma-core-devel-41.0-36.oe2203sp4.aarch64
- To install KuRTM, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuRTM installation package is decompressed. Otherwise, KuRTM will fail to install.
1 2
Enter the KuRTM install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuRTM KuRTM Installation Finished.
- To install KuLitho, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuLitho installation package is decompressed. Otherwise, KuLitho will fail to install.
1 2
Enter the KuLitho install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuLitho KuLitho Installation Finished.
If the following information is displayed (for example, all components are installed), KML, KUPL, HMPI, KuLitho, KuTACC, KuRTM, KuDNN, and KuQCD are successfully installed. Otherwise, rectify the fault based on the error message and then install the components.1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
Confirm Installation. Start Installing gcc compiled KML KML Installation Finished Start Installing gcc compiled KUPL KUPL Installation Finished. Start Installing gcc compiled Hyper MPI Please enter the type of HMPI: 'hns'(default) or 'mlx'. hns HMPI Release Version Installation Finished. HMPI Debug Version Installation Finished. Start Installing gcc compiled KuLitho Enter the KuLitho install package path (default: /home/xxx/HPCKit_26.1.RC1_Linux-aarch64/package): KuLitho Installation Finished. Start Installing gcc compiled KuRTM KuRTM Installation Finished. Start Installing gcc compiled KuDNN KuDNN Installation Finished. Start Installing gcc compiled KuQCD KuQCD Installation Finished.
- Install HIO.
- Scenario 1: The following HIO bridge target libraries have been installed: libhdf5.so 1.12.0 or later, libnetcdf.so 4.7.4 or later, and libpnetcdf.so 1.12.1 or later. All required environment variables have been configured. The following prompt will be displayed:
1 2 3 4 5
Start installing HIO Component... Please Enter (1-1) to switch component selection, only checked component(s) will be installed. Enter 'q' to quit, 'y' or enter to confirm component installation. Number Option Choice Descriptions 1 HIO [v] Kunpeng Hyper IO Middleware
- To install HIO (default), press Enter.If the following information is displayed, the installation is successful and no further action is required. Otherwise, rectify the fault based on the error message and perform the installation again.
1 2 3
Confirm Installation. Start Installing HIO HIO Installation Finished
- If you do not want to install HIO, refer to the preceding steps.
- To install HIO (default), press Enter.
- Scenario 2: The following HIO bridge target libraries have not been installed: libhdf5.so 1.12.0 or later, libnetcdf.so 4.7.4 or later, and libpnetcdf.so 1.12.1 or later. Alternatively, the libraries have been installed but the required environment variables have not been configured. The following prompt will be displayed:
- Enter y to continue to install HIO. After HIO is installed, install the HIO bridge target libraries by referring to Installing HIO Bridge Target Libraries.
- If the HIO bridge target libraries do not exist in the environment, install them and configure environment variables by referring to Installing HIO Bridge Target Libraries.
- If the HIO bridge target libraries exist in the environment but environment variables have not been configured, configure environment variables by referring to Configuring Environment Variables for HIO Bridge Target Libraries.
- Enter n to exit the HIO installation.
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Start Installing HIO libhdf5.so >= 1.12.0 required, Please update the library to the required version. Continue Installation? [y/n] y Confirm Installation. libnetcdf.so >= 4.7.4 required, Please update the library to the required version. Continue Installation? [y/n] y Confirm Installation. libpnetcdf.so >= 1.12.1 required, Please update the library to the required version. Continue Installation? [y/n] y Confirm Installation. HIO Installation Finished
- Enter y to continue to install HIO. After HIO is installed, install the HIO bridge target libraries by referring to Installing HIO Bridge Target Libraries.
- Scenario 1: The following HIO bridge target libraries have been installed: libhdf5.so 1.12.0 or later, libnetcdf.so 4.7.4 or later, and libpnetcdf.so 1.12.1 or later. All required environment variables have been configured. The following prompt will be displayed:
- Run the following command to start the installation:
Parent topic: HPCKit Installation and Uninstallation