Rate This Document
Findability
Accuracy
Completeness
Readability

Installing HPCKit (Interactive)

Interactive installation allows you to select the HPCKit components to be installed as required.

Procedure

  1. Use PuTTY to log in to the node where HPCKit is installed.
  2. (Optional) If you need to install KuLitho, run the following commands to go to the directory where the KuLitho software package is stored and decompress the package:
    cd Directory_hosting_the_KuLitho_software_package
    tar xvf HPCKit_KuLitho_26.1.RC1_Linux-aarch64.tar.gz
  3. (Optional) If you need to install KuRTM, run the following commands to go to the directory where the KuRTM software package is stored and decompress the package:
    cd Directory_hosting_the_KuRTM_software_package
    tar xvf HPCKit_KuRTM_26.1.RC1_Linux-aarch64.tar.gz
  4. Run the following command to go to the directory where the HPCKit software package is stored:

    cd Directory_hosting_the_HPCKit_software_package

    To install HPCKit in a shared directory, obtain the installation directory by referring to Basic Project Info > Shared Storage Directory Plan > HPCKit Installation Directory in the Kunpeng HPC Solution 26.1.RC1 LLD Template.

  5. Run the following command to decompress the HPCKit software package:
    tar xvf HPCKit_26.1.RC1_Linux-aarch64.tar.gz
  6. Install HPCKit.
    1. Run the following command to start the installation:
      sh HPCKit_26.1.RC1_Linux-aarch64/install.sh
    2. Enter the HPCKit installation directory as prompted.
      1
      Enter the installation path (default: /opt): HPCKit_installation_directory
      

      If the command output contains the following information, the installation directory has been configured. In this case, go to 6.c. Otherwise, rectify the fault based on the error message, configure the installation directory, and then go to 6.c.

      1
      You have selected: /opt
      
      • If you have the write permission on the HPCKit installation directory entered in 6.b, HPCKit can be installed in this directory.
      • If you do not have the write permission on the HPCKit installation directory entered in 6.b, information similar to the following will be displayed and you will be prompted to enter the installation directory again. If you do not enter the installation directory but directly press Enter, HPCKit will be installed in the ~ directory by default. The ~ directory is the $HOME directory of the user.
        1
        Error: You do not have permission to write to HPCKit_installation_directory. Please choose another path.
        
      • If the space of the configured installation directory is less than 10 GB, the following information will be displayed. In this case, you are advised to replan the installation directory or clear the directory.
        1
        2
        3
        The space of the HPCKit installation directory is insufficient.
        About 10 GB space is required for installing HPCKit.
        Run the 'df -h /opt' command to check the space of the installation directory.
        
    3. Select the compiler to be installed as prompted.
      • To install all components (default), press Enter.
      • To select specific components for installation, toggle each option by entering its corresponding number. For example, 1 indicates BiSheng Compiler (installed by default). To deselect BiSheng Compiler, enter 1 and press Enter to confirm the change. To select BiSheng Compiler for installation, enter 1 again and press Enter to confirm the change. Press Enter again to confirm the installation.

        KuTACC supports only BiSheng Compiler.

      1
      2
      3
      4
      5
      6
      Start installing Compiler...
      Please Enter (1-2) to switch compiler selection, only checked compiler(s) will be installed.
      Enter 'q' to quit, 'y' or enter to confirm compiler installation.
      Number     Option                    Choice     Descriptions
      1          Bisheng-Compiler          [v]          Bisheng Compiler
      2          GCC-Compiler              [v]          GCC Compiler   
      
      [v] indicates that the component is selected for installation, while [x] indicates that the component is not selected for installation. The same applies below. If the following information is displayed (for example, all components are installed), the installation is successful. In this case, go to 6.d. Otherwise, rectify the fault based on the error message, install the compiler, and then go to 6.d.
      1
      2
      3
      4
      5
      Confirm Installation.
      Start Installing Bisheng Compiler
      Bisheng Compiler Installation Finished.
      Start Installing Gcc For openEuler
      Gcc For openEuler Installation Finished.
      
    4. Select KML, KUPL, HMPI, KuLitho, KuTACC, KuRTM, KuDNN, and KuQCD for installation.
      • If both BiSheng Compiler and GCC are used, install the components compiled by BiSheng Compiler first and then those compiled by GCC as prompted.
      • If only BiSheng Compiler or GCC is used, install the corresponding components as prompted.
      • If BiSheng Compiler is used, the following prompt will be displayed:
         1
         2
         3
         4
         5
         6
         7
         8
         9
        10
        11
        12
        Start Installing Bisheng Compiled Component...
        Please Enter (1-3) to switch component selection, only checked component(s) will be installed.
        Enter 'q' to quit, 'y' or enter to confirm component installation.
        Number     Option                    Choice     Descriptions
        1          KML                       [v]          Kunpeng Math Library (Bisheng compiled)
        2          KUPL                     [v]          Kunpeng Unified Parallel Library (Bisheng compiled)
        3          HMPI                      [v]          Hyper Message Passing Interface (Bisheng compiled)
        4          KuLitho                   [x]          Kunpeng Lithography Library (Bisheng compiled)
        5          KuTACC                  [v]          Kunpeng Unified Transformer Accelerator (Bisheng compiled)
        6          KuRTM                    [x]          Kunpeng Unified Reverse Time Migration (Bisheng compiled)
        7          KuDNN                    [v]          Kunpeng Unified Deep Neural Networks (Bisheng compiled)
        8          KuQCD                    [v]          Kunpeng Unified Quantum Chromodynamics Library (Bisheng compiled)
        
        • To install all components except KuLitho and KuRTM (default), press Enter.
        • To select specific components for installation, toggle each option by entering its corresponding number. For example, 1 indicates KML (installed by default). Press 1 to deselect KML and press Enter to confirm the change. Press 1 again to select KML and press Enter to confirm the change. Press Enter again to confirm the installation.
        • If you do not want to install any component, enter q and press Enter.
        • Enter hns or mlx to select the corresponding HMPI version. The default HMPI version is hns. If the following information is displayed, the installation is successful and no further action is required. If you enter an invalid value, enter the HMPI version again.
          1
          2
          3
          4
          5
          Start Installing gcc compiled Hyper MPI
          Please enter the type of HMPI: 'hns'(default) or 'mlx'.
          hns
          HMPI Release Version Installation Finished.
          HMPI Debug Version Installation Finished.
          
          • Kylin Linux Advanced Server V10 SP2 AArch64 and openEuler 20.03 LTS SP3 AArch64 support only HMPI of the mlx version.
          • If the Huawei-developed NIC driver is used, select hns. If the Mellanox NIC driver is used, select mlx. Run the following command to query the NIC driver type:
            rpm -qa | grep rdma-core
            If the command output contains mlnx, use --hmpi_type=mlx. The following is an example of the command output:
            rdma-core-58mlnx43-1.58112.aarch64
            rdma-core-devel-58mlnx43-1.58112.aarch64
            Otherwise, use the default setting --hmpi_type=hns. The following is an example of the command output:
            rdma-core-41.0-36.oe2203sp4.aarch64
            rdma-core-devel-41.0-36.oe2203sp4.aarch64
        • To install KuRTM, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuRTM installation package is decompressed. Otherwise, KuRTM will fail to install.
          1
          2
          Enter the KuRTM install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuRTM
          KuRTM Installation Finished.
          
        • To install KuLitho, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuLitho installation package is decompressed. Otherwise, KuLitho will fail to install.
          1
          2
          Enter the KuLitho install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuLitho
          KuLitho Installation Finished.
          
        If the following information is displayed (for example, all components are installed), KML, KUPL, HMPI, KuLitho, KuTACC, KuRTM, KuDNN, and KuQCD are successfully installed. Otherwise, rectify the fault based on the error message and then install the components.
         1
         2
         3
         4
         5
         6
         7
         8
         9
        10
        11
        12
        13
        14
        15
        16
        17
        18
        19
        20
        21
        Confirm Installation.
        Start Installing bisheng compiled KML
        KML Installation Finished
        Start Installing bisheng compiled KUPL
        KUPL Installation Finished.
        Start Installing bisheng compiled Hyper MPI
        Please enter the type of HMPI: 'hns'(default) or 'mlx'.
        hns
        HMPI Release Version Installation Finished.
        HMPI Debug Version Installation Finished.
        Start Installing bisheng compiled KuLitho
        Enter the KuLitho install package path (default: /home/xxx/HPCKit_26.1.RC1_Linux-aarch64/package): 
        KuLitho Installation Finished.
        Start Installing bisheng compiled KuTACC
        KuTACC Installation Finished.
        Start Installing bisheng compiled KuRTM
        KuRTM Installation Finished.
        Start Installing bisheng compiled KuDNN
        KuDNN Installation Finished.
        Start Installing bisheng compiled KuQCD
        KuQCD Installation Finished.
        
      • If GCC is used, the following prompt will be displayed:
         1
         2
         3
         4
         5
         6
         7
         8
         9
        10
        11
        Start installing GCC Compiled Component...
        Please Enter (1-3) to switch component selection, only checked component(s) will be installed.
        Enter 'q' to quit, 'y' or enter to confirm component installation.
        Number     Option                    Choice     Descriptions
        1          KML                       [v]          Kunpeng Math Library (GCC compiled)
        2          KUPL                      [v]          Kunpeng Unified Parallel Library (GCC compiled)
        3         HMPI                      [v]          Hyper Message Passing Interface (GCC compiled)
        4          KuLitho                   [x]          Kunpeng Lithography Library (GCC compiled)
        5          KuRTM                     [x]          Kunpeng Unified Reverse Time Migration (GCC compiled)
        6          KuDNN                     [v]          Kunpeng Unified Deep Neural Networks (GCC compiled)
        7          KuQCD                     [v]          Kunpeng Unified Quantum Chromodynamics Library (GCC compiled)
        
        • To install all components except KuLitho and KuRTM (default), press Enter.
        • To select specific components for installation, toggle each option by entering its corresponding number.
        • If you do not want to install any component, enter q and press Enter.
        • Enter hns or mlx to select the corresponding HMPI version. The default HMPI version is hns. If the following information is displayed, the installation is successful and no further action is required. If you enter an invalid value, enter the HMPI version again.
          1
          2
          3
          4
          5
          Start Installing gcc compiled Hyper MPI
          Please enter the type of HMPI: 'hns'(default) or 'mlx'.
          hns
          HMPI Release Version Installation Finished.
          HMPI Debug Version Installation Finished.
          
          • Kylin Linux Advanced Server V10 SP2 AArch64 and openEuler 20.03 LTS SP3 AArch64 support only HMPI of the mlx version.
          • If the Huawei-developed NIC driver is used, select hns. If the Mellanox NIC driver is used, select mlx. Run the following command to query the NIC driver type:
            rpm -qa | grep rdma-core
            If the command output contains mlnx, use --hmpi_type=mlx. The following is an example of the command output:
            rdma-core-58mlnx43-1.58112.aarch64
            rdma-core-devel-58mlnx43-1.58112.aarch64
            Otherwise, use the default setting --hmpi_type=hns. The following is an example of the command output:
            rdma-core-41.0-36.oe2203sp4.aarch64
            rdma-core-devel-41.0-36.oe2203sp4.aarch64
        • To install KuRTM, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuRTM installation package is decompressed. Otherwise, KuRTM will fail to install.
          1
          2
          Enter the KuRTM install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuRTM
          KuRTM Installation Finished.
          
        • To install KuLitho, you need to specify the path where the installation package is decompressed. The default path is the package folder extracted from the HPCKit installation package. If the following information is displayed, the installation is successful and no further action is required. If the required installation package cannot be found in the specified path, the system will prompt you whether to continue the installation. If you choose to continue, you need to enter the path where the KuLitho installation package is decompressed. Otherwise, KuLitho will fail to install.
          1
          2
          Enter the KuLitho install package path (default: /home/xxx/HPCKit_xxx_Linux-aarch64/package): /home/xxx/KuLitho
          KuLitho Installation Finished.
          
        If the following information is displayed (for example, all components are installed), KML, KUPL, HMPI, KuLitho, KuTACC, KuRTM, KuDNN, and KuQCD are successfully installed. Otherwise, rectify the fault based on the error message and then install the components.
         1
         2
         3
         4
         5
         6
         7
         8
         9
        10
        11
        12
        13
        14
        15
        16
        17
        18
        19
        Confirm Installation.
        Start Installing gcc compiled KML
        KML Installation Finished
        Start Installing gcc compiled KUPL
        KUPL Installation Finished.
        Start Installing gcc compiled Hyper MPI
        Please enter the type of HMPI: 'hns'(default) or 'mlx'.
        hns
        HMPI Release Version Installation Finished.
        HMPI Debug Version Installation Finished.
        Start Installing gcc compiled KuLitho
        Enter the KuLitho install package path (default: /home/xxx/HPCKit_26.1.RC1_Linux-aarch64/package): 
        KuLitho Installation Finished.
        Start Installing gcc compiled KuRTM
        KuRTM Installation Finished.
        Start Installing gcc compiled KuDNN
        KuDNN Installation Finished.
        Start Installing gcc compiled KuQCD
        KuQCD Installation Finished.
        
    5. Install HIO.
      • Scenario 1: The following HIO bridge target libraries have been installed: libhdf5.so 1.12.0 or later, libnetcdf.so 4.7.4 or later, and libpnetcdf.so 1.12.1 or later. All required environment variables have been configured. The following prompt will be displayed:
        1
        2
        3
        4
        5
        Start installing HIO Component...
        Please Enter (1-1) to switch component selection, only checked component(s) will be installed.
        Enter 'q' to quit, 'y' or enter to confirm component installation.
        Number     Option                    Choice     Descriptions
        1          HIO                       [v]          Kunpeng Hyper IO Middleware
        
        • To install HIO (default), press Enter.
          If the following information is displayed, the installation is successful and no further action is required. Otherwise, rectify the fault based on the error message and perform the installation again.
          1
          2
          3
          Confirm Installation.
          Start Installing HIO
          HIO Installation Finished
          
        • If you do not want to install HIO, refer to the preceding steps.
      • Scenario 2: The following HIO bridge target libraries have not been installed: libhdf5.so 1.12.0 or later, libnetcdf.so 4.7.4 or later, and libpnetcdf.so 1.12.1 or later. Alternatively, the libraries have been installed but the required environment variables have not been configured. The following prompt will be displayed:
         1
         2
         3
         4
         5
         6
         7
         8
         9
        10
        11
        12
        13
        14
        Start Installing HIO
        libhdf5.so >= 1.12.0 required, Please update the library to the required version.
        Continue Installation? [y/n]
        y
        Confirm Installation.
        libnetcdf.so >= 4.7.4 required, Please update the library to the required version.
        Continue Installation? [y/n]
        y
        Confirm Installation.
        libpnetcdf.so >= 1.12.1 required, Please update the library to the required version.
        Continue Installation? [y/n]
        y
        Confirm Installation.
        HIO Installation Finished