Obtaining the Software
Table 1 lists the required software packages and methods to obtain them.
Software Package |
Description |
How to Obtain |
|---|---|---|
BoostKit-ml_2.2.0.zip |
The package contains multiple files. boostkit-xgboost4j-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar (Spark 2.3.2), boostkit-xgboost4j-kernel-2.11-2.2.0-spark2.4.6-aarch64.jar (Spark 2.4.6), and libboostkit_xgboost_kernel.so are required by the XGBoost algorithm. boostkit-ml-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar (Spark 2.3.2), boostkit-ml-kernel-2.11-2.2.0-spark2.4.6-aarch64.jar (Spark 2.4.5/Spark 2.4.6), and boostkit-ml-kernel-2.12-2.2.0-spark3.1.1-aarch64.jar (Spark 3.1.1) are required by other machine learning algorithms except XGBoost. NOTE:
Spark 2.4.5 and Spark 2.4.6 use the JAR package of the same version. |
NOTE:
The software packages of the current version are restricted in commercial use. You need to submit an application and wait for approval before downloading the software packages. |
boostkit-xgboost4j_2.11-2.2.0.jar |
Adaptation packages required by the XGBoost algorithm, which can be compiled from the open source adaptation code |
Obtain the JAR files through compilation by referring to Compiling the Code. |
boostkit-xgboost4j-spark2.3.2_2.11-2.2.0.jar |
||
boostkit-ml-acc_2.11-2.2.0-spark2.3.2.jar |
Adaptation packages required by machine learning algorithms excluding XGBoost. boostkit-ml-kernel-client_2.11-2.2.0-spark2.3.2.jar is the dependency library for application development and does not need to be deployed in the Spark cluster. It is used only during compilation in the development phase. |
|
boostkit-ml-core_2.11-2.2.0-spark2.3.2.jar |
||
boostkit-ml-kernel-client_2.11-2.2.0-spark2.3.2.jar |
Verifying Software Package Integrity
After obtaining the BoostKit-ml_2.2.0.zip software package, verify that it is consistent with that provided on the website.
Verify the software package as follows:
- Obtain the digital certificate and software.
- Obtain the verification tool and method from the following link:
- Verify the software package integrity by following the procedure described in the OpenPGP Signature Verification Guide obtained from the URL.
Obtaining the Core JAR File of the Machine Learning Algorithm Library
BoostKit-ml_2.2.0.zip can be obtained from Huawei support website (see Obtaining the Software). You can decompress the package to obtain boostkit-ml-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar, boostkit-xgboost4j-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar, and libboostkit_xgboost_kernel.so and save them to the /opt/ directory.
- From the client node, log in to the server as an authorized user of the big data component. Save the core JAR package of the machine learning algorithm library to the /opt/ directory and decompress BoostKit-ml_2.2.0.zip.
1 2
cd /opt/ unzip BoostKit-ml_2.2.0.zip
- Create a lib directory.
1mkdir -p /home/test/boostkit/lib
- Copy boostkit-ml-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar, boostkit-xgboost4j-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar, and libboostkit_xgboost_kernel.so to the /home/test/boostkit/lib directory.
1 2 3 4
cd BoostKit-ml_2.2.0 cp boostkit-ml-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar /home/test/boostkit/lib cp boostkit-xgboost4j-kernel-2.11-2.2.0-spark2.3.2-aarch64.jar /home/test/boostkit/lib cp libboostkit_xgboost_kernel.so /home/test/boostkit/lib