Obtaining Code
- To run machine learning algorithms, you need to obtain the JAR files of the core algorithm library and the adaption code, and then compile JAR files adapted to the algorithm library based on the adaption code. Table 1 shows how to obtain the JAR files and code.
- Only sophon-ml-kernel-2.11-1.2.0-aarch_64.jar, sophon-mlacc_2.11-1.2.0.jar, and sophon-ml-core_2.11-1.2.0.jar need to be deployed for running machine learning algorithms. sophon-ml-kernelclient_2.11-1.2.0.jar does not need to be deployed in the Spark cluster and is used only during compilation in the development phase.
Obtaining the Adaptation Code Spark-ml-algo-lib of the Machine Learning Algorithm Library
The adaptation code is developed based on the open-source software Spark 2.3.2 and is used for compiling the machine learning algorithm library. Download the open-source repository code for big data machine learning algorithms to the /opt/ directory and decompress the package.
cd /opt/ unzip Spark-ml-algo-lib-1.2.0.zip
Alternatively, you can build the code by incorporating some of the native code files of Spark 2.3.2 and Breeze 0.13.1 into a patch. For details, see References.
Obtaining the JAR File of the Machine Learning Algorithm Library
Obtain the sophon-ml-kernel-2.11-1.2.0-aarch_64.jar file of the machine learning algorithm library 1.2.0 and save it to the /opt/ directory.
The downloaded software package must be verified to ensure that it is the same as the one on the website. The verification method is as follows:
- Obtain the digital certificate and software.
- Obtain the verification tool and operation guide from:
- Verify the software package integrity by following the procedure described in the OpenPGP Signature Verification Guide obtained in 2.
Parent topic: Software Compiling