Software Update
Do as follows to update the algorithm library.
- Obtain the latest packages (for example, version 1.2.0) by referring to Obtaining Code.
- Log in to the server as an authorized user of the big data component, and replace the algorithm library packages in the /home/test/sophon/lib/ directory of the client with the latest one.
rm -f /home/test/sophon/lib/sophon-* cp /opt/Spark-ml-algo-lib-1.2.0/ml-core/target/sophon-ml-core_2.11-1.2.0.jar /home/test/sophon/lib cp /opt/Spark-ml-algo-lib-1.2.0/ml-accelerator/target/sophon-ml-acc_2.11-1.2.0.jar /home/test/ sophon/lib cp /opt/sophon-ml-kernel-2.11-1.2.0-aarch_64.jar /home/test/sophon/lib
- Replace the algorithm library package names in the shell script for task submission with the names of the latest packages. An example of a modified shell script is as follows:
#!/bin/bash spark-submit \ --class com.bigdata.ml.RFMain \ --driver-class-path "./lib/*" \ --master yarn \ --deploy-mode client \ --driver-cores 36 \ --driver-memory 50g \ --jars "lib/fastutil-8.3.1.jar,lib/sophon-ml-acc_2.11-1.2.0.jar,lib/sophon-ml-core_2.11-1.2.0.jar,lib/sophon-mlkernel-2.11-1.2.0-aarch_64.jar" \ --conf "spark.executor.extraClassPath=fastutil-8.3.1.jar:sophon-ml-acc_2.11-1.2.0.jar:sophon-mlcore_2.11-1.2.0.jar:sophon-ml-kernel-2.11-1.2.0-aarch_64.jar" \ ./ml-test.jar
Table 2 describes the statements in the script.
Parent topic: Installing Software