Rate This Document
Findability
Accuracy
Completeness
Readability

Software Update

Do as follows to update the algorithm library.

  1. Obtain the latest packages (for example, version 1.2.0) by referring to Obtaining Code.
  2. Log in to the server as an authorized user of the big data component, and replace the algorithm library packages in the /home/test/sophon/lib/ directory of the client with the latest one.
    rm -f /home/test/sophon/lib/sophon-*
    cp /opt/Spark-ml-algo-lib-1.2.0/ml-core/target/sophon-ml-core_2.11-1.2.0.jar /home/test/sophon/lib
    cp /opt/Spark-ml-algo-lib-1.2.0/ml-accelerator/target/sophon-ml-acc_2.11-1.2.0.jar /home/test/ sophon/lib
    cp /opt/sophon-ml-kernel-2.11-1.2.0-aarch_64.jar /home/test/sophon/lib
  3. Replace the algorithm library package names in the shell script for task submission with the names of the latest packages. An example of a modified shell script is as follows:
    #!/bin/bash
    spark-submit \
    --class com.bigdata.ml.RFMain \
    --driver-class-path "./lib/*" \
    --master yarn \
    --deploy-mode client \
    --driver-cores 36 \
    --driver-memory 50g \
    --jars "lib/fastutil-8.3.1.jar,lib/sophon-ml-acc_2.11-1.2.0.jar,lib/sophon-ml-core_2.11-1.2.0.jar,lib/sophon-mlkernel-2.11-1.2.0-aarch_64.jar" \
    --conf "spark.executor.extraClassPath=fastutil-8.3.1.jar:sophon-ml-acc_2.11-1.2.0.jar:sophon-mlcore_2.11-1.2.0.jar:sophon-ml-kernel-2.11-1.2.0-aarch_64.jar" \ ./ml-test.jar

    Table 2 describes the statements in the script.