Rate This Document
Findability
Accuracy
Completeness
Readability

Installing OmniData

Distribute the OmniData package to all nodes, decompress the package, and install and initialize OmniData.

  1. Copy the OmniData binary package prepared in Obtaining Software to all nodes using the file transfer function.
    1. Select offload nodes (ceph1, ceph2, and ceph3) and click Configure Service.

    2. Select Custom and click Next.

    3. Select File Transfer and click Add a Task.

    4. Set task 1 parameters and click Save.
      Table 1 Parameter description

      Parameter

      Description

      Task Name

      Transferring the OmniData installation package

      Task Description

      Copying the OmniData installation package to offload nodes

      Transfer Direction

      From Local to Remote

      Local Path

      Directory where the local installation package is stored

      Remote Path

      /opt/haf-software

  2. Copy the OmniData third-party dependencies prepared in Obtaining Software to offload nodes using the file transfer function.
    1. Select File Transfer and click Add a Task.

    2. Set parameters for tasks 2 to 5 and click Save.
      Table 2 Task 2 parameters

      Parameter

      Description

      Task Name

      Copying the OmniData lib package

      Task Description

      Copying the OmniData lib package to offload nodes

      Transfer Direction

      From Local to Remote

      Local Path

      Directory where the local installation package is stored

      Remote Path

      /opt/haf-software

      Table 3 Task 3 parameters

      Parameter

      Description

      Task Name

      Copying the OmniData UDF package

      Task Description

      Copying the OmniData UDF package to all offload nodes

      Transfer Direction

      From Local to Remote

      Local Path

      Directory where the local installation package is stored

      Remote Path

      /opt/haf-software

      Table 4 Task 4 parameters

      Parameter

      Description

      Task Name

      Copying Ceph dependencies

      Task Description

      Copying Ceph dependencies to all offload nodes

      Transfer Direction

      From Local to Remote

      Local Path

      Directory where the local installation package is stored

      Remote Path

      /opt/haf-software

      Table 5 Task 5 parameters

      Parameter

      Description

      Task Name

      Copy the librgw file

      Task Description

      Copy the librgw dependency to all offload nodes

      Transfer Direction

      From Local to Remote

      Local Path

      Directory where the local installation package is stored

      Remote Path

      /opt/haf-software

  3. Decompress the OmniData package boostkit-omnidata-server-1.0.0-aarch64.tar.gz and copy the third-party dependencies to the corresponding directories.
    1. Select Command Execution and click Add a Task.

    2. Set parameters for tasks 6 to 8 and click Save.
      Table 6 Task 6 parameters

      Parameter

      Description

      Task Name

      Decompressing OmniData packages

      Task Description

      Decompressing the OmniData installation package and third-party dependency packages

      Run Directory

      /opt/haf-software

      Run Command

      unzip BoostKit-omnidata_1.1.0.zip; tar -zxvf BoostKit-omnidata_1.1.0.tar.gz;tar -zxvf boostkit-omnidata-server-1.1.0-aarch64.tar.gz; unzip boostkit-omnidata-server-1.1.0-aarch64-lib.zip; unzip boostkit-omnidata-udf-1.1.0-aarch64.zip;

      Table 7 Task 7 parameters

      Parameter

      Description

      Task Name

      Adding OmniData dependencies

      Task Description

      Copying third-party dependencies to the corresponding OmniData directories

      Run Directory

      /opt/haf-software

      Run Command

      mv boostkit-omnidata-udf-1.1.0-aarch64/* omnidata/plugin/boostkit-omnidata-udf-1.1.0-aarch64/; mv boostkit-omnidata-server-1.1.0-aarch64-lib/* omnidata/lib; rm -rf boostkit-omnidata-*;

      Table 8 Task 8 parameters

      Parameter

      Description

      Task Name

      Adding Ceph dependencies

      Task Description

      Copying Ceph dependencies to the corresponding OmniData directory

      Run Directory

      /opt/haf-software

      Run Command

      cp librgw_jni.so /opt/haf-target/lib/; cp /usr/lib64/ceph/libceph-common.so.0 /opt/haf-target/lib/; cp hdfs-ceph-3.2.0.jar omnidata/lib/;

  4. Install the OmniData service on offload nodes (ceph1, ceph2, and ceph3).
    1. Select Command Execution and click Add a Task.

    2. Set task 9 parameters and click Save.
      Table 9 Task 9 parameters

      Parameter

      Description

      Task Name

      Installing a service

      Task Description

      Installing the OmniData service

      Run Directory

      /opt/haf-software/omnidata-setup

      Run Command

      sh omnidata-install.sh -s register_ip:2181 -l /var/log/omnidata

      • If the big data engine is Spark, run sh omnidata-install.sh -s Register_IP:Register_Port'.
      • The -s parameter in the script is used to specify the IP address/domain and port of the third-party registration service used by OmniData.
        • -s indicates Spark, which is used to specify the registration address of the Spark engine. The default IP address and port of the ZooKeeper node are 2181.
      • The -l parameter in the script is used to specify the OmniData service log path. The default path is /var/log/omnidata.

  5. Export the service flow and save it to your local PC. You can import service flows to quickly install other components.
    1. In the upper right corner of the displayed page, click Export.

      The window for selecting a path for saving the template is displayed.

    2. Name the template Install OmniData and Configure Workflow and click Save.

  6. Execute the service flow.

    Click Finish in the lower right corner and select Run Service. The procedure is complete when the execution is successful.