Installing OmniData

Distribute the OmniData package to all nodes, decompress the package, and install and initialize OmniData.

1. Copy the OmniData binary package prepared in Obtaining Software to all nodes using the file transfer function.
   1. Select offload nodes (ceph1, ceph2, and ceph3) and click Configure Service.

      

   2. Select Custom and click Next.

      

   3. Select File Transfer and click Add a Task.

      

   4. Set task 1 parameters and click Save.
      

      Table 1 Task 1 parameters

      Parameter	Description
      Task Name	Transferring the OmniData installation package
      Task Description	Copying the OmniData installation package to offload nodes
      Transfer Direction	From Local to Remote
      Local Path	Directory where the local installation package is stored
      Remote Path	/home/omm/haf-software

      

2. Copy the OmniData third-party dependencies prepared in Obtaining Software to offload nodes using the file transfer function.
   1. Select File Transfer and click Add a Task.

      

   2. Set parameters for tasks 2 to 5 and click Save.
      

      Table 2 Task 2 parameters

      Parameter	Description
      Task Name	Copying the OmniData lib package
      Task Description	Copying the OmniData lib package to offload nodes
      Transfer Direction	From Local to Remote
      Local Path	Directory where the local installation package is stored
      Remote Path	/home/omm/haf-software

      

      Table 3 Task 3 parameters

      Parameter	Description
      Task Name	Copying the OmniData UDF plugin
      Task Description	Copying the OmniData UDF plugin package to all offload nodes
      Transfer Direction	From Local to Remote
      Local Path	Directory where the local installation package is stored
      Remote Path	/home/omm/haf-software

      

      Table 4 Task 4 parameters

      Parameter	Description
      Task Name	Copying Ceph dependencies
      Task Description	Copying Ceph dependencies to all offload nodes (Skip this step for an HDFS cluster.)
      Transfer Direction	From Local to Remote
      Local Path	Directory where the local installation package is stored
      Remote Path	/home/omm/haf-software

      

      Table 5 Task 5 parameters

      Parameter	Description
      Task Name	Copying the librgw file
      Task Description	Copying the librgw dependency to all offload nodes (Skip this step for an HDFS cluster.)
      Transfer Direction	From Local to Remote
      Local Path	Directory where the local installation package is stored
      Remote Path	/home/omm/haf-software

      

3. Decompress the OmniData package boostkit-omnidata-server-1.3.0-aarch64.tar.gz and copy the third-party dependencies to the corresponding directories.
   1. Select Command Execution and click Add a Task.

      

   2. Set parameters for tasks 6 to 8 and click Save.
      

      Table 6 Task 6 parameters

      Parameter	Description
      Task Name	Decompressing OmniData packages
      Task Description	Decompressing the OmniData installation package and third-party dependency packages
      Run Directory	/home/omm/haf-software
      Run Command	unzip BoostKit-omnidata_1.3.0.zip; tar -zxvf BoostKit-omnidata_1.3.0.tar.gz;tar -zxvf boostkit-omnidata-server-1.3.0-aarch64.tar.gz; unzip boostkit-omnidata-server-1.3.0-aarch64-lib.zip; unzip boostkit-omnidata-udf-1.3.0-aarch64.zip;

      

      Table 7 Task 7 parameters

      Parameter	Description
      Task Name	Copying OmniData dependencies
      Task Description	Copying third-party dependencies to the corresponding OmniData directories
      Run Directory	/home/omm/haf-software
      Run Command	mv boostkit-omnidata-udf-1.3.0-aarch64/* omnidata/plugin/boostkit-omnidata-udf-1.3.0-aarch64/; mv boostkit-omnidata-server-1.3.0-aarch64-lib/* omnidata/lib; rm -rf boostkit-omnidata-*;

      

      Table 8 Task 8 parameters

      Parameter	Description
      Task Name	Copying Ceph dependencies
      Task Description	Copying the Ceph dependencies to the corresponding OmniData directories (Skip this step for an HDFS cluster.)
      Run Directory	/home/omm/haf-software
      Run Command	chmod 700 /home/omm/haf-install/haf-target/lib/; cp librgw_jni.so /home/omm/haf-install/haf-target/lib/; cp /usr/lib64/ceph/libceph-common.so.0 /home/omm/haf-install/haf-target/lib/; chmod -R 500 /home/omm/haf-install/haf-target/lib/; cp hdfs-ceph-3.2.0.jar omnidata/lib/;

      

4. Install the OmniData service on offload nodes (ceph1, ceph2, and ceph3).
   1. Select Command Execution and click Add a Task.

      

   2. Set task 9 parameters and click Save.
      

      Table 9 Task 9 parameters

      Parameter	Description
      Task Name	Installing a service
      Task Description	Installing the OmniData service
      Run Directory	/home/omm/haf-software/omnidata-setup
      Run Command	sh omnidata-install.sh -s register_ip:2181 -t /home/omm/haf-install/haf-target

      

      • If the big data engine is Spark, run sh omnidata-install.sh -s Register_IP:Register_Port'.
      • The -s parameter in the script is used to specify the IP address/domain and port of the third-party registration service used by OmniData.
        • -s indicates Spark, which is used to specify the registration address of the Spark engine. The default IP address and port of the ZooKeeper node are 2181.
      • The script parameter -l specifies the OmniData service log path. The default value is the run/haf_user/omnidata/log directory in the HAF installation path specified by -t. Ensure that the current installation user has operation permission on the directory.
      • The script parameter -t specifies the HAF installation path. Set it based on site requirements.

      

5. Export the service flow and save it to your local PC. You can import service flows to quickly install other components.
   1. In the upper right corner of the displayed page, click Export.

      The window for selecting a path for saving the template is displayed.

      

   2. Name the template Install OmniData and Configure Workflow and click Save.

      

6. Execute the service flow.

   Click Finish in the lower right corner and select Run Service. The procedure is complete when the execution is successful.

   

   

   • You can develop your own OmniData plugins and ensure the security of the plugins.
   • You can add UDF and Hive UDF plugins to OmniData. The preceding steps describe how to deploy the UDF plugin. You can add your own UDF plugin following the procedures below.
     1. Add a task similar to task 3 of step 2 in Installing OmniData, for example, copying the Hive UDF plugin.
     2. Add the unzip boostkit-omnidata-hive-udf-loader-1.6.1-1.3.0-aarch64.zip command to the beginning of the commands executed in task 6 in step 3 of Installing OmniData.
     3. Add the mv boostkit-omnidata-hive-udf-loader-1.6.1-1.3.0-aarch64 omnidata/plugin command to the beginning of the commands executed in task 7 in step 3 of Installing OmniData.