Installing the Software

When installing OmniShuffle in SmartKit, you need to deploy OmniShuffle.

Before the installation, confirm the installation directory and the swap directory that can be used by OmniShuffle independently. The default installation directory is ~/opt, and the swap directory is ~/tmp/ock_swap.

1. Configure a service flow. Select Command Execution and import the install.json file. To obtain the install.json file, copy the content of install.json in "JSON File Description" and save it as the install.json file.

   

2. Modify the configurations and save the modification.
   1. Select the local OmniShuffle installation package and upload it to a directory on the server (the home directory /home/ockadmin of the ockadmin user is used as an example).

      

   2. Decompress the installation package, change the run directory of the installation package to /home/ockadmin, and modify the execution command. Change the field following tar -zxvf to the name of the uploaded installation package, for example, BoostKit-omnishuffle_1.3.0.tar.gz.

      

   3. Decompress the inner package and the deployment package, and modify the run directory and execution command.
      • /home/ockadmin/: run directory
      • BoostKit-omnishuffle_1.3.0.tar.gz: inner package to be decompressed
      • /home/ockadmin/BoostKit-omnishuffle_1.3.0: run directory
      • BoostKit-omnishuffle_1.3.0.tar.gz: name of the decompressed inner package
      • omnishuffleUtils_openeuler-aarch64.tar.gz: compressed script package for internal deployment

      

      

   4. Select Spark 3.1.1 based on the version you use in the actual environment and assign the Spark version to the common_params.sh file.

      sed -i 's/^spark_version.*/spark_version=spark-3.1/g' /home/ockadmin/BoostKit-omnishuffle_1.3.0/omnishuffleUtils/common/common_params.sh

      

   5. Grant the ockadmin user the permissions on all files in the directory where the uploaded file resides.

      1	chown -R ockadmin:ockadmin /home/ockadmin

      

   6. Change the absolute path of the script in the command.
      • Installing OmniShuffle in the ~/opt directory of the ockadmin user

        1	su - ockadmin -c 'sh /home/ockadmin/BoostKit-omnishuffle_1.3.0/omnishuffleUtils/bin/ock_install.sh'

      • Installing OmniShuffle in a specified path
        

        The ockadmin user must have the execute permission on the specified path. The path can contain a maximum of 128 characters, including slashes (/), letters (a to z and A to Z), digits (0 to 9), hyphens (-), and underscores (_). The swap path must be the same as that in the ock.conf file and needs to be manually created.

        1	su - ockadmin -c 'sh /home/ockadmin/BoostKit-omnishuffle_1.3.0/omnishuffleUtils/bin/ock_install.sh Installation path'

        

3. Click Run Service.

   

4. Check the execution status and ensure that the service flow is successfully executed.