Rate This Document
Findability
Accuracy
Completeness
Readability

Deploying the UDF Plugin Row-by-Row Processing

After the OmniOperator UDF plugin is deployed, you can add configuration items to enable UDFs to enter the row-by-row processing process. Therefore, you need to deploy the OmniOperator UDF plugin first. For details, see Deploying the OmniOperator UDF Plugin.

  1. Configure row-by-row processing parameters in the omni.conf file on all nodes.
    1. Select Command Execution and click Add a Task.

    2. Set parameters for task 1 and 2 and click Save.
      Table 1 Task 1 parameters

      Parameter

      Description

      Task Name

      Create an /opt/omni-operator/conf directory.

      Task Description

      Create an /opt/omni-operator/conf directory. If this directory already exists, delete it.

      Run Directory

      /opt/omni-operator

      Run Command

      mkdir -p /opt/omni-operator/conf;

      sed -i '/enableBatchExprEvaluate/d' /opt/omni-operator/conf/omni.conf;

      sed -i '/hiveUdfPropertyFilePath/d' /opt/omni-operator/conf/omni.conf;

      sed -i '/hiveUdfDir/d' /opt/omni-operator/conf/omni.conf;

      Table 2 Task 2 parameters

      Parameter

      Description

      Task Name

      Configure row-by-row processing in omni.conf.

      Task Description

      Configure row-by-row processing parameters in the omni.conf file on all nodes.

      Run Directory

      /opt/omni-operator/conf

      Run Command

      echo "enableBatchExprEvaluate=false" >> /opt/omni-operator/conf/omni.conf;

      echo "hiveUdfPropertyFilePath=/opt/omni-operator/hive-udf/udf.properties" >> /opt/omni-operator/conf/omni.conf;

      echo "hiveUdfDir=/opt/omni-operator/hive-udf/udf" >> /opt/omni-operator/conf/omni.conf;

  2. Optional: Export the service flow and save it to your local PC. You can import service flows to quickly install other components.
    1. In the upper right corner of the displayed page, click Export.

      The window for selecting a path for saving the template is displayed.

    2. Name the template OmniOperator UDF Plugin Row-by-Row Processing Deployment and Configuration Workflow and click Save.

  3. Execute the service flow.

    Click Finish in the lower right corner and select Run Service. The procedure is complete when the execution is successful.