Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

Deploying the Spark Engine

  1. Deploy the Spark engine.

    For details, see Software Requirements.

  2. Configure SparkExtension.
    • Extract boostkit-omniop-spark-3.1.1-1.0.0-aarch64 from boostkit-omniop-spark-3.1.1-1.0.0-aarch64.zip obtained in 1.3.
    • Decompress dependencies.tar.gz in the boostkit-omniop-spark-3.1.1-1.0.0-aarch64 folder and copy the extracted dependencies folder, liborc.so, and libprotobuf.so.23 to the /opt/omni-operator/lib directory on the management node and three compute nodes.
    • Run the following command in any directory on the management node:
      export LD_LIBRARY_PATH=/opt/omni-operator/lib