Overview

When using the OmniOperator feature on Spark, you can enable it through SparkExtension or Gluten. Choose the appropriate enabling mode based on your specific scenario and requirements to maximize acceleration.

If you are using Spark 3.3.1, it is recommended to use Gluten to enable OmniOperator. For other Spark versions, use SparkExtension.

If you choose to enable OmniOperator through the Gluten framework, install Spark 3.3.1 and Gluten 1.3. For details about Spark installation requirements, see OS and Software Requirements. The sections that follow describe how to install and configure Gluten, and how to apply the OmniOperator feature to Spark.