Software Architecture

OmniOperator JIT provides fixed interfaces for distributed tasks. You can submit SQL tasks to Spark or clusters. The cluster management node allocates tasks and distributes subtasks to multiple compute nodes for execution. OmniOperator is invoked by user code only in a single task and does not interact with other subtasks. Figure 1 shows the OmniOperator JIT architecture.

Figure 1 Architecture of the OmniOperator JIT operator optimization feature