OmniOperator and OmniShuffle

The example environment planned in this document for OmniOperator and OmniShuffle consists of four servers, which are one management node and three compute nodes. The coupled storage and compute network is used. In the following, we will be using HDFS as the storage node for illustration:

• The management node is server1 for managing tasks.
• The compute nodes are agent1, agent2, and agent3, which are used to run OmniOperator and OmniShuffle query engine services and store datasets.

A server can function as a management node and compute node at the same time. In single-node mode, operations performed on the management node or compute node mentioned in the following sections are performed on the same node. Figure 1 shows the networking diagram.